00010000:00010000:3.0:1788201555.608337:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006c446f78/0xd138388016f6e29b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171093793 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201555.608633:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201555.608635:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201555.608636:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201555.608652:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727773184:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201555.614478:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743415296 00000100:00100000:3.0:1788201555.614485:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743415296 00000100:00100000:3.0:1788201555.614577:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 422 00000100:00100000:3.0:1788201555.614587:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743415296:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201555.614597:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000024db6f57/0xd138388016f6e2a2 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x17a:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109379a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.614607:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000024db6f57/0xd138388016f6e2a2 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x17a:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109379a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.614616:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000024db6f57/0xd138388016f6e2a2 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e217109379a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.614625:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000024db6f57/0xd138388016f6e2a2 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e217109379a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.614633:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000024db6f57/0xd138388016f6e2a2 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e217109379a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.614643:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000024db6f57/0xd138388016f6e2a2 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e217109379a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.614674:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc143a48e00) 00000100:00100000:3.0:1788201555.614736:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743415296:12345-192.168.201.143@tcp:105: Request processed in 150us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201555.614744:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 422 00000100:00100000:3.0:1788201555.618553:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727773184:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201555.637883:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201555.637904:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17275b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727774080:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201555.643011:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c303a2ad/0xd138388016f6e2be lrc: 6/2,0 mode: --/PR res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.643045:0:10054:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c303a2ad/0xd138388016f6e2be lrc: 6/2,0 mode: --/PR res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710937ee expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.643173:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c303a2ad/0xd138388016f6e2be lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710937ee expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.643188:0:10054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c303a2ad/0xd138388016f6e2be lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710937ee expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201555.643205:0:10054:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c303a2ad/0xd138388016f6e2be lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710937ee expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201555.643219:0:10054:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201555.643239:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c303a2ad/0xd138388016f6e2be lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710937ee expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.643249:0:10054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c303a2ad/0xd138388016f6e2be lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710937ee expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.643256:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c303a2ad/0xd138388016f6e2be lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710937ee expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.643265:0:10054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c303a2ad/0xd138388016f6e2be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e21710937ee expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201555.643286:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727774080:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201555.658167:0:21781:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201555.658457:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743415552 00000100:00100000:3.0:1788201555.658464:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743415552 00000100:00100000:3.0:1788201555.658520:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 424 00000100:00100000:3.0:1788201555.658530:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc149fa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23418:x1875064743415552:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201555.658540:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e1840c2c/0xd138388016f6e2c5 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->397311] (req 0->397311) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710937f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.658551:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e1840c2c/0xd138388016f6e2c5 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->397311] (req 0->397311) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710937f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.658560:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e1840c2c/0xd138388016f6e2c5 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710937f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.658575:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e1840c2c/0xd138388016f6e2c5 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710937f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.658584:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e1840c2c/0xd138388016f6e2c5 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710937f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.658594:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e1840c2c/0xd138388016f6e2c5 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e21710937f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.658693:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc143a49800) 00000100:00100000:3.0:1788201555.658768:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc149fa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23418:x1875064743415552:12345-192.168.201.143@tcp:105: Request processed in 238us (4471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201555.658776:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 424 00000100:00100000:3.0:1788201555.700384:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17275a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727775232:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201555.707603:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6e2e1 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.707634:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6e2e1 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171093849 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.707649:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6e2e1 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171093849 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.707661:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6e2e1 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171093849 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201555.707678:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6e2e1 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093849 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201555.707691:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201555.707752:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6e2e1 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171093849 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.707763:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6e2e1 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171093849 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.707773:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6e2e1 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171093849 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.707781:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6e2e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171093849 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201555.707850:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727775232:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201555.721061:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:21dcfac0-2fe1-402c-8fca-db923b83f76c:10055:1875064727775488:192.168.201.143@tcp:400:kworker.0 00010000:00010000:3.0:1788201555.722969:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201555.722978:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6e2e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171093849 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201555.722991:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc143a48a00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201555.722998:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6e2e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171093849 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201555.723067:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xe9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201555.723082:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xe9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201555.723154:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6e2e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x17b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171093849 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201555.723163:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201555.723218:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6e2e1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x17b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171093849 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201555.723229:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6e2e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171093849 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201555.723246:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201555.723248:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201555.723250:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201555.727898:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743415808 00000100:00100000:3.0:1788201555.727908:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743415808 00000100:00100000:3.0:1788201555.727969:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 426 00000100:00100000:3.0:1788201555.727979:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21005:x1875064743415808:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201555.727997:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000042ad0cc8/0xd138388016f6e2e8 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171093850 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.728014:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000042ad0cc8/0xd138388016f6e2e8 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171093850 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.728046:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000042ad0cc8/0xd138388016f6e2e8 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171093850 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.728057:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000042ad0cc8/0xd138388016f6e2e8 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171093850 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.728067:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000042ad0cc8/0xd138388016f6e2e8 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171093850 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.728077:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000042ad0cc8/0xd138388016f6e2e8 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171093850 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201555.761955:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201555.761975:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727776512:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201555.767777:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006a5c86da/0xd138388016f6e304 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.767852:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006a5c86da/0xd138388016f6e304 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710938a4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.767868:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006a5c86da/0xd138388016f6e304 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710938a4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.767882:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006a5c86da/0xd138388016f6e304 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710938a4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201555.767901:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006a5c86da/0xd138388016f6e304 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710938a4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201555.767913:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201555.767935:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006a5c86da/0xd138388016f6e304 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710938a4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.767943:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006a5c86da/0xd138388016f6e304 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710938a4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.767950:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006a5c86da/0xd138388016f6e304 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710938a4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.767959:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006a5c86da/0xd138388016f6e304 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e21710938a4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201555.767981:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727776512:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201555.773125:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201555.773132:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006a5c86da/0xd138388016f6e304 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710938a4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201555.773142:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172723200 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201555.773148:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006a5c86da/0xd138388016f6e304 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e21710938a4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201555.773227:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xea:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201555.773241:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xea:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201555.773309:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006a5c86da/0xd138388016f6e304 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710938a4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201555.773318:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201555.773342:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006a5c86da/0xd138388016f6e304 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x17c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710938a4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201555.773349:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006a5c86da/0xd138388016f6e304 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710938a4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201555.773365:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201555.773367:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201555.773368:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201555.773376:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201555.773390:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727776768:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201555.776605:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201555.781484:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727776768:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201555.829514:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:3.0:1788201555.830701:0:23731:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000038efa3ed/0xd138388016f6e32e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171093906 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.830714:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000038efa3ed/0xd138388016f6e32e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171093906 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.830730:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000038efa3ed/0xd138388016f6e32e lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171093906 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201555.830742:0:23731:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000038efa3ed/0xd138388016f6e32e lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171093906 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.830754:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000038efa3ed/0xd138388016f6e32e lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171093906 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.830761:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000038efa3ed/0xd138388016f6e32e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171093906 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201555.830788:0:23731:0:(vvp_io.c:1292:vvp_io_write_start()) functions.sh: write [0, 38517) append 0 append lockpos 0 00000080:00200000:3.0:1788201555.830838:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:3.0:1788201555.830888:0:23731:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:3.0:1788201555.830900:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000adb9066c[3 00000000183a1c26 2 1 00000000465c075d 0 0 0] 00000080:00200000:3.0:1788201555.830903:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000cd7299e3 17ffffc0001001 3:0 ffff8bc144e41380 0 lru 00000080:00200000:3.0:1788201555.830911:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000ef289877 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000612852e0 > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201555.830913:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000adb9066c 00000080:00200000:3.0:1788201555.830915:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201555.830917:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:3.0:1788201555.830941:0:23731:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:3.0:1788201555.830945:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000acb75770[3 00000000183a1c26 2 1 00000000465c075d 0 0 1] 00000080:00200000:3.0:1788201555.830947:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000fd9c8136 17ffffc0001001 3:0 ffff8bc144e41000 1 lru 00000080:00200000:3.0:1788201555.830952:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000cbd03e5c 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 00000000612852e0 > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201555.830954:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000acb75770 00000080:00200000:3.0:1788201555.830956:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:3.0:1788201555.830957:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:3.0:1788201555.830969:0:23731:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:3.0:1788201555.830972:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000ae9d0aed[3 00000000183a1c26 2 1 00000000465c075d 0 0 2] 00000080:00200000:3.0:1788201555.830974:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000003df6e5f6 17ffffc0001001 3:0 ffff8bc144e41d20 2 lru 00000080:00200000:3.0:1788201555.830979:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000002504fe7f 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000000ce25486 00000000612852e0 > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201555.830980:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000ae9d0aed 00000080:00200000:3.0:1788201555.830982:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:3.0:1788201555.830983:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:3.0:1788201555.830993:0:23731:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:3.0:1788201555.830996:0:23731:0:(rw26.c:956:ll_write_end()) page@000000000979c3ad[3 00000000183a1c26 2 1 00000000465c075d 0 0 3] 00000080:00200000:3.0:1788201555.830999:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000a715feb2 17ffffc0001001 3:0 ffff8bc144e41460 3 lru 00000080:00200000:3.0:1788201555.831003:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000003279146a 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000000ce25486 00000000612852e0 > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201555.831005:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000000979c3ad 00000080:00200000:3.0:1788201555.831007:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:3.0:1788201555.831008:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:3.0:1788201555.831020:0:23731:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:3.0:1788201555.831034:0:23731:0:(rw26.c:956:ll_write_end()) page@000000001fea53e0[3 00000000183a1c26 2 1 00000000465c075d 0 0 4] 00000080:00200000:3.0:1788201555.831037:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000097579880 17ffffc0001001 3:0 ffff8bc144e410e0 4 lru 00000080:00200000:3.0:1788201555.831042:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000051ecba12 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000000ce25486 00000000612852e0 > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201555.831044:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000001fea53e0 00000080:00200000:3.0:1788201555.831045:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:3.0:1788201555.831046:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:3.0:1788201555.831059:0:23731:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:3.0:1788201555.831063:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000271dab17[3 00000000183a1c26 2 1 00000000465c075d 0 0 5] 00000080:00200000:3.0:1788201555.831065:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000504b89fd 17ffffc0001001 3:0 ffff8bc144e419a0 5 lru 00000080:00200000:3.0:1788201555.831070:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000006820223d 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000000ce25486 00000000612852e0 > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201555.831072:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000271dab17 00000080:00200000:3.0:1788201555.831073:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:3.0:1788201555.831074:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:3.0:1788201555.831084:0:23731:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:3.0:1788201555.831087:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000bd1eb0b4[3 00000000183a1c26 2 1 00000000465c075d 0 0 6] 00000080:00200000:3.0:1788201555.831099:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000d7c500eb 17ffffc0001001 3:0 ffff8bc144e41c40 6 lru 00000080:00200000:3.0:1788201555.831105:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000000487e280 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000000ce25486 00000000612852e0 > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201555.831107:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000bd1eb0b4 00000080:00200000:3.0:1788201555.831108:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:3.0:1788201555.831110:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:3.0:1788201555.831124:0:23731:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:3.0:1788201555.831127:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000e4f55302[3 00000000183a1c26 2 1 00000000465c075d 0 0 7] 00000080:00200000:3.0:1788201555.831130:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000004473b02 17ffffc0001001 3:0 ffff8bc144e41a80 7 lru 00000080:00200000:3.0:1788201555.831135:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000003a48fb1b 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000000ce25486 00000000612852e0 > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201555.831137:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000e4f55302 00000080:00200000:3.0:1788201555.831138:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:3.0:1788201555.831140:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:3.0:1788201555.831150:0:23731:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:3.0:1788201555.831154:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000b8e9bfe7[3 00000000183a1c26 2 1 00000000465c075d 0 0 8] 00000080:00200000:3.0:1788201555.831156:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000000be29df5 17ffffc0001001 3:0 ffff8bc144e41540 8 lru 00000080:00200000:3.0:1788201555.831161:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b9590384 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000000ce25486 00000000612852e0 > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201555.831163:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000b8e9bfe7 00000080:00200000:3.0:1788201555.831164:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:3.0:1788201555.831166:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 1653 bytes 00000080:00200000:3.0:1788201555.833397:0:23731:0:(rw26.c:898:ll_write_end()) pos 36864, len 1653, copied 1653 00000080:00200000:3.0:1788201555.833413:0:23731:0:(rw26.c:956:ll_write_end()) page@000000002c39eb96[3 00000000183a1c26 2 1 00000000465c075d 0 0 9] 00000080:00200000:3.0:1788201555.833418:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000004357d489 17ffffc0001001 3:0 ffff8bc144e418c0 9 lru 00000080:00200000:3.0:1788201555.833424:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000006a59ed48 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000000ce25486 00000000612852e0 > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201555.833498:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000002c39eb96 00000080:00200000:3.0:1788201555.833499:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:3.0:1788201555.833506:0:23731:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 10, from 0, to 1653 prio 0 00000008:00010000:3.0:1788201555.833535:0:23731:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000f9bccc34 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000038efa3ed/0xd138388016f6e32e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093906 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201555.833568:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459354f8, count 10, dirtied 10 00000080:00200000:3.0:1788201555.833575:0:23731:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 10 pages 38517 bytes, tot: 38517 00000080:00200000:3.0:1788201555.833579:0:23731:0:(vvp_io.c:1358:vvp_io_write_start()) functions.sh: write bytes 0, result: 38517 00000020:00010000:3.0:1788201555.833599:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c4d58 (ffff8bc148e3bc68/0) at cl_lock_release():245 00000020:00010000:3.0:1788201555.833603:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c4d58 (ffff8bc148e3bc68/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201555.833607:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151a504b0 (ffff8bc148e3b7e8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1788201555.833615:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000038efa3ed/0xd138388016f6e32e lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171093906 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.833627:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000038efa3ed/0xd138388016f6e32e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093906 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1788201555.833646:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c4d58 (ffff8bc148e3bc68/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201555.833650:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151a504b0 (ffff8bc148e3bc68/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201555.833659:0:23731:0:(vvp_io.c:533:vvp_io_advance()) advancing 38517 bytes 00000080:00200000:3.0:1788201555.833668:0:23731:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 9] 00000080:00200000:3.0:1788201555.833701:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xeb:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201555.833705:0:23731:0:(file.c:2238:ll_file_io_generic()) functions.sh: 2 io complete with rc: 0, result: 38517, restart: 0 00000080:00200000:3.0:1788201555.833713:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0xeb:0x0] updating i_size 38517 i_blocks 1 00000080:00200000:3.0:1788201555.833718:0:23731:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 38517 00000080:00200008:3.0:1788201555.833763:0:23731:0:(file.c:479:ll_file_release()) START file functions.sh:[0x200000bd7:0xeb:0x0](ffff8bc145935348), flags 100001 00000002:00100000:3.0:1788201555.833865:0:23731:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1725b2680 x1875064727777536/t8589936995(8589936995) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201571 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1788201555.833877:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1788201555.833883:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc151ff6d80 x1875064727778176/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1788201555.833907:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff6d80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727778176:192.168.201.143@tcp:35:cp.0 00000100:00100000:3.0:1788201555.833991:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8cf00 going to sleep for 11 seconds 00010000:00010000:3.0:1788201555.876748:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201555.876755:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ccd6f472/0xd138388016f6e34a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109395a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201555.876765:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172722a00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201555.876770:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ccd6f472/0xd138388016f6e34a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e217109395a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201555.876862:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xec:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201555.876875:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xec:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201555.876944:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ccd6f472/0xd138388016f6e34a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109395a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201555.876952:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201555.876979:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ccd6f472/0xd138388016f6e34a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x17d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109395a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201555.876988:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ccd6f472/0xd138388016f6e34a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109395a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201555.877003:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201555.877004:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201555.877006:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201555.877020:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727779072:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201555.890770:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727779072:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201555.923114:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201555.952623:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727781120:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201555.966916:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201555.993144:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727782272:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201555.996683:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006b86fbe8/0xd138388016f6e3b3 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.996710:0:10054:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006b86fbe8/0xd138388016f6e3b3 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171093a6b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.996723:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006b86fbe8/0xd138388016f6e3b3 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171093a6b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.996735:0:10054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006b86fbe8/0xd138388016f6e3b3 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171093a6b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201555.996749:0:10054:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006b86fbe8/0xd138388016f6e3b3 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093a6b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201555.996761:0:10054:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201555.996854:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006b86fbe8/0xd138388016f6e3b3 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171093a6b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.996863:0:10054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006b86fbe8/0xd138388016f6e3b3 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171093a6b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.996871:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006b86fbe8/0xd138388016f6e3b3 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171093a6b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201555.996881:0:10054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006b86fbe8/0xd138388016f6e3b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171093a6b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201555.996902:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727782272:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201556.002828:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727782528:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.006211:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201556.009221:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727782528:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.051273:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201556.087901:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17275b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727784576:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201556.144330:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e2cf3b12/0xd138388016f6e41c lrc: 6/2,0 mode: --/PR res: [0x280000400:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.144370:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e2cf3b12/0xd138388016f6e41c lrc: 6/2,0 mode: --/PR res: [0x280000400:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171093b7c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.144385:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e2cf3b12/0xd138388016f6e41c lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171093b7c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.144399:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e2cf3b12/0xd138388016f6e41c lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171093b7c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201556.144425:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e2cf3b12/0xd138388016f6e41c lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093b7c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201556.144438:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201556.144489:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e2cf3b12/0xd138388016f6e41c lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171093b7c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.144500:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e2cf3b12/0xd138388016f6e41c lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171093b7c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.144508:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e2cf3b12/0xd138388016f6e41c lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171093b7c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.144516:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e2cf3b12/0xd138388016f6e41c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171093b7c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201556.144537:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727785728:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201556.153326:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201556.153354:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727785984:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.172668:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727785984:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.201687:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727787136:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.229071:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727788032:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201556.232586:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fee015f1/0xd138388016f6e462 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.232609:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fee015f1/0xd138388016f6e462 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171093c32 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.232620:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fee015f1/0xd138388016f6e462 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171093c32 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.232628:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fee015f1/0xd138388016f6e462 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171093c32 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201556.232639:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fee015f1/0xd138388016f6e462 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093c32 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201556.232647:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201556.232658:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fee015f1/0xd138388016f6e462 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171093c32 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.232667:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fee015f1/0xd138388016f6e462 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171093c32 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.232675:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fee015f1/0xd138388016f6e462 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171093c32 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.232684:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fee015f1/0xd138388016f6e462 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171093c32 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201556.232706:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727788032:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201556.237119:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743418496 00000100:00100000:3.0:1788201556.237131:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743418496 00000100:00100000:3.0:1788201556.237230:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 447 00000100:00100000:3.0:1788201556.237240:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23413:x1875064743418496:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201556.237257:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fee015f1/0xd138388016f6e462 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x181:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171093c32 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.237339:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201556.237345:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23413:x1875064743418496:12345-192.168.201.143@tcp:104: Request processed in 107us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201556.237352:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 447 00000100:00100000:3.0:1788201556.274436:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743418752 00000100:00100000:3.0:1788201556.274449:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743418752 00000100:00100000:3.0:1788201556.274520:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 449 00000100:00100000:3.0:1788201556.274530:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17275b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23390:x1875064743418752:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201556.274548:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000af56bec5/0xd138388016f6e485 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x181:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171093c8d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.274649:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201556.274656:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17275b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23390:x1875064743418752:12345-192.168.201.143@tcp:104: Request processed in 128us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201556.274663:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 449 00000100:00100000:3.0:1788201556.313788:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727790336:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201556.317030:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bdea9c81/0xd138388016f6e4a8 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.317056:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bdea9c81/0xd138388016f6e4a8 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171093ce8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.317070:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bdea9c81/0xd138388016f6e4a8 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171093ce8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.317082:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bdea9c81/0xd138388016f6e4a8 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171093ce8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201556.317186:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bdea9c81/0xd138388016f6e4a8 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093ce8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201556.317253:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201556.317299:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bdea9c81/0xd138388016f6e4a8 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171093ce8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.317308:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bdea9c81/0xd138388016f6e4a8 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171093ce8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.317315:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bdea9c81/0xd138388016f6e4a8 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171093ce8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.317328:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bdea9c81/0xd138388016f6e4a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171093ce8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201556.317346:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727790336:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201556.320557:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:3.0:1788201556.321723:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201556.321733:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bdea9c81/0xd138388016f6e4a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x182:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171093ce8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.321744:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17267e400 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201556.321750:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bdea9c81/0xd138388016f6e4a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x182:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171093ce8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201556.321840:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201556.321855:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201556.321919:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bdea9c81/0xd138388016f6e4a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x182:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171093ce8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.321926:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201556.321956:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bdea9c81/0xd138388016f6e4a8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x182:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171093ce8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.321964:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bdea9c81/0xd138388016f6e4a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x182:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171093ce8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.321983:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201556.321984:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201556.321986:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201556.326224:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743419136 00000100:00100000:3.0:1788201556.326234:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743419136 00000100:00100000:3.0:1788201556.326285:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 452 00000100:00100000:3.0:1788201556.326294:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21003:x1875064743419136:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201556.326309:0:20877:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006b86fbe8/0xd138388016f6e4af lrc: 4/0,1 mode: --/PW res: [0x280000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171093cef expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.326321:0:20877:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006b86fbe8/0xd138388016f6e4af lrc: 4/0,1 mode: --/PW res: [0x280000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171093cef expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.326329:0:20877:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006b86fbe8/0xd138388016f6e4af lrc: 4/0,1 mode: --/PW res: [0x280000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171093cef expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.326340:0:20877:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006b86fbe8/0xd138388016f6e4af lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171093cef expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.326349:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006b86fbe8/0xd138388016f6e4af lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171093cef expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.326358:0:20877:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006b86fbe8/0xd138388016f6e4af lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171093cef expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.326379:0:20877:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc17267f800) 00000100:00100000:3.0:1788201556.326484:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21003:x1875064743419136:12345-192.168.201.143@tcp:105: Request processed in 190us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201556.326490:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 452 00000100:00100000:3.0:1788201556.328434:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727790848:192.168.201.143@tcp:4:cp.0 00000100:00100000:3.0:1788201556.329511:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727791360:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201556.338234:0:10055:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 0000000028f6ddfc ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000052b7c868/0xd138388016f6e3dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093acd expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201556.338282:0:10055:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 0000000028f6ddfc ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000052b7c868/0xd138388016f6e3dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093acd expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201556.338312:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727791360:192.168.201.143@tcp:4:cp.0 00000100:00100000:3.0:1788201556.354420:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416d880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727792000:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201556.354439:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267e800/0xd138388016f6e4b6 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.354452:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267e800/0xd138388016f6e4b6 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.354460:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267e800/0xd138388016f6e4b6 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.354467:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267e800/0xd138388016f6e4b6 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.354477:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267e800/0xd138388016f6e4b6 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.354485:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17267e800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201556.354490:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267e800/0xd138388016f6e4b6 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.354497:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267e800/0xd138388016f6e4b6 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.354504:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267e800/0xd138388016f6e4b6 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.354512:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201556.354519:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267e800/0xd138388016f6e4b6 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.354525:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267e800/0xd138388016f6e4b6 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201556.354543:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14416d880 x1875064727792000/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201572 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201556.354560:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201556.354587:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:3.0:1788201556.354654:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201556.354668:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201556.354677:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 73 lru_type: 1 00010000:00010000:3.0:1788201556.354694:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 73 lru_type: 1 00000080:00200000:3.0:1788201556.354701:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201556.354707:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201556.354710:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201556.354715:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201556.354719:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 73 lru_type: 1 00010000:00010000:3.0:1788201556.354728:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 74 lru_type: 1 00000080:00200000:3.0:1788201556.354743:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.354750:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201556.354755:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.354767:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=lustre-rsync-test.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=8 00000080:00200000:3.0:1788201556.354771:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=lustre-rsync-test.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:3.0:1788201556.354781:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: lustre-rsync-test.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201556.354882:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d200/0xd138388016f6e4bd lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.354890:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d200/0xd138388016f6e4bd lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.354900:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d200/0xd138388016f6e4bd lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201556.354925:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff7480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727792128:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201556.354996:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201556.361869:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff7480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727792128:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201556.361885:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d200/0xd138388016f6e4bd lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.361895:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d200/0xd138388016f6e4bd lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.361901:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d200/0xd138388016f6e4bd lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.361908:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d200/0xd138388016f6e4bd lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.361916:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d200/0xd138388016f6e4bd lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.361923:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14400d200 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201556.361927:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d200/0xd138388016f6e4bd lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.361934:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d200/0xd138388016f6e4bd lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.361940:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d200/0xd138388016f6e4bd lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.361946:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201556.361952:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d200/0xd138388016f6e4bd lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.361958:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d200/0xd138388016f6e4bd lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201556.361974:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc151ff7480 x1875064727792128/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201572 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201556.361988:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201556.362011:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:3.0:1788201556.362124:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201556.362138:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201556.362147:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 74 lru_type: 1 00010000:00010000:3.0:1788201556.362157:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 74 lru_type: 1 00000080:00200000:3.0:1788201556.362163:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201556.362168:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201556.362172:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201556.362177:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3bf8 00010000:00010000:3.0:1788201556.362181:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 74 lru_type: 1 00010000:00010000:3.0:1788201556.362188:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 75 lru_type: 1 00000080:00200000:3.0:1788201556.362214:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.362222:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201556.362227:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.362237:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:3.0:1788201556.362241:0:23731:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=lustre-rsync-test.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), file ffff8bc143847c80, open_flags 80c1, mode 81ed opened 0 00000080:00200000:3.0:1788201556.362247:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=lustre-rsync-test.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000002:00010000:3.0:1788201556.362265:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: lustre-rsync-test.sh,[0x200000bd7:0xf7:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open|creat flags 0100302 00010000:00010000:3.0:1788201556.362306:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.362313:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1788201556.362322:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1788201556.362328:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc151ff7480 x1875064727792384/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1788201556.362336:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201556.362356:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff7480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727792384:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201556.362513:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201556.369230:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff7480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727792384:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201556.369257:0:23731:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.369278:0:23731:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.369291:0:23731:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.369301:0:23731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.369311:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.369324:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.369332:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.369339:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201556.369351:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc151ff7480 x1875064727792384/t8589937020(8589937020) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201572 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1788201556.369364:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc151ff7480 x1875064727792384/t8589937020(8589937020) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201572 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201556.369377:0:23731:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1788201556.369389:0:23731:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.369400:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/247 (0 0) 00000080:00200000:3.0:1788201556.369407:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1788201556.369422:0:23731:0:(namei.c:1628:ll_create_it()) VFS Op:name=lustre-rsync-test.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000080:00200000:3.0:1788201556.369452:0:23731:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0xf7:0x0](ffff8bc1459d1988) 00000080:00200000:3.0:1788201556.369587:0:23731:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0xf7:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1788201556.369597:0:23731:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0xf7:0x0](ffff8bc1459d1988) 00000080:00010000:3.0:1788201556.369601:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0xf7:0x0](ffff8bc1459d1988) for lock 0xd138388016f6e4c4 00000080:00010000:3.0:1788201556.369610:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0xf7:0x0](ffff8bc1459d1988) 00000080:00200008:3.0:1788201556.369624:0:23731:0:(file.c:1090:ll_file_open()) START file lustre-rsync-test.sh:[0x200000bd7:0xf7:0x0](ffff8bc1459d1988), flags 100301 00000002:00100000:3.0:1788201556.369643:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc151ff7480 x1875064727792384/t8589937020(8589937020) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201572 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1788201556.369681:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e4c4 from it ffff8bc148c9be40 00010000:00010000:3.0:1788201556.369685:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.369695:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201556.369717:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xf7:0x0](ffff8bc1459d1988), inode mode 81ed mask 40 00000080:00200008:3.0:1788201556.369745:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file lustre-rsync-test.sh:[0x200000bd7:0xf7:0x0](ffff8bc1459d1988), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201556.369751:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0xf7:0x0](ffff8bc1459d1988),name=lustre-rsync-test.sh 00000002:00010000:3.0:1788201556.369770:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0xf7:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201556.369780:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.369835:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201556.369843:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201556.369849:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0xf7:0x0](ffff8bc1459d1988) 00000080:00010000:3.0:1788201556.369852:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0xf7:0x0](ffff8bc1459d1988) for lock 0xd138388016f6e4c4 00000080:00010000:3.0:1788201556.369857:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e4c4 from it ffffadd1c7da3cd8 00010000:00010000:3.0:1788201556.369860:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.369867:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201556.369892:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf7:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201556.369902:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0xf7:0x0] 00000008:00010000:3.0:1788201556.369932:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201556.369936:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc144008830, osc lock ffff8bc14691abe0, flags 0x400001002 00010000:00010000:3.0:1788201556.369979:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6e4cb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.369989:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6e4cb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201556.370037:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:3.0:1788201556.372715:0:10055:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000008c6b1e01 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e1840c2c/0xd138388016f6e2c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710937f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201556.372871:0:10055:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000008c6b1e01 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e1840c2c/0xd138388016f6e2c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710937f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201556.372904:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727790848:192.168.201.143@tcp:4:cp.0 00000080:00200000:3.0:1788201556.376768:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0xf7:0x0] updating i_size 0 i_blocks 1 00000020:00010000:3.0:1788201556.376775:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc79d0 (ffff8bc1460e9c68/0) at cl_lock_release():245 00000020:00010000:3.0:1788201556.376779:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc79d0 (ffff8bc1460e9c68/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201556.376784:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc144008830 (ffff8bc1460e96c8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201556.376788:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc79d0 (ffff8bc1460e9c68/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201556.376932:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc144008830 (ffff8bc1460e9c68/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201556.376974:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf7:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:3.0:1788201556.387711:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172758380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727792640:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201556.387741:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e38d3ff7/0xd138388016f6e4d2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171093d4a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.387763:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e38d3ff7/0xd138388016f6e4d2 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171093d4a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201556.387777:0:23731:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e38d3ff7/0xd138388016f6e4d2 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171093d4a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.387881:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e38d3ff7/0xd138388016f6e4d2 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171093d4a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.387897:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e38d3ff7/0xd138388016f6e4d2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171093d4a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201556.410954:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727794048:192.168.201.143@tcp:35:cp.0 00000002:00100000:3.0:1788201556.410992:0:23731:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc151ff7480 x1875064727792384/t8589937020(8589937020) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201572 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201556.411081:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201556.411101:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201556.411120:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 75 lru_type: 1 00010000:00010000:3.0:1788201556.411134:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 75 lru_type: 1 00000080:00200000:3.0:1788201556.411142:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201556.411148:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201556.411151:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201556.411159:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201556.411162:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 75 lru_type: 1 00010000:00010000:3.0:1788201556.411172:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 76 lru_type: 1 00000080:00200000:3.0:1788201556.411187:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.411201:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201556.411207:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.411210:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=lustre-rsync-test.sh, flags=8 00000080:00200008:3.0:1788201556.411217:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file lustre-rsync-test.sh:[0x200000bd7:0xf7:0x0](ffff8bc1459d1988), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201556.411222:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0xf7:0x0](ffff8bc1459d1988),name=lustre-rsync-test.sh 00000002:00010000:3.0:1788201556.411233:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0xf7:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201556.411241:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201556.411250:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201556.411257:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201556.411260:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0xf7:0x0](ffff8bc1459d1988) 00000080:00010000:3.0:1788201556.411263:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0xf7:0x0](ffff8bc1459d1988) for lock 0xd138388016f6e4c4 00000080:00010000:3.0:1788201556.411267:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e4c4 from it ffffadd1c7da3cb8 00010000:00010000:3.0:1788201556.411271:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201556.411278:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201556.411323:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf7:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201556.411336:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0xf7:0x0] 00000008:00010000:3.0:1788201556.411367:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201556.411370:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc144008830, osc lock ffff8bc14691abe0, flags 0x400001002 00010000:00010000:3.0:1788201556.411388:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e38d3ff7/0xd138388016f6e4d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093d4a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.411404:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e38d3ff7/0xd138388016f6e4d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093d4a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:3.0:1788201556.411416:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1788201556.411420:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e38d3ff7/0xd138388016f6e4d2 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171093d4a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.411428:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e38d3ff7/0xd138388016f6e4d2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093d4a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1788201556.411438:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1788201556.411447:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0xf7:0x0] updating i_size 16105 i_blocks 1 00000020:00010000:3.0:1788201556.411452:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc79d0 (ffff8bc1460e9c68/0) at cl_lock_release():245 00000020:00010000:3.0:1788201556.411455:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc79d0 (ffff8bc1460e9c68/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201556.411458:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc144008830 (ffff8bc1460e96c8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201556.411462:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc79d0 (ffff8bc1460e9c68/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201556.411464:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc144008830 (ffff8bc1460e9c68/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201556.411491:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf7:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201556.411537:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201556.411545:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201556.411553:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 76 lru_type: 1 00010000:00010000:3.0:1788201556.411562:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 76 lru_type: 1 00000080:00200000:3.0:1788201556.411574:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201556.411578:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201556.411580:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201556.411584:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201556.411588:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 76 lru_type: 1 00010000:00010000:3.0:1788201556.411595:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 77 lru_type: 1 00000080:00200000:3.0:1788201556.411604:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.411609:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201556.411613:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.411624:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=maloo_upload.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=9 00000080:00200000:3.0:1788201556.411628:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=maloo_upload.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:3.0:1788201556.411637:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: maloo_upload.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201556.411681:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4d9 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.411688:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4d9 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.411699:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4d9 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201556.411723:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff7100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727794176:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201556.411914:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201556.419047:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff7100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727794176:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201556.419063:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4d9 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.419071:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4d9 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.419077:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4d9 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.419083:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4d9 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.419101:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4d9 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.419108:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14400ce00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201556.419112:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4d9 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.419118:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4d9 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.419124:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4d9 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.419131:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201556.419136:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4d9 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.419142:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4d9 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201556.419163:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc151ff7100 x1875064727794176/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201572 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201556.419176:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201556.419206:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:3.0:1788201556.419262:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201556.419275:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201556.419283:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 77 lru_type: 1 00010000:00010000:3.0:1788201556.419293:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 77 lru_type: 1 00000080:00200000:3.0:1788201556.419299:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201556.419304:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201556.419308:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201556.419313:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201556.419316:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 77 lru_type: 1 00010000:00010000:3.0:1788201556.419324:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 78 lru_type: 1 00000080:00200000:3.0:1788201556.419337:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.419344:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201556.419349:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.419361:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=maloo_upload.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=8 00000080:00200000:3.0:1788201556.419366:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=maloo_upload.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:3.0:1788201556.419377:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: maloo_upload.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201556.419414:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c200/0xd138388016f6e4e0 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.419422:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c200/0xd138388016f6e4e0 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.419432:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c200/0xd138388016f6e4e0 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201556.419451:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff7100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727794304:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201556.419521:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201556.437255:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff7100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727794304:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201556.437281:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c200/0xd138388016f6e4e0 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.437295:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c200/0xd138388016f6e4e0 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.437302:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c200/0xd138388016f6e4e0 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.437308:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c200/0xd138388016f6e4e0 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.437317:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c200/0xd138388016f6e4e0 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.437323:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14400c200 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201556.437328:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c200/0xd138388016f6e4e0 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.437335:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c200/0xd138388016f6e4e0 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.437343:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c200/0xd138388016f6e4e0 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.437350:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201556.437357:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c200/0xd138388016f6e4e0 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.437364:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c200/0xd138388016f6e4e0 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201556.437383:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc151ff7100 x1875064727794304/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201572 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201556.437398:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201556.437423:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:3.0:1788201556.437530:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201556.437547:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201556.437556:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 78 lru_type: 1 00010000:00010000:3.0:1788201556.437568:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 78 lru_type: 1 00000080:00200000:3.0:1788201556.437576:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201556.437581:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201556.437585:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201556.437590:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3bf8 00010000:00010000:3.0:1788201556.437594:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 78 lru_type: 1 00010000:00010000:3.0:1788201556.437602:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 79 lru_type: 1 00000080:00200000:3.0:1788201556.437618:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.437626:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201556.437632:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.437645:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:3.0:1788201556.437649:0:23731:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=maloo_upload.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), file ffff8bc143847c80, open_flags 80c1, mode 81ed opened 0 00000080:00200000:3.0:1788201556.437658:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=maloo_upload.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000002:00010000:3.0:1788201556.437677:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: maloo_upload.sh,[0x200000bd7:0xf8:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open|creat flags 0100302 00010000:00010000:3.0:1788201556.437723:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.437730:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1788201556.437741:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1788201556.437748:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc151ff7100 x1875064727794560/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1788201556.437757:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201556.437778:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff7100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727794560:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201556.437966:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201556.443422:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff7100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727794560:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201556.443452:0:23731:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171093d90 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.443476:0:23731:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0xf8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171093d90 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.443485:0:23731:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171093d90 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.443497:0:23731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171093d90 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.443509:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171093d90 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.443524:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171093d90 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.443532:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171093d90 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.443539:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171093d90 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201556.443551:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc151ff7100 x1875064727794560/t8589937022(8589937022) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201572 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1788201556.443566:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc151ff7100 x1875064727794560/t8589937022(8589937022) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201572 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201556.443579:0:23731:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171093d90 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1788201556.443590:0:23731:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171093d90 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.443600:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/248 (0 0) 00000080:00200000:3.0:1788201556.443607:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1788201556.443621:0:23731:0:(namei.c:1628:ll_create_it()) VFS Op:name=maloo_upload.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000080:00200000:3.0:1788201556.443674:0:23731:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0xf8:0x0](ffff8bc1459d5b88) 00000080:00200000:3.0:1788201556.443853:0:23731:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0xf8:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1788201556.443864:0:23731:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0xf8:0x0](ffff8bc1459d5b88) 00000080:00010000:3.0:1788201556.443868:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0xf8:0x0](ffff8bc1459d5b88) for lock 0xd138388016f6e4e7 00000080:00010000:3.0:1788201556.443878:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0xf8:0x0](ffff8bc1459d5b88) 00000080:00200008:3.0:1788201556.443892:0:23731:0:(file.c:1090:ll_file_open()) START file maloo_upload.sh:[0x200000bd7:0xf8:0x0](ffff8bc1459d5b88), flags 100301 00000002:00100000:3.0:1788201556.443911:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc151ff7100 x1875064727794560/t8589937022(8589937022) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201572 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1788201556.443949:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e4e7 from it ffff8bc148c9be40 00010000:00010000:3.0:1788201556.443954:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093d90 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.443964:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093d90 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201556.443991:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xf8:0x0](ffff8bc1459d5b88), inode mode 81ed mask 40 00000080:00200008:3.0:1788201556.444025:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file maloo_upload.sh:[0x200000bd7:0xf8:0x0](ffff8bc1459d5b88), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201556.444031:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0xf8:0x0](ffff8bc1459d5b88),name=maloo_upload.sh 00000002:00010000:3.0:1788201556.444048:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0xf8:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201556.444057:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093d90 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.444066:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093d90 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201556.444072:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201556.444076:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0xf8:0x0](ffff8bc1459d5b88) 00000080:00010000:3.0:1788201556.444079:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0xf8:0x0](ffff8bc1459d5b88) for lock 0xd138388016f6e4e7 00000080:00010000:3.0:1788201556.444082:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e4e7 from it ffffadd1c7da3cd8 00010000:00010000:3.0:1788201556.444084:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093d90 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.444091:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093d90 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201556.444113:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf8:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201556.444123:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0xf8:0x0] 00000008:00010000:3.0:1788201556.444149:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201556.444153:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1440084b0, osc lock ffff8bc14691abe0, flags 0x400001002 00010000:00010000:3.0:1788201556.444258:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000018252b8c/0xd138388016f6e4ee lrc: 3/1,0 mode: --/PR res: [0x280000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.444273:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000018252b8c/0xd138388016f6e4ee lrc: 3/1,0 mode: --/PR res: [0x280000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201556.444308:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1788201556.451612:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0xf8:0x0] updating i_size 0 i_blocks 1 00000020:00010000:3.0:1788201556.451619:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc79d0 (ffff8bc1460e9c68/0) at cl_lock_release():245 00000020:00010000:3.0:1788201556.451622:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc79d0 (ffff8bc1460e9c68/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201556.451628:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1440084b0 (ffff8bc1460e96c8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201556.451632:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc79d0 (ffff8bc1460e9c68/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201556.451635:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1440084b0 (ffff8bc1460e9c68/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201556.451676:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf8:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1788201556.451732:0:23731:0:(file.c:2638:do_file_write_iter()) START file maloo_upload.sh:[0x200000bd7:0xf8:0x0], ppos: 0, count: 838 00000080:00200000:3.0:1788201556.451745:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 838 bytes 00000080:00200000:3.0:1788201556.451750:0:23731:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 838 00000080:00200000:3.0:1788201556.451773:0:23731:0:(file.c:2090:ll_file_io_generic()) maloo_upload.sh: write ppos: 0, bytes: 838 00000080:00200000:3.0:1788201556.451779:0:23731:0:(file.c:1848:ll_io_set_mirror()) maloo_upload.sh: desiginated mirror: 0 00000020:00200000:3.0:1788201556.451785:0:23731:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b6a0cc8b[0x110, 1, [0x200000bd7:0xf8:0x0] hash] 00000020:00200000:3.0:1788201556.451788:0:23731:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 838) 0 0 00000080:00200000:3.0:1788201556.451834:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf8:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201556.451848:0:23731:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1788201556.451857:0:23731:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 838) 838, 838 00020000:00200000:3.0:1788201556.451862:0:23731:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1788201556.451892:0:23731:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1788201556.451906:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1788201556.451911:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1440084b0, osc lock ffff8bc14691abe0, flags 0x0 00010000:00010000:3.0:1788201556.451927:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/387 (0 4095) 00010000:00010000:3.0:1788201556.451965:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d554d574/0xd138388016f6e4f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x183:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.451981:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d554d574/0xd138388016f6e4f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x183:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.451992:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d554d574/0xd138388016f6e4f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x183:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201556.452026:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff6a00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727794816:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201556.452112:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8c300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201556.467891:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:3.0:1788201556.468470:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201556.468479:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000018252b8c/0xd138388016f6e4ee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x183:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171093d9e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.468488:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14400ce00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201556.468495:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000018252b8c/0xd138388016f6e4ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171093d9e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201556.468551:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201556.468567:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201556.468627:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000018252b8c/0xd138388016f6e4ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x183:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171093d9e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.468635:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201556.468664:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000018252b8c/0xd138388016f6e4ee lrc: 1/0,0 mode: --/PR res: [0x280000400:0x183:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171093d9e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.468678:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000018252b8c/0xd138388016f6e4ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x183:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171093d9e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.468692:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201556.468694:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201556.468695:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201556.472746:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201556.477027:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff6a00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727794816:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201556.477062:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d554d574/0xd138388016f6e4f5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171093da5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.477083:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d554d574/0xd138388016f6e4f5 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171093da5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201556.477103:0:23731:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d554d574/0xd138388016f6e4f5 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171093da5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.477117:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d554d574/0xd138388016f6e4f5 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171093da5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.477126:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d554d574/0xd138388016f6e4f5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171093da5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201556.477155:0:23731:0:(vvp_io.c:1292:vvp_io_write_start()) maloo_upload.sh: write [0, 838) append 0 append lockpos 0 00000080:00200000:3.0:1788201556.477174:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 838 bytes 00000080:00200000:3.0:1788201556.477236:0:23731:0:(rw26.c:898:ll_write_end()) pos 0, len 838, copied 838 00000080:00200000:3.0:1788201556.477250:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000a98c06ff[3 00000000ceed2ee3 2 1 00000000f6277908 0 0 0] 00000080:00200000:3.0:1788201556.477254:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000d5b0f3f5 17ffffc0001001 3:0 ffff8bc144e41e00 0 lru 00000080:00200000:3.0:1788201556.477261:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000000b5098f6 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 000000009a229d98 > 3< 0 0 > 4< 0 0 8 25559040 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201556.477263:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000a98c06ff 00000080:00200000:3.0:1788201556.477264:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201556.477268:0:23731:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 838 prio 0 00000008:00010000:3.0:1788201556.477288:0:23731:0:(osc_cache.c:857:osc_extent_find()) ### extent: 000000007f312f51 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d554d574/0xd138388016f6e4f5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093da5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201556.477307:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d5d38, count 1, dirtied 1 00000080:00200000:3.0:1788201556.477313:0:23731:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 838 bytes, tot: 838 00000080:00200000:3.0:1788201556.477316:0:23731:0:(vvp_io.c:1358:vvp_io_write_start()) maloo_upload.sh: write bytes 0, result: 838 00000020:00010000:3.0:1788201556.477333:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460e6b78 (ffff8bc1460e9c68/0) at cl_lock_release():245 00000020:00010000:3.0:1788201556.477336:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460e6b78 (ffff8bc1460e9c68/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201556.477340:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1440084b0 (ffff8bc1460e96c8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1788201556.477345:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d554d574/0xd138388016f6e4f5 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171093da5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.477355:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d554d574/0xd138388016f6e4f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093da5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1788201556.477371:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460e6b78 (ffff8bc1460e9c68/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201556.477375:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1440084b0 (ffff8bc1460e9c68/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201556.477383:0:23731:0:(vvp_io.c:533:vvp_io_advance()) advancing 838 bytes 00000080:00200000:3.0:1788201556.477390:0:23731:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1788201556.477421:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf8:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201556.477426:0:23731:0:(file.c:2238:ll_file_io_generic()) maloo_upload.sh: 2 io complete with rc: 0, result: 838, restart: 0 00000080:00200000:3.0:1788201556.477434:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0xf8:0x0] updating i_size 838 i_blocks 1 00000080:00200000:3.0:1788201556.477440:0:23731:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 838 00000080:00200008:3.0:1788201556.477481:0:23731:0:(file.c:479:ll_file_release()) START file maloo_upload.sh:[0x200000bd7:0xf8:0x0](ffff8bc1459d5b88), flags 100001 00000002:00100000:3.0:1788201556.477529:0:23731:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc151ff7100 x1875064727794560/t8589937022(8589937022) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201572 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1788201556.477541:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1788201556.477546:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146c5b800 x1875064727795200/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1788201556.477571:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c5b800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727795200:192.168.201.143@tcp:35:cp.0 00000100:00100000:3.0:1788201556.477659:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8c300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201556.485466:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c5b800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727795200:192.168.201.143@tcp:35:cp.0 00000002:00100000:3.0:1788201556.485495:0:23731:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc151ff7100 x1875064727794560/t8589937022(8589937022) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201572 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201556.485564:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201556.485581:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201556.485600:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 79 lru_type: 1 00010000:00010000:3.0:1788201556.485613:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 79 lru_type: 1 00000080:00200000:3.0:1788201556.485621:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201556.485626:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201556.485630:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201556.485636:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201556.485640:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 79 lru_type: 1 00010000:00010000:3.0:1788201556.485649:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 80 lru_type: 1 00000080:00200000:3.0:1788201556.485663:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.485669:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201556.485675:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.485678:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=maloo_upload.sh, flags=8 00000080:00200008:3.0:1788201556.485685:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file maloo_upload.sh:[0x200000bd7:0xf8:0x0](ffff8bc1459d5b88), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201556.485689:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0xf8:0x0](ffff8bc1459d5b88),name=maloo_upload.sh 00000002:00010000:3.0:1788201556.485699:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0xf8:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201556.485707:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093d90 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201556.485715:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093d90 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201556.485722:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201556.485725:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0xf8:0x0](ffff8bc1459d5b88) 00000080:00010000:3.0:1788201556.485728:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0xf8:0x0](ffff8bc1459d5b88) for lock 0xd138388016f6e4e7 00000080:00010000:3.0:1788201556.485731:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e4e7 from it ffffadd1c7da3cb8 00010000:00010000:3.0:1788201556.485734:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093d90 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201556.485742:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093d90 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201556.485853:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf8:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201556.485866:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0xf8:0x0] 00000008:00010000:3.0:1788201556.485897:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201556.485900:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1440084b0, osc lock ffff8bc14691abe0, flags 0x400001002 00010000:00010000:3.0:1788201556.485917:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d554d574/0xd138388016f6e4f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093da5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.485928:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d554d574/0xd138388016f6e4f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093da5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:3.0:1788201556.485941:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1788201556.485945:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d554d574/0xd138388016f6e4f5 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171093da5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.485952:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d554d574/0xd138388016f6e4f5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093da5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1788201556.485963:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1788201556.485973:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0xf8:0x0] updating i_size 838 i_blocks 1 00000020:00010000:3.0:1788201556.485977:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc79d0 (ffff8bc1460e9c68/0) at cl_lock_release():245 00000020:00010000:3.0:1788201556.485980:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc79d0 (ffff8bc1460e9c68/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201556.485983:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1440084b0 (ffff8bc1460e96c8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201556.485988:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc79d0 (ffff8bc1460e9c68/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201556.485991:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1440084b0 (ffff8bc1460e9c68/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201556.486030:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf8:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201556.486079:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201556.486086:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201556.486093:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 80 lru_type: 1 00010000:00010000:3.0:1788201556.486102:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 80 lru_type: 1 00000080:00200000:3.0:1788201556.486108:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201556.486112:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201556.486115:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201556.486119:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201556.486122:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 80 lru_type: 1 00010000:00010000:3.0:1788201556.486130:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 81 lru_type: 1 00000080:00200000:3.0:1788201556.486138:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.486142:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201556.486146:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.486158:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=mds-survey.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=9 00000080:00200000:3.0:1788201556.486162:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=mds-survey.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:3.0:1788201556.486171:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: mds-survey.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201556.486220:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4fc lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.486227:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4fc lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.486241:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4fc lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201556.486260:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c5b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727795328:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201556.486339:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8c300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201556.495984:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c5b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727795328:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201556.496010:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4fc lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.496034:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4fc lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.496040:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4fc lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.496047:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4fc lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.496056:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4fc lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.496062:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14400ce00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201556.496067:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4fc lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.496074:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4fc lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.496082:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4fc lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.496090:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201556.496096:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4fc lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.496103:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e4fc lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201556.496125:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc146c5b100 x1875064727795328/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201572 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201556.496140:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201556.496165:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:3.0:1788201556.496242:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201556.496259:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201556.496269:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 81 lru_type: 1 00010000:00010000:3.0:1788201556.496281:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 81 lru_type: 1 00000080:00200000:3.0:1788201556.496288:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201556.496293:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201556.496297:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201556.496303:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201556.496307:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 81 lru_type: 1 00010000:00010000:3.0:1788201556.496316:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 82 lru_type: 1 00000080:00200000:3.0:1788201556.496331:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.496338:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201556.496344:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.496356:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=mds-survey.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=8 00000080:00200000:3.0:1788201556.496361:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=mds-survey.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:3.0:1788201556.496372:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: mds-survey.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201556.496412:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e503 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.496419:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e503 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.496430:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e503 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201556.496451:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c5b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727795456:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201556.496534:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8c300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201556.501370:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c5b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727795456:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201556.501395:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e503 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.501409:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e503 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.501431:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e503 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.501438:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e503 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.501448:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e503 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.501455:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14400d400 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201556.501460:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e503 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.501467:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e503 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.501475:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e503 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.501482:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201556.501489:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e503 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.501494:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e503 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201556.501514:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc146c5b100 x1875064727795456/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201572 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201556.501529:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201556.501555:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:3.0:1788201556.501661:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201556.501675:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201556.501684:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 82 lru_type: 1 00010000:00010000:3.0:1788201556.501711:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 82 lru_type: 1 00000080:00200000:3.0:1788201556.501719:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201556.501724:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201556.501728:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201556.501734:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3bf8 00010000:00010000:3.0:1788201556.501737:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 82 lru_type: 1 00010000:00010000:3.0:1788201556.501746:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 83 lru_type: 1 00000080:00200000:3.0:1788201556.501762:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.501769:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201556.501775:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.501787:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:3.0:1788201556.501825:0:23731:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=mds-survey.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), file ffff8bc143847c80, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:3.0:1788201556.501834:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=mds-survey.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000002:00010000:3.0:1788201556.501856:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: mds-survey.sh,[0x200000bd7:0xf9:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open|creat flags 0100302 00000100:00100000:3.0:1788201556.524277:0:21781:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201556.524309:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743420800 00000100:00100000:3.0:1788201556.524317:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743420800 00000100:00100000:3.0:1788201556.524349:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743420928 00000100:00100000:3.0:1788201556.524351:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743420928 00000100:00100000:3.0:1788201556.524359:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743421056 00000100:00100000:3.0:1788201556.524362:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743421056 00000100:00100000:3.0:1788201556.524369:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743421184 00000100:00100000:3.0:1788201556.524371:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743421184 00000100:00100000:3.0:1788201556.524377:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743421312 00000100:00100000:3.0:1788201556.524379:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743421312 00000100:00100000:3.0:1788201556.524391:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 457 00000100:00100000:3.0:1788201556.524398:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc146029180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+8:21821:x1875064743420800:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201556.524414:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007da1b444/0xd138388016f6d78f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x159:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090861 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.524480:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201556.524486:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc146029180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+8:21821:x1875064743420800:12345-192.168.201.143@tcp:104: Request processed in 88us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201556.524493:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 457 00000100:00100000:3.0:1788201556.524507:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 458 00000100:00100000:3.0:1788201556.524513:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14602b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+7:24638:x1875064743420928:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201556.524521:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6dad7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x165:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710910e9 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 1 00010000:00010000:3.0:1788201556.524543:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788201556.524548:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14602b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+7:24638:x1875064743420928:12345-192.168.201.143@tcp:104: Request processed in 36us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201556.524554:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 458 00000100:00100000:3.0:1788201556.524562:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 459 00000100:00100000:3.0:1788201556.524567:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc146029f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+6:23417:x1875064743421056:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201556.524573:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f496f752/0xd138388016f6dbef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x169:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710913c1 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201556.524600:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788201556.524604:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc146029f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+6:23417:x1875064743421056:12345-192.168.201.143@tcp:104: Request processed in 38us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201556.524610:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 459 00000100:00100000:3.0:1788201556.524618:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 460 00000100:00100000:3.0:1788201556.524623:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc146028e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+5:23408:x1875064743421184:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201556.524630:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6db63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171091255 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.524647:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788201556.524651:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc146028e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+5:23408:x1875064743421184:12345-192.168.201.143@tcp:104: Request processed in 29us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201556.524657:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 460 00000100:00100000:3.0:1788201556.524664:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 461 00000100:00100000:3.0:1788201556.524669:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172657050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23392:x1875064743421312:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201556.524676:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000047c458cf/0xd138388016f6dcc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710915e3 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201556.524693:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788201556.524697:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172657050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23392:x1875064743421312:12345-192.168.201.143@tcp:104: Request processed in 28us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201556.524702:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 461 00010000:00010000:3.0:1788201556.524728:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788201556.524733:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007da1b444/0xd138388016f6d78f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x159:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090861 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.524748:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc15c12b800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201556.524753:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007da1b444/0xd138388016f6d78f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x159:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171090861 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.524908:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007da1b444/0xd138388016f6d78f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x159:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090861 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.524917:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201556.524936:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007da1b444/0xd138388016f6d78f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x159:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090861 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.524945:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007da1b444/0xd138388016f6d78f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x159:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090861 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.524964:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788201556.524967:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6dad7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x165:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710910e9 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 1 00010000:00010000:3.0:1788201556.524974:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3de00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201556.524977:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6dad7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x165:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e21710910e9 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 1 00010000:00010000:3.0:1788201556.525005:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6dad7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x165:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710910e9 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 1 00010000:00010000:3.0:1788201556.525029:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201556.525041:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6dad7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x165:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710910e9 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 1 00010000:00010000:3.0:1788201556.525048:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6dad7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x165:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710910e9 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 1 00010000:00010000:3.0:1788201556.525059:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788201556.525063:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f496f752/0xd138388016f6dbef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x169:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710913c1 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201556.525069:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14a778200 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201556.525072:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f496f752/0xd138388016f6dbef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x169:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e21710913c1 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201556.525099:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f496f752/0xd138388016f6dbef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x169:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710913c1 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201556.525105:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201556.525110:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f496f752/0xd138388016f6dbef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x169:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710913c1 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201556.525117:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f496f752/0xd138388016f6dbef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x169:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710913c1 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201556.525128:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201556.525132:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6db63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171091255 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.525138:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14a778a00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201556.525141:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6db63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171091255 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.525164:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6db63 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171091255 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.525170:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201556.525174:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6db63 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171091255 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.525181:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6db63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171091255 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.525418:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201556.525422:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000047c458cf/0xd138388016f6dcc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710915e3 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201556.525428:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14400cc00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201556.525432:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000047c458cf/0xd138388016f6dcc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e21710915e3 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201556.525466:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000047c458cf/0xd138388016f6dcc1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710915e3 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201556.525478:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201556.525483:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000047c458cf/0xd138388016f6dcc1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710915e3 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201556.525490:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000047c458cf/0xd138388016f6dcc1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710915e3 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201556.525501:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201556.525503:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201556.525505:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201556.525513:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201556.525527:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727796096:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.525575:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727796608:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.525593:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201556.525597:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727796480:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.525636:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201556.525659:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743421440 00000100:00100000:3.0:1788201556.525663:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743421440 00000100:00100000:3.0:1788201556.525683:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 462 00000100:00100000:3.0:1788201556.525689:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc146c58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23407:x1875064743421440:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201556.525698:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6dd4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109174f expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.525722:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201556.525727:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc146c58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23407:x1875064743421440:12345-192.168.201.143@tcp:104: Request processed in 39us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201556.525733:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 462 00010000:00010000:3.0:1788201556.525744:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201556.525748:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6dd4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109174f expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.525756:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1727c9c00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201556.525759:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6dd4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e217109174f expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.527509:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6dd4d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109174f expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.527517:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201556.527525:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6dd4d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109174f expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.527533:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6dd4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109174f expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.527609:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201556.527613:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007488086b/0xd138388016f6dd70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710917aa expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.527621:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172725600 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201556.527624:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007488086b/0xd138388016f6dd70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e21710917aa expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.527666:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007488086b/0xd138388016f6dd70 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710917aa expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.527673:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201556.527737:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007488086b/0xd138388016f6dd70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710917aa expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.527745:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007488086b/0xd138388016f6dd70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710917aa expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.527758:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201556.527760:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201556.527761:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201556.527775:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727796736:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.527838:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201556.527845:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727797120:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.529925:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 469 00000100:00100000:3.0:1788201556.529936:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14602a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+8:23391:x1875064743423360:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201556.529944:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000065c4536c/0xd138388016f6db86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710912b0 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201556.530000:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201556.530006:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14602a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+8:23391:x1875064743423360:12345-192.168.201.143@tcp:104: Request processed in 73us (3031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201556.530026:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 469 00000100:00100000:3.0:1788201556.530045:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 470 00000100:00100000:3.0:1788201556.530051:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14602a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+7:21822:x1875064743423488:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201556.530060:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004373584d/0xd138388016f6d607 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x153:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109045c expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 1 00010000:00010000:3.0:1788201556.531663:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788201556.531670:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14602a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21822:x1875064743423488:12345-192.168.201.143@tcp:104: Request processed in 1618us (4674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201556.531676:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 470 00000100:00100000:3.0:1788201556.531702:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727797632:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.531746:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201556.531753:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727797504:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.531956:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201556.531983:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743423872 00000100:00100000:3.0:1788201556.531989:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743423872 00000100:00100000:3.0:1788201556.532027:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 473 00000100:00100000:3.0:1788201556.532035:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc146c59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:28099:x1875064743423872:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201556.532044:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000dbcdbffe/0xd138388016f6e511 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x183:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171093df9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.532066:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788201556.532071:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc146c59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:28099:x1875064743423872:12345-192.168.201.143@tcp:104: Request processed in 38us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201556.532076:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 473 00000100:00100000:3.0:1788201556.554101:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201556.554147:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201556.554179:0:21781:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201556.554207:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743424256 00000100:00100000:3.0:1788201556.554215:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743424256 00000100:00100000:3.0:1788201556.554256:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743424384 00000100:00100000:3.0:1788201556.554259:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743424384 00000100:00100000:3.0:1788201556.554274:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 474 00000100:00100000:3.0:1788201556.554282:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc146c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23392:x1875064743424256:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201556.554299:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6d749 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x158:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710907ab expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201556.554362:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201556.554368:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc146c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23392:x1875064743424256:12345-192.168.201.143@tcp:104: Request processed in 87us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201556.554375:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 474 00000100:00100000:3.0:1788201556.554390:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 475 00000100:00100000:3.0:1788201556.554395:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1664a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23407:x1875064743424384:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201556.554404:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041b95a58/0xd138388016f6da28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x162:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090f22 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201556.554431:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788201556.554437:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1664a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23407:x1875064743424384:12345-192.168.201.143@tcp:104: Request processed in 41us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201556.554442:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 475 00000100:00100000:3.0:1788201556.555409:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727798272:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.555480:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201556.555489:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727798400:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.564670:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201556.564720:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201556.564750:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201556.564782:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201556.564891:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201556.564921:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201556.564946:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201556.565036:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727798400:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.565052:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727798272:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.565065:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727797888:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.565073:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727797760:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.574064:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201556.590349:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743427584 00000100:00100000:3.0:1788201556.590359:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743427584 00000100:00100000:3.0:1788201556.590396:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743427712 00000100:00100000:3.0:1788201556.590400:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743427712 00000100:00100000:3.0:1788201556.590409:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743427840 00000100:00100000:3.0:1788201556.590411:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743427840 00000100:00100000:3.0:1788201556.590432:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743427968 00000100:00100000:3.0:1788201556.590434:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743427968 00000100:00100000:3.0:1788201556.590444:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743428096 00000100:00100000:3.0:1788201556.590447:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743428096 00000100:00100000:3.0:1788201556.590462:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 484 00000100:00100000:3.0:1788201556.590473:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14602b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+7:24638:x1875064743427584:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201556.590492:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6d7b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x159:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710908bc expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201556.593606:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201556.593614:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14602b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:24638:x1875064743427584:12345-192.168.201.143@tcp:104: Request processed in 3143us (3656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201556.593622:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 484 00010000:00010000:3.0:1788201556.593645:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201556.593649:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6d7b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x159:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710908bc expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201556.593656:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1725a1000 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201556.593661:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6d7b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x159:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e21710908bc expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201556.593710:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6d7b2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x159:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710908bc expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201556.593717:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201556.593726:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6d7b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x159:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710908bc expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201556.593732:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6d7b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x159:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710908bc expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201556.593746:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201556.593748:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201556.593749:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201556.593755:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201556.593762:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727800320:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.593833:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727799552:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.593844:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727798784:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.593853:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727798912:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.595429:0:21781:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201556.595444:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743428608 00000100:00100000:3.0:1788201556.595455:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743428608 00000100:00100000:3.0:1788201556.595502:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 489 00000100:00100000:3.0:1788201556.595510:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1726d3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23389:x1875064743428608:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201556.595522:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6d6bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x156:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109063f expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201556.595565:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201556.595572:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1726d3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23389:x1875064743428608:12345-192.168.201.143@tcp:104: Request processed in 62us (1529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201556.595579:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 489 00000100:00100000:3.0:1788201556.602059:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743428736 00000100:00100000:3.0:1788201556.602072:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743428736 00000100:00100000:3.0:1788201556.602143:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743428864 00000100:00100000:3.0:1788201556.602146:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743428864 00000100:00100000:3.0:1788201556.602164:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 490 00000100:00100000:3.0:1788201556.602173:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc146029880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+5:23417:x1875064743428736:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201556.602202:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d27fab30/0xd138388016f6d654 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x154:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109052e expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201556.602300:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201556.602307:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc146029880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+5:23417:x1875064743428736:12345-192.168.201.143@tcp:104: Request processed in 134us (3772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201556.602314:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 490 00000100:00100000:3.0:1788201556.602333:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 491 00000100:00100000:3.0:1788201556.602339:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14602a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:24636:x1875064743428864:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201556.602348:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3b98f9e/0xd138388016f6da6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x163:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090fd8 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201556.602376:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788201556.602382:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14602a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:24636:x1875064743428864:12345-192.168.201.143@tcp:104: Request processed in 43us (3225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201556.602388:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 491 00010000:00010000:3.0:1788201556.602410:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201556.602973:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d27fab30/0xd138388016f6d654 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x154:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109052e expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201556.602983:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172610600 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201556.602989:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d27fab30/0xd138388016f6d654 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x154:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e217109052e expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201556.603088:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d27fab30/0xd138388016f6d654 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x154:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109052e expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201556.603096:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201556.603346:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d27fab30/0xd138388016f6d654 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x154:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109052e expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201556.603356:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d27fab30/0xd138388016f6d654 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x154:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109052e expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201556.603376:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201556.603380:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3b98f9e/0xd138388016f6da6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x163:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090fd8 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201556.603387:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149eb6200 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201556.603391:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3b98f9e/0xd138388016f6da6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x163:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171090fd8 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201556.603440:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3b98f9e/0xd138388016f6da6e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x163:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090fd8 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201556.603448:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201556.603462:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3b98f9e/0xd138388016f6da6e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x163:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090fd8 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201556.603469:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3b98f9e/0xd138388016f6da6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x163:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090fd8 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201556.603482:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201556.603484:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201556.603486:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201556.603498:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727800832:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.607760:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743428992 00000100:00100000:3.0:1788201556.607773:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743428992 00000100:00100000:3.0:1788201556.608035:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 492 00000100:00100000:3.0:1788201556.608049:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14602ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23407:x1875064743428992:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201556.608069:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6d703 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710906f5 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201556.608162:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201556.608170:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14602ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23407:x1875064743428992:12345-192.168.201.143@tcp:104: Request processed in 124us (7815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201556.608177:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 492 00010000:00010000:3.0:1788201556.610279:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201556.610286:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000a59f58f/0xd138388016f6de42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x171:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710919cc expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.610294:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17258ae00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201556.610299:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000a59f58f/0xd138388016f6de42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x171:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e21710919cc expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.610374:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000a59f58f/0xd138388016f6de42 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x171:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710919cc expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.610382:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201556.610415:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000a59f58f/0xd138388016f6de42 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x171:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710919cc expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.610428:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000a59f58f/0xd138388016f6de42 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x171:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710919cc expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201556.610453:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201556.610455:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201556.610457:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201556.610476:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201556.610492:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727800960:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201556.615436:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201556.615455:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146029180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727801600:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.615524:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727800320:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.615534:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727799808:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.615542:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727800192:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.615561:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201556.615566:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727801728:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.626604:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727800832:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.630227:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727801728:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.630246:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146029180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727801600:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.630256:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727800960:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.638269:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201556.655866:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727803136:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.695079:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:3.0:1788201556.695434:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201556.695442:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f97ad2a0/0xd138388016f6e557 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x184:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171093ff8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.695453:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172734200 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201556.695459:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f97ad2a0/0xd138388016f6e557 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x184:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171093ff8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201556.695522:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xfb:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201556.695539:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xfb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201556.695606:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f97ad2a0/0xd138388016f6e557 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x184:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171093ff8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.695614:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201556.695662:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f97ad2a0/0xd138388016f6e557 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x184:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171093ff8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.695671:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f97ad2a0/0xd138388016f6e557 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x184:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171093ff8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.695689:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201556.695691:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201556.695692:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201556.703170:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201556.751538:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727805568:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.784175:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743432832 00000100:00100000:3.0:1788201556.784281:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743432832 00000100:00100000:3.0:1788201556.784341:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 512 00000100:00100000:3.0:1788201556.784350:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23392:x1875064743432832:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201556.784368:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000bdea9c81/0xd138388016f6e59d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x185:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710940ae expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.784493:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201556.784500:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23392:x1875064743432832:12345-192.168.201.143@tcp:104: Request processed in 151us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201556.784507:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 512 00010000:00010000:3.0:1788201556.827768:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201556.827776:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000684893b6/0xd138388016f6e5c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x186:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094109 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.827786:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172723a00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201556.827822:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000684893b6/0xd138388016f6e5c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x186:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171094109 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201556.827880:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xfe:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201556.827894:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xfe:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201556.827956:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000684893b6/0xd138388016f6e5c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x186:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094109 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.827964:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201556.827986:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000684893b6/0xd138388016f6e5c0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x186:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094109 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.827999:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000684893b6/0xd138388016f6e5c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x186:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094109 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.828025:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201556.828027:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201556.828029:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201556.828044:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727807872:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.832836:0:20876:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201556.832857:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743433216 00000100:00100000:3.0:1788201556.832866:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743433216 00000100:00100000:3.0:1788201556.832925:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 515 00000100:00100000:3.0:1788201556.832936:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1664a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23412:x1875064743433216:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201556.832952:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f97ad2a0/0xd138388016f6e5c7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094110 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.832966:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f97ad2a0/0xd138388016f6e5c7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094110 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.832975:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f97ad2a0/0xd138388016f6e5c7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094110 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.832985:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f97ad2a0/0xd138388016f6e5c7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171094110 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.832994:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f97ad2a0/0xd138388016f6e5c7 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171094110 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.833015:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f97ad2a0/0xd138388016f6e5c7 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171094110 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.833033:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc172734200) 00000100:00100000:3.0:1788201556.833347:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1664a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23412:x1875064743433216:12345-192.168.201.143@tcp:105: Request processed in 413us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201556.833356:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 515 00000100:00100000:3.0:1788201556.839945:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727807872:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.854586:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727808768:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201556.867203:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:3.0:1788201556.868025:0:23731:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017a4a5c3/0xd138388016f6e5ea lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109416b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.868034:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017a4a5c3/0xd138388016f6e5ea lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109416b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.868049:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017a4a5c3/0xd138388016f6e5ea lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e217109416b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201556.868062:0:23731:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017a4a5c3/0xd138388016f6e5ea lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e217109416b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.868075:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017a4a5c3/0xd138388016f6e5ea lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109416b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.868084:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017a4a5c3/0xd138388016f6e5ea lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109416b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201556.868125:0:23731:0:(vvp_io.c:1292:vvp_io_write_start()) ost-pools.sh: write [0, 55540) append 0 append lockpos 0 00000080:00200000:3.0:1788201556.868144:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:3.0:1788201556.868198:0:23731:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:3.0:1788201556.868211:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000fb2118f6[3 00000000f502b47a 2 1 000000000235009b 0 0 0] 00000080:00200000:3.0:1788201556.868215:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000ea9cc260 17ffffc0001001 3:0 ffff8bc144e41ee0 0 lru 00000080:00200000:3.0:1788201556.868222:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000009b0ceaaa 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000e14f883c > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201556.868224:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000fb2118f6 00000080:00200000:3.0:1788201556.868225:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201556.868229:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:3.0:1788201556.868251:0:23731:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:3.0:1788201556.868256:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000fa3750df[3 00000000f502b47a 2 1 000000000235009b 0 0 1] 00000080:00200000:3.0:1788201556.868258:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000b0de332f 17ffffc0001001 3:0 ffff8bc144e41620 1 lru 00000080:00200000:3.0:1788201556.868264:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b28ef659 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 00000000e14f883c > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201556.868266:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000fa3750df 00000080:00200000:3.0:1788201556.868267:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:3.0:1788201556.868270:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:3.0:1788201556.868287:0:23731:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:3.0:1788201556.868291:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000b881867a[3 00000000f502b47a 2 1 000000000235009b 0 0 2] 00000080:00200000:3.0:1788201556.868294:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000006cce39fd 17ffffc0001001 3:0 ffff8bc144e417e0 2 lru 00000080:00200000:3.0:1788201556.868299:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000bd209dd3 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000000ce25486 00000000e14f883c > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201556.868301:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000b881867a 00000080:00200000:3.0:1788201556.868302:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:3.0:1788201556.868304:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:3.0:1788201556.868329:0:23731:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:3.0:1788201556.868334:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000019352ad7[3 00000000f502b47a 2 1 000000000235009b 0 0 3] 00000080:00200000:3.0:1788201556.868337:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000001f17ef88 17ffffc0001021 2:0 ffff8bc144e41700 3 lru 00000080:00200000:3.0:1788201556.868342:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b271604a 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000000ce25486 00000000e14f883c > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201556.868344:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000019352ad7 00000080:00200000:3.0:1788201556.868346:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:3.0:1788201556.868347:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:3.0:1788201556.868362:0:23731:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:3.0:1788201556.868366:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000dfeeba6b[3 00000000f502b47a 2 1 000000000235009b 0 0 4] 00000080:00200000:3.0:1788201556.868369:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000033c3d3e5 17ffffc0001001 3:0 ffff8bc144e41b60 4 lru 00000080:00200000:3.0:1788201556.868374:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000bb8feca9 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000000ce25486 00000000e14f883c > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201556.868376:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000dfeeba6b 00000080:00200000:3.0:1788201556.868377:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:3.0:1788201556.868379:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:3.0:1788201556.868394:0:23731:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:3.0:1788201556.868398:0:23731:0:(rw26.c:956:ll_write_end()) page@000000005b1f1cea[3 00000000f502b47a 2 1 000000000235009b 0 0 5] 00000080:00200000:3.0:1788201556.868401:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000005f4d3341 17ffffc0001001 3:0 ffff8bc144e412a0 5 lru 00000080:00200000:3.0:1788201556.868406:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000a061546a 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000000ce25486 00000000e14f883c > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201556.868409:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000005b1f1cea 00000080:00200000:3.0:1788201556.868410:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:3.0:1788201556.868411:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:3.0:1788201556.868425:0:23731:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:3.0:1788201556.868429:0:23731:0:(rw26.c:956:ll_write_end()) page@000000004f778072[3 00000000f502b47a 2 1 000000000235009b 0 0 6] 00000080:00200000:3.0:1788201556.868432:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000039ca7425 17ffffc0001001 3:0 ffff8bc144e411c0 6 lru 00000080:00200000:3.0:1788201556.868437:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000f6a25614 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000000ce25486 00000000e14f883c > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201556.868439:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000004f778072 00000080:00200000:3.0:1788201556.868440:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:3.0:1788201556.868442:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:3.0:1788201556.868457:0:23731:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:3.0:1788201556.868461:0:23731:0:(rw26.c:956:ll_write_end()) page@000000003c88775f[3 00000000f502b47a 2 1 000000000235009b 0 0 7] 00000080:00200000:3.0:1788201556.868464:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000edfbe056 17ffffc0001001 3:0 ffff8bc1506ccc40 7 lru 00000080:00200000:3.0:1788201556.868468:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000d604fcc4 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000000ce25486 00000000e14f883c > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201556.868470:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000003c88775f 00000080:00200000:3.0:1788201556.868471:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:3.0:1788201556.868473:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:3.0:1788201556.868487:0:23731:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:3.0:1788201556.868492:0:23731:0:(rw26.c:956:ll_write_end()) page@000000003cb1bdd0[3 00000000f502b47a 2 1 000000000235009b 0 0 8] 00000080:00200000:3.0:1788201556.868494:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000004fac017 17ffffc0001001 3:0 ffff8bc1506cc9a0 8 lru 00000080:00200000:3.0:1788201556.868499:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000001b404991 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000000ce25486 00000000e14f883c > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201556.868501:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000003cb1bdd0 00000080:00200000:3.0:1788201556.868502:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:3.0:1788201556.868504:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 4096 bytes 00000080:00200000:3.0:1788201556.868517:0:23731:0:(rw26.c:898:ll_write_end()) pos 36864, len 4096, copied 4096 00000080:00200000:3.0:1788201556.868521:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000da6f0a83[3 00000000f502b47a 2 1 000000000235009b 0 0 9] 00000080:00200000:3.0:1788201556.868523:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000007fd3a140 17ffffc0001001 3:0 ffff8bc1506cc8c0 9 lru 00000080:00200000:3.0:1788201556.868528:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b46c31cd 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000000ce25486 00000000e14f883c > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201556.868531:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000da6f0a83 00000080:00200000:3.0:1788201556.868532:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:3.0:1788201556.868533:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 10 of 0 to 4096 bytes 00000080:00200000:3.0:1788201556.868547:0:23731:0:(rw26.c:898:ll_write_end()) pos 40960, len 4096, copied 4096 00000080:00200000:3.0:1788201556.868551:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000f9cd48d1[3 00000000f502b47a 2 1 000000000235009b 0 0 10] 00000080:00200000:3.0:1788201556.868554:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000001406cf7d 17ffffc0001001 3:0 ffff8bc1506cce00 10 lru 00000080:00200000:3.0:1788201556.868559:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000008dd08365 10: 1< 0 - - > 2< 40960 0 0 0x0 0x0 | 000000000ce25486 00000000e14f883c > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201556.868561:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000f9cd48d1 00000080:00200000:3.0:1788201556.868562:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 11. 00000080:00200000:3.0:1788201556.868564:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 11 of 0 to 4096 bytes 00000080:00200000:3.0:1788201556.868576:0:23731:0:(rw26.c:898:ll_write_end()) pos 45056, len 4096, copied 4096 00000080:00200000:3.0:1788201556.868580:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000eaded81d[3 00000000f502b47a 2 1 000000000235009b 0 0 11] 00000080:00200000:3.0:1788201556.868583:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000fd2b2c95 17ffffc0001001 3:0 ffff8bc1506ccee0 11 lru 00000080:00200000:3.0:1788201556.868588:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b722778e 11: 1< 0 - - > 2< 45056 0 0 0x0 0x0 | 000000000ce25486 00000000e14f883c > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201556.868590:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000eaded81d 00000080:00200000:3.0:1788201556.868591:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 12. 00000080:00200000:3.0:1788201556.868592:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 12 of 0 to 4096 bytes 00000080:00200000:3.0:1788201556.868607:0:23731:0:(rw26.c:898:ll_write_end()) pos 49152, len 4096, copied 4096 00000080:00200000:3.0:1788201556.868612:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000a7b55a29[3 00000000f502b47a 2 1 000000000235009b 0 0 12] 00000080:00200000:3.0:1788201556.868614:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000358abb35 17ffffc0001001 3:0 ffff8bc1506cc620 12 lru 00000080:00200000:3.0:1788201556.868619:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000024184c2d 12: 1< 0 - - > 2< 49152 0 0 0x0 0x0 | 000000000ce25486 00000000e14f883c > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201556.868621:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000a7b55a29 00000080:00200000:3.0:1788201556.868622:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 13. 00000080:00200000:3.0:1788201556.868624:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 13 of 0 to 2292 bytes 00000080:00200000:3.0:1788201556.868646:0:23731:0:(rw26.c:898:ll_write_end()) pos 53248, len 2292, copied 2292 00000080:00200000:3.0:1788201556.868650:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000033543ca4[3 00000000f502b47a 2 1 000000000235009b 0 0 13] 00000080:00200000:3.0:1788201556.868652:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000fa5b7015 17ffffc0001001 3:0 ffff8bc1506cc7e0 13 lru 00000080:00200000:3.0:1788201556.868658:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000f5854e63 13: 1< 0 - - > 2< 53248 0 0 0x0 0x0 | 000000000ce25486 00000000e14f883c > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201556.868660:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000033543ca4 00000080:00200000:3.0:1788201556.868661:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 14. 00000080:00200000:3.0:1788201556.868665:0:23731:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 14, from 0, to 2292 prio 0 00000008:00010000:3.0:1788201556.868684:0:23731:0:(osc_cache.c:857:osc_extent_find()) ### extent: 0000000014c5a66b ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017a4a5c3/0xd138388016f6e5ea lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109416b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201556.868712:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145929b38, count 14, dirtied 14 00000080:00200000:3.0:1788201556.868719:0:23731:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 14 pages 55540 bytes, tot: 55540 00000080:00200000:3.0:1788201556.868722:0:23731:0:(vvp_io.c:1358:vvp_io_write_start()) ost-pools.sh: write bytes 0, result: 55540 00000020:00010000:3.0:1788201556.868739:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c4128 (ffff8bc148e3b3f8/0) at cl_lock_release():245 00000020:00010000:3.0:1788201556.868742:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c4128 (ffff8bc148e3b3f8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201556.868745:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151a508b0 (ffff8bc148e3ba28/1) at cl_lock_cancel():142 00010000:00010000:3.0:1788201556.868750:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017a4a5c3/0xd138388016f6e5ea lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109416b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.868760:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017a4a5c3/0xd138388016f6e5ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109416b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1788201556.868775:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c4128 (ffff8bc148e3b3f8/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201556.868779:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151a508b0 (ffff8bc148e3b3f8/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201556.868787:0:23731:0:(vvp_io.c:533:vvp_io_advance()) advancing 55540 bytes 00000080:00200000:3.0:1788201556.868830:0:23731:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 13] 00000080:00200000:3.0:1788201556.868863:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xff:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201556.868866:0:23731:0:(file.c:2238:ll_file_io_generic()) ost-pools.sh: 2 io complete with rc: 0, result: 55540, restart: 0 00000080:00200000:3.0:1788201556.868874:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0xff:0x0] updating i_size 55540 i_blocks 1 00000080:00200000:3.0:1788201556.868879:0:23731:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 55540 00000080:00200008:3.0:1788201556.868924:0:23731:0:(file.c:479:ll_file_release()) START file ost-pools.sh:[0x200000bd7:0xff:0x0](ffff8bc145929988), flags 100001 00000002:00100000:3.0:1788201556.868974:0:23731:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1725f7100 x1875064727808640/t8589937036(8589937036) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201572 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1788201556.868986:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1788201556.868990:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146c5bb80 x1875064727809280/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1788201556.869022:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c5bb80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727809280:192.168.201.143@tcp:35:cp.0 00000100:00100000:3.0:1788201556.869089:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201556.874088:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c5bb80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727809280:192.168.201.143@tcp:35:cp.0 00000002:00100000:3.0:1788201556.874134:0:23731:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1725f7100 x1875064727808640/t8589937036(8589937036) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201572 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201556.874223:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201556.874242:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201556.874261:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 107 lru_type: 1 00010000:00010000:3.0:1788201556.874276:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 107 lru_type: 1 00000080:00200000:3.0:1788201556.874285:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201556.874291:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201556.874294:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201556.874302:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201556.874306:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 107 lru_type: 1 00010000:00010000:3.0:1788201556.874315:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 108 lru_type: 1 00000080:00200000:3.0:1788201556.874331:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.874338:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201556.874344:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.874348:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=ost-pools.sh, flags=8 00000080:00200008:3.0:1788201556.874355:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file ost-pools.sh:[0x200000bd7:0xff:0x0](ffff8bc145929988), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201556.874360:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0xff:0x0](ffff8bc145929988),name=ost-pools.sh 00000002:00010000:3.0:1788201556.874371:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0xff:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201556.874380:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611000/0xd138388016f6e5dc lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094156 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201556.874389:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611000/0xd138388016f6e5dc lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094156 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201556.874396:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201556.874400:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0xff:0x0](ffff8bc145929988) 00000080:00010000:3.0:1788201556.874402:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0xff:0x0](ffff8bc145929988) for lock 0xd138388016f6e5dc 00000080:00010000:3.0:1788201556.874407:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e5dc from it ffffadd1c7da3cb8 00010000:00010000:3.0:1788201556.874409:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611000/0xd138388016f6e5dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094156 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201556.874417:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611000/0xd138388016f6e5dc lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094156 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201556.874468:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xff:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201556.874478:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0xff:0x0] 00000008:00010000:3.0:1788201556.874511:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201556.874515:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1440080b0, osc lock ffff8bc14691abe0, flags 0x400001002 00010000:00010000:3.0:1788201556.874534:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017a4a5c3/0xd138388016f6e5ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109416b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.874545:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017a4a5c3/0xd138388016f6e5ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109416b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:3.0:1788201556.874558:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1788201556.874563:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017a4a5c3/0xd138388016f6e5ea lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109416b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.874572:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017a4a5c3/0xd138388016f6e5ea lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109416b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1788201556.874582:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1788201556.874592:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0xff:0x0] updating i_size 55540 i_blocks 1 00000020:00010000:3.0:1788201556.874596:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc79d0 (ffff8bc1460e9c68/0) at cl_lock_release():245 00000020:00010000:3.0:1788201556.874599:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc79d0 (ffff8bc1460e9c68/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201556.874602:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1440080b0 (ffff8bc1460e96c8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201556.874606:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc79d0 (ffff8bc1460e9c68/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201556.874608:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1440080b0 (ffff8bc1460e9c68/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201556.874636:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xff:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201556.874683:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201556.874691:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201556.874698:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 108 lru_type: 1 00010000:00010000:3.0:1788201556.874706:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 108 lru_type: 1 00000080:00200000:3.0:1788201556.874713:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201556.874717:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201556.874719:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201556.874723:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201556.874726:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 108 lru_type: 1 00010000:00010000:3.0:1788201556.874734:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 109 lru_type: 1 00000080:00200000:3.0:1788201556.874742:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.874746:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201556.874750:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.874767:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=parallel-scale-cifs.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=9 00000080:00200000:3.0:1788201556.874771:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=parallel-scale-cifs.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:3.0:1788201556.874782:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: parallel-scale-cifs.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201556.907539:0:23731:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.907551:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.907572:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201556.907585:0:23731:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.907596:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.907604:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201556.907633:0:23731:0:(vvp_io.c:1292:vvp_io_write_start()) parallel-scale-cifs.sh: write [0, 6813) append 0 append lockpos 0 00000080:00200000:3.0:1788201556.907651:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:3.0:1788201556.907700:0:23731:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:3.0:1788201556.907712:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000062ec86ff[3 00000000f6cf99a3 2 1 000000007115fab0 0 0 0] 00000080:00200000:3.0:1788201556.907716:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000016e1663e 17ffffc0001001 3:0 ffff8bc1506cc700 0 lru 00000080:00200000:3.0:1788201556.907723:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000006f258138 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 00000000e46a07f0 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201556.907726:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000062ec86ff 00000080:00200000:3.0:1788201556.907727:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201556.907730:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 2717 bytes 00000080:00200000:3.0:1788201556.907758:0:23731:0:(rw26.c:898:ll_write_end()) pos 4096, len 2717, copied 2717 00000080:00200000:3.0:1788201556.907764:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000c8feff6b[3 00000000f6cf99a3 2 1 000000007115fab0 0 0 1] 00000080:00200000:3.0:1788201556.907766:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000a41f4338 17ffffc0001001 3:0 ffff8bc1506ccb60 1 lru 00000080:00200000:3.0:1788201556.907772:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000060b21d03 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 00000000e46a07f0 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201556.907774:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000c8feff6b 00000080:00200000:3.0:1788201556.907775:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:3.0:1788201556.907779:0:23731:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 2, from 0, to 2717 prio 0 00000008:00010000:3.0:1788201556.907840:0:23731:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000c5f1d161 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201556.907865:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145980ab8, count 2, dirtied 2 00000080:00200000:3.0:1788201556.907872:0:23731:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 2 pages 6813 bytes, tot: 6813 00000080:00200000:3.0:1788201556.907875:0:23731:0:(vvp_io.c:1358:vvp_io_write_start()) parallel-scale-cifs.sh: write bytes 0, result: 6813 00000020:00010000:3.0:1788201556.907893:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc148fb13f8 (ffff8bc1499c4ea8/0) at cl_lock_release():245 00000020:00010000:3.0:1788201556.907897:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc148fb13f8 (ffff8bc1499c4ea8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201556.907901:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146f0a030 (ffff8bc1499c41b8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1788201556.907907:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.907916:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1788201556.907931:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc148fb13f8 (ffff8bc1499c4ea8/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201556.907934:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146f0a030 (ffff8bc1499c4ea8/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201556.907941:0:23731:0:(vvp_io.c:533:vvp_io_advance()) advancing 6813 bytes 00000080:00200000:3.0:1788201556.907949:0:23731:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 1] 00000080:00200000:3.0:1788201556.907977:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x100:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201556.907982:0:23731:0:(file.c:2238:ll_file_io_generic()) parallel-scale-cifs.sh: 2 io complete with rc: 0, result: 6813, restart: 0 00000080:00200000:3.0:1788201556.907991:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x100:0x0] updating i_size 6813 i_blocks 1 00000080:00200000:3.0:1788201556.907995:0:23731:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 6813 00000080:00200008:3.0:1788201556.908046:0:23731:0:(file.c:479:ll_file_release()) START file parallel-scale-cifs.sh:[0x200000bd7:0x100:0x0](ffff8bc145980908), flags 100001 00000002:00100000:3.0:1788201556.908101:0:23731:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc146028a80 x1875064727809792/t8589937038(8589937038) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201572 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1788201556.908112:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1788201556.908118:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146c5b480 x1875064727810432/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1788201556.908138:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c5b480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727810432:192.168.201.143@tcp:35:cp.0 00000100:00100000:3.0:1788201556.908204:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201556.911954:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c5b480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727810432:192.168.201.143@tcp:35:cp.0 00000002:00100000:3.0:1788201556.911991:0:23731:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc146028a80 x1875064727809792/t8589937038(8589937038) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201572 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201556.912078:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201556.912109:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201556.912129:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 111 lru_type: 1 00010000:00010000:3.0:1788201556.912142:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 111 lru_type: 1 00000080:00200000:3.0:1788201556.912151:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201556.912157:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201556.912161:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201556.912168:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201556.912172:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 111 lru_type: 1 00010000:00010000:3.0:1788201556.912190:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 112 lru_type: 1 00000080:00200000:3.0:1788201556.912207:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.912215:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201556.912220:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.912225:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=parallel-scale-cifs.sh, flags=8 00000080:00200008:3.0:1788201556.912233:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file parallel-scale-cifs.sh:[0x200000bd7:0x100:0x0](ffff8bc145980908), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201556.912239:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x100:0x0](ffff8bc145980908),name=parallel-scale-cifs.sh 00000002:00010000:3.0:1788201556.912249:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x100:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201556.912258:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725a00/0xd138388016f6e5ff lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x100:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710941b1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201556.912267:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725a00/0xd138388016f6e5ff lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x100:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710941b1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201556.912274:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201556.912278:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x100:0x0](ffff8bc145980908) 00000080:00010000:3.0:1788201556.912280:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x100:0x0](ffff8bc145980908) for lock 0xd138388016f6e5ff 00000080:00010000:3.0:1788201556.912284:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e5ff from it ffffadd1c7da3cb8 00010000:00010000:3.0:1788201556.912288:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725a00/0xd138388016f6e5ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x100:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710941b1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201556.912296:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725a00/0xd138388016f6e5ff lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x100:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710941b1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201556.912342:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x100:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201556.912351:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x100:0x0] 00000008:00010000:3.0:1788201556.912379:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201556.912382:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1440080b0, osc lock ffff8bc14691abe0, flags 0x400001002 00010000:00010000:3.0:1788201556.912401:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x187:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.912418:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:3.0:1788201556.912431:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1788201556.912436:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.912444:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1788201556.912454:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1788201556.912464:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x100:0x0] updating i_size 6813 i_blocks 1 00000020:00010000:3.0:1788201556.912468:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc79d0 (ffff8bc1460e9c68/0) at cl_lock_release():245 00000020:00010000:3.0:1788201556.912471:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc79d0 (ffff8bc1460e9c68/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201556.912474:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1440080b0 (ffff8bc1460e96c8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201556.912478:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc79d0 (ffff8bc1460e9c68/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201556.912481:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1440080b0 (ffff8bc1460e9c68/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201556.912509:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x100:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201556.912555:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201556.912563:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201556.912570:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 112 lru_type: 1 00010000:00010000:3.0:1788201556.912579:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 112 lru_type: 1 00000080:00200000:3.0:1788201556.912591:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201556.912595:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201556.912598:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201556.912602:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201556.912605:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 112 lru_type: 1 00010000:00010000:3.0:1788201556.912613:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 113 lru_type: 1 00000080:00200000:3.0:1788201556.912622:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.912626:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201556.912629:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.912643:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=parallel-scale-nfs.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=9 00000080:00200000:3.0:1788201556.912646:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=parallel-scale-nfs.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:3.0:1788201556.912655:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: parallel-scale-nfs.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201556.912694:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e614 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.912702:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e614 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.912712:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e614 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201556.912733:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c59180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727810560:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201556.912844:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201556.919878:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f7800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727810688:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201556.919901:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611400/0xd138388016f6e61b lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.919914:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611400/0xd138388016f6e61b lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.919922:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611400/0xd138388016f6e61b lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.919929:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611400/0xd138388016f6e61b lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.919936:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611400/0xd138388016f6e61b lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.919943:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172611400 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201556.919948:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611400/0xd138388016f6e61b lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.919956:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611400/0xd138388016f6e61b lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.919962:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611400/0xd138388016f6e61b lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.919970:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201556.919976:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611400/0xd138388016f6e61b lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.919983:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611400/0xd138388016f6e61b lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201556.920016:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1725f7800 x1875064727810688/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201572 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201556.920031:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201556.920056:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:3.0:1788201556.920409:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201556.920427:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201556.920437:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 114 lru_type: 1 00010000:00010000:3.0:1788201556.920449:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 114 lru_type: 1 00000080:00200000:3.0:1788201556.920455:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201556.920460:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201556.920464:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201556.920469:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3bf8 00010000:00010000:3.0:1788201556.920472:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 114 lru_type: 1 00010000:00010000:3.0:1788201556.920480:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 115 lru_type: 1 00000080:00200000:3.0:1788201556.920494:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.920502:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201556.920507:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.920520:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:3.0:1788201556.920525:0:23731:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=parallel-scale-nfs.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), file ffff8bc143847b00, open_flags 80c1, mode 81ed opened 0 00000080:00200000:3.0:1788201556.920532:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=parallel-scale-nfs.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000002:00010000:3.0:1788201556.920550:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: parallel-scale-nfs.sh,[0x200000bd7:0x101:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open|creat flags 0100302 00010000:00010000:3.0:1788201556.920600:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.920607:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1788201556.920619:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1788201556.920628:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146c58380 x1875064727810944/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1788201556.920636:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201556.920657:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c58380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727810944:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201556.921067:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8c300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201556.926109:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c58380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727810944:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201556.926135:0:23731:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109420c expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.926159:0:23731:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x101:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109420c expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.926168:0:23731:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109420c expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.926193:0:23731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109420c expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.926205:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109420c expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.926219:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109420c expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.926227:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109420c expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.926236:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109420c expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201556.926248:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc146c58380 x1875064727810944/t8589937040(8589937040) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201572 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1788201556.926260:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc146c58380 x1875064727810944/t8589937040(8589937040) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201572 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201556.926274:0:23731:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109420c expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1788201556.926288:0:23731:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109420c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.926299:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/257 (0 0) 00000080:00200000:3.0:1788201556.926306:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1788201556.926321:0:23731:0:(namei.c:1628:ll_create_it()) VFS Op:name=parallel-scale-nfs.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000080:00200000:3.0:1788201556.926352:0:23731:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x101:0x0](ffff8bc1459d3a88) 00000080:00200000:3.0:1788201556.926480:0:23731:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x101:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1788201556.926491:0:23731:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x101:0x0](ffff8bc1459d3a88) 00000080:00010000:3.0:1788201556.926495:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x101:0x0](ffff8bc1459d3a88) for lock 0xd138388016f6e622 00000080:00010000:3.0:1788201556.926505:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x101:0x0](ffff8bc1459d3a88) 00000080:00200008:3.0:1788201556.926519:0:23731:0:(file.c:1090:ll_file_open()) START file parallel-scale-nfs.sh:[0x200000bd7:0x101:0x0](ffff8bc1459d3a88), flags 100301 00000002:00100000:3.0:1788201556.926539:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc146c58380 x1875064727810944/t8589937040(8589937040) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201572 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1788201556.926580:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e622 from it ffff8bc148c9b000 00010000:00010000:3.0:1788201556.926585:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109420c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.926594:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109420c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201556.926615:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x101:0x0](ffff8bc1459d3a88), inode mode 81ed mask 40 00000080:00200008:3.0:1788201556.926642:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file parallel-scale-nfs.sh:[0x200000bd7:0x101:0x0](ffff8bc1459d3a88), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201556.926648:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x101:0x0](ffff8bc1459d3a88),name=parallel-scale-nfs.sh 00000002:00010000:3.0:1788201556.926666:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x101:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201556.926677:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109420c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.926687:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109420c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201556.926698:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201556.926703:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x101:0x0](ffff8bc1459d3a88) 00000080:00010000:3.0:1788201556.926706:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x101:0x0](ffff8bc1459d3a88) for lock 0xd138388016f6e622 00000080:00010000:3.0:1788201556.926710:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e622 from it ffffadd1c7da3cd8 00010000:00010000:3.0:1788201556.926714:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109420c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.926723:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109420c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201556.926750:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x101:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201556.926760:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x101:0x0] 00000008:00010000:3.0:1788201556.926838:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201556.926842:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1440087b0, osc lock ffff8bc14691abe0, flags 0x400001002 00010000:00010000:3.0:1788201556.926887:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b50d7ba3/0xd138388016f6e629 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.926897:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b50d7ba3/0xd138388016f6e629 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201556.926925:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1788201556.931640:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x101:0x0] updating i_size 0 i_blocks 1 00000020:00010000:3.0:1788201556.931646:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc79d0 (ffff8bc1460e9c68/0) at cl_lock_release():245 00000020:00010000:3.0:1788201556.931650:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc79d0 (ffff8bc1460e9c68/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201556.931655:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1440087b0 (ffff8bc1460e96c8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201556.931659:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc79d0 (ffff8bc1460e9c68/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201556.931662:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1440087b0 (ffff8bc1460e9c68/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201556.931702:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x101:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1788201556.931758:0:23731:0:(file.c:2638:do_file_write_iter()) START file parallel-scale-nfs.sh:[0x200000bd7:0x101:0x0], ppos: 0, count: 6213 00000080:00200000:3.0:1788201556.931784:0:23731:0:(file.c:2090:ll_file_io_generic()) parallel-scale-nfs.sh: write ppos: 0, bytes: 6213 00000080:00200000:3.0:1788201556.931941:0:23731:0:(file.c:1848:ll_io_set_mirror()) parallel-scale-nfs.sh: desiginated mirror: 0 00000020:00200000:3.0:1788201556.931948:0:23731:0:(cl_io.c:214:cl_io_rw_init()) header@0000000058674cc0[0x110, 1, [0x200000bd7:0x101:0x0] hash] 00000020:00200000:3.0:1788201556.931950:0:23731:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 6213) 0 0 00000080:00200000:3.0:1788201556.931955:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x101:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201556.931968:0:23731:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 1] 00020000:00200000:3.0:1788201556.931976:0:23731:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 6213) 6213, 6213 00020000:00200000:3.0:1788201556.931981:0:23731:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1788201556.932020:0:23731:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 1] 00000008:00010000:3.0:1788201556.932034:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1788201556.932040:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1440087b0, osc lock ffff8bc14691abe0, flags 0x0 00010000:00010000:3.0:1788201556.932057:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/391 (0 8191) 00010000:00010000:3.0:1788201556.932248:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000499c3d5c/0xd138388016f6e630 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x187:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.932259:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000499c3d5c/0xd138388016f6e630 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x187:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.932270:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000499c3d5c/0xd138388016f6e630 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x187:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201556.932292:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c5b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727811200:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201556.932422:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8cb40 going to sleep for 11 seconds 00010000:00010000:3.0:1788201556.935830:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201556.935839:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b50d7ba3/0xd138388016f6e629 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x187:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109421a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.935848:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14400d400 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201556.935854:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b50d7ba3/0xd138388016f6e629 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x187:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e217109421a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201556.935914:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x101:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201556.935928:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x101:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201556.935993:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b50d7ba3/0xd138388016f6e629 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x187:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109421a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.936001:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201556.936038:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b50d7ba3/0xd138388016f6e629 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x187:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109421a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.936048:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b50d7ba3/0xd138388016f6e629 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x187:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109421a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.936065:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201556.936067:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201556.936068:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201556.936077:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201556.936103:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727811328:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201556.938423:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201556.942721:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c5b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727811200:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201556.942750:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000499c3d5c/0xd138388016f6e630 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094221 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.942773:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000499c3d5c/0xd138388016f6e630 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171094221 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201556.942788:0:23731:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000499c3d5c/0xd138388016f6e630 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171094221 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.942827:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000499c3d5c/0xd138388016f6e630 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094221 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.942835:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000499c3d5c/0xd138388016f6e630 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094221 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201556.942866:0:23731:0:(vvp_io.c:1292:vvp_io_write_start()) parallel-scale-nfs.sh: write [0, 6213) append 0 append lockpos 0 00000080:00200000:3.0:1788201556.942887:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:3.0:1788201556.942941:0:23731:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:3.0:1788201556.942953:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000556f0fe8[3 000000004de513d1 2 1 00000000f6277908 0 0 0] 00000080:00200000:3.0:1788201556.942958:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000003780894a 17ffffc0001001 3:0 ffff8bc1506cc2a0 0 lru 00000080:00200000:3.0:1788201556.942966:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000045dda935 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 0000000063bf212e > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201556.942968:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000556f0fe8 00000080:00200000:3.0:1788201556.942970:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201556.942973:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 2117 bytes 00000080:00200000:3.0:1788201556.943001:0:23731:0:(rw26.c:898:ll_write_end()) pos 4096, len 2117, copied 2117 00000080:00200000:3.0:1788201556.943033:0:23731:0:(rw26.c:956:ll_write_end()) page@000000006ae21ea3[3 000000004de513d1 2 1 00000000f6277908 0 0 1] 00000080:00200000:3.0:1788201556.943037:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000002e54040 17ffffc0001001 3:0 ffff8bc1506cc460 1 lru 00000080:00200000:3.0:1788201556.943043:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000084987d1b 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 0000000063bf212e > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201556.943046:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000006ae21ea3 00000080:00200000:3.0:1788201556.943047:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:3.0:1788201556.943051:0:23731:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 2, from 0, to 2117 prio 0 00000008:00010000:3.0:1788201556.943071:0:23731:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000f9bccc34 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000499c3d5c/0xd138388016f6e630 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094221 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201556.943211:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d3c38, count 2, dirtied 2 00000080:00200000:3.0:1788201556.943218:0:23731:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 2 pages 6213 bytes, tot: 6213 00000080:00200000:3.0:1788201556.943221:0:23731:0:(vvp_io.c:1358:vvp_io_write_start()) parallel-scale-nfs.sh: write bytes 0, result: 6213 00000020:00010000:3.0:1788201556.943242:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460e6b78 (ffff8bc1460e9c68/0) at cl_lock_release():245 00000020:00010000:3.0:1788201556.943246:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460e6b78 (ffff8bc1460e9c68/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201556.943249:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1440087b0 (ffff8bc1460e96c8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1788201556.943255:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000499c3d5c/0xd138388016f6e630 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094221 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201556.943264:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000499c3d5c/0xd138388016f6e630 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094221 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1788201556.943281:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460e6b78 (ffff8bc1460e9c68/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201556.943284:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1440087b0 (ffff8bc1460e9c68/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201556.943293:0:23731:0:(vvp_io.c:533:vvp_io_advance()) advancing 6213 bytes 00000080:00200000:3.0:1788201556.943302:0:23731:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 1] 00000080:00200000:3.0:1788201556.943333:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x101:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201556.943337:0:23731:0:(file.c:2238:ll_file_io_generic()) parallel-scale-nfs.sh: 2 io complete with rc: 0, result: 6213, restart: 0 00000080:00200000:3.0:1788201556.943345:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x101:0x0] updating i_size 6213 i_blocks 1 00000080:00200000:3.0:1788201556.943350:0:23731:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 6213 00000080:00200008:3.0:1788201556.943396:0:23731:0:(file.c:479:ll_file_release()) START file parallel-scale-nfs.sh:[0x200000bd7:0x101:0x0](ffff8bc1459d3a88), flags 100001 00000002:00100000:3.0:1788201556.943445:0:23731:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc146c58380 x1875064727810944/t8589937040(8589937040) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201572 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1788201556.943457:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1788201556.943462:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146c5b100 x1875064727811584/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1788201556.943489:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c5b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727811584:192.168.201.143@tcp:35:cp.0 00000100:00100000:3.0:1788201556.944629:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201556.947386:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c5b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727811584:192.168.201.143@tcp:35:cp.0 00000002:00100000:3.0:1788201556.947421:0:23731:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc146c58380 x1875064727810944/t8589937040(8589937040) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201572 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201556.947490:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201556.947511:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201556.947531:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 115 lru_type: 1 00010000:00010000:3.0:1788201556.947544:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 115 lru_type: 1 00000080:00200000:3.0:1788201556.947553:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201556.947559:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201556.947562:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201556.947571:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201556.947575:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 115 lru_type: 1 00010000:00010000:3.0:1788201556.947584:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 116 lru_type: 1 00000080:00200000:3.0:1788201556.947600:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.947608:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201556.947614:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201556.947619:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=parallel-scale-nfs.sh, flags=8 00000080:00200008:3.0:1788201556.947626:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file parallel-scale-nfs.sh:[0x200000bd7:0x101:0x0](ffff8bc1459d3a88), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201556.947632:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x101:0x0](ffff8bc1459d3a88),name=parallel-scale-nfs.sh 00000002:00010000:3.0:1788201556.947643:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x101:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201556.947651:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109420c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201556.947660:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109420c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201556.947667:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201556.947670:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x101:0x0](ffff8bc1459d3a88) 00000080:00010000:3.0:1788201556.947673:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x101:0x0](ffff8bc1459d3a88) for lock 0xd138388016f6e622 00000080:00010000:3.0:1788201556.947676:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e622 from it ffffadd1c7da3cb8 00010000:00010000:3.0:1788201556.947679:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109420c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201556.947687:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109420c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201556.947733:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x101:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201556.947743:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x101:0x0] 00000008:00010000:3.0:1788201556.947774:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201556.947778:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1440087b0, osc lock ffff8bc14691abe0, flags 0x400001002 00010000:00010000:3.0:1788201556.948071:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000499c3d5c/0xd138388016f6e630 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094221 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201556.972535:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743434112 00000100:00100000:3.0:1788201556.972545:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743434112 00000100:00100000:3.0:1788201556.972600:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 522 00000100:00100000:3.0:1788201556.972610:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14416ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23392:x1875064743434112:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201556.972630:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1560c4/0xd138388016f6e64c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x188:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094275 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201556.972720:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201556.972727:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14416ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23392:x1875064743434112:12345-192.168.201.143@tcp:104: Request processed in 119us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201556.972735:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 522 00000100:00100000:3.0:1788201557.001663:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201557.012371:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727813632:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201557.016357:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743434496 00000100:00100000:3.0:1788201557.016365:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743434496 00000100:00100000:3.0:1788201557.016456:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 525 00000100:00100000:3.0:1788201557.016467:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21004:x1875064743434496:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201557.016481:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000029fa8324/0xd138388016f6e676 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x188:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710942d7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.016495:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000029fa8324/0xd138388016f6e676 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x188:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710942d7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.016505:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000029fa8324/0xd138388016f6e676 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710942d7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.016522:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000029fa8324/0xd138388016f6e676 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710942d7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.016532:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000029fa8324/0xd138388016f6e676 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710942d7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.016542:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000029fa8324/0xd138388016f6e676 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e21710942d7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.016570:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc172610200) 00000100:00100000:3.0:1788201557.016628:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21004:x1875064743434496:12345-192.168.201.143@tcp:105: Request processed in 163us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201557.016636:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 525 00010000:00010000:3.0:1788201557.057960:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201557.057969:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000098444412/0xd138388016f6e692 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x189:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109432b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.057978:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172724a00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201557.057983:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000098444412/0xd138388016f6e692 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x189:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e217109432b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201557.058049:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x104:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201557.058063:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x104:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201557.058185:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000098444412/0xd138388016f6e692 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x189:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109432b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.058194:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201557.058228:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000098444412/0xd138388016f6e692 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x189:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109432b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.058237:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000098444412/0xd138388016f6e692 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x189:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109432b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.058253:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201557.058255:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201557.058257:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201557.062607:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743434752 00000100:00100000:3.0:1788201557.062616:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743434752 00000100:00100000:3.0:1788201557.062676:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 527 00000100:00100000:3.0:1788201557.062685:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc150bc4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23412:x1875064743434752:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201557.062700:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a3ce3255/0xd138388016f6e699 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094332 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.062712:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a3ce3255/0xd138388016f6e699 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094332 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.062722:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a3ce3255/0xd138388016f6e699 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171094332 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.062733:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a3ce3255/0xd138388016f6e699 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171094332 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.062748:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a3ce3255/0xd138388016f6e699 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171094332 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.062759:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a3ce3255/0xd138388016f6e699 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171094332 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.063847:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc172724400) 00000100:00100000:3.0:1788201557.097993:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201557.098346:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727815680:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201557.104993:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007488086b/0xd138388016f6e6b5 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.105030:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007488086b/0xd138388016f6e6b5 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094386 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.105044:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007488086b/0xd138388016f6e6b5 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094386 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.105059:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007488086b/0xd138388016f6e6b5 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094386 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201557.105073:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007488086b/0xd138388016f6e6b5 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094386 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201557.105151:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201557.105215:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007488086b/0xd138388016f6e6b5 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094386 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.105226:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007488086b/0xd138388016f6e6b5 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094386 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.105236:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007488086b/0xd138388016f6e6b5 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094386 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.105246:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007488086b/0xd138388016f6e6b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171094386 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201557.105267:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727815680:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201557.121963:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602bb80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727815808:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201557.121990:0:23731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.122021:0:23731:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.122030:0:23731:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.123050:0:23731:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.123063:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.123079:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201557.123103:0:23731:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.123117:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.123127:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201557.123157:0:23731:0:(vvp_io.c:1292:vvp_io_write_start()) performance-sanity.sh: write [0, 3079) append 0 append lockpos 0 00000080:00200000:3.0:1788201557.123187:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 3079 bytes 00000080:00200000:3.0:1788201557.123256:0:23731:0:(rw26.c:898:ll_write_end()) pos 0, len 3079, copied 3079 00000080:00200000:3.0:1788201557.123269:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000bfe89afe[3 000000008df50774 2 1 000000001af0523d 0 0 0] 00000080:00200000:3.0:1788201557.123273:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000df8dd49d 17ffffc0001021 2:0 ffff8bc1506ccd20 0 lru 00000080:00200000:3.0:1788201557.123281:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000e44d3ea4 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 000000000f9fd83d > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201557.123284:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000bfe89afe 00000080:00200000:3.0:1788201557.123285:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201557.123290:0:23731:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 3079 prio 0 00000008:00010000:3.0:1788201557.123311:0:23731:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000390cd994 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201557.123330:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc14592a378, count 1, dirtied 1 00000080:00200000:3.0:1788201557.123335:0:23731:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 3079 bytes, tot: 3079 00000080:00200000:3.0:1788201557.123338:0:23731:0:(vvp_io.c:1358:vvp_io_write_start()) performance-sanity.sh: write bytes 0, result: 3079 00000020:00010000:3.0:1788201557.123354:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1498445d8 (ffff8bc146919248/0) at cl_lock_release():245 00000020:00010000:3.0:1788201557.123358:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1498445d8 (ffff8bc146919248/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201557.123362:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151240bb0 (ffff8bc146919008/1) at cl_lock_cancel():142 00010000:00010000:3.0:1788201557.123367:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.123377:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1788201557.123541:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1498445d8 (ffff8bc146919248/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201557.123545:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151240bb0 (ffff8bc146919248/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201557.123554:0:23731:0:(vvp_io.c:533:vvp_io_advance()) advancing 3079 bytes 00000080:00200000:3.0:1788201557.123563:0:23731:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1788201557.123597:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x105:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201557.123602:0:23731:0:(file.c:2238:ll_file_io_generic()) performance-sanity.sh: 2 io complete with rc: 0, result: 3079, restart: 0 00000080:00200000:3.0:1788201557.123610:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x105:0x0] updating i_size 3079 i_blocks 1 00000080:00200000:3.0:1788201557.123615:0:23731:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 3079 00000080:00200008:3.0:1788201557.123661:0:23731:0:(file.c:479:ll_file_release()) START file performance-sanity.sh:[0x200000bd7:0x105:0x0](ffff8bc14592a1c8), flags 100001 00000002:00100000:3.0:1788201557.123723:0:23731:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1725f5f80 x1875064727815552/t8589937049(8589937049) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201573 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1788201557.123735:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1788201557.123741:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146c59c00 x1875064727816192/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1788201557.123765:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c59c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727816192:192.168.201.143@tcp:35:cp.0 00000100:00100000:3.0:1788201557.123876:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8c900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201557.132067:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c59c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727816192:192.168.201.143@tcp:35:cp.0 00000002:00100000:3.0:1788201557.132103:0:23731:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1725f5f80 x1875064727815552/t8589937049(8589937049) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201573 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201557.132191:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201557.132212:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201557.132231:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 131 lru_type: 1 00010000:00010000:3.0:1788201557.132244:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 131 lru_type: 1 00000080:00200000:3.0:1788201557.132253:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201557.132259:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201557.132263:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201557.132270:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201557.132274:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 131 lru_type: 1 00010000:00010000:3.0:1788201557.132282:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 132 lru_type: 1 00000080:00200000:3.0:1788201557.132297:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201557.132305:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201557.132311:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201557.132315:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=performance-sanity.sh, flags=8 00000080:00200008:3.0:1788201557.132322:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file performance-sanity.sh:[0x200000bd7:0x105:0x0](ffff8bc14592a1c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201557.132328:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x105:0x0](ffff8bc14592a1c8),name=performance-sanity.sh 00000002:00010000:3.0:1788201557.132339:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x105:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201557.132348:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611400/0xd138388016f6e6ae lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x105:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094378 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201557.132356:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611400/0xd138388016f6e6ae lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x105:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094378 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201557.132362:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201557.132366:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x105:0x0](ffff8bc14592a1c8) 00000080:00010000:3.0:1788201557.132368:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x105:0x0](ffff8bc14592a1c8) for lock 0xd138388016f6e6ae 00000080:00010000:3.0:1788201557.132372:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e6ae from it ffffadd1c7da3cb8 00010000:00010000:3.0:1788201557.132375:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611400/0xd138388016f6e6ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x105:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094378 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201557.132392:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611400/0xd138388016f6e6ae lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x105:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094378 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201557.132441:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x105:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201557.132452:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x105:0x0] 00000008:00010000:3.0:1788201557.132486:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201557.132490:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1440081b0, osc lock ffff8bc14691b7c0, flags 0x400001002 00010000:00010000:3.0:1788201557.132508:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x189:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.132525:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:3.0:1788201557.132539:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1788201557.132544:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.132552:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1788201557.132563:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1788201557.132574:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x105:0x0] updating i_size 3079 i_blocks 1 00000020:00010000:3.0:1788201557.132578:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc5e10 (ffff8bc1460e9518/0) at cl_lock_release():245 00000020:00010000:3.0:1788201557.132581:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc5e10 (ffff8bc1460e9518/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201557.132584:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1440081b0 (ffff8bc1460e9908/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201557.132588:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc5e10 (ffff8bc1460e9518/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201557.132591:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1440081b0 (ffff8bc1460e9518/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201557.132619:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x105:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201557.132670:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201557.132677:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201557.132684:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 132 lru_type: 1 00010000:00010000:3.0:1788201557.132694:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 132 lru_type: 1 00000080:00200000:3.0:1788201557.132706:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201557.132710:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201557.132713:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201557.132716:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201557.132720:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 132 lru_type: 1 00010000:00010000:3.0:1788201557.132727:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 133 lru_type: 1 00000080:00200000:3.0:1788201557.132736:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201557.132740:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201557.132744:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201557.132757:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=pjdfstest.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=9 00000080:00200000:3.0:1788201557.132762:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=pjdfstest.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:3.0:1788201557.132772:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: pjdfstest.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201557.133062:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e6c3 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.133071:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e6c3 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.133081:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e6c3 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201557.133102:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c5a680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727816320:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201557.133375:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8c900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201557.141669:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c5a680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727816320:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201557.141694:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e6c3 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.141708:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e6c3 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.141716:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e6c3 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.141723:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e6c3 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.141733:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e6c3 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.141739:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14400d400 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201557.141743:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e6c3 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.141750:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e6c3 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.141759:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e6c3 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.141767:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201557.141774:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e6c3 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.141781:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e6c3 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201557.141910:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc146c5a680 x1875064727816320/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201573 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201557.141927:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201557.147880:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:3.0:1788201557.147968:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201557.147984:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201557.148010:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 133 lru_type: 1 00010000:00010000:3.0:1788201557.148025:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 133 lru_type: 1 00000080:00200000:3.0:1788201557.148034:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201557.148040:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201557.148043:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201557.148050:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201557.148055:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 133 lru_type: 1 00010000:00010000:3.0:1788201557.148064:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 134 lru_type: 1 00000080:00200000:3.0:1788201557.148080:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201557.148089:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201557.148094:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201557.148109:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=pjdfstest.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=8 00000080:00200000:3.0:1788201557.148114:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=pjdfstest.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:3.0:1788201557.148127:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: pjdfstest.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201557.148174:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ca lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.148183:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ca lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.148192:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ca lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201557.148220:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c5a680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727816448:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201557.150229:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8c900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201557.158150:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c5a680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727816448:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201557.158173:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ca lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.158188:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ca lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.158195:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ca lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.158203:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ca lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.158212:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ca lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.158219:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14400cc00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201557.158224:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ca lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.158231:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ca lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.158239:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ca lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.158246:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201557.158253:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ca lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.158259:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ca lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201557.158278:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc146c5a680 x1875064727816448/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201573 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201557.158294:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201557.158324:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:3.0:1788201557.158440:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201557.158453:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201557.158462:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 134 lru_type: 1 00010000:00010000:3.0:1788201557.158474:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 134 lru_type: 1 00000080:00200000:3.0:1788201557.158481:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201557.158486:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201557.158490:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201557.158495:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3bf8 00010000:00010000:3.0:1788201557.158499:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 134 lru_type: 1 00010000:00010000:3.0:1788201557.158507:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 135 lru_type: 1 00000080:00200000:3.0:1788201557.158520:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201557.158526:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201557.158531:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201557.158541:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:3.0:1788201557.158545:0:23731:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=pjdfstest.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), file ffff8bc143847b00, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:3.0:1788201557.158552:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=pjdfstest.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000002:00010000:3.0:1788201557.158569:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: pjdfstest.sh,[0x200000bd7:0x106:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open|creat flags 0100302 00010000:00010000:3.0:1788201557.158607:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e6d1 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.158614:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e6d1 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1788201557.158624:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1788201557.158630:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146c5a680 x1875064727816704/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1788201557.158638:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e6d1 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201557.158655:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c5a680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727816704:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201557.192598:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201557.192605:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d27fab30/0xd138388016f6e6d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710943e1 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.192615:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172610600 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201557.192620:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d27fab30/0xd138388016f6e6d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e21710943e1 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201557.192675:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x106:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201557.192688:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x106:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201557.192752:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d27fab30/0xd138388016f6e6d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710943e1 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.192760:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201557.192788:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d27fab30/0xd138388016f6e6d8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x18a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710943e1 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.192827:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d27fab30/0xd138388016f6e6d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710943e1 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.192843:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201557.192845:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201557.192847:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201557.210926:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146028700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727817472:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201557.210949:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172724a00/0xd138388016f6e6e6 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.210968:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172724a00/0xd138388016f6e6e6 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.210975:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172724a00/0xd138388016f6e6e6 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.210983:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172724a00/0xd138388016f6e6e6 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.210991:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172724a00/0xd138388016f6e6e6 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.210997:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172724a00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201557.211013:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172724a00/0xd138388016f6e6e6 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.211020:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172724a00/0xd138388016f6e6e6 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.211027:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172724a00/0xd138388016f6e6e6 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.211033:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201557.211039:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172724a00/0xd138388016f6e6e6 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.211046:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172724a00/0xd138388016f6e6e6 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201557.211064:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc146028700 x1875064727817472/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201573 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201557.211083:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201557.211106:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:3.0:1788201557.211163:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201557.211179:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201557.211188:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 137 lru_type: 1 00010000:00010000:3.0:1788201557.211198:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 137 lru_type: 1 00000080:00200000:3.0:1788201557.211205:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201557.211211:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201557.211214:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201557.211220:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201557.211223:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 137 lru_type: 1 00010000:00010000:3.0:1788201557.211231:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 138 lru_type: 1 00000080:00200000:3.0:1788201557.211245:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201557.211252:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201557.211257:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201557.211269:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=racer.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=8 00000080:00200000:3.0:1788201557.211273:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=racer.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:3.0:1788201557.211285:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: racer.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201557.211323:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ed lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.211332:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ed lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.211342:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ed lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201557.211363:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c58000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727817600:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201557.211447:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8c240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201557.223240:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c58000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727817600:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201557.223259:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ed lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.223269:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ed lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.223274:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ed lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.223279:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ed lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.223285:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ed lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.223290:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14400cc00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201557.223293:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ed lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.223299:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ed lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.223307:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ed lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.223314:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201557.223321:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ed lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.223329:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6e6ed lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201557.223348:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc146c58000 x1875064727817600/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201573 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201557.223361:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201557.223385:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:3.0:1788201557.223489:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201557.223512:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201557.223520:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 138 lru_type: 1 00010000:00010000:3.0:1788201557.223530:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 138 lru_type: 1 00000080:00200000:3.0:1788201557.223535:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201557.223539:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201557.223541:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201557.223545:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3bf8 00010000:00010000:3.0:1788201557.223548:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 138 lru_type: 1 00010000:00010000:3.0:1788201557.223558:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 139 lru_type: 1 00000080:00200000:3.0:1788201557.223569:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201557.223574:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201557.223578:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201557.223587:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:3.0:1788201557.223590:0:23731:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=racer.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), file ffff8bc143846900, open_flags 80c1, mode 81ed opened 0 00000080:00200000:3.0:1788201557.223595:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=racer.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000002:00010000:3.0:1788201557.223610:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: racer.sh,[0x200000bd7:0x107:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open|creat flags 0100302 00010000:00010000:3.0:1788201557.223645:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400da00/0xd138388016f6e6f4 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.223649:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400da00/0xd138388016f6e6f4 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1788201557.223657:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1788201557.223661:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146c58000 x1875064727817856/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1788201557.223667:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400da00/0xd138388016f6e6f4 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201557.223685:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c58000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727817856:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201557.223895:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8c240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201557.236406:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c58000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727817856:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201557.236435:0:23731:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400da00/0xd138388016f6e6f4 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109442e expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.236460:0:23731:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400da00/0xd138388016f6e6f4 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109442e expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.236469:0:23731:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400da00/0xd138388016f6e6f4 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109442e expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.236481:0:23731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400da00/0xd138388016f6e6f4 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109442e expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.236502:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400da00/0xd138388016f6e6f4 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109442e expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.236518:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400da00/0xd138388016f6e6f4 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109442e expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.236525:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400da00/0xd138388016f6e6f4 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109442e expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.236533:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400da00/0xd138388016f6e6f4 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109442e expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201557.236545:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc146c58000 x1875064727817856/t8589937053(8589937053) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201573 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1788201557.236558:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc146c58000 x1875064727817856/t8589937053(8589937053) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201573 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201557.236572:0:23731:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400da00/0xd138388016f6e6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109442e expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1788201557.236586:0:23731:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400da00/0xd138388016f6e6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109442e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.236597:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/263 (0 0) 00000080:00200000:3.0:1788201557.236604:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1788201557.236620:0:23731:0:(namei.c:1628:ll_create_it()) VFS Op:name=racer.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000080:00200000:3.0:1788201557.236650:0:23731:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x107:0x0](ffff8bc1459d42c8) 00000080:00200000:3.0:1788201557.236767:0:23731:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x107:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1788201557.236776:0:23731:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x107:0x0](ffff8bc1459d42c8) 00000080:00010000:3.0:1788201557.236779:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x107:0x0](ffff8bc1459d42c8) for lock 0xd138388016f6e6f4 00000080:00010000:3.0:1788201557.236815:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x107:0x0](ffff8bc1459d42c8) 00000080:00200008:3.0:1788201557.236830:0:23731:0:(file.c:1090:ll_file_open()) START file racer.sh:[0x200000bd7:0x107:0x0](ffff8bc1459d42c8), flags 100301 00000002:00100000:3.0:1788201557.236850:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc146c58000 x1875064727817856/t8589937053(8589937053) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201573 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1788201557.236900:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e6f4 from it ffff8bc148c9b3c0 00010000:00010000:3.0:1788201557.236905:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400da00/0xd138388016f6e6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109442e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.236915:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400da00/0xd138388016f6e6f4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109442e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201557.236948:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x107:0x0](ffff8bc1459d42c8), inode mode 81ed mask 40 00000080:00200008:3.0:1788201557.236975:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file racer.sh:[0x200000bd7:0x107:0x0](ffff8bc1459d42c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201557.236981:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x107:0x0](ffff8bc1459d42c8),name=racer.sh 00000002:00010000:3.0:1788201557.237009:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x107:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201557.237020:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400da00/0xd138388016f6e6f4 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109442e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.237031:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400da00/0xd138388016f6e6f4 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109442e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201557.237038:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201557.237043:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x107:0x0](ffff8bc1459d42c8) 00000080:00010000:3.0:1788201557.237046:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x107:0x0](ffff8bc1459d42c8) for lock 0xd138388016f6e6f4 00000080:00010000:3.0:1788201557.237050:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e6f4 from it ffffadd1c7da3cd8 00010000:00010000:3.0:1788201557.237054:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400da00/0xd138388016f6e6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109442e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.237062:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400da00/0xd138388016f6e6f4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109442e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201557.237089:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x107:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201557.237098:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x107:0x0] 00000008:00010000:3.0:1788201557.237125:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201557.237129:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc144008030, osc lock ffff8bc14691b7c0, flags 0x400001002 00010000:00010000:3.0:1788201557.237174:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000047c458cf/0xd138388016f6e6fb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.237196:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000047c458cf/0xd138388016f6e6fb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201557.237238:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1788201557.244111:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x107:0x0] updating i_size 0 i_blocks 1 00000020:00010000:3.0:1788201557.244118:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc5e10 (ffff8bc1460e9518/0) at cl_lock_release():245 00000020:00010000:3.0:1788201557.244122:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc5e10 (ffff8bc1460e9518/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201557.244127:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc144008030 (ffff8bc1460e9908/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201557.244132:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc5e10 (ffff8bc1460e9518/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201557.244135:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc144008030 (ffff8bc1460e9518/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201557.244175:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x107:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1788201557.244249:0:23731:0:(file.c:2638:do_file_write_iter()) START file racer.sh:[0x200000bd7:0x107:0x0], ppos: 0, count: 7187 00000080:00200000:3.0:1788201557.244280:0:23731:0:(file.c:2090:ll_file_io_generic()) racer.sh: write ppos: 0, bytes: 7187 00000080:00200000:3.0:1788201557.244286:0:23731:0:(file.c:1848:ll_io_set_mirror()) racer.sh: desiginated mirror: 0 00000020:00200000:3.0:1788201557.244293:0:23731:0:(cl_io.c:214:cl_io_rw_init()) header@000000008bf05468[0x110, 1, [0x200000bd7:0x107:0x0] hash] 00000020:00200000:3.0:1788201557.244295:0:23731:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 7187) 0 0 00000080:00200000:3.0:1788201557.244299:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x107:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201557.244313:0:23731:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 1] 00020000:00200000:3.0:1788201557.244321:0:23731:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 7187) 7187, 7187 00020000:00200000:3.0:1788201557.244325:0:23731:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1788201557.244353:0:23731:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 1] 00000008:00010000:3.0:1788201557.244367:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1788201557.244373:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc144008030, osc lock ffff8bc14691b7c0, flags 0x0 00010000:00010000:3.0:1788201557.244388:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/394 (0 8191) 00010000:00010000:3.0:1788201557.244430:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aa9ac74c/0xd138388016f6e702 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.244440:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aa9ac74c/0xd138388016f6e702 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18a:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.244451:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aa9ac74c/0xd138388016f6e702 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18a:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201557.244478:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c59880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727818112:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201557.244581:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201557.253259:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c59880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727818112:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201557.253291:0:23731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aa9ac74c/0xd138388016f6e702 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171094443 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.253305:0:23731:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aa9ac74c/0xd138388016f6e702 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094443 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.253314:0:23731:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aa9ac74c/0xd138388016f6e702 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094443 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.255536:0:23731:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aa9ac74c/0xd138388016f6e702 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094443 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.255548:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aa9ac74c/0xd138388016f6e702 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094443 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.255564:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aa9ac74c/0xd138388016f6e702 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171094443 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201557.255576:0:23731:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aa9ac74c/0xd138388016f6e702 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171094443 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.255589:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aa9ac74c/0xd138388016f6e702 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094443 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.255597:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aa9ac74c/0xd138388016f6e702 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094443 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201557.255693:0:23731:0:(vvp_io.c:1292:vvp_io_write_start()) racer.sh: write [0, 7187) append 0 append lockpos 0 00000080:00200000:3.0:1788201557.255712:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:3.0:1788201557.255758:0:23731:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:3.0:1788201557.255770:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000d36a526f[3 000000003cc254c7 2 1 000000002bd95bbc 0 0 0] 00000080:00200000:3.0:1788201557.255774:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000bee1071f 17ffffc0001001 3:0 ffff8bc1506cc000 0 lru 00000080:00200000:3.0:1788201557.255781:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000048d855a4 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 0000000073aeaabc > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201557.255784:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000d36a526f 00000080:00200000:3.0:1788201557.255785:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201557.255788:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 3091 bytes 00000100:00100000:3.0:1788201557.310420:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201557.321090:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:3.0:1788201557.373932:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201557.373940:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ccd6f472/0xd138388016f6e741 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710944f2 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.373949:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172722a00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201557.373955:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ccd6f472/0xd138388016f6e741 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e21710944f2 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201557.374021:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x109:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201557.374035:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x109:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201557.374114:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ccd6f472/0xd138388016f6e741 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710944f2 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.374122:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201557.374147:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ccd6f472/0xd138388016f6e741 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x18b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710944f2 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.374155:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ccd6f472/0xd138388016f6e741 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710944f2 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.374171:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201557.374173:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201557.374175:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201557.374200:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727820544:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201557.382169:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727820544:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201557.406040:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727821440:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201557.461410:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602b480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727822080:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201557.461438:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725400/0xd138388016f6e772 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.461454:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725400/0xd138388016f6e772 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.461461:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725400/0xd138388016f6e772 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.461469:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725400/0xd138388016f6e772 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.461479:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725400/0xd138388016f6e772 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.461491:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172725400 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201557.461496:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725400/0xd138388016f6e772 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.461503:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725400/0xd138388016f6e772 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.461511:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725400/0xd138388016f6e772 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.461518:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201557.461525:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725400/0xd138388016f6e772 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.461532:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725400/0xd138388016f6e772 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201557.461555:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14602b480 x1875064727822080/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 600/584 e 0 to 0 dl 1788201573 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201557.461572:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201557.525481:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201557.525490:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017d957e3/0xd138388016f6e787 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710945a8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.525498:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172610a00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201557.525547:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017d957e3/0xd138388016f6e787 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e21710945a8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201557.525608:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x10b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201557.525622:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x10b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201557.525690:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017d957e3/0xd138388016f6e787 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710945a8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.525699:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201557.525736:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017d957e3/0xd138388016f6e787 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x18c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710945a8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.525745:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017d957e3/0xd138388016f6e787 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710945a8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.525762:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201557.525764:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201557.525765:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201557.525774:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201557.525825:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727822848:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201557.536264:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743436544 00000100:00100000:3.0:1788201557.536273:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743436544 00000100:00100000:3.0:1788201557.536375:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 541 00000100:00100000:3.0:1788201557.536386:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14602b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21003:x1875064743436544:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201557.536399:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d8911af5/0xd138388016f6e78e lrc: 5/0,1 mode: --/PW res: [0x240000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710945af expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.536410:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d8911af5/0xd138388016f6e78e lrc: 5/0,1 mode: --/PW res: [0x240000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710945af expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.536420:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d8911af5/0xd138388016f6e78e lrc: 5/0,1 mode: --/PW res: [0x240000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710945af expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.536430:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d8911af5/0xd138388016f6e78e lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710945af expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.536439:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d8911af5/0xd138388016f6e78e lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710945af expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.536449:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d8911af5/0xd138388016f6e78e lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e21710945af expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.536477:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc172610400) 00000100:00100000:3.0:1788201557.536551:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14602b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21003:x1875064743436544:12345-192.168.201.143@tcp:105: Request processed in 166us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201557.536559:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 541 00000100:00100000:3.0:1788201557.544437:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727822848:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201557.567323:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727823744:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201557.595665:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:3.0:1788201557.596748:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201557.596769:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007949dac1/0xd138388016f6e7aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094603 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.596828:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1727c9e00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201557.596838:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007949dac1/0xd138388016f6e7aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171094603 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201557.596916:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x10c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201557.596933:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x10c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201557.597020:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007949dac1/0xd138388016f6e7aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094603 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.597029:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201557.597056:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007949dac1/0xd138388016f6e7aa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094603 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.597064:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007949dac1/0xd138388016f6e7aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094603 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.597080:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201557.597082:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201557.597084:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201557.597102:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727824000:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201557.606170:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:3.0:1788201557.606770:0:23731:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000acf6f96b/0xd138388016f6e7b1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109460a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.606831:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000acf6f96b/0xd138388016f6e7b1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109460a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.606848:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000acf6f96b/0xd138388016f6e7b1 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e217109460a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201557.606861:0:23731:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000acf6f96b/0xd138388016f6e7b1 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e217109460a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.606874:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000acf6f96b/0xd138388016f6e7b1 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109460a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.606883:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000acf6f96b/0xd138388016f6e7b1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109460a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201557.606912:0:23731:0:(vvp_io.c:1292:vvp_io_write_start()) recovery-scale-lib.sh: write [0, 6234) append 0 append lockpos 0 00000080:00200000:3.0:1788201557.606930:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:3.0:1788201557.606978:0:23731:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:3.0:1788201557.606989:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000079fcba7b[3 00000000f98a4cc7 2 1 00000000b8d441ae 0 0 0] 00000080:00200000:3.0:1788201557.607004:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000a5ab1076 17ffffc0001001 3:0 ffff8bc1506cc380 0 lru 00000080:00200000:3.0:1788201557.607012:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000294de251 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 000000008a89985d > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201557.607014:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000079fcba7b 00000080:00200000:3.0:1788201557.607015:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201557.607018:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 2138 bytes 00000080:00200000:3.0:1788201557.607048:0:23731:0:(rw26.c:898:ll_write_end()) pos 4096, len 2138, copied 2138 00000080:00200000:3.0:1788201557.607053:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000889182dc[3 00000000f98a4cc7 2 1 00000000b8d441ae 0 0 1] 00000080:00200000:3.0:1788201557.607056:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000bc21ac5a 17ffffc0001001 3:0 ffff8bc1506cc1c0 1 lru 00000080:00200000:3.0:1788201557.607062:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000c8849e92 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 000000008a89985d > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201557.607064:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000889182dc 00000080:00200000:3.0:1788201557.607066:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:3.0:1788201557.607069:0:23731:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 2, from 0, to 2138 prio 0 00000008:00010000:3.0:1788201557.607088:0:23731:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000cc8ad32a ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000acf6f96b/0xd138388016f6e7b1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109460a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201557.607109:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145934cb8, count 2, dirtied 2 00000080:00200000:3.0:1788201557.607446:0:23731:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 2 pages 6234 bytes, tot: 6234 00000080:00200000:3.0:1788201557.607451:0:23731:0:(vvp_io.c:1358:vvp_io_write_start()) recovery-scale-lib.sh: write bytes 0, result: 6234 00000020:00010000:3.0:1788201557.607471:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c45d8 (ffff8bc148e3bbd8/0) at cl_lock_release():245 00000020:00010000:3.0:1788201557.607475:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c45d8 (ffff8bc148e3bbd8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201557.607478:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151a50230 (ffff8bc148e3b998/1) at cl_lock_cancel():142 00010000:00010000:3.0:1788201557.607483:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000acf6f96b/0xd138388016f6e7b1 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109460a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.607494:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000acf6f96b/0xd138388016f6e7b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109460a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1788201557.607510:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c45d8 (ffff8bc148e3bbd8/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201557.607513:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151a50230 (ffff8bc148e3bbd8/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201557.607522:0:23731:0:(vvp_io.c:533:vvp_io_advance()) advancing 6234 bytes 00000080:00200000:3.0:1788201557.607530:0:23731:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 1] 00000080:00200000:3.0:1788201557.607562:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x10c:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201557.607566:0:23731:0:(file.c:2238:ll_file_io_generic()) recovery-scale-lib.sh: 2 io complete with rc: 0, result: 6234, restart: 0 00000080:00200000:3.0:1788201557.607575:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x10c:0x0] updating i_size 6234 i_blocks 1 00000080:00200000:3.0:1788201557.607580:0:23731:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 6234 00000080:00200008:3.0:1788201557.607624:0:23731:0:(file.c:479:ll_file_release()) START file recovery-scale-lib.sh:[0x200000bd7:0x10c:0x0](ffff8bc145934b08), flags 100001 00000002:00100000:3.0:1788201557.607684:0:23731:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc14416ca80 x1875064727823616/t8589937063(8589937063) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201573 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1788201557.607696:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1788201557.607702:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146c59500 x1875064727824256/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1788201557.607723:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c59500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727824256:192.168.201.143@tcp:35:cp.0 00000100:00100000:3.0:1788201557.607897:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201557.640521:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727824896:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201557.654146:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6e7cd lrc: 6/2,0 mode: --/PR res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.654180:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6e7cd lrc: 6/2,0 mode: --/PR res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109465e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.654194:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6e7cd lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109465e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.654205:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6e7cd lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109465e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201557.654220:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6e7cd lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109465e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201557.654231:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201557.654244:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6e7cd lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109465e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.654259:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6e7cd lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109465e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.654267:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6e7cd lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109465e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.654276:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6e7cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e217109465e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201557.654295:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727824896:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201557.658732:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201557.658739:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6e7cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109465e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.658747:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1727c9600 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201557.658763:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6e7cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e217109465e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201557.658861:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x10d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201557.658875:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x10d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201557.658940:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6e7cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109465e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.658953:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201557.658972:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6e7cd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109465e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.658979:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6e7cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109465e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.659007:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201557.659009:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201557.659011:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201557.665827:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727825024:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201557.665863:0:23731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6e7d4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->114687] (req 0->114687) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171094665 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.665878:0:23731:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6e7d4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->114687] (req 0->114687) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094665 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.665886:0:23731:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6e7d4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->114687] (req 0->114687) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094665 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.679935:0:23731:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6e7d4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094665 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.679960:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6e7d4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094665 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.679985:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6e7d4 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171094665 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201557.680019:0:23731:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6e7d4 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171094665 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.680032:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6e7d4 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094665 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.680041:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6e7d4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094665 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201557.715753:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201557.715771:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727826048:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201557.722364:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f773ecea/0xd138388016f6e7f0 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.722396:0:10054:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f773ecea/0xd138388016f6e7f0 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710946b9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.722411:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f773ecea/0xd138388016f6e7f0 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710946b9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.722425:0:10054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f773ecea/0xd138388016f6e7f0 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710946b9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201557.722452:0:10054:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f773ecea/0xd138388016f6e7f0 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710946b9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201557.722474:0:10054:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201557.722497:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f773ecea/0xd138388016f6e7f0 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710946b9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.722514:0:10054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f773ecea/0xd138388016f6e7f0 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710946b9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.722528:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f773ecea/0xd138388016f6e7f0 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710946b9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.722543:0:10054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f773ecea/0xd138388016f6e7f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e21710946b9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201557.722575:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727826048:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201557.737781:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201557.737789:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f773ecea/0xd138388016f6e7f0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710946b9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.737823:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172611a00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201557.737828:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f773ecea/0xd138388016f6e7f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e21710946b9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201557.737880:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x10e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201557.737892:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x10e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201557.737952:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f773ecea/0xd138388016f6e7f0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710946b9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.737958:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201557.737975:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f773ecea/0xd138388016f6e7f0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x18e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710946b9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.737981:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f773ecea/0xd138388016f6e7f0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710946b9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.738002:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201557.738004:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201557.738006:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201557.738013:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201557.738028:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727826304:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201557.745850:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727826304:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201557.790947:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743437440 00000100:00100000:3.0:1788201557.790957:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743437440 00000100:00100000:3.0:1788201557.795077:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b3480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727827328:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201557.795121:0:23731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000618f56a5/0xd138388016f6e81a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e217109471b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.795140:0:23731:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000618f56a5/0xd138388016f6e81a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109471b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.795149:0:23731:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000618f56a5/0xd138388016f6e81a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109471b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201557.814246:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f7b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727827840:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201557.814272:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6e821 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.814286:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6e821 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.814293:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6e821 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.814300:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6e821 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.814310:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6e821 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.814317:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172610a00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201557.814322:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6e821 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.814330:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6e821 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.814340:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6e821 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.814347:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201557.814354:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6e821 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.814361:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6e821 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201557.814381:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1725f7b80 x1875064727827840/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201573 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201557.814396:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201557.814423:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:3.0:1788201557.814490:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201557.814507:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201557.814518:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 173 lru_type: 1 00010000:00010000:3.0:1788201557.814530:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 173 lru_type: 1 00000080:00200000:3.0:1788201557.814537:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201557.814543:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201557.814546:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201557.814551:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201557.814555:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 173 lru_type: 1 00010000:00010000:3.0:1788201557.814568:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 174 lru_type: 1 00000080:00200000:3.0:1788201557.814583:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201557.814590:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201557.814595:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201557.814609:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=replay-single-lmv.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=8 00000080:00200000:3.0:1788201557.814612:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=replay-single-lmv.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:3.0:1788201557.814624:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: replay-single-lmv.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201557.814665:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e828 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.814671:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e828 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.814680:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e828 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201557.814704:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c58700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727827968:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201557.814825:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201557.818967:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c58700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727827968:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201557.818999:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e828 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.819013:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e828 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.819023:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e828 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.819029:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e828 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.819038:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e828 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.819044:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14400d600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201557.819049:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e828 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.819056:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e828 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.819064:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e828 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.819071:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201557.819077:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e828 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.819084:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e828 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201557.819102:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc146c58700 x1875064727827968/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201573 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201557.819117:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201557.819140:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:3.0:1788201557.819258:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201557.819274:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201557.819283:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 174 lru_type: 1 00010000:00010000:3.0:1788201557.819294:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 174 lru_type: 1 00000080:00200000:3.0:1788201557.819301:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201557.819307:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201557.819311:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201557.819317:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3bf8 00010000:00010000:3.0:1788201557.819321:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 174 lru_type: 1 00010000:00010000:3.0:1788201557.819328:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 175 lru_type: 1 00000080:00200000:3.0:1788201557.819343:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201557.819351:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201557.819355:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201557.819371:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:3.0:1788201557.819376:0:23731:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=replay-single-lmv.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), file ffff8bc143846f00, open_flags 80c1, mode 81ed opened 0 00000080:00200000:3.0:1788201557.819383:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=replay-single-lmv.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000002:00010000:3.0:1788201557.819402:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: replay-single-lmv.sh,[0x200000bd7:0x110:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open|creat flags 0100302 00010000:00010000:3.0:1788201557.819449:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.819460:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1788201557.819471:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1788201557.819478:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146c58700 x1875064727828224/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1788201557.819487:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201557.819509:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c58700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727828224:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201557.819679:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201557.829221:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c58700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727828224:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201557.829252:0:23731:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.829275:0:23731:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x110:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.829284:0:23731:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.829296:0:23731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.829307:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.829326:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.829335:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.829343:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201557.829355:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc146c58700 x1875064727828224/t8589937071(8589937071) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201573 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1788201557.829368:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc146c58700 x1875064727828224/t8589937071(8589937071) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201573 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201557.829384:0:23731:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1788201557.829398:0:23731:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.829409:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/272 (0 0) 00000080:00200000:3.0:1788201557.829417:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1788201557.829434:0:23731:0:(namei.c:1628:ll_create_it()) VFS Op:name=replay-single-lmv.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000080:00200000:3.0:1788201557.829467:0:23731:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x110:0x0](ffff8bc1459d5348) 00000080:00200000:3.0:1788201557.829592:0:23731:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x110:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1788201557.829602:0:23731:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x110:0x0](ffff8bc1459d5348) 00000080:00010000:3.0:1788201557.829606:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x110:0x0](ffff8bc1459d5348) for lock 0xd138388016f6e82f 00000080:00010000:3.0:1788201557.829616:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x110:0x0](ffff8bc1459d5348) 00000080:00200008:3.0:1788201557.829630:0:23731:0:(file.c:1090:ll_file_open()) START file replay-single-lmv.sh:[0x200000bd7:0x110:0x0](ffff8bc1459d5348), flags 100301 00000002:00100000:3.0:1788201557.829648:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc146c58700 x1875064727828224/t8589937071(8589937071) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201573 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1788201557.829686:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e82f from it ffff8bc148c9b2a0 00010000:00010000:3.0:1788201557.829691:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.829700:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201557.829720:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x110:0x0](ffff8bc1459d5348), inode mode 81ed mask 40 00000080:00200008:3.0:1788201557.829744:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file replay-single-lmv.sh:[0x200000bd7:0x110:0x0](ffff8bc1459d5348), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201557.829750:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x110:0x0](ffff8bc1459d5348),name=replay-single-lmv.sh 00000002:00010000:3.0:1788201557.829769:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x110:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201557.829778:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.829788:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201557.829836:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201557.829841:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x110:0x0](ffff8bc1459d5348) 00000080:00010000:3.0:1788201557.829845:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x110:0x0](ffff8bc1459d5348) for lock 0xd138388016f6e82f 00000080:00010000:3.0:1788201557.829849:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e82f from it ffffadd1c7da3cd8 00010000:00010000:3.0:1788201557.829852:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.829859:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201557.829885:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x110:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201557.829894:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x110:0x0] 00000008:00010000:3.0:1788201557.829921:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201557.829925:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc144008cb0, osc lock ffff8bc14691b690, flags 0x400001002 00010000:00010000:3.0:1788201557.829968:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6e836 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.829978:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6e836 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201557.830031:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1788201557.841448:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201557.841463:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6e836 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109476f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.841474:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14400d000 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201557.841487:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6e836 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e217109476f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201557.841541:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x110:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201557.841554:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x110:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201557.841639:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6e836 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109476f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.841653:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201557.841682:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6e836 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x18f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109476f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.841691:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6e836 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109476f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.841705:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201557.841707:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201557.841709:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201557.841715:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201557.841728:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727828608:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201557.846940:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201557.855539:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727828608:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201557.881037:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b2d80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727829376:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201557.881064:0:23731:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.881088:0:23731:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x111:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.881109:0:23731:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.881125:0:23731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.881136:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.881150:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.881159:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.881174:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201557.881184:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1725b2d80 x1875064727829376/t8589937073(8589937073) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201573 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1788201557.881199:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725b2d80 x1875064727829376/t8589937073(8589937073) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201573 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201557.881213:0:23731:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1788201557.881225:0:23731:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.881235:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/273 (0 0) 00000080:00200000:3.0:1788201557.881243:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1788201557.881256:0:23731:0:(namei.c:1628:ll_create_it()) VFS Op:name=replay-single.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000080:00200000:3.0:1788201557.881288:0:23731:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x111:0x0](ffff8bc1459d21c8) 00000080:00200000:3.0:1788201557.881400:0:23731:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x111:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1788201557.881409:0:23731:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x111:0x0](ffff8bc1459d21c8) 00000080:00010000:3.0:1788201557.881412:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x111:0x0](ffff8bc1459d21c8) for lock 0xd138388016f6e852 00000080:00010000:3.0:1788201557.881421:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x111:0x0](ffff8bc1459d21c8) 00000080:00200008:3.0:1788201557.881435:0:23731:0:(file.c:1090:ll_file_open()) START file replay-single.sh:[0x200000bd7:0x111:0x0](ffff8bc1459d21c8), flags 100301 00000002:00100000:3.0:1788201557.881454:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725b2d80 x1875064727829376/t8589937073(8589937073) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201573 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1788201557.881493:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e852 from it ffff8bc1466cd2a0 00010000:00010000:3.0:1788201557.881497:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.881507:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201557.881529:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x111:0x0](ffff8bc1459d21c8), inode mode 81ed mask 40 00000080:00200008:3.0:1788201557.881557:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file replay-single.sh:[0x200000bd7:0x111:0x0](ffff8bc1459d21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201557.881562:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x111:0x0](ffff8bc1459d21c8),name=replay-single.sh 00000002:00010000:3.0:1788201557.881579:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x111:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201557.881587:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.881598:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201557.881611:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201557.881615:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x111:0x0](ffff8bc1459d21c8) 00000080:00010000:3.0:1788201557.881618:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x111:0x0](ffff8bc1459d21c8) for lock 0xd138388016f6e852 00000080:00010000:3.0:1788201557.881622:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e852 from it ffffadd1c7da3cd8 00010000:00010000:3.0:1788201557.881625:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.881633:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201557.881655:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x111:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201557.881664:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x111:0x0] 00000008:00010000:3.0:1788201557.881689:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201557.881692:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc144008bb0, osc lock ffff8bc14691a4c0, flags 0x400001002 00010000:00010000:3.0:1788201557.881734:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6e859 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.881744:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6e859 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201557.881785:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1788201557.881830:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727829504:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201557.894881:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6e859 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.894917:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6e859 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710947ca expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.894933:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6e859 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710947ca expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.894948:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6e859 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710947ca expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201557.894963:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6e859 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710947ca expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201557.894975:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201557.895183:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6e859 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710947ca expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.895193:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6e859 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710947ca expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.895202:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6e859 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710947ca expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.895213:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6e859 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e21710947ca expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201557.895235:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727829504:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201557.904648:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743438080 00000100:00100000:3.0:1788201557.904655:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743438080 00000100:00100000:3.0:1788201557.904711:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 553 00000100:00100000:3.0:1788201557.904720:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14602b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21003:x1875064743438080:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201557.904730:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084c24abf/0xd138388016f6e860 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710947d1 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.904740:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084c24abf/0xd138388016f6e860 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710947d1 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.904750:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084c24abf/0xd138388016f6e860 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710947d1 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.904759:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084c24abf/0xd138388016f6e860 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710947d1 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.904769:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084c24abf/0xd138388016f6e860 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710947d1 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.904811:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084c24abf/0xd138388016f6e860 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e21710947d1 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.904834:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1727c8a00) 00000100:00100000:3.0:1788201557.907725:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14602b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21003:x1875064743438080:12345-192.168.201.143@tcp:105: Request processed in 3000us (3591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201557.907739:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 553 00000100:00100000:3.0:1788201557.912408:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b0e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727830016:192.168.201.143@tcp:35:cp.0 00000002:00100000:3.0:1788201557.912435:0:23731:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1725b2d80 x1875064727829376/t8589937073(8589937073) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201573 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201557.912508:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201557.912527:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201557.912547:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 179 lru_type: 1 00010000:00010000:3.0:1788201557.912562:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 179 lru_type: 1 00000080:00200000:3.0:1788201557.912570:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201557.912577:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201557.912581:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201557.912589:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201557.912593:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 179 lru_type: 1 00010000:00010000:3.0:1788201557.912603:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 180 lru_type: 1 00000080:00200000:3.0:1788201557.912620:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201557.912628:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201557.912633:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201557.912637:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=replay-single.sh, flags=8 00000080:00200008:3.0:1788201557.912644:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file replay-single.sh:[0x200000bd7:0x111:0x0](ffff8bc1459d21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201557.912650:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x111:0x0](ffff8bc1459d21c8),name=replay-single.sh 00000002:00010000:3.0:1788201557.912663:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x111:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201557.912671:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201557.912681:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201557.912687:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201557.912691:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x111:0x0](ffff8bc1459d21c8) 00000080:00010000:3.0:1788201557.912694:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x111:0x0](ffff8bc1459d21c8) for lock 0xd138388016f6e852 00000080:00010000:3.0:1788201557.912698:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e852 from it ffffadd1c7da3cb8 00010000:00010000:3.0:1788201557.912701:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201557.912709:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201557.912756:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x111:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201557.912766:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x111:0x0] 00010000:00010000:1.0:1788201557.922415:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9800/0xd138388016f6e86e lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.922424:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9800/0xd138388016f6e86e lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.922431:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1727c9800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201557.922435:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9800/0xd138388016f6e86e lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.922442:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9800/0xd138388016f6e86e lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.922449:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9800/0xd138388016f6e86e lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.922456:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201557.922464:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9800/0xd138388016f6e86e lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.922470:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9800/0xd138388016f6e86e lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201557.922489:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1725b2300 x1875064727830272/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201573 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201557.922504:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201557.922530:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:1.0:1788201557.922628:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201557.922641:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201557.922651:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 182 lru_type: 1 00010000:00010000:1.0:1788201557.922669:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 182 lru_type: 1 00000080:00200000:1.0:1788201557.922676:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201557.922681:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201557.922685:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201557.922691:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3bf8 00010000:00010000:1.0:1788201557.922695:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 182 lru_type: 1 00010000:00010000:1.0:1788201557.922703:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 183 lru_type: 1 00000080:00200000:1.0:1788201557.922719:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201557.922727:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201557.922733:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201557.922748:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201557.922752:0:23731:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=replay-vbr.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), file ffff8bc153aa9200, open_flags 80c1, mode 81ed opened 0 00000080:00200000:1.0:1788201557.922761:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=replay-vbr.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000002:00010000:1.0:1788201557.922780:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: replay-vbr.sh,[0x200000bd7:0x112:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201557.922870:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6e875 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.922878:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6e875 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201557.922889:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201557.922897:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b2300 x1875064727830528/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201557.922907:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6e875 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201557.922929:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b2300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727830528:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201557.923110:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc146705480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201557.934718:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b2300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727830528:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201557.934746:0:23731:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6e875 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094817 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.934769:0:23731:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6e875 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x112:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094817 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.934777:0:23731:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6e875 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094817 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.934819:0:23731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6e875 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094817 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.934831:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6e875 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094817 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.934844:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6e875 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094817 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.934853:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6e875 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094817 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.934867:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6e875 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094817 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201557.934879:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1725b2300 x1875064727830528/t8589937075(8589937075) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201573 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201557.934893:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725b2300 x1875064727830528/t8589937075(8589937075) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201573 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201557.934907:0:23731:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6e875 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094817 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201557.934920:0:23731:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6e875 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094817 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.934930:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/274 (0 0) 00000080:00200000:1.0:1788201557.934936:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201557.934950:0:23731:0:(namei.c:1628:ll_create_it()) VFS Op:name=replay-vbr.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000080:00200000:1.0:1788201557.934980:0:23731:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x112:0x0](ffff8bc144658908) 00000080:00200000:1.0:1788201557.935116:0:23731:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x112:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201557.935125:0:23731:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x112:0x0](ffff8bc144658908) 00000080:00010000:1.0:1788201557.935129:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x112:0x0](ffff8bc144658908) for lock 0xd138388016f6e875 00000080:00010000:1.0:1788201557.935138:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x112:0x0](ffff8bc144658908) 00000080:00200008:1.0:1788201557.935151:0:23731:0:(file.c:1090:ll_file_open()) START file replay-vbr.sh:[0x200000bd7:0x112:0x0](ffff8bc144658908), flags 100301 00000002:00100000:1.0:1788201557.935231:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725b2300 x1875064727830528/t8589937075(8589937075) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201573 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201557.935271:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e875 from it ffff8bc1466cdf00 00010000:00010000:1.0:1788201557.935276:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6e875 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094817 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.935286:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6e875 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094817 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201557.935309:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x112:0x0](ffff8bc144658908), inode mode 81ed mask 40 00000080:00200008:1.0:1788201557.935335:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file replay-vbr.sh:[0x200000bd7:0x112:0x0](ffff8bc144658908), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201557.935341:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x112:0x0](ffff8bc144658908),name=replay-vbr.sh 00000002:00010000:1.0:1788201557.935358:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x112:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201557.935500:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6e875 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094817 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201557.935513:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6e875 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094817 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201557.935520:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201557.935525:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x112:0x0](ffff8bc144658908) 00000080:00010000:1.0:1788201557.935528:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x112:0x0](ffff8bc144658908) for lock 0xd138388016f6e875 00000080:00010000:1.0:1788201557.935532:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e875 from it ffffadd1c7da3cd8 00010000:00010000:1.0:1788201557.935536:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6e875 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094817 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201557.935542:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6e875 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094817 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201557.935569:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x112:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201557.935578:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x112:0x0] 00000008:00010000:1.0:1788201557.935609:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201557.935613:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc151a50730, osc lock ffff8bc145d091d0, flags 0x400001002 00010000:00010000:1.0:1788201557.935660:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6e87c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.935670:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6e87c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201557.936118:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:1.0:1788201557.940189:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x112:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201557.940196:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e26500 (ffff8bc148e3b5a8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201557.940200:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e26500 (ffff8bc148e3b5a8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201557.940205:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151a50730 (ffff8bc148e3b878/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201557.940209:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e26500 (ffff8bc148e3b5a8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201557.940212:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151a50730 (ffff8bc148e3b5a8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201557.940249:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x112:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201557.940319:0:23731:0:(file.c:2638:do_file_write_iter()) START file replay-vbr.sh:[0x200000bd7:0x112:0x0], ppos: 0, count: 37842 00000080:00200000:1.0:1788201557.940345:0:23731:0:(file.c:2090:ll_file_io_generic()) replay-vbr.sh: write ppos: 0, bytes: 37842 00000080:00200000:1.0:1788201557.940351:0:23731:0:(file.c:1848:ll_io_set_mirror()) replay-vbr.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201557.940357:0:23731:0:(cl_io.c:214:cl_io_rw_init()) header@000000000d531ce3[0x110, 1, [0x200000bd7:0x112:0x0] hash] 00000020:00200000:1.0:1788201557.940359:0:23731:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 37842) 0 0 00000080:00200000:1.0:1788201557.940362:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x112:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201557.940386:0:23731:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 9] 00020000:00200000:1.0:1788201557.940395:0:23731:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 37842) 37842, 37842 00020000:00200000:1.0:1788201557.940399:0:23731:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201557.940428:0:23731:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 9] 00000008:00010000:1.0:1788201557.940441:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201557.940447:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc151a50730, osc lock ffff8bc145d091d0, flags 0x0 00010000:00010000:1.0:1788201557.940463:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/400 (0 40959) 00010000:00010000:1.0:1788201557.940501:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x190:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.940512:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x190:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.940523:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x190:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201557.940544:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b3b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727830784:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201557.940637:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1467050c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201557.943132:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:3.0:1788201557.943648:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201557.943656:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6e87c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094825 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.943666:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1727c9800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201557.943672:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6e87c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171094825 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201557.943734:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x112:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201557.943747:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x112:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201557.943856:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6e87c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094825 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.943863:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201557.943886:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6e87c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094825 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.943893:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6e87c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094825 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201557.943908:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201557.943910:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201557.943912:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201557.943919:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201557.943935:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727830912:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201557.948216:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743438336 00000100:00100000:3.0:1788201557.948226:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743438336 00000100:00100000:3.0:1788201557.948311:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 555 00000100:00100000:3.0:1788201557.948322:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc146028380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21004:x1875064743438336:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201557.948340:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.948353:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.948362:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.948374:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.948382:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.948394:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.948412:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1727c8c00) 00000100:00100000:3.0:1788201557.948483:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc146028380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21004:x1875064743438336:12345-192.168.201.143@tcp:105: Request processed in 163us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201557.948491:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 555 00000100:00100000:1.0:1788201557.948676:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b3b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727830784:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201557.948695:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.948711:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201557.948725:0:23731:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.948737:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.948746:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201557.948928:0:23731:0:(vvp_io.c:1292:vvp_io_write_start()) replay-vbr.sh: write [0, 37842) append 0 append lockpos 0 00000100:00100000:3.0:1788201557.951981:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727830912:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201557.973378:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201557.973399:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727831808:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201557.977061:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e89f lrc: 6/2,0 mode: --/PR res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.977082:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e89f lrc: 6/2,0 mode: --/PR res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094880 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.977094:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e89f lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094880 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.977107:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e89f lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094880 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201557.977123:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e89f lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094880 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201557.977135:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1788201557.977154:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e89f lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094880 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.977164:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e89f lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094880 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.977187:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e89f lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094880 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.977197:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e89f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171094880 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201557.977218:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727831808:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201557.983560:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743438464 00000100:00100000:1.0:1788201557.983576:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743438464 00000100:00100000:1.0:1788201557.983703:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 556 00000100:00100000:1.0:1788201557.983715:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc146029880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23394:x1875064743438464:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201557.983736:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e89f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094880 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201557.983885:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201557.983892:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc146029880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23394:x1875064743438464:12345-192.168.201.143@tcp:104: Request processed in 180us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201557.983899:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 556 00000100:00100000:3.0:1788201557.988650:0:20877:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201557.988671:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743438592 00000100:00100000:3.0:1788201557.988677:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743438592 00000100:00100000:3.0:1788201557.988782:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 557 00000100:00100000:3.0:1788201557.988820:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc146015c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23412:x1875064743438592:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201557.988832:0:20877:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a08eaec7/0xd138388016f6e8a6 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094887 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.988847:0:20877:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a08eaec7/0xd138388016f6e8a6 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094887 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.988857:0:20877:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a08eaec7/0xd138388016f6e8a6 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171094887 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.988867:0:20877:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a08eaec7/0xd138388016f6e8a6 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171094887 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.988876:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a08eaec7/0xd138388016f6e8a6 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171094887 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.988886:0:20877:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a08eaec7/0xd138388016f6e8a6 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171094887 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201557.988908:0:20877:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc172734000) 00000100:00100000:3.0:1788201557.988977:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc146015c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23412:x1875064743438592:12345-192.168.201.143@tcp:105: Request processed in 186us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201557.988993:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 557 00000100:00100000:1.0:1788201557.993745:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727832320:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201557.993778:0:23731:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1725f4000 x1875064727831680/t8589937077(8589937077) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/664 e 0 to 0 dl 1788201573 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201557.993879:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201557.993898:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201557.993916:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 187 lru_type: 1 00010000:00010000:1.0:1788201557.993929:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 187 lru_type: 1 00000080:00200000:1.0:1788201557.993939:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201557.993946:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201557.993950:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201557.993957:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201557.993961:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 187 lru_type: 1 00010000:00010000:1.0:1788201557.993970:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 188 lru_type: 1 00000080:00200000:1.0:1788201557.993984:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201557.994002:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201557.994008:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201557.994011:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=rpc.sh, flags=8 00000080:00200008:1.0:1788201557.994018:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file rpc.sh:[0x200000bd7:0x113:0x0](ffff8bc14592e3c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201557.994023:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x113:0x0](ffff8bc14592e3c8),name=rpc.sh 00000002:00010000:1.0:1788201557.994034:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x113:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201557.994042:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267fc00/0xd138388016f6e898 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x113:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094872 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201557.994051:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267fc00/0xd138388016f6e898 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x113:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094872 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201557.994062:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201557.994066:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x113:0x0](ffff8bc14592e3c8) 00000080:00010000:1.0:1788201557.994068:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x113:0x0](ffff8bc14592e3c8) for lock 0xd138388016f6e898 00000080:00010000:1.0:1788201557.994071:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e898 from it ffffadd1c7da3cb8 00010000:00010000:1.0:1788201557.994074:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267fc00/0xd138388016f6e898 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x113:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094872 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201557.994081:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267fc00/0xd138388016f6e898 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x113:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094872 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201557.994130:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x113:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201557.994142:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x113:0x0] 00000008:00010000:1.0:1788201557.994180:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201557.994184:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc151a503b0, osc lock ffff8bc145d090a0, flags 0x400001002 00010000:00010000:1.0:1788201557.994202:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a08eaec7/0xd138388016f6e8a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094887 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201557.994214:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a08eaec7/0xd138388016f6e8a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094887 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201557.994226:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201557.994230:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a08eaec7/0xd138388016f6e8a6 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094887 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201557.994237:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a08eaec7/0xd138388016f6e8a6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094887 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201557.994252:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201557.994262:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x113:0x0] updating i_size 423 i_blocks 1 00000020:00010000:1.0:1788201557.994267:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e26e40 (ffff8bc148e3b3f8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201557.994270:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e26e40 (ffff8bc148e3b3f8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201557.994272:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151a503b0 (ffff8bc148e3ba28/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201557.994276:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e26e40 (ffff8bc148e3b3f8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201557.994279:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151a503b0 (ffff8bc148e3b3f8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201557.994304:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x113:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201557.994355:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201557.994362:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201557.994370:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 188 lru_type: 1 00010000:00010000:1.0:1788201557.994379:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 188 lru_type: 1 00000080:00200000:1.0:1788201557.994385:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201557.994389:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201557.994391:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201557.994394:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201557.994397:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 188 lru_type: 1 00010000:00010000:1.0:1788201557.994404:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 189 lru_type: 1 00000080:00200000:1.0:1788201557.994418:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201557.994422:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201557.994425:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201557.994440:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=run_dbench.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=9 00000080:00200000:1.0:1788201557.994445:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run_dbench.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:1.0:1788201557.994454:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run_dbench.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201557.994574:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9800/0xd138388016f6e8ad lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.994583:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9800/0xd138388016f6e8ad lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201557.994593:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9800/0xd138388016f6e8ad lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201557.994617:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b3b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727832448:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201557.994770:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1467050c0 going to sleep for 11 seconds 00000080:00200000:1.0:1788201558.022312:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x114:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201558.022319:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d8de0 (ffff8bc1499c4bd8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201558.022323:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d8de0 (ffff8bc1499c4bd8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201558.022328:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146f0a3b0 (ffff8bc1499c4f38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201558.022332:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d8de0 (ffff8bc1499c4bd8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201558.022334:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146f0a3b0 (ffff8bc1499c4bd8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201558.022377:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x114:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201558.022439:0:23731:0:(file.c:2638:do_file_write_iter()) START file run_dbench.sh:[0x200000bd7:0x114:0x0], ppos: 0, count: 1342 00000080:00200000:1.0:1788201558.022452:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 1342 bytes 00000080:00200000:1.0:1788201558.022457:0:23731:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 1342 00000080:00200000:1.0:1788201558.022483:0:23731:0:(file.c:2090:ll_file_io_generic()) run_dbench.sh: write ppos: 0, bytes: 1342 00000080:00200000:1.0:1788201558.022489:0:23731:0:(file.c:1848:ll_io_set_mirror()) run_dbench.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201558.022494:0:23731:0:(cl_io.c:214:cl_io_rw_init()) header@000000007f13552c[0x110, 1, [0x200000bd7:0x114:0x0] hash] 00000020:00200000:1.0:1788201558.022496:0:23731:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 1342) 0 0 00000080:00200000:1.0:1788201558.022500:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x114:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201558.022514:0:23731:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1788201558.022522:0:23731:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 1342) 1342, 1342 00020000:00200000:1.0:1788201558.022527:0:23731:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201558.022555:0:23731:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1788201558.022569:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201558.022575:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc151a503b0, osc lock ffff8bc145d090a0, flags 0x0 00010000:00010000:1.0:1788201558.022595:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/401 (0 4095) 00010000:00010000:1.0:1788201558.022637:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6e8c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x191:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.022647:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6e8c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x191:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.022657:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6e8c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x191:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201558.022680:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b0a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727833088:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201558.022773:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1467050c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201558.026835:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743438720 00000100:00100000:1.0:1788201558.026846:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743438720 00000100:00100000:1.0:1788201558.027052:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 558 00000100:00100000:1.0:1788201558.027064:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23131:x1875064743438720:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201558.027084:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000017d957e3/0xd138388016f6e8c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x191:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710948db expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.027187:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201558.027194:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23131:x1875064743438720:12345-192.168.201.143@tcp:104: Request processed in 133us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201558.027202:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 558 00010000:00010000:3.0:1788201558.027263:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201558.027279:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000017d957e3/0xd138388016f6e8c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x191:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710948db expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.027288:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172610a00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201558.027294:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000017d957e3/0xd138388016f6e8c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x191:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e21710948db expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201558.027367:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x114:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201558.027380:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x114:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201558.027442:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000017d957e3/0xd138388016f6e8c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x191:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710948db expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.027448:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201558.027467:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000017d957e3/0xd138388016f6e8c2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x191:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710948db expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.027473:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000017d957e3/0xd138388016f6e8c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x191:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710948db expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.027494:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201558.027496:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201558.027497:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201558.027510:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727833216:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201558.031359:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201558.085650:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727834112:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201558.089329:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000098444412/0xd138388016f6e8e5 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.089355:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000098444412/0xd138388016f6e8e5 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094936 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.089376:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000098444412/0xd138388016f6e8e5 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094936 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.089388:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000098444412/0xd138388016f6e8e5 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094936 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201558.089403:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000098444412/0xd138388016f6e8e5 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094936 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201558.089416:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201558.089436:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000098444412/0xd138388016f6e8e5 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094936 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.089446:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000098444412/0xd138388016f6e8e5 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094936 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.089455:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000098444412/0xd138388016f6e8e5 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094936 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.089465:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000098444412/0xd138388016f6e8e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171094936 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201558.089488:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727834112:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201558.102723:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:3.0:1788201558.105043:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201558.105056:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000098444412/0xd138388016f6e8e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x191:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094936 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.105069:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172724a00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201558.105077:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000098444412/0xd138388016f6e8e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x191:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171094936 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201558.105154:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x115:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201558.105384:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x115:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201558.105465:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000098444412/0xd138388016f6e8e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x191:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094936 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.105474:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201558.105511:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000098444412/0xd138388016f6e8e5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x191:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094936 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.105520:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000098444412/0xd138388016f6e8e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x191:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094936 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.105537:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201558.105539:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201558.105540:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201558.106153:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727834368:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201558.109707:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743439104 00000100:00100000:3.0:1788201558.109718:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743439104 00000100:00100000:3.0:1788201558.109782:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 561 00000100:00100000:3.0:1788201558.109822:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21004:x1875064743439104:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201558.109840:0:20877:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000004e9ac6d/0xd138388016f6e8ec lrc: 5/0,1 mode: --/PW res: [0x240000400:0x191:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109493d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.109854:0:20877:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000004e9ac6d/0xd138388016f6e8ec lrc: 5/0,1 mode: --/PW res: [0x240000400:0x191:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109493d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.109864:0:20877:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000004e9ac6d/0xd138388016f6e8ec lrc: 5/0,1 mode: --/PW res: [0x240000400:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e217109493d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.109876:0:20877:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000004e9ac6d/0xd138388016f6e8ec lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e217109493d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.109886:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000004e9ac6d/0xd138388016f6e8ec lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e217109493d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.109898:0:20877:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000004e9ac6d/0xd138388016f6e8ec lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e217109493d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.109924:0:20877:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc172725400) 00000100:00100000:3.0:1788201558.110002:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21004:x1875064743439104:12345-192.168.201.143@tcp:105: Request processed in 211us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201558.110010:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 561 00000100:00100000:1.0:1788201558.115054:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727834368:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201558.159622:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743439360 00000100:00100000:1.0:1788201558.159643:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743439360 00000100:00100000:1.0:1788201558.159816:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 562 00000100:00100000:1.0:1788201558.159830:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc146028000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21822:x1875064743439360:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201558.159851:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f0cf06e3/0xd138388016f6e908 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x192:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094991 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.159956:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201558.159964:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc146028000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21822:x1875064743439360:12345-192.168.201.143@tcp:104: Request processed in 137us (3931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201558.159972:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 562 00000100:00100000:3.0:1788201558.165941:0:20876:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201558.165962:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743439488 00000100:00100000:3.0:1788201558.165971:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743439488 00000100:00100000:3.0:1788201558.166037:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 563 00000100:00100000:3.0:1788201558.166049:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc150bc7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23412:x1875064743439488:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201558.166067:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e90f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094998 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.166080:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e90f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094998 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.166410:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e90f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094998 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.166427:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e90f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171094998 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.166438:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e90f lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171094998 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.166450:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e90f lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171094998 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.166468:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc172734c00) 00000100:00100000:3.0:1788201558.166536:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc150bc7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23412:x1875064743439488:12345-192.168.201.143@tcp:105: Request processed in 488us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201558.166544:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 563 00000100:00100000:1.0:1788201558.170756:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727835904:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201558.170816:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727836416:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201558.170844:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788201558.170851:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727835776:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201558.170874:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727836288:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201558.171493:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201558.171504:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727836544:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201558.182696:0:10055:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000007f312f51 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d554d574/0xd138388016f6e4f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093da5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201558.182755:0:10055:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000007f312f51 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d554d574/0xd138388016f6e4f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093da5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201558.182815:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727835776:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201558.182843:0:10055:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000fa2f0cf3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000011373b93/0xd138388016f6e653 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109427c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201558.182858:0:10055:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000fa2f0cf3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000011373b93/0xd138388016f6e653 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109427c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201558.182871:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727836416:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201558.191036:0:10055:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000c5f1d161 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201558.191086:0:10055:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000c5f1d161 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201558.191123:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727836288:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201558.205586:0:10052:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000fb431209 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f6fd8f72/0xd138388016f6e6df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710943e8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201558.205631:0:10052:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000fb431209 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f6fd8f72/0xd138388016f6e6df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710943e8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201558.205661:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727836672:192.168.201.143@tcp:4:cp.0 00000100:00100000:3.0:1788201558.206138:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a3800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727837184:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201558.206155:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6e91d lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.206176:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6e91d lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.206184:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6e91d lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.206191:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6e91d lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.206199:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6e91d lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.206205:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3c600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201558.206210:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6e91d lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.206217:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6e91d lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.206224:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6e91d lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.206231:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201558.206237:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6e91d lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.206243:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6e91d lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201558.206260:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a3800 x1875064727837184/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201574 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201558.206275:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201558.206297:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:3.0:1788201558.206402:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201558.206416:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201558.206425:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 202 lru_type: 1 00010000:00010000:3.0:1788201558.206437:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 202 lru_type: 1 00000080:00200000:3.0:1788201558.206444:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201558.206449:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201558.206453:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201558.206458:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3bf8 00010000:00010000:3.0:1788201558.206462:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 202 lru_type: 1 00010000:00010000:3.0:1788201558.206471:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 203 lru_type: 1 00000080:00200000:3.0:1788201558.206485:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201558.206492:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201558.206497:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201558.206509:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:3.0:1788201558.206514:0:23731:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=run_iozone.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), file ffff8bc143847800, open_flags 80c1, mode 81ed opened 0 00000080:00200000:3.0:1788201558.206521:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run_iozone.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000002:00010000:3.0:1788201558.206539:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run_iozone.sh,[0x200000bd7:0x117:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open|creat flags 0100302 00010000:00010000:3.0:1788201558.206581:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.206593:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1788201558.206603:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1788201558.206609:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146c59f80 x1875064727837440/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1788201558.206618:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201558.206635:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c59f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727837440:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201558.206833:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8cb40 going to sleep for 11 seconds 00000008:00010000:1.0:1788201558.213554:0:10055:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000122197b3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000cd330330/0xd138388016f6e53b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093fa4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201558.213605:0:10055:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000122197b3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000cd330330/0xd138388016f6e53b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093fa4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201558.213635:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727835904:192.168.201.143@tcp:4:cp.0 00000100:00100000:3.0:1788201558.214928:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c59f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727837440:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201558.214954:0:23731:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.214977:0:23731:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.214995:0:23731:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.215008:0:23731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.215019:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.215039:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.215047:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.215055:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201558.215069:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc146c59f80 x1875064727837440/t8589937085(8589937085) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201574 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1788201558.215082:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc146c59f80 x1875064727837440/t8589937085(8589937085) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201574 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201558.215096:0:23731:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1788201558.215108:0:23731:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.215120:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/279 (0 0) 00000080:00200000:3.0:1788201558.215126:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1788201558.215141:0:23731:0:(namei.c:1628:ll_create_it()) VFS Op:name=run_iozone.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000080:00200000:3.0:1788201558.215181:0:23731:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x117:0x0](ffff8bc1459d63c8) 00000080:00200000:3.0:1788201558.215298:0:23731:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x117:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1788201558.215307:0:23731:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x117:0x0](ffff8bc1459d63c8) 00000080:00010000:3.0:1788201558.215312:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x117:0x0](ffff8bc1459d63c8) for lock 0xd138388016f6e924 00000080:00010000:3.0:1788201558.215322:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x117:0x0](ffff8bc1459d63c8) 00000080:00200008:3.0:1788201558.215336:0:23731:0:(file.c:1090:ll_file_open()) START file run_iozone.sh:[0x200000bd7:0x117:0x0](ffff8bc1459d63c8), flags 100301 00000002:00100000:3.0:1788201558.215355:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc146c59f80 x1875064727837440/t8589937085(8589937085) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201574 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1788201558.215395:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e924 from it ffff8bc148c9b9c0 00010000:00010000:3.0:1788201558.215400:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.215411:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201558.215432:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x117:0x0](ffff8bc1459d63c8), inode mode 81ed mask 40 00000080:00200008:3.0:1788201558.215458:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file run_iozone.sh:[0x200000bd7:0x117:0x0](ffff8bc1459d63c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201558.215464:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x117:0x0](ffff8bc1459d63c8),name=run_iozone.sh 00000002:00010000:3.0:1788201558.215484:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x117:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201558.215495:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.215507:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201558.215513:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201558.215518:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x117:0x0](ffff8bc1459d63c8) 00000080:00010000:3.0:1788201558.215521:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x117:0x0](ffff8bc1459d63c8) for lock 0xd138388016f6e924 00000080:00010000:3.0:1788201558.215524:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e924 from it ffffadd1c7da3cd8 00010000:00010000:3.0:1788201558.215527:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.215536:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201558.215562:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x117:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201558.215572:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x117:0x0] 00000008:00010000:3.0:1788201558.215603:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201558.215608:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc144008c30, osc lock ffff8bc14691b300, flags 0x400001002 00010000:00010000:3.0:1788201558.215655:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6e92b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.215665:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6e92b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201558.215755:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727837568:192.168.201.143@tcp:101:cp.0 00000020:00200000:3.0:1788201558.216091:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201558.226490:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6e92b lrc: 6/2,0 mode: --/PR res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.226518:0:10054:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6e92b lrc: 6/2,0 mode: --/PR res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710949ec expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.226534:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6e92b lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710949ec expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.226554:0:10054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6e92b lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710949ec expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201558.226571:0:10054:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6e92b lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710949ec expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201558.226584:0:10054:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1788201558.226652:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6e92b lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710949ec expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.226662:0:10054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6e92b lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710949ec expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.226670:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6e92b lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710949ec expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.226680:0:10054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6e92b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e21710949ec expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201558.226702:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727837568:192.168.201.143@tcp:101:cp.0 00000080:00200000:3.0:1788201558.226857:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x117:0x0] updating i_size 0 i_blocks 1 00000020:00010000:3.0:1788201558.226864:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc5280 (ffff8bc1460e92d8/0) at cl_lock_release():245 00000020:00010000:3.0:1788201558.226867:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc5280 (ffff8bc1460e92d8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201558.226873:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc144008c30 (ffff8bc1460e9128/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201558.226877:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc5280 (ffff8bc1460e92d8/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201558.226880:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc144008c30 (ffff8bc1460e92d8/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201558.226923:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x117:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1788201558.226996:0:23731:0:(file.c:2638:do_file_write_iter()) START file run_iozone.sh:[0x200000bd7:0x117:0x0], ppos: 0, count: 1408 00000080:00200000:3.0:1788201558.227011:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 1408 bytes 00000080:00200000:3.0:1788201558.227016:0:23731:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 1408 00000080:00200000:3.0:1788201558.227039:0:23731:0:(file.c:2090:ll_file_io_generic()) run_iozone.sh: write ppos: 0, bytes: 1408 00000080:00200000:3.0:1788201558.227045:0:23731:0:(file.c:1848:ll_io_set_mirror()) run_iozone.sh: desiginated mirror: 0 00000020:00200000:3.0:1788201558.227050:0:23731:0:(cl_io.c:214:cl_io_rw_init()) header@0000000053196436[0x110, 1, [0x200000bd7:0x117:0x0] hash] 00000020:00200000:3.0:1788201558.227053:0:23731:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 1408) 0 0 00000080:00200000:3.0:1788201558.227057:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x117:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201558.227070:0:23731:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1788201558.227078:0:23731:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 1408) 1408, 1408 00020000:00200000:3.0:1788201558.227083:0:23731:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1788201558.227244:0:23731:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1788201558.227257:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1788201558.227263:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc144008c30, osc lock ffff8bc14691b300, flags 0x0 00010000:00010000:3.0:1788201558.227277:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/402 (0 4095) 00010000:00010000:3.0:1788201558.227382:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x192:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.227392:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x192:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.227403:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x192:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201558.227429:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c58a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727837696:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201558.227574:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1450a6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201558.230541:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743439744 00000100:00100000:1.0:1788201558.230553:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743439744 00000100:00100000:1.0:1788201558.230613:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 564 00000100:00100000:1.0:1788201558.230624:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14602b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23394:x1875064743439744:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201558.230643:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6e92b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x192:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710949ec expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.231165:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201558.231174:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14602b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23394:x1875064743439744:12345-192.168.201.143@tcp:104: Request processed in 552us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201558.231183:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 564 00000100:00100000:3.0:1788201558.232036:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201558.232055:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727837824:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201558.236061:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c58a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727837696:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201558.236107:0:23731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.236121:0:23731:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.236134:0:23731:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201558.240360:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743439872 00000100:00100000:3.0:1788201558.240371:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743439872 00000100:00100000:3.0:1788201558.240432:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 565 00000100:00100000:3.0:1788201558.240442:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21003:x1875064743439872:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201558.240459:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.240472:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.240482:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.240495:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.240504:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.240514:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.240553:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc14400ca00) 00000100:00100000:3.0:1788201558.240627:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21003:x1875064743439872:12345-192.168.201.143@tcp:105: Request processed in 186us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201558.240634:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 565 00000100:00100000:1.0:1788201558.242318:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727837952:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201558.242413:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727838464:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201558.242445:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727838976:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201558.242473:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201558.242480:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727838080:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201558.242502:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727838592:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201558.242532:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727838336:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201558.242554:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727838848:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201558.242574:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788201558.242581:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727838208:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201558.242600:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17270ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727838720:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201558.272586:0:10052:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000f57833e2 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e38d3ff7/0xd138388016f6e4d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093d4a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201558.272649:0:10052:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000f57833e2 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e38d3ff7/0xd138388016f6e4d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093d4a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201558.272679:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727837952:192.168.201.143@tcp:4:cp.0 00000100:00100000:3.0:1788201558.272717:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727837824:192.168.201.143@tcp:103:ldlm_bl.0 00000008:00010000:1.0:1788201558.272876:0:10055:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000004c75ab65 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002cadee1/0xd138388016f6e5a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710940b5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201558.272893:0:10055:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000004c75ab65 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002cadee1/0xd138388016f6e5a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710940b5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201558.272910:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727838336:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201558.272991:0:10055:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000908bab3b ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000dbcdbffe/0xd138388016f6e55e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093fff expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201558.272991:0:10052:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000781b57b3 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000af56bec5/0xd138388016f6e518 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093e70 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201558.273007:0:10052:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000781b57b3 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000af56bec5/0xd138388016f6e518 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093e70 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201558.273025:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727838080:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201558.273047:0:10052:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000f9bccc34 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000499c3d5c/0xd138388016f6e630 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094221 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201558.273061:0:10052:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000f9bccc34 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000499c3d5c/0xd138388016f6e630 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094221 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201558.273075:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727838592:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201558.273094:0:10052:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000311b2370 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aa9ac74c/0xd138388016f6e702 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094443 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201558.273100:0:10055:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000908bab3b ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000dbcdbffe/0xd138388016f6e55e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093fff expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201558.273107:0:10052:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000311b2370 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aa9ac74c/0xd138388016f6e702 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094443 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201558.273113:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727838208:192.168.201.143@tcp:4:cp.0 00000100:00100000:3.0:1788201558.273117:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727838976:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201558.273181:0:10055:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000390cd994 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201558.273195:0:10055:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000390cd994 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201558.273217:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727838848:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201558.278978:0:10055:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 0000000075bbbd45 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000029fa8324/0xd138388016f6e676 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710942d7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201558.279220:0:10055:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 0000000075bbbd45 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000029fa8324/0xd138388016f6e676 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710942d7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201558.279254:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17270ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727838720:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201558.279536:0:10052:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 0000000014c5a66b ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017a4a5c3/0xd138388016f6e5ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109416b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201558.279557:0:10052:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 0000000014c5a66b ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017a4a5c3/0xd138388016f6e5ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109416b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201558.279571:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727838464:192.168.201.143@tcp:4:cp.0 00000080:00200000:1.0:1788201558.281286:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x117:0x0](ffff8bc1459d63c8),name=run_iozone.sh 00000002:00010000:1.0:1788201558.281421:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x117:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201558.281433:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201558.281443:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201558.281450:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201558.281457:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x117:0x0](ffff8bc1459d63c8) 00000080:00010000:1.0:1788201558.281460:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x117:0x0](ffff8bc1459d63c8) for lock 0xd138388016f6e924 00000080:00010000:1.0:1788201558.281464:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e924 from it ffffadd1c7da3cb8 00010000:00010000:1.0:1788201558.281467:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201558.281476:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201558.281522:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x117:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201558.281532:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x117:0x0] 00000008:00010000:1.0:1788201558.281558:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201558.281561:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc151a50730, osc lock ffff8bc145d08980, flags 0x400001002 00010000:00010000:1.0:1788201558.281576:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x192:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.281584:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201558.281593:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201558.281643:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.281649:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201558.281658:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201558.281665:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x117:0x0] updating i_size 1408 i_blocks 1 00000020:00010000:1.0:1788201558.281668:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e26e40 (ffff8bc148e3bcf8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201558.281670:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e26e40 (ffff8bc148e3bcf8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201558.281673:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151a50730 (ffff8bc148e3bb48/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201558.281675:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e26e40 (ffff8bc148e3bcf8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201558.281677:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151a50730 (ffff8bc148e3bcf8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201558.281699:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x117:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201558.281748:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201558.281755:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201558.281760:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 204 lru_type: 1 00010000:00010000:1.0:1788201558.281767:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 204 lru_type: 1 00000080:00200000:1.0:1788201558.281774:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201558.281778:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201558.281780:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201558.281784:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201558.281787:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 204 lru_type: 1 00010000:00010000:1.0:1788201558.281922:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 205 lru_type: 1 00000080:00200000:1.0:1788201558.281932:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201558.281937:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201558.281941:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201558.281955:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=run-llog.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=9 00000080:00200000:1.0:1788201558.281958:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run-llog.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:1.0:1788201558.281967:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run-llog.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201558.282155:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6e939 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.282161:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6e939 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.282176:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6e939 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201558.282203:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b0700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727839360:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201558.282418:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc148a80540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201558.284881:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b0700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727839360:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201558.284900:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6e939 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.284911:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6e939 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.284915:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6e939 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.284920:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6e939 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.284926:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6e939 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.284930:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14a778000 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201558.284934:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6e939 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.284938:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6e939 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.284943:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6e939 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.284948:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201558.284953:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6e939 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.284957:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6e939 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201558.284970:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1725b0700 x1875064727839360/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201574 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201558.284993:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201558.285021:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:1.0:1788201558.285080:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201558.285095:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201558.285104:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 205 lru_type: 1 00010000:00010000:1.0:1788201558.285115:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 205 lru_type: 1 00000080:00200000:1.0:1788201558.285122:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201558.285128:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201558.285131:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201558.285137:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201558.285140:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 205 lru_type: 1 00010000:00010000:1.0:1788201558.285147:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 206 lru_type: 1 00000080:00200000:1.0:1788201558.285160:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201558.285165:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201558.285169:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201558.285180:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=run-llog.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=8 00000080:00200000:1.0:1788201558.285184:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run-llog.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:1.0:1788201558.285194:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run-llog.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201558.285228:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778600/0xd138388016f6e940 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.285235:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778600/0xd138388016f6e940 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.285245:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778600/0xd138388016f6e940 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201558.285267:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b0700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727839488:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201558.285369:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc148a80540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201558.287919:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b0700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727839488:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201558.287939:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778600/0xd138388016f6e940 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.287949:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778600/0xd138388016f6e940 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.287953:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778600/0xd138388016f6e940 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.287958:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778600/0xd138388016f6e940 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.287965:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778600/0xd138388016f6e940 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.287969:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14a778600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201558.287973:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778600/0xd138388016f6e940 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.287977:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778600/0xd138388016f6e940 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.287994:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778600/0xd138388016f6e940 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.288002:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201558.288007:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778600/0xd138388016f6e940 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.288011:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778600/0xd138388016f6e940 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201558.288025:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1725b0700 x1875064727839488/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201574 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201558.288037:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201558.288057:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:1.0:1788201558.288165:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201558.288183:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201558.288192:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 206 lru_type: 1 00010000:00010000:1.0:1788201558.288213:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 206 lru_type: 1 00000080:00200000:1.0:1788201558.288220:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201558.288226:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201558.288230:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201558.288236:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3bf8 00010000:00010000:1.0:1788201558.288240:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 206 lru_type: 1 00010000:00010000:1.0:1788201558.288248:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 207 lru_type: 1 00000080:00200000:1.0:1788201558.288262:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201558.288268:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201558.288274:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201558.288286:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201558.288291:0:23731:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=run-llog.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), file ffff8bc153aa8a80, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:1.0:1788201558.288309:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run-llog.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000002:00010000:1.0:1788201558.288328:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run-llog.sh,[0x200000bd7:0x118:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201558.288385:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6e947 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.288394:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6e947 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201558.288406:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201558.288413:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b0700 x1875064727839744/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201558.288422:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6e947 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201558.288442:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b0700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727839744:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201558.288594:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc148a80540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201558.292890:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b0700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727839744:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201558.292917:0:23731:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6e947 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094a39 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.292937:0:23731:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6e947 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x118:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094a39 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.292945:0:23731:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6e947 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x118:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094a39 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.292965:0:23731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6e947 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x118:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094a39 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.292975:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6e947 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x118:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094a39 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.292999:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6e947 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x118:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094a39 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.293008:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6e947 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x118:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094a39 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.293022:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6e947 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x118:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094a39 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201558.293033:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1725b0700 x1875064727839744/t8589937087(8589937087) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201574 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201558.293047:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725b0700 x1875064727839744/t8589937087(8589937087) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201574 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201558.293060:0:23731:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6e947 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x118:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094a39 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201558.293072:0:23731:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6e947 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x118:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094a39 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.293082:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/280 (0 0) 00000080:00200000:1.0:1788201558.293089:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201558.293104:0:23731:0:(namei.c:1628:ll_create_it()) VFS Op:name=run-llog.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000080:00200000:1.0:1788201558.293143:0:23731:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x118:0x0](ffff8bc14465e3c8) 00000080:00200000:1.0:1788201558.293268:0:23731:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x118:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201558.293278:0:23731:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x118:0x0](ffff8bc14465e3c8) 00000080:00010000:1.0:1788201558.293282:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x118:0x0](ffff8bc14465e3c8) for lock 0xd138388016f6e947 00000080:00010000:1.0:1788201558.293291:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x118:0x0](ffff8bc14465e3c8) 00000080:00200008:1.0:1788201558.293315:0:23731:0:(file.c:1090:ll_file_open()) START file run-llog.sh:[0x200000bd7:0x118:0x0](ffff8bc14465e3c8), flags 100301 00000002:00100000:1.0:1788201558.293335:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725b0700 x1875064727839744/t8589937087(8589937087) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201574 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201558.293385:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e947 from it ffff8bc1466cd600 00010000:00010000:1.0:1788201558.293391:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6e947 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x118:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094a39 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.293400:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6e947 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x118:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094a39 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201558.293424:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x118:0x0](ffff8bc14465e3c8), inode mode 81a4 mask 40 00000080:00200008:1.0:1788201558.293455:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file run-llog.sh:[0x200000bd7:0x118:0x0](ffff8bc14465e3c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201558.293462:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x118:0x0](ffff8bc14465e3c8),name=run-llog.sh 00000002:00010000:1.0:1788201558.293489:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x118:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201558.293499:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6e947 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x118:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094a39 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.293510:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6e947 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x118:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094a39 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201558.293517:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201558.293522:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x118:0x0](ffff8bc14465e3c8) 00000080:00010000:1.0:1788201558.293525:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x118:0x0](ffff8bc14465e3c8) for lock 0xd138388016f6e947 00000080:00010000:1.0:1788201558.293529:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e947 from it ffffadd1c7da3cd8 00010000:00010000:1.0:1788201558.293532:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6e947 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x118:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094a39 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.293540:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6e947 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x118:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094a39 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201558.293563:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x118:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201558.293572:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x118:0x0] 00000008:00010000:1.0:1788201558.293597:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201558.293600:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc151a50eb0, osc lock ffff8bc145d08980, flags 0x400001002 00010000:00010000:1.0:1788201558.293640:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6e94e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.293649:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6e94e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201558.293686:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1788201558.299457:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201558.299484:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727839872:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201558.302938:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6e94e lrc: 6/2,0 mode: --/PR res: [0x280000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.302966:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6e94e lrc: 6/2,0 mode: --/PR res: [0x280000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094a47 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.302990:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6e94e lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094a47 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.303003:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6e94e lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094a47 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201558.303019:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6e94e lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094a47 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201558.303031:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201558.303043:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6e94e lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094a47 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.303052:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6e94e lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094a47 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.303060:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6e94e lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094a47 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.303069:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6e94e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171094a47 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201558.303091:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x118:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201558.303098:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e26e40 (ffff8bc148e3bcf8/0) at cl_lock_release():245 00000100:00100000:3.0:1788201558.303100:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727839872:192.168.201.143@tcp:101:cp.0 00000020:00010000:1.0:1788201558.303102:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e26e40 (ffff8bc148e3bcf8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201558.303108:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151a50eb0 (ffff8bc148e3bb48/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201558.303112:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e26e40 (ffff8bc148e3bcf8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201558.303115:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151a50eb0 (ffff8bc148e3bcf8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201558.303151:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x118:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201558.303211:0:23731:0:(file.c:2638:do_file_write_iter()) START file run-llog.sh:[0x200000bd7:0x118:0x0], ppos: 0, count: 855 00000080:00200000:1.0:1788201558.303224:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 855 bytes 00000080:00200000:1.0:1788201558.303228:0:23731:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 855 00000080:00200000:1.0:1788201558.303250:0:23731:0:(file.c:2090:ll_file_io_generic()) run-llog.sh: write ppos: 0, bytes: 855 00000080:00200000:1.0:1788201558.303255:0:23731:0:(file.c:1848:ll_io_set_mirror()) run-llog.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201558.303261:0:23731:0:(cl_io.c:214:cl_io_rw_init()) header@000000005126184d[0x110, 1, [0x200000bd7:0x118:0x0] hash] 00000020:00200000:1.0:1788201558.303263:0:23731:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 855) 0 0 00000080:00200000:1.0:1788201558.303267:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x118:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201558.303281:0:23731:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1788201558.303289:0:23731:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 855) 855, 855 00020000:00200000:1.0:1788201558.303293:0:23731:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201558.303333:0:23731:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1788201558.303346:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201558.303352:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc151a50eb0, osc lock ffff8bc145d08980, flags 0x0 00010000:00010000:1.0:1788201558.303377:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/403 (0 4095) 00010000:00010000:1.0:1788201558.303415:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6e955 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x193:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.303425:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6e955 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x193:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.303436:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6e955 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x193:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201558.303456:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b3b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727840000:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201558.303574:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc148a80cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201558.307274:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201558.307452:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743440000 00000100:00100000:3.0:1788201558.307461:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743440000 00000100:00100000:3.0:1788201558.307520:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 566 00000100:00100000:3.0:1788201558.307531:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23131:x1875064743440000:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201558.307551:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6e94e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x193:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094a47 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.307645:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201558.307652:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23131:x1875064743440000:12345-192.168.201.143@tcp:104: Request processed in 123us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201558.307661:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 566 00010000:00010000:1.0:1788201558.307729:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201558.307737:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6e94e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x193:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094a47 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.307746:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14a778000 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201558.307752:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6e94e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x193:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171094a47 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201558.307849:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x118:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201558.307865:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x118:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201558.307927:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6e94e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x193:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094a47 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.307935:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201558.307968:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6e94e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x193:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094a47 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.307978:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6e94e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x193:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094a47 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.308004:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201558.308006:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201558.308008:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201558.308134:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727840128:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201558.313943:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743440128 00000100:00100000:1.0:1788201558.313951:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743440128 00000100:00100000:1.0:1788201558.314030:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 567 00000100:00100000:1.0:1788201558.314039:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc146028000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21004:x1875064743440128:12345-192.168.201.143@tcp:105: 00010000:00010000:1.0:1788201558.314051:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6e955 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094a4e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.314060:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6e955 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094a4e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.314069:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6e955 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171094a4e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.314079:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6e955 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171094a4e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.314089:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6e955 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171094a4e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.314103:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6e955 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171094a4e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.314119:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc14a778600) 00000100:00100000:1.0:1788201558.314184:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc146028000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21004:x1875064743440128:12345-192.168.201.143@tcp:105: Request processed in 146us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201558.314192:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 567 00000100:00100000:1.0:1788201558.330262:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602b800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727840512:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201558.330287:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6c00/0xd138388016f6e95c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.330302:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6c00/0xd138388016f6e95c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.330310:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6c00/0xd138388016f6e95c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.330447:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6c00/0xd138388016f6e95c lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.330458:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6c00/0xd138388016f6e95c lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.330465:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149eb6c00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201558.330469:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6c00/0xd138388016f6e95c lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.330539:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6c00/0xd138388016f6e95c lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.330549:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6c00/0xd138388016f6e95c lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.330556:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201558.330563:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6c00/0xd138388016f6e95c lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.330571:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6c00/0xd138388016f6e95c lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201558.330590:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14602b800 x1875064727840512/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201574 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201558.330678:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201558.330704:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:1.0:1788201558.331105:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201558.331124:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201558.331136:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 209 lru_type: 1 00010000:00010000:1.0:1788201558.331148:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 209 lru_type: 1 00000080:00200000:1.0:1788201558.331155:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201558.331291:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201558.331296:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201558.331302:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201558.331307:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 209 lru_type: 1 00010000:00010000:1.0:1788201558.331317:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 210 lru_type: 1 00000080:00200000:1.0:1788201558.331331:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201558.331338:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201558.331345:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201558.331358:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=run_tar.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=8 00000080:00200000:1.0:1788201558.331361:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run_tar.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:1.0:1788201558.331374:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run_tar.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201558.331417:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6e963 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.331424:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6e963 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.331433:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6e963 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201558.331455:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b2a00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727840640:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201558.331700:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc148a80780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201558.359588:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146028380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727840896:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201558.359684:0:23731:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.359713:0:23731:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.359721:0:23731:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.359732:0:23731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.359842:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.359858:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.359867:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.359882:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201558.359896:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc146028380 x1875064727840896/t8589937089(8589937089) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201574 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201558.359910:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc146028380 x1875064727840896/t8589937089(8589937089) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201574 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201558.359924:0:23731:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201558.359939:0:23731:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.359951:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/281 (0 0) 00000080:00200000:1.0:1788201558.359973:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201558.360670:0:23731:0:(namei.c:1628:ll_create_it()) VFS Op:name=run_tar.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000080:00200000:1.0:1788201558.360705:0:23731:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x119:0x0](ffff8bc144659988) 00000080:00200000:1.0:1788201558.361299:0:23731:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x119:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201558.361312:0:23731:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x119:0x0](ffff8bc144659988) 00000080:00010000:1.0:1788201558.361316:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x119:0x0](ffff8bc144659988) for lock 0xd138388016f6e96a 00000080:00010000:1.0:1788201558.361327:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x119:0x0](ffff8bc144659988) 00000080:00200008:1.0:1788201558.361342:0:23731:0:(file.c:1090:ll_file_open()) START file run_tar.sh:[0x200000bd7:0x119:0x0](ffff8bc144659988), flags 100301 00000002:00100000:1.0:1788201558.361368:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc146028380 x1875064727840896/t8589937089(8589937089) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201574 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201558.361413:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e96a from it ffff8bc1468c0a80 00010000:00010000:1.0:1788201558.361419:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.361430:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201558.361452:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x119:0x0](ffff8bc144659988), inode mode 81ed mask 40 00000080:00200008:1.0:1788201558.361476:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file run_tar.sh:[0x200000bd7:0x119:0x0](ffff8bc144659988), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201558.361888:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x119:0x0](ffff8bc144659988),name=run_tar.sh 00000002:00010000:1.0:1788201558.361908:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x119:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201558.361922:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.361936:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201558.361944:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201558.362077:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x119:0x0](ffff8bc144659988) 00000080:00010000:1.0:1788201558.362081:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x119:0x0](ffff8bc144659988) for lock 0xd138388016f6e96a 00000080:00010000:1.0:1788201558.362086:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e96a from it ffffadd1c7da3cd8 00010000:00010000:1.0:1788201558.362089:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.362195:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201558.362232:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x119:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201558.362243:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x119:0x0] 00000008:00010000:1.0:1788201558.362273:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201558.362277:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc151a50230, osc lock ffff8bc145d08be0, flags 0x400001002 00010000:00010000:1.0:1788201558.362330:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6e971 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.362340:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6e971 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201558.362835:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201558.366423:0:10055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6e971 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.366454:0:10055:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6e971 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094aa2 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.366471:0:10055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6e971 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094aa2 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.366564:0:10055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6e971 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094aa2 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201558.366583:0:10055:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6e971 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094aa2 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201558.366670:0:10055:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1788201558.366732:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6e971 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094aa2 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.366751:0:10055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6e971 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094aa2 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.366760:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6e971 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094aa2 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.366779:0:10055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6e971 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171094aa2 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201558.366846:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727841024:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201558.376337:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201558.376455:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743440256 00000100:00100000:1.0:1788201558.376465:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743440256 00000100:00100000:1.0:1788201558.376648:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 568 00000100:00100000:1.0:1788201558.376659:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc146c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23413:x1875064743440256:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201558.376678:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6e971 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x193:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094aa2 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.377353:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1788201558.377489:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201558.377497:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6e971 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x193:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094aa2 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.377508:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14a778a00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201558.377514:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6e971 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x193:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171094aa2 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201558.377574:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x119:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000100:00100000:1.0:1788201558.377585:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc146c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23413:x1875064743440256:12345-192.168.201.143@tcp:104: Request processed in 704us (1034us total) trans 0 rc 0/0 00000080:00200000:3.0:1788201558.377588:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x119:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00000100:00100000:1.0:1788201558.377594:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 568 00010000:00010000:3.0:1788201558.377669:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6e971 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x193:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094aa2 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.377676:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201558.377708:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6e971 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x193:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094aa2 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.377717:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6e971 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x193:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094aa2 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.377733:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201558.377735:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201558.377737:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201558.377745:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201558.377761:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727841280:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201558.380918:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201558.381760:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727841152:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201558.381780:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.381819:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201558.381831:0:23731:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.381842:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.381851:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201558.381876:0:23731:0:(vvp_io.c:1292:vvp_io_write_start()) run_tar.sh: write [0, 1654) append 0 append lockpos 0 00000080:00200000:1.0:1788201558.381896:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 1654 bytes 00000080:00200000:1.0:1788201558.381953:0:23731:0:(rw26.c:898:ll_write_end()) pos 0, len 1654, copied 1654 00000080:00200000:1.0:1788201558.381966:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000e8faa72f[3 000000003b87b6a9 2 1 00000000bc75318a 0 0 0] 00000080:00200000:1.0:1788201558.381969:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000da73b306 17ffffc0001001 3:0 ffff8bc1474181c0 0 lru 00000080:00200000:1.0:1788201558.381977:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000002ba8fcc8 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 000000002dcecbba > 3< 0 0 > 4< 0 0 8 28966912 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201558.381991:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000e8faa72f 00000080:00200000:1.0:1788201558.381992:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201558.382195:0:23731:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 1654 prio 0 00000008:00010000:1.0:1788201558.382514:0:23731:0:(osc_cache.c:857:osc_extent_find()) ### extent: 000000009a8144be ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201558.382536:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc144659b38, count 1, dirtied 1 00000080:00200000:1.0:1788201558.382543:0:23731:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 1654 bytes, tot: 1654 00000080:00200000:1.0:1788201558.382546:0:23731:0:(vvp_io.c:1358:vvp_io_write_start()) run_tar.sh: write bytes 0, result: 1654 00000020:00010000:1.0:1788201558.382564:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1498445d8 (ffff8bc146919908/0) at cl_lock_release():245 00000020:00010000:1.0:1788201558.382567:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1498445d8 (ffff8bc146919908/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201558.382571:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151240db0 (ffff8bc146919368/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201558.382577:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.382587:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201558.382608:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1498445d8 (ffff8bc146919908/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201558.382611:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151240db0 (ffff8bc146919908/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201558.382620:0:23731:0:(vvp_io.c:533:vvp_io_advance()) advancing 1654 bytes 00000080:00200000:1.0:1788201558.382628:0:23731:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1788201558.382661:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x119:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201558.382665:0:23731:0:(file.c:2238:ll_file_io_generic()) run_tar.sh: 2 io complete with rc: 0, result: 1654, restart: 0 00000080:00200000:1.0:1788201558.382674:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x119:0x0] updating i_size 1654 i_blocks 1 00000080:00200000:1.0:1788201558.382679:0:23731:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 1654 00000080:00200008:1.0:1788201558.382724:0:23731:0:(file.c:479:ll_file_release()) START file run_tar.sh:[0x200000bd7:0x119:0x0](ffff8bc144659988), flags 100001 00000002:00100000:1.0:1788201558.382773:0:23731:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc146028380 x1875064727840896/t8589937089(8589937089) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201574 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201558.382785:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1788201558.384457:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727841280:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201558.386108:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b3480 x1875064727841536/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201558.386153:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b3480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727841536:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201558.387124:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc148a806c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201558.394990:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b3480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727841536:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201558.395034:0:23731:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc146028380 x1875064727840896/t8589937089(8589937089) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201574 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201558.395119:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201558.395142:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201558.395162:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 211 lru_type: 1 00010000:00010000:1.0:1788201558.395183:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 211 lru_type: 1 00000080:00200000:1.0:1788201558.395192:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201558.395198:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201558.395202:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201558.395220:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201558.395225:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 211 lru_type: 1 00010000:00010000:1.0:1788201558.395234:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 212 lru_type: 1 00000080:00200000:1.0:1788201558.395250:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201558.395258:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201558.395264:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201558.395267:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=run_tar.sh, flags=8 00000080:00200008:1.0:1788201558.395277:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file run_tar.sh:[0x200000bd7:0x119:0x0](ffff8bc144659988), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201558.395282:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x119:0x0](ffff8bc144659988),name=run_tar.sh 00000002:00010000:1.0:1788201558.395518:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x119:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201558.395529:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201558.395540:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201558.395545:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201558.395549:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x119:0x0](ffff8bc144659988) 00000080:00010000:1.0:1788201558.395551:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x119:0x0](ffff8bc144659988) for lock 0xd138388016f6e96a 00000080:00010000:1.0:1788201558.395555:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e96a from it ffffadd1c7da3cb8 00010000:00010000:1.0:1788201558.395557:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201558.395562:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201558.395606:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x119:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201558.395618:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x119:0x0] 00000008:00010000:1.0:1788201558.395651:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201558.395656:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc151a50230, osc lock ffff8bc145d097c0, flags 0x400001002 00010000:00010000:1.0:1788201558.395674:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x193:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.395683:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201558.395693:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201558.395696:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.395701:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201558.395708:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201558.395716:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x119:0x0] updating i_size 1654 i_blocks 1 00000020:00010000:1.0:1788201558.395720:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e26060 (ffff8bc148e3b638/0) at cl_lock_release():245 00000020:00010000:1.0:1788201558.395721:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e26060 (ffff8bc148e3b638/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201558.395723:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151a50230 (ffff8bc148e3b6c8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201558.395726:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e26060 (ffff8bc148e3b638/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201558.395728:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151a50230 (ffff8bc148e3b638/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201558.395760:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x119:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201558.395865:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201558.395874:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201558.395882:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 212 lru_type: 1 00010000:00010000:1.0:1788201558.395890:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 212 lru_type: 1 00000080:00200000:1.0:1788201558.395897:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201558.395900:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201558.395903:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201558.395906:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201558.395909:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 212 lru_type: 1 00010000:00010000:1.0:1788201558.395916:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 213 lru_type: 1 00000080:00200000:1.0:1788201558.395925:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201558.395930:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201558.395933:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201558.395946:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-benchmark.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=9 00000080:00200000:1.0:1788201558.395950:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-benchmark.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:1.0:1788201558.395959:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-benchmark.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201558.396015:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e97f lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.396024:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e97f lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.396034:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e97f lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201558.396057:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727841664:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201558.396154:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc148a806c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201558.403443:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727841664:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201558.403465:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e97f lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.403475:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e97f lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.403482:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e97f lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.403489:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e97f lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.403498:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e97f lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.403504:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14a778400 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201558.403510:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e97f lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.403517:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e97f lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.403525:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e97f lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.403532:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201558.403539:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e97f lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.403544:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e97f lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201558.403559:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1725b1f80 x1875064727841664/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201574 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201558.403570:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201558.403593:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:1.0:1788201558.403660:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201558.403674:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201558.403681:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 213 lru_type: 1 00010000:00010000:1.0:1788201558.403690:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 213 lru_type: 1 00000080:00200000:1.0:1788201558.403695:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201558.403699:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201558.403702:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201558.403706:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201558.403708:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 213 lru_type: 1 00010000:00010000:1.0:1788201558.403714:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 214 lru_type: 1 00000080:00200000:1.0:1788201558.403725:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201558.403731:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201558.403735:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201558.403743:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-benchmark.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=8 00000080:00200000:1.0:1788201558.403746:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-benchmark.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:1.0:1788201558.403755:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-benchmark.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201558.403831:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778e00/0xd138388016f6e986 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.403839:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778e00/0xd138388016f6e986 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.403849:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778e00/0xd138388016f6e986 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201558.403870:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727841792:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201558.403947:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc148a806c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201558.414408:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727841792:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201558.414432:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778e00/0xd138388016f6e986 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.414449:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778e00/0xd138388016f6e986 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.414456:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778e00/0xd138388016f6e986 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.414464:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778e00/0xd138388016f6e986 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.414473:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778e00/0xd138388016f6e986 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.414479:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14a778e00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201558.414484:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778e00/0xd138388016f6e986 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.414491:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778e00/0xd138388016f6e986 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.414498:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778e00/0xd138388016f6e986 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.414505:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201558.414511:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778e00/0xd138388016f6e986 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.414518:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778e00/0xd138388016f6e986 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201558.414538:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1725b1f80 x1875064727841792/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201574 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201558.414555:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201558.414577:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:1.0:1788201558.414672:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201558.414686:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201558.414693:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 214 lru_type: 1 00010000:00010000:1.0:1788201558.414702:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 214 lru_type: 1 00000080:00200000:1.0:1788201558.414707:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201558.414710:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201558.414713:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201558.414717:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3bf8 00010000:00010000:1.0:1788201558.414719:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 214 lru_type: 1 00010000:00010000:1.0:1788201558.414724:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 215 lru_type: 1 00000080:00200000:1.0:1788201558.414735:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201558.414741:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201558.414745:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201558.414753:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201558.414757:0:23731:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sanity-benchmark.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), file ffff8bc153aa8a80, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:1.0:1788201558.414763:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-benchmark.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000002:00010000:1.0:1788201558.414781:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-benchmark.sh,[0x200000bd7:0x11a:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201558.414864:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.414871:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201558.414882:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201558.414888:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b1f80 x1875064727842048/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201558.414896:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201558.414914:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727842048:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201558.415109:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc148a806c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201558.420854:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727842048:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201558.420884:0:23731:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.420907:0:23731:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x11a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.420914:0:23731:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.420926:0:23731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.420940:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.420953:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.420972:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.420988:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201558.421000:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1725b1f80 x1875064727842048/t8589937091(8589937091) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201574 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201558.421013:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725b1f80 x1875064727842048/t8589937091(8589937091) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201574 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201558.421027:0:23731:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201558.421040:0:23731:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.421051:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/282 (0 0) 00000080:00200000:1.0:1788201558.421058:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201558.421076:0:23731:0:(namei.c:1628:ll_create_it()) VFS Op:name=sanity-benchmark.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000080:00200000:1.0:1788201558.421113:0:23731:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x11a:0x0](ffff8bc14465cb08) 00000080:00200000:1.0:1788201558.421257:0:23731:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x11a:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201558.421268:0:23731:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x11a:0x0](ffff8bc14465cb08) 00000080:00010000:1.0:1788201558.421272:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x11a:0x0](ffff8bc14465cb08) for lock 0xd138388016f6e98d 00000080:00010000:1.0:1788201558.421282:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x11a:0x0](ffff8bc14465cb08) 00000080:00200008:1.0:1788201558.421307:0:23731:0:(file.c:1090:ll_file_open()) START file sanity-benchmark.sh:[0x200000bd7:0x11a:0x0](ffff8bc14465cb08), flags 100301 00000002:00100000:1.0:1788201558.421326:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725b1f80 x1875064727842048/t8589937091(8589937091) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201574 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201558.421375:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e98d from it ffff8bc1466cdcc0 00010000:00010000:1.0:1788201558.421380:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.421389:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201558.421412:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x11a:0x0](ffff8bc14465cb08), inode mode 81a4 mask 40 00000080:00200008:1.0:1788201558.421438:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file sanity-benchmark.sh:[0x200000bd7:0x11a:0x0](ffff8bc14465cb08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201558.421445:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x11a:0x0](ffff8bc14465cb08),name=sanity-benchmark.sh 00000002:00010000:1.0:1788201558.421463:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x11a:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201558.421473:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.421483:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201558.421490:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201558.421495:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x11a:0x0](ffff8bc14465cb08) 00000080:00010000:1.0:1788201558.421498:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x11a:0x0](ffff8bc14465cb08) for lock 0xd138388016f6e98d 00000080:00010000:1.0:1788201558.421502:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e98d from it ffffadd1c7da3cd8 00010000:00010000:1.0:1788201558.421505:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.421512:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201558.421538:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x11a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201558.421549:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x11a:0x0] 00000008:00010000:1.0:1788201558.421575:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201558.421579:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc151a50eb0, osc lock ffff8bc145d097c0, flags 0x400001002 00010000:00010000:1.0:1788201558.421625:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6e994 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.421635:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6e994 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201558.421665:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1788201558.422124:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727842176:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201558.426973:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6e994 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.427010:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6e994 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094afd expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.427025:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6e994 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094afd expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.427038:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6e994 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094afd expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201558.427057:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6e994 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094afd expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201558.427072:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201558.427087:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6e994 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094afd expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.427115:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6e994 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094afd expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.427124:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6e994 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094afd expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.427134:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6e994 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171094afd expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201558.427496:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x11a:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201558.427504:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e26060 (ffff8bc148e3b638/0) at cl_lock_release():245 00000020:00010000:1.0:1788201558.427507:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e26060 (ffff8bc148e3b638/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201558.427513:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151a50eb0 (ffff8bc148e3b6c8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201558.427517:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e26060 (ffff8bc148e3b638/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201558.427521:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151a50eb0 (ffff8bc148e3b638/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201558.427560:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x11a:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201558.427622:0:23731:0:(file.c:2638:do_file_write_iter()) START file sanity-benchmark.sh:[0x200000bd7:0x11a:0x0], ppos: 0, count: 6548 00000080:00200000:1.0:1788201558.427653:0:23731:0:(file.c:2090:ll_file_io_generic()) sanity-benchmark.sh: write ppos: 0, bytes: 6548 00000080:00200000:1.0:1788201558.427660:0:23731:0:(file.c:1848:ll_io_set_mirror()) sanity-benchmark.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201558.427665:0:23731:0:(cl_io.c:214:cl_io_rw_init()) header@00000000718fb336[0x110, 1, [0x200000bd7:0x11a:0x0] hash] 00000020:00200000:1.0:1788201558.427668:0:23731:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 6548) 0 0 00000080:00200000:1.0:1788201558.427672:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x11a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201558.427687:0:23731:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 1] 00020000:00200000:1.0:1788201558.427695:0:23731:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 6548) 6548, 6548 00020000:00200000:1.0:1788201558.427700:0:23731:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201558.427730:0:23731:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 1] 00000008:00010000:1.0:1788201558.427744:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201558.427750:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc151a50eb0, osc lock ffff8bc145d097c0, flags 0x0 00010000:00010000:1.0:1788201558.427765:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/404 (0 8191) 00010000:00010000:1.0:1788201558.427849:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fff55c5/0xd138388016f6e99b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x194:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.427860:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fff55c5/0xd138388016f6e99b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x194:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.427870:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fff55c5/0xd138388016f6e99b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x194:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201558.427892:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727842304:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201558.428285:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727842176:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201558.433523:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201558.433637:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743440512 00000100:00100000:3.0:1788201558.433648:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743440512 00000100:00100000:3.0:1788201558.433753:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 570 00000100:00100000:3.0:1788201558.433773:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:28099:x1875064743440512:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201558.433827:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6e994 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x194:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094afd expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.433907:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201558.433915:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:28099:x1875064743440512:12345-192.168.201.143@tcp:104: Request processed in 154us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201558.433923:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 570 00010000:00010000:1.0:1788201558.434184:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201558.434192:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6e994 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x194:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094afd expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.434203:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14a778e00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201558.434217:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6e994 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x194:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171094afd expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201558.434275:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x11a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201558.434289:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x11a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201558.434354:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6e994 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x194:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094afd expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.434369:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201558.434396:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6e994 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x194:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094afd expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.434404:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6e994 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x194:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094afd expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.434420:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201558.434421:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201558.434423:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201558.434430:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201558.434443:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727842432:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201558.442661:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201558.450373:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727842432:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201558.488911:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743440896 00000100:00100000:3.0:1788201558.488925:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743440896 00000100:00100000:3.0:1788201558.489002:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 572 00000100:00100000:3.0:1788201558.489013:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172708a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23390:x1875064743440896:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201558.489033:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6e9b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x194:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094b58 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.489584:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201558.489593:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172708a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23390:x1875064743440896:12345-192.168.201.143@tcp:104: Request processed in 581us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201558.489601:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 572 00010000:00010000:3.0:1788201558.489639:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201558.489646:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6e9b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x194:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094b58 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.489656:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149eb7800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201558.489662:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6e9b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x194:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171094b58 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201558.489719:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x11b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201558.489733:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x11b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201558.489833:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6e9b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x194:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094b58 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.489841:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201558.489863:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6e9b7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x194:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094b58 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.489877:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6e9b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x194:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094b58 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.489893:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201558.489895:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201558.489897:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201558.489915:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727843584:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201558.494115:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172709f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727843456:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201558.494148:0:23731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000096aa1f32/0xd138388016f6e9be lrc: 4/0,1 mode: --/PW res: [0x240000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171094b5f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.494173:0:23731:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000096aa1f32/0xd138388016f6e9be lrc: 4/0,1 mode: --/PW res: [0x240000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094b5f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.494182:0:23731:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000096aa1f32/0xd138388016f6e9be lrc: 4/0,1 mode: --/PW res: [0x240000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094b5f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201558.496521:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743441024 00000100:00100000:3.0:1788201558.496531:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743441024 00000100:00100000:3.0:1788201558.496588:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 573 00000100:00100000:3.0:1788201558.496599:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14602b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21004:x1875064743441024:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201558.496615:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000096aa1f32/0xd138388016f6e9be lrc: 5/0,1 mode: --/PW res: [0x240000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094b5f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.496632:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000096aa1f32/0xd138388016f6e9be lrc: 5/0,1 mode: --/PW res: [0x240000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094b5f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.496642:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000096aa1f32/0xd138388016f6e9be lrc: 5/0,1 mode: --/PW res: [0x240000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171094b5f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.496653:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000096aa1f32/0xd138388016f6e9be lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171094b5f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.496662:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000096aa1f32/0xd138388016f6e9be lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171094b5f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.496672:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000096aa1f32/0xd138388016f6e9be lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171094b5f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.496708:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc149f3d600) 00000100:00100000:3.0:1788201558.496935:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14602b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21004:x1875064743441024:12345-192.168.201.143@tcp:105: Request processed in 170us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201558.496946:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 573 00000100:00100000:3.0:1788201558.505026:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727843584:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201558.528995:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727844480:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201558.535466:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892703bf/0xd138388016f6e9da lrc: 6/2,0 mode: --/PR res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.535493:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892703bf/0xd138388016f6e9da lrc: 6/2,0 mode: --/PR res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094bb3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.535515:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892703bf/0xd138388016f6e9da lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094bb3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.535529:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892703bf/0xd138388016f6e9da lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094bb3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201558.535545:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892703bf/0xd138388016f6e9da lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094bb3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201558.535558:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1788201558.535623:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892703bf/0xd138388016f6e9da lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094bb3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.535634:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892703bf/0xd138388016f6e9da lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094bb3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.535642:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892703bf/0xd138388016f6e9da lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094bb3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.535652:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892703bf/0xd138388016f6e9da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171094bb3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201558.535674:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727844480:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201558.541935:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743441152 00000100:00100000:3.0:1788201558.541944:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743441152 00010000:00010000:3.0:1788201558.542380:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201558.542388:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892703bf/0xd138388016f6e9da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x195:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094bb3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.542403:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149eb6a00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201558.542409:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892703bf/0xd138388016f6e9da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x195:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171094bb3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201558.542465:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x11c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201558.542479:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x11c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201558.542543:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892703bf/0xd138388016f6e9da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x195:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094bb3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.542551:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201558.542575:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892703bf/0xd138388016f6e9da lrc: 1/0,0 mode: --/PR res: [0x280000400:0x195:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094bb3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.542584:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892703bf/0xd138388016f6e9da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x195:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094bb3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.542600:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201558.542602:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201558.542604:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201558.542621:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727844736:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201558.546307:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201558.550392:0:21781:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788201558.550427:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743441280 00000100:00100000:1.0:1788201558.550438:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743441280 00000100:00100000:1.0:1788201558.550502:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 575 00000100:00100000:1.0:1788201558.550514:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc146015450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23412:x1875064743441280:12345-192.168.201.143@tcp:105: 00010000:00010000:1.0:1788201558.550534:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.550549:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.550559:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.550573:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.550585:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.550599:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.550619:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc149eb6c00) 00000100:00100000:1.0:1788201558.550714:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc146015450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23412:x1875064743441280:12345-192.168.201.143@tcp:105: Request processed in 201us (4426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201558.550727:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 575 00000100:00100000:3.0:1788201558.553163:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602a300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727844608:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201558.553195:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.553225:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201558.553239:0:23731:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.553252:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.553261:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201558.553289:0:23731:0:(vvp_io.c:1292:vvp_io_write_start()) sanity-dom.sh: write [0, 6821) append 0 append lockpos 0 00000080:00200000:3.0:1788201558.553496:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.553544:0:23731:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:3.0:1788201558.553556:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000db1296d4[3 0000000081a9f3df 2 1 000000007aed2f44 0 0 0] 00000080:00200000:3.0:1788201558.553560:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000053dfb2ba 17ffffc0001001 3:0 ffff8bc1506cc540 0 lru 00000080:00200000:3.0:1788201558.553568:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000002aa0c42a 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 00000000486df03a > 3< 0 0 > 4< 0 0 8 25559040 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.553570:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000db1296d4 00000080:00200000:3.0:1788201558.553572:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201558.553575:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 2725 bytes 00000080:00200000:3.0:1788201558.553605:0:23731:0:(rw26.c:898:ll_write_end()) pos 4096, len 2725, copied 2725 00000080:00200000:3.0:1788201558.553610:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000ffb594ba[3 0000000081a9f3df 2 1 000000007aed2f44 0 0 1] 00000080:00200000:3.0:1788201558.553613:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000e658fc00 17ffffc0001001 3:0 ffff8bc1506cca80 1 lru 00000080:00200000:3.0:1788201558.553617:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000718f13da 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 00000000486df03a > 3< 0 0 > 4< 0 0 8 25559040 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.553619:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000ffb594ba 00000080:00200000:3.0:1788201558.553621:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:3.0:1788201558.553624:0:23731:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 2, from 0, to 2725 prio 0 00000008:00010000:3.0:1788201558.553644:0:23731:0:(osc_cache.c:857:osc_extent_find()) ### extent: 0000000014c5a66b ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201558.553665:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145986578, count 2, dirtied 2 00000080:00200000:3.0:1788201558.553671:0:23731:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 2 pages 6821 bytes, tot: 6821 00000080:00200000:3.0:1788201558.553674:0:23731:0:(vvp_io.c:1358:vvp_io_write_start()) sanity-dom.sh: write bytes 0, result: 6821 00000020:00010000:3.0:1788201558.553690:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1498447b8 (ffff8bc1469197e8/0) at cl_lock_release():245 00000020:00010000:3.0:1788201558.553694:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1498447b8 (ffff8bc1469197e8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201558.553699:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151240bb0 (ffff8bc1469196c8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1788201558.553703:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.553713:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1788201558.553729:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1498447b8 (ffff8bc1469197e8/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201558.553732:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151240bb0 (ffff8bc1469197e8/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201558.553741:0:23731:0:(vvp_io.c:533:vvp_io_advance()) advancing 6821 bytes 00000080:00200000:3.0:1788201558.553749:0:23731:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 1] 00000080:00200000:3.0:1788201558.553819:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x11c:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201558.553824:0:23731:0:(file.c:2238:ll_file_io_generic()) sanity-dom.sh: 2 io complete with rc: 0, result: 6821, restart: 0 00000080:00200000:3.0:1788201558.553832:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x11c:0x0] updating i_size 6821 i_blocks 1 00000080:00200000:3.0:1788201558.553837:0:23731:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 6821 00000080:00200008:3.0:1788201558.553881:0:23731:0:(file.c:479:ll_file_release()) START file sanity-dom.sh:[0x200000bd7:0x11c:0x0](ffff8bc1459863c8), flags 100001 00000002:00100000:3.0:1788201558.553942:0:23731:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc14602b100 x1875064727844352/t8589937095(8589937095) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201574 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1788201558.553955:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1788201558.553960:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146c5aa00 x1875064727844992/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1788201558.553995:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c5aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727844992:192.168.201.143@tcp:35:cp.0 00000100:00100000:3.0:1788201558.554085:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1450a6300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201558.554453:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727844736:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201558.558961:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c5aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727844992:192.168.201.143@tcp:35:cp.0 00000002:00100000:3.0:1788201558.559009:0:23731:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc14602b100 x1875064727844352/t8589937095(8589937095) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201574 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201558.559088:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201558.559107:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201558.559278:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 223 lru_type: 1 00010000:00010000:3.0:1788201558.559359:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 223 lru_type: 1 00000080:00200000:3.0:1788201558.559370:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201558.559376:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201558.559380:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201558.559388:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201558.559392:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 223 lru_type: 1 00010000:00010000:3.0:1788201558.559402:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 224 lru_type: 1 00000080:00200000:3.0:1788201558.559425:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201558.559432:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201558.559439:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201558.559443:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-dom.sh, flags=8 00000080:00200008:3.0:1788201558.559450:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file sanity-dom.sh:[0x200000bd7:0x11c:0x0](ffff8bc1459863c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201558.559455:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x11c:0x0](ffff8bc1459863c8),name=sanity-dom.sh 00000002:00010000:3.0:1788201558.559466:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x11c:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201558.559475:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6e00/0xd138388016f6e9d3 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x11c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094ba5 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201558.559484:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6e00/0xd138388016f6e9d3 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x11c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094ba5 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201558.559490:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201558.559494:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x11c:0x0](ffff8bc1459863c8) 00000080:00010000:3.0:1788201558.559496:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x11c:0x0](ffff8bc1459863c8) for lock 0xd138388016f6e9d3 00000080:00010000:3.0:1788201558.559500:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e9d3 from it ffffadd1c7da3cb8 00010000:00010000:3.0:1788201558.559503:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6e00/0xd138388016f6e9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x11c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094ba5 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201558.559510:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6e00/0xd138388016f6e9d3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x11c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094ba5 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201558.559561:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x11c:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201558.559572:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x11c:0x0] 00000008:00010000:3.0:1788201558.559604:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201558.559609:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1440082b0, osc lock ffff8bc14691ad10, flags 0x400001002 00010000:00010000:3.0:1788201558.559627:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.559639:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:3.0:1788201558.559652:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1788201558.559656:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.559663:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1788201558.559673:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1788201558.559684:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x11c:0x0] updating i_size 6821 i_blocks 1 00000020:00010000:3.0:1788201558.559689:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc72e0 (ffff8bc1460e9368/0) at cl_lock_release():245 00000020:00010000:3.0:1788201558.559692:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc72e0 (ffff8bc1460e9368/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201558.559695:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1440082b0 (ffff8bc1460e9248/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201558.559698:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc72e0 (ffff8bc1460e9368/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201558.559701:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1440082b0 (ffff8bc1460e9368/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201558.559729:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x11c:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:1.0:1788201558.580444:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17270b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727845632:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201558.583754:0:10055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6e9fd lrc: 6/2,0 mode: --/PR res: [0x240000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.583783:0:10055:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6e9fd lrc: 6/2,0 mode: --/PR res: [0x240000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094c0e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.583886:0:10055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6e9fd lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094c0e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.583902:0:10055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6e9fd lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094c0e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201558.583921:0:10055:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6e9fd lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094c0e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201558.583934:0:10055:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1788201558.584008:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6e9fd lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094c0e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.584018:0:10055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6e9fd lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094c0e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.584026:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6e9fd lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094c0e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.584035:0:10055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6e9fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171094c0e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201558.584056:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17270b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727845632:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201558.587226:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201558.587235:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6e9fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x195:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094c0e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.587244:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3c600 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201558.587250:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6e9fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x195:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171094c0e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201558.587301:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x11d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201558.587314:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x11d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201558.587490:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6e9fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x195:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094c0e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.587499:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201558.587532:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6e9fd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x195:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094c0e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.587541:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6e9fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x195:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094c0e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.587564:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201558.587565:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201558.587566:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201558.591970:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743441536 00000100:00100000:3.0:1788201558.591988:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743441536 00000100:00100000:3.0:1788201558.629063:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201558.629081:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727846784:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201558.641401:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201558.643549:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201558.643570:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727847040:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201558.674344:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727847040:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201558.718906:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201558.718923:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727847936:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201558.727033:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743441920 00000100:00100000:1.0:1788201558.727044:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743441920 00000100:00100000:1.0:1788201558.727137:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 580 00000100:00100000:1.0:1788201558.727147:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17270b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:28099:x1875064743441920:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201558.727175:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f1e1fa05/0xd138388016f6ea43 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x196:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094cc4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.727271:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201558.727279:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17270b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:28099:x1875064743441920:12345-192.168.201.143@tcp:104: Request processed in 133us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201558.727286:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 580 00000100:00100000:3.0:1788201558.727534:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727848192:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201558.730868:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201558.731180:0:20877:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788201558.731289:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743442048 00000100:00100000:1.0:1788201558.731296:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743442048 00000100:00100000:1.0:1788201558.731388:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 581 00000100:00100000:1.0:1788201558.731397:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc149fa7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23412:x1875064743442048:12345-192.168.201.143@tcp:105: 00010000:00010000:1.0:1788201558.731405:0:20877:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6ea4a lrc: 5/0,1 mode: --/PW res: [0x240000400:0x196:0x0].0x0 rrc: 2 type: EXT [0->172031] (req 0->172031) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094ccb expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.731415:0:20877:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6ea4a lrc: 5/0,1 mode: --/PW res: [0x240000400:0x196:0x0].0x0 rrc: 2 type: EXT [0->172031] (req 0->172031) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094ccb expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.731421:0:20877:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6ea4a lrc: 5/0,1 mode: --/PW res: [0x240000400:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171094ccb expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.731427:0:20877:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6ea4a lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171094ccb expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.731433:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6ea4a lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171094ccb expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.731440:0:20877:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6ea4a lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171094ccb expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.731456:0:20877:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc149eb7800) 00000100:00100000:1.0:1788201558.731554:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc149fa7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23412:x1875064743442048:12345-192.168.201.143@tcp:105: Request processed in 158us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201558.731561:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 581 00000100:00100000:1.0:1788201558.736329:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727848192:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201558.754086:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727849088:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201558.757702:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000078855fdf/0xd138388016f6ea66 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.757742:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000078855fdf/0xd138388016f6ea66 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094d1f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.757753:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000078855fdf/0xd138388016f6ea66 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094d1f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.757767:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000078855fdf/0xd138388016f6ea66 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094d1f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201558.757778:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000078855fdf/0xd138388016f6ea66 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094d1f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201558.757787:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1788201558.757826:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000078855fdf/0xd138388016f6ea66 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094d1f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.757836:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000078855fdf/0xd138388016f6ea66 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094d1f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.757844:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000078855fdf/0xd138388016f6ea66 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094d1f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.757853:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000078855fdf/0xd138388016f6ea66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171094d1f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201558.757878:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727849088:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201558.761877:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743442176 00000100:00100000:1.0:1788201558.761887:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743442176 00000100:00100000:1.0:1788201558.762052:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 582 00000100:00100000:1.0:1788201558.762063:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17270aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23390:x1875064743442176:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201558.762082:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000078855fdf/0xd138388016f6ea66 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x197:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094d1f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.762660:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201558.762667:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17270aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23390:x1875064743442176:12345-192.168.201.143@tcp:104: Request processed in 607us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201558.762673:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 582 00000100:00100000:1.0:1788201558.763416:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201558.763434:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727849344:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201558.765987:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201558.766068:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743442304 00000100:00100000:1.0:1788201558.766076:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743442304 00000100:00100000:1.0:1788201558.766130:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 583 00000100:00100000:1.0:1788201558.766141:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc146c58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21003:x1875064743442304:12345-192.168.201.143@tcp:105: 00010000:00010000:1.0:1788201558.766164:0:20877:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f1e1fa05/0xd138388016f6ea6d lrc: 5/0,1 mode: --/PW res: [0x280000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094d26 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.766177:0:20877:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f1e1fa05/0xd138388016f6ea6d lrc: 5/0,1 mode: --/PW res: [0x280000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094d26 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.766192:0:20877:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f1e1fa05/0xd138388016f6ea6d lrc: 5/0,1 mode: --/PW res: [0x280000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171094d26 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.766203:0:20877:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f1e1fa05/0xd138388016f6ea6d lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171094d26 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.766213:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f1e1fa05/0xd138388016f6ea6d lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171094d26 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.766224:0:20877:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f1e1fa05/0xd138388016f6ea6d lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171094d26 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.766254:0:20877:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc149eb7200) 00000100:00100000:1.0:1788201558.766320:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc146c58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21003:x1875064743442304:12345-192.168.201.143@tcp:105: Request processed in 181us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201558.766327:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 583 00000100:00100000:1.0:1788201558.769056:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727849344:192.168.201.143@tcp:103:ldlm_bl.0 00000080:00200000:3.0:1788201558.790619:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x121:0x0] updating i_size 0 i_blocks 1 00000020:00010000:3.0:1788201558.790625:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc146007090 (ffff8bc1469197e8/0) at cl_lock_release():245 00000020:00010000:3.0:1788201558.790628:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146007090 (ffff8bc1469197e8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201558.790632:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261dd30 (ffff8bc1469196c8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201558.790635:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146007090 (ffff8bc1469197e8/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201558.790638:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261dd30 (ffff8bc1469197e8/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201558.790673:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x121:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1788201558.790981:0:23731:0:(file.c:2638:do_file_write_iter()) START file sanity-lfsck.sh:[0x200000bd7:0x121:0x0], ppos: 0, count: 215293 00000080:00200000:3.0:1788201558.791014:0:23731:0:(file.c:2090:ll_file_io_generic()) sanity-lfsck.sh: write ppos: 0, bytes: 215293 00000080:00200000:3.0:1788201558.791019:0:23731:0:(file.c:1848:ll_io_set_mirror()) sanity-lfsck.sh: desiginated mirror: 0 00000020:00200000:3.0:1788201558.791442:0:23731:0:(cl_io.c:214:cl_io_rw_init()) header@00000000db0a24df[0x110, 1, [0x200000bd7:0x121:0x0] hash] 00000020:00200000:3.0:1788201558.791445:0:23731:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 215293) 0 0 00000080:00200000:3.0:1788201558.791449:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x121:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201558.791464:0:23731:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 52] 00020000:00200000:3.0:1788201558.791473:0:23731:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 215293) 215293, 215293 00020000:00200000:3.0:1788201558.791477:0:23731:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1788201558.791512:0:23731:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 52] 00000008:00010000:3.0:1788201558.791528:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1788201558.791532:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1440082b0, osc lock ffff8bc14691ad10, flags 0x0 00010000:00010000:3.0:1788201558.791550:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/407 (0 217087) 00010000:00010000:3.0:1788201558.791593:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x197:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.791602:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x197:0x0].0x0 rrc: 3 type: EXT [0->217087] (req 0->217087) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.791613:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x197:0x0].0x0 rrc: 3 type: EXT [0->217087] (req 0->217087) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201558.791637:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c59880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727850368:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201558.791740:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1450a6300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201558.793760:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201558.793921:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743442432 00000100:00100000:1.0:1788201558.793931:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743442432 00000100:00100000:1.0:1788201558.793997:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 584 00000100:00100000:1.0:1788201558.794009:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc146c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23416:x1875064743442432:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201558.794026:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006878b912/0xd138388016f6ea89 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x197:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094d7a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.794149:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201558.794156:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc146c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23416:x1875064743442432:12345-192.168.201.143@tcp:104: Request processed in 151us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201558.794164:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 584 00000100:00100000:1.0:1788201558.794665:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727850496:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201558.796474:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c59880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727850368:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201558.796495:0:23731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->217087] (req 0->217087) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.796504:0:23731:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->217087] (req 0->217087) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.796509:0:23731:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->217087] (req 0->217087) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201558.797335:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:3.0:1788201558.797543:0:23731:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.797552:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.797566:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201558.797585:0:23731:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.797597:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.797606:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201558.797632:0:23731:0:(vvp_io.c:1292:vvp_io_write_start()) sanity-lfsck.sh: write [0, 215293) append 0 append lockpos 0 00000080:00200000:3.0:1788201558.797650:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.797697:0:23731:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:3.0:1788201558.797710:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000060397496[3 000000008d37f26a 2 1 00000000a46cf215 0 0 0] 00000080:00200000:3.0:1788201558.797713:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000cf228cc8 17ffffc0001001 3:0 ffff8bc1506cc0e0 0 lru 00000080:00200000:3.0:1788201558.797721:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b6db996a 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.797723:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000060397496 00000080:00200000:3.0:1788201558.797724:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201558.797727:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.797754:0:23731:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:3.0:1788201558.797759:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000b89b0644[3 000000008d37f26a 2 1 00000000a46cf215 0 0 1] 00000080:00200000:3.0:1788201558.797762:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000151f2602 17ffffc0001001 3:0 ffff8bc148decb60 1 lru 00000080:00200000:3.0:1788201558.797768:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000004bea21ea 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.797770:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000b89b0644 00000080:00200000:3.0:1788201558.797771:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:3.0:1788201558.797773:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.798061:0:23731:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:3.0:1788201558.798066:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000f0318971[3 000000008d37f26a 2 1 00000000a46cf215 0 0 2] 00000080:00200000:3.0:1788201558.798070:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000cae70df5 17ffffc0001001 3:0 ffff8bc148dec2a0 2 lru 00000080:00200000:3.0:1788201558.798074:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000003029b15d 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.798077:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000f0318971 00000080:00200000:3.0:1788201558.798078:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:3.0:1788201558.798080:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.798158:0:23731:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:3.0:1788201558.798163:0:23731:0:(rw26.c:956:ll_write_end()) page@000000009ba8a800[3 000000008d37f26a 2 1 00000000a46cf215 0 0 3] 00000080:00200000:3.0:1788201558.798166:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000006800daed 17ffffc0001001 3:0 ffff8bc148dec460 3 lru 00000080:00200000:3.0:1788201558.798171:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000f5efb6da 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.798173:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000009ba8a800 00000080:00200000:3.0:1788201558.798175:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:3.0:1788201558.798177:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.798191:0:23731:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:3.0:1788201558.798196:0:23731:0:(rw26.c:956:ll_write_end()) page@000000002a136ef7[3 000000008d37f26a 2 1 00000000a46cf215 0 0 4] 00000080:00200000:3.0:1788201558.798198:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000032725064 17ffffc0001001 3:0 ffff8bc148dec8c0 4 lru 00000080:00200000:3.0:1788201558.798266:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000002db88535 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.798270:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000002a136ef7 00000080:00200000:3.0:1788201558.798271:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:3.0:1788201558.798274:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.798291:0:23731:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:3.0:1788201558.798295:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000d565cb3e[3 000000008d37f26a 2 1 00000000a46cf215 0 0 5] 00000080:00200000:3.0:1788201558.798298:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000cf1888cf 17ffffc0001001 3:0 ffff8bc148dece00 5 lru 00000080:00200000:3.0:1788201558.798303:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000003024ae0 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.798305:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000d565cb3e 00000080:00200000:3.0:1788201558.798306:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:3.0:1788201558.798308:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.798324:0:23731:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:3.0:1788201558.798328:0:23731:0:(rw26.c:956:ll_write_end()) page@000000009e25b6e9[3 000000008d37f26a 2 1 00000000a46cf215 0 0 6] 00000080:00200000:3.0:1788201558.798331:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000009dd25f21 17ffffc0001001 3:0 ffff8bc148decee0 6 lru 00000080:00200000:3.0:1788201558.798336:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000089fded6 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.798339:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000009e25b6e9 00000080:00200000:3.0:1788201558.798340:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:3.0:1788201558.798342:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.798368:0:23731:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:3.0:1788201558.798376:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000001a1e9fc[3 000000008d37f26a 2 1 00000000a46cf215 0 0 7] 00000080:00200000:3.0:1788201558.798379:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000009d3e9448 17ffffc0001001 3:0 ffff8bc148dec620 7 lru 00000080:00200000:3.0:1788201558.798385:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000077d1c923 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.798387:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000001a1e9fc 00000080:00200000:3.0:1788201558.798388:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:3.0:1788201558.798390:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.798404:0:23731:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:3.0:1788201558.798408:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000a043db63[3 000000008d37f26a 2 1 00000000a46cf215 0 0 8] 00000080:00200000:3.0:1788201558.798411:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000a7d44451 17ffffc0001001 3:0 ffff8bc148dec7e0 8 lru 00000080:00200000:3.0:1788201558.798417:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000007046de9 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.798419:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000a043db63 00000080:00200000:3.0:1788201558.798420:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:3.0:1788201558.798422:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.798439:0:23731:0:(rw26.c:898:ll_write_end()) pos 36864, len 4096, copied 4096 00000080:00200000:3.0:1788201558.798442:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000ed28b14a[3 000000008d37f26a 2 1 00000000a46cf215 0 0 9] 00000080:00200000:3.0:1788201558.798445:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000000849bc96 17ffffc0001021 2:0 ffff8bc148dec700 9 lru 00000080:00200000:3.0:1788201558.798450:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000f02dbc67 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.798452:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000ed28b14a 00000080:00200000:3.0:1788201558.798454:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:3.0:1788201558.798455:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 10 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.798466:0:23731:0:(rw26.c:898:ll_write_end()) pos 40960, len 4096, copied 4096 00000080:00200000:3.0:1788201558.798470:0:23731:0:(rw26.c:956:ll_write_end()) page@000000008be580e6[3 000000008d37f26a 2 1 00000000a46cf215 0 0 10] 00000080:00200000:3.0:1788201558.798473:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000008a4d7699 17ffffc0001001 3:0 ffff8bc148decd20 10 lru 00000080:00200000:3.0:1788201558.798478:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000deb0dfe0 10: 1< 0 - - > 2< 40960 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.798480:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000008be580e6 00000080:00200000:3.0:1788201558.798481:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 11. 00000080:00200000:3.0:1788201558.798483:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 11 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.798492:0:23731:0:(rw26.c:898:ll_write_end()) pos 45056, len 4096, copied 4096 00000080:00200000:3.0:1788201558.798495:0:23731:0:(rw26.c:956:ll_write_end()) page@000000003b0d458e[3 000000008d37f26a 2 1 00000000a46cf215 0 0 11] 00000080:00200000:3.0:1788201558.798498:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000d1648d8b 17ffffc0001001 3:0 ffff8bc148dec000 11 lru 00000080:00200000:3.0:1788201558.798504:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000012840271 11: 1< 0 - - > 2< 45056 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.798506:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000003b0d458e 00000080:00200000:3.0:1788201558.798507:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 12. 00000080:00200000:3.0:1788201558.798508:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 12 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.798517:0:23731:0:(rw26.c:898:ll_write_end()) pos 49152, len 4096, copied 4096 00000080:00200000:3.0:1788201558.798520:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000088d4339[3 000000008d37f26a 2 1 00000000a46cf215 0 0 12] 00000080:00200000:3.0:1788201558.798523:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000003fb2e4d1 17ffffc0001001 3:0 ffff8bc148dec380 12 lru 00000080:00200000:3.0:1788201558.798528:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000093de627e 12: 1< 0 - - > 2< 49152 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.798529:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000088d4339 00000080:00200000:3.0:1788201558.798530:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 13. 00000080:00200000:3.0:1788201558.798532:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 13 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.798541:0:23731:0:(rw26.c:898:ll_write_end()) pos 53248, len 4096, copied 4096 00000080:00200000:3.0:1788201558.798544:0:23731:0:(rw26.c:956:ll_write_end()) page@000000000484e7e5[3 000000008d37f26a 2 1 00000000a46cf215 0 0 13] 00000080:00200000:3.0:1788201558.798547:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000008a473ca3 17ffffc0001001 3:0 ffff8bc148dec1c0 13 lru 00000080:00200000:3.0:1788201558.798553:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000000ba7cbd1 13: 1< 0 - - > 2< 53248 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.798554:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000000484e7e5 00000080:00200000:3.0:1788201558.798556:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 14. 00000080:00200000:3.0:1788201558.798557:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 14 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.798566:0:23731:0:(rw26.c:898:ll_write_end()) pos 57344, len 4096, copied 4096 00000080:00200000:3.0:1788201558.798570:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000c2210f6f[3 000000008d37f26a 2 1 00000000a46cf215 0 0 14] 00000080:00200000:3.0:1788201558.798572:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000005ccb005e 17ffffc0001001 3:0 ffff8bc148dec0e0 14 lru 00000080:00200000:3.0:1788201558.798578:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000f9b9eba6 14: 1< 0 - - > 2< 57344 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.798580:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000c2210f6f 00000080:00200000:3.0:1788201558.798582:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 15. 00000080:00200000:3.0:1788201558.798583:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 15 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.798592:0:23731:0:(rw26.c:898:ll_write_end()) pos 61440, len 4096, copied 4096 00000080:00200000:3.0:1788201558.798595:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000c90826a3[3 000000008d37f26a 2 1 00000000a46cf215 0 0 15] 00000080:00200000:3.0:1788201558.798598:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000bb319ee9 17ffffc0001001 3:0 ffff8bc148dec9a0 15 lru 00000080:00200000:3.0:1788201558.798603:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000f82afe65 15: 1< 0 - - > 2< 61440 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.798605:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000c90826a3 00000080:00200000:3.0:1788201558.798606:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 16. 00000080:00200000:3.0:1788201558.798608:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 16 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.798617:0:23731:0:(rw26.c:898:ll_write_end()) pos 65536, len 4096, copied 4096 00000080:00200000:3.0:1788201558.798621:0:23731:0:(rw26.c:956:ll_write_end()) page@000000005cfaaa06[3 000000008d37f26a 2 1 00000000a46cf215 0 0 16] 00000080:00200000:3.0:1788201558.798624:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000006c4f9409 17ffffc0001001 3:0 ffff8bc148decc40 16 lru 00000080:00200000:3.0:1788201558.798629:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000001806f64b 16: 1< 0 - - > 2< 65536 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.798631:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000005cfaaa06 00000080:00200000:3.0:1788201558.798632:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 17. 00000080:00200000:3.0:1788201558.798634:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 17 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.798644:0:23731:0:(rw26.c:898:ll_write_end()) pos 69632, len 4096, copied 4096 00000080:00200000:3.0:1788201558.798647:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000e3405c08[3 000000008d37f26a 2 1 00000000a46cf215 0 0 17] 00000080:00200000:3.0:1788201558.798650:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000cf2882b7 17ffffc0001001 3:0 ffff8bc148deca80 17 lru 00000080:00200000:3.0:1788201558.798655:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000085ba5ccc 17: 1< 0 - - > 2< 69632 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.798657:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000e3405c08 00000080:00200000:3.0:1788201558.798658:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 18. 00000080:00200000:3.0:1788201558.798660:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 18 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.798668:0:23731:0:(rw26.c:898:ll_write_end()) pos 73728, len 4096, copied 4096 00000080:00200000:3.0:1788201558.798672:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000004b5282c[3 000000008d37f26a 2 1 00000000a46cf215 0 0 18] 00000080:00200000:3.0:1788201558.798674:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000ad3415bf 17ffffc0001001 3:0 ffff8bc148dec540 18 lru 00000080:00200000:3.0:1788201558.798680:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000006e2d1cfa 18: 1< 0 - - > 2< 73728 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.798682:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000004b5282c 00000080:00200000:3.0:1788201558.798682:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 19. 00000080:00200000:3.0:1788201558.798684:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 19 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.798693:0:23731:0:(rw26.c:898:ll_write_end()) pos 77824, len 4096, copied 4096 00000080:00200000:3.0:1788201558.798697:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000c24ef939[3 000000008d37f26a 2 1 00000000a46cf215 0 0 19] 00000080:00200000:3.0:1788201558.798700:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000e991e596 17ffffc0001001 3:0 ffff8bc145cc5ee0 19 lru 00000080:00200000:3.0:1788201558.798705:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000005ec40622 19: 1< 0 - - > 2< 77824 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.798706:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000c24ef939 00000080:00200000:3.0:1788201558.798707:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 20. 00000080:00200000:3.0:1788201558.798709:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 20 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.798718:0:23731:0:(rw26.c:898:ll_write_end()) pos 81920, len 4096, copied 4096 00000080:00200000:3.0:1788201558.798721:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000791a696b[3 000000008d37f26a 2 1 00000000a46cf215 0 0 20] 00000080:00200000:3.0:1788201558.798724:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000096630e36 17ffffc0001001 3:0 ffff8bc145cc5e00 20 lru 00000080:00200000:3.0:1788201558.798731:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000008b1a8a2 20: 1< 0 - - > 2< 81920 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.798733:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000791a696b 00000080:00200000:3.0:1788201558.798734:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 21. 00000080:00200000:3.0:1788201558.798735:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 21 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.798746:0:23731:0:(rw26.c:898:ll_write_end()) pos 86016, len 4096, copied 4096 00000080:00200000:3.0:1788201558.798750:0:23731:0:(rw26.c:956:ll_write_end()) page@000000009a825976[3 000000008d37f26a 2 1 00000000a46cf215 0 0 21] 00000080:00200000:3.0:1788201558.798753:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000082e5f1b1 17ffffc0001001 3:0 ffff8bc145cc58c0 21 lru 00000080:00200000:3.0:1788201558.798759:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000934c304c 21: 1< 0 - - > 2< 86016 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.798761:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000009a825976 00000080:00200000:3.0:1788201558.798762:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 22. 00000080:00200000:3.0:1788201558.798764:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 22 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.798775:0:23731:0:(rw26.c:898:ll_write_end()) pos 90112, len 4096, copied 4096 00000080:00200000:3.0:1788201558.798778:0:23731:0:(rw26.c:956:ll_write_end()) page@000000002b887316[3 000000008d37f26a 2 1 00000000a46cf215 0 0 22] 00000080:00200000:3.0:1788201558.798781:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000002d7d46e1 17ffffc0001001 3:0 ffff8bc145cc5540 22 lru 00000080:00200000:3.0:1788201558.798786:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000020cd987b 22: 1< 0 - - > 2< 90112 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.798788:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000002b887316 00000080:00200000:3.0:1788201558.798968:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 23. 00000080:00200000:3.0:1788201558.798970:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 23 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.798995:0:23731:0:(rw26.c:898:ll_write_end()) pos 94208, len 4096, copied 4096 00000080:00200000:3.0:1788201558.798999:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000d0ff51e3[3 000000008d37f26a 2 1 00000000a46cf215 0 0 23] 00000080:00200000:3.0:1788201558.799002:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000b6477d67 17ffffc0001001 3:0 ffff8bc145cc5a80 23 lru 00000080:00200000:3.0:1788201558.799007:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000e68a1f44 23: 1< 0 - - > 2< 94208 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799010:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000d0ff51e3 00000080:00200000:3.0:1788201558.799011:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 24. 00000080:00200000:3.0:1788201558.799012:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 24 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799027:0:23731:0:(rw26.c:898:ll_write_end()) pos 98304, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799031:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000df2bb9d6[3 000000008d37f26a 2 1 00000000a46cf215 0 0 24] 00000080:00200000:3.0:1788201558.799034:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000034eff576 17ffffc0001021 2:0 ffff8bc145cc5c40 24 lru 00000080:00200000:3.0:1788201558.799039:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000087b0f775 24: 1< 0 - - > 2< 98304 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799041:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000df2bb9d6 00000080:00200000:3.0:1788201558.799042:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 25. 00000080:00200000:3.0:1788201558.799045:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 25 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799054:0:23731:0:(rw26.c:898:ll_write_end()) pos 102400, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799058:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000062fd7dc6[3 000000008d37f26a 2 1 00000000a46cf215 0 0 25] 00000080:00200000:3.0:1788201558.799061:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000e5ba08c4 17ffffc0001001 3:0 ffff8bc145cc5700 25 lru 00000080:00200000:3.0:1788201558.799066:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000af8a4ba1 25: 1< 0 - - > 2< 102400 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799069:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000062fd7dc6 00000080:00200000:3.0:1788201558.799069:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 26. 00000080:00200000:3.0:1788201558.799071:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 26 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799079:0:23731:0:(rw26.c:898:ll_write_end()) pos 106496, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799083:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000010e20074[3 000000008d37f26a 2 1 00000000a46cf215 0 0 26] 00000080:00200000:3.0:1788201558.799085:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000bcc4f978 17ffffc0001001 3:0 ffff8bc145cc57e0 26 lru 00000080:00200000:3.0:1788201558.799091:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000e60acd52 26: 1< 0 - - > 2< 106496 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799093:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000010e20074 00000080:00200000:3.0:1788201558.799094:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 27. 00000080:00200000:3.0:1788201558.799096:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 27 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799108:0:23731:0:(rw26.c:898:ll_write_end()) pos 110592, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799112:0:23731:0:(rw26.c:956:ll_write_end()) page@000000006949c413[3 000000008d37f26a 2 1 00000000a46cf215 0 0 27] 00000080:00200000:3.0:1788201558.799115:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000034164d72 17ffffc0001001 3:0 ffff8bc145cc5620 27 lru 00000080:00200000:3.0:1788201558.799120:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000035b4e88d 27: 1< 0 - - > 2< 110592 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799123:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000006949c413 00000080:00200000:3.0:1788201558.799124:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 28. 00000080:00200000:3.0:1788201558.799126:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 28 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799139:0:23731:0:(rw26.c:898:ll_write_end()) pos 114688, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799143:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000e45e147a[3 000000008d37f26a 2 1 00000000a46cf215 0 0 28] 00000080:00200000:3.0:1788201558.799146:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000004b4ff07 17ffffc0001001 3:0 ffff8bc145cc59a0 28 lru 00000080:00200000:3.0:1788201558.799152:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000e0a41b91 28: 1< 0 - - > 2< 114688 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799154:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000e45e147a 00000080:00200000:3.0:1788201558.799155:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 29. 00000080:00200000:3.0:1788201558.799157:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 29 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799171:0:23731:0:(rw26.c:898:ll_write_end()) pos 118784, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799176:0:23731:0:(rw26.c:956:ll_write_end()) page@000000004f1fce99[3 000000008d37f26a 2 1 00000000a46cf215 0 0 29] 00000080:00200000:3.0:1788201558.799178:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000bec158ec 17ffffc0001001 3:0 ffff8bc145cc50e0 29 lru 00000080:00200000:3.0:1788201558.799184:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000d0fde444 29: 1< 0 - - > 2< 118784 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799186:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000004f1fce99 00000080:00200000:3.0:1788201558.799187:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 30. 00000080:00200000:3.0:1788201558.799189:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 30 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799202:0:23731:0:(rw26.c:898:ll_write_end()) pos 122880, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799302:0:23731:0:(rw26.c:956:ll_write_end()) page@000000000d08252f[3 000000008d37f26a 2 1 00000000a46cf215 0 0 30] 00000080:00200000:3.0:1788201558.799305:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000b67cbc67 17ffffc0001001 3:0 ffff8bc145cc51c0 30 lru 00000080:00200000:3.0:1788201558.799310:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000c1d3aa6d 30: 1< 0 - - > 2< 122880 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799313:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000000d08252f 00000080:00200000:3.0:1788201558.799314:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 31. 00000080:00200000:3.0:1788201558.799315:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 31 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799333:0:23731:0:(rw26.c:898:ll_write_end()) pos 126976, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799337:0:23731:0:(rw26.c:956:ll_write_end()) page@000000001b5c68a7[3 000000008d37f26a 2 1 00000000a46cf215 0 0 31] 00000080:00200000:3.0:1788201558.799340:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000004a961c52 17ffffc0001001 3:0 ffff8bc145cc5380 31 lru 00000080:00200000:3.0:1788201558.799346:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000030754133 31: 1< 0 - - > 2< 126976 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799348:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000001b5c68a7 00000080:00200000:3.0:1788201558.799400:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 32. 00000080:00200000:3.0:1788201558.799403:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 32 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799418:0:23731:0:(rw26.c:898:ll_write_end()) pos 131072, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799422:0:23731:0:(rw26.c:956:ll_write_end()) page@000000001dc68604[3 000000008d37f26a 2 1 00000000a46cf215 0 0 32] 00000080:00200000:3.0:1788201558.799425:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000ec1f796f 17ffffc0001001 3:0 ffff8bc145cc5000 32 lru 00000080:00200000:3.0:1788201558.799431:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000d997c851 32: 1< 0 - - > 2< 131072 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799433:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000001dc68604 00000080:00200000:3.0:1788201558.799434:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 33. 00000080:00200000:3.0:1788201558.799435:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 33 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799445:0:23731:0:(rw26.c:898:ll_write_end()) pos 135168, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799448:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000053c68b7d[3 000000008d37f26a 2 1 00000000a46cf215 0 0 33] 00000080:00200000:3.0:1788201558.799451:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000056ebb932 17ffffc0001001 3:0 ffff8bc145cc5d20 33 lru 00000080:00200000:3.0:1788201558.799456:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000005343cf44 33: 1< 0 - - > 2< 135168 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799458:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000053c68b7d 00000080:00200000:3.0:1788201558.799460:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 34. 00000080:00200000:3.0:1788201558.799461:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 34 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799470:0:23731:0:(rw26.c:898:ll_write_end()) pos 139264, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799474:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000027a1138[3 000000008d37f26a 2 1 00000000a46cf215 0 0 34] 00000080:00200000:3.0:1788201558.799477:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000f2e6df74 17ffffc0001001 3:0 ffff8bc145cc5460 34 lru 00000080:00200000:3.0:1788201558.799483:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000000de97ea2 34: 1< 0 - - > 2< 139264 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799485:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000027a1138 00000080:00200000:3.0:1788201558.799486:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 35. 00000080:00200000:3.0:1788201558.799488:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 35 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799497:0:23731:0:(rw26.c:898:ll_write_end()) pos 143360, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799500:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000029cd5b85[3 000000008d37f26a 2 1 00000000a46cf215 0 0 35] 00000080:00200000:3.0:1788201558.799503:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000920b5c02 17ffffc0001001 3:0 ffff8bc145cc52a0 35 lru 00000080:00200000:3.0:1788201558.799508:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000151ef08b 35: 1< 0 - - > 2< 143360 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799509:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000029cd5b85 00000080:00200000:3.0:1788201558.799510:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 36. 00000080:00200000:3.0:1788201558.799511:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 36 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799521:0:23731:0:(rw26.c:898:ll_write_end()) pos 147456, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799524:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000055b6ff42[3 000000008d37f26a 2 1 00000000a46cf215 0 0 36] 00000080:00200000:3.0:1788201558.799527:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000006f455357 17ffffc0001001 3:0 ffff8bc145cc5b60 36 lru 00000080:00200000:3.0:1788201558.799532:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000831a4c53 36: 1< 0 - - > 2< 147456 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799533:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000055b6ff42 00000080:00200000:3.0:1788201558.799535:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 37. 00000080:00200000:3.0:1788201558.799536:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 37 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799547:0:23731:0:(rw26.c:898:ll_write_end()) pos 151552, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799551:0:23731:0:(rw26.c:956:ll_write_end()) page@000000008dae841d[3 000000008d37f26a 2 1 00000000a46cf215 0 0 37] 00000080:00200000:3.0:1788201558.799554:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000048e46e64 17ffffc0001001 3:0 ffff8bc1727fcc40 37 lru 00000080:00200000:3.0:1788201558.799560:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000000706c5ff 37: 1< 0 - - > 2< 151552 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799562:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000008dae841d 00000080:00200000:3.0:1788201558.799563:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 38. 00000080:00200000:3.0:1788201558.799565:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 38 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799577:0:23731:0:(rw26.c:898:ll_write_end()) pos 155648, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799580:0:23731:0:(rw26.c:956:ll_write_end()) page@000000008f06716d[3 000000008d37f26a 2 1 00000000a46cf215 0 0 38] 00000080:00200000:3.0:1788201558.799584:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000c648867c 17ffffc0001001 3:0 ffff8bc1727fc9a0 38 lru 00000080:00200000:3.0:1788201558.799589:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000034dfa38e 38: 1< 0 - - > 2< 155648 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799591:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000008f06716d 00000080:00200000:3.0:1788201558.799592:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 39. 00000080:00200000:3.0:1788201558.799593:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 39 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799609:0:23731:0:(rw26.c:898:ll_write_end()) pos 159744, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799613:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000c9ff1f01[3 000000008d37f26a 2 1 00000000a46cf215 0 0 39] 00000080:00200000:3.0:1788201558.799616:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000001492f142 17ffffc0001021 2:0 ffff8bc1727fc0e0 39 lru 00000080:00200000:3.0:1788201558.799621:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000825b17aa 39: 1< 0 - - > 2< 159744 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799623:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000c9ff1f01 00000080:00200000:3.0:1788201558.799624:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 40. 00000080:00200000:3.0:1788201558.799626:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 40 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799635:0:23731:0:(rw26.c:898:ll_write_end()) pos 163840, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799638:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000ab6b4581[3 000000008d37f26a 2 1 00000000a46cf215 0 0 40] 00000080:00200000:3.0:1788201558.799641:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000b4e83d41 17ffffc0001001 3:0 ffff8bc1727fc1c0 40 lru 00000080:00200000:3.0:1788201558.799646:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000167729af 40: 1< 0 - - > 2< 163840 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799648:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000ab6b4581 00000080:00200000:3.0:1788201558.799650:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 41. 00000080:00200000:3.0:1788201558.799651:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 41 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799661:0:23731:0:(rw26.c:898:ll_write_end()) pos 167936, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799664:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000027456873[3 000000008d37f26a 2 1 00000000a46cf215 0 0 41] 00000080:00200000:3.0:1788201558.799667:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000009801a1a9 17ffffc0001001 3:0 ffff8bc1727fc380 41 lru 00000080:00200000:3.0:1788201558.799672:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000d389a183 41: 1< 0 - - > 2< 167936 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799674:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000027456873 00000080:00200000:3.0:1788201558.799675:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 42. 00000080:00200000:3.0:1788201558.799676:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 42 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799685:0:23731:0:(rw26.c:898:ll_write_end()) pos 172032, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799689:0:23731:0:(rw26.c:956:ll_write_end()) page@000000000a2dd77a[3 000000008d37f26a 2 1 00000000a46cf215 0 0 42] 00000080:00200000:3.0:1788201558.799691:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000006eb8b8f 17ffffc0001001 3:0 ffff8bc1727fc000 42 lru 00000080:00200000:3.0:1788201558.799696:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000032685a73 42: 1< 0 - - > 2< 172032 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799698:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000000a2dd77a 00000080:00200000:3.0:1788201558.799699:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 43. 00000080:00200000:3.0:1788201558.799701:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 43 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799710:0:23731:0:(rw26.c:898:ll_write_end()) pos 176128, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799713:0:23731:0:(rw26.c:956:ll_write_end()) page@000000004c474d7d[3 000000008d37f26a 2 1 00000000a46cf215 0 0 43] 00000080:00200000:3.0:1788201558.799716:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000007c3043bb 17ffffc0001001 3:0 ffff8bc1727fcd20 43 lru 00000080:00200000:3.0:1788201558.799721:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000000a401ff8 43: 1< 0 - - > 2< 176128 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799723:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000004c474d7d 00000080:00200000:3.0:1788201558.799725:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 44. 00000080:00200000:3.0:1788201558.799726:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 44 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799734:0:23731:0:(rw26.c:898:ll_write_end()) pos 180224, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799738:0:23731:0:(rw26.c:956:ll_write_end()) page@000000009672508d[3 000000008d37f26a 2 1 00000000a46cf215 0 0 44] 00000080:00200000:3.0:1788201558.799740:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000b20170bd 17ffffc0001001 3:0 ffff8bc1727fc460 44 lru 00000080:00200000:3.0:1788201558.799745:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000007bb31124 44: 1< 0 - - > 2< 180224 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799747:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000009672508d 00000080:00200000:3.0:1788201558.799748:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 45. 00000080:00200000:3.0:1788201558.799750:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 45 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799762:0:23731:0:(rw26.c:898:ll_write_end()) pos 184320, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799766:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000024e10abd[3 000000008d37f26a 2 1 00000000a46cf215 0 0 45] 00000080:00200000:3.0:1788201558.799769:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000001db114fd 17ffffc0001001 3:0 ffff8bc1727fc2a0 45 lru 00000080:00200000:3.0:1788201558.799774:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b860a0e0 45: 1< 0 - - > 2< 184320 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799776:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000024e10abd 00000080:00200000:3.0:1788201558.799777:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 46. 00000080:00200000:3.0:1788201558.799779:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 46 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799885:0:23731:0:(rw26.c:898:ll_write_end()) pos 188416, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799890:0:23731:0:(rw26.c:956:ll_write_end()) page@000000003a4f2a70[3 000000008d37f26a 2 1 00000000a46cf215 0 0 46] 00000080:00200000:3.0:1788201558.799892:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000066a59086 17ffffc0001001 3:0 ffff8bc1727fcb60 46 lru 00000080:00200000:3.0:1788201558.799898:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000574a4f28 46: 1< 0 - - > 2< 188416 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799900:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000003a4f2a70 00000080:00200000:3.0:1788201558.799901:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 47. 00000080:00200000:3.0:1788201558.799903:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 47 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799916:0:23731:0:(rw26.c:898:ll_write_end()) pos 192512, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799920:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000d7b3a523[3 000000008d37f26a 2 1 00000000a46cf215 0 0 47] 00000080:00200000:3.0:1788201558.799923:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000050c52509 17ffffc0001001 3:0 ffff8bc1727fc700 47 lru 00000080:00200000:3.0:1788201558.799929:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000005e6fcf65 47: 1< 0 - - > 2< 192512 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799931:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000d7b3a523 00000080:00200000:3.0:1788201558.799932:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 48. 00000080:00200000:3.0:1788201558.799933:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 48 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799943:0:23731:0:(rw26.c:898:ll_write_end()) pos 196608, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799946:0:23731:0:(rw26.c:956:ll_write_end()) page@000000000b7df029[3 000000008d37f26a 2 1 00000000a46cf215 0 0 48] 00000080:00200000:3.0:1788201558.799949:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000042ebf5a9 17ffffc0001001 3:0 ffff8bc1727fc7e0 48 lru 00000080:00200000:3.0:1788201558.799954:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000005a9d0945 48: 1< 0 - - > 2< 196608 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799956:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000000b7df029 00000080:00200000:3.0:1788201558.799957:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 49. 00000080:00200000:3.0:1788201558.799958:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 49 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.799967:0:23731:0:(rw26.c:898:ll_write_end()) pos 200704, len 4096, copied 4096 00000080:00200000:3.0:1788201558.799980:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000012ef86c6[3 000000008d37f26a 2 1 00000000a46cf215 0 0 49] 00000080:00200000:3.0:1788201558.799983:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000003f05979 17ffffc0001001 3:0 ffff8bc1727fc620 49 lru 00000080:00200000:3.0:1788201558.799989:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000c71a0f3f 49: 1< 0 - - > 2< 200704 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.799991:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000012ef86c6 00000080:00200000:3.0:1788201558.799992:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 50. 00000080:00200000:3.0:1788201558.799993:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 50 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.800004:0:23731:0:(rw26.c:898:ll_write_end()) pos 204800, len 4096, copied 4096 00000080:00200000:3.0:1788201558.800008:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000063af61d4[3 000000008d37f26a 2 1 00000000a46cf215 0 0 50] 00000080:00200000:3.0:1788201558.800011:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000619727e6 17ffffc0001001 3:0 ffff8bc1727fcee0 50 lru 00000080:00200000:3.0:1788201558.800016:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000048f71123 50: 1< 0 - - > 2< 204800 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.800019:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000063af61d4 00000080:00200000:3.0:1788201558.800020:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 51. 00000080:00200000:3.0:1788201558.800021:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 51 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.800030:0:23731:0:(rw26.c:898:ll_write_end()) pos 208896, len 4096, copied 4096 00000080:00200000:3.0:1788201558.800034:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000e44b52bd[3 000000008d37f26a 2 1 00000000a46cf215 0 0 51] 00000080:00200000:3.0:1788201558.800036:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000004abbffe4 17ffffc0001001 3:0 ffff8bc1727fce00 51 lru 00000080:00200000:3.0:1788201558.800041:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000daf5251b 51: 1< 0 - - > 2< 208896 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.800043:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000e44b52bd 00000080:00200000:3.0:1788201558.800045:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 52. 00000080:00200000:3.0:1788201558.800046:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 52 of 0 to 2301 bytes 00000080:00200000:3.0:1788201558.800065:0:23731:0:(rw26.c:898:ll_write_end()) pos 212992, len 2301, copied 2301 00000080:00200000:3.0:1788201558.800068:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000831faa42[3 000000008d37f26a 2 1 00000000a46cf215 0 0 52] 00000080:00200000:3.0:1788201558.800071:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000045becd56 17ffffc0001001 3:0 ffff8bc1727fc8c0 52 lru 00000080:00200000:3.0:1788201558.800076:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000ada24a44 52: 1< 0 - - > 2< 212992 0 0 0x0 0x0 | 000000000ce25486 00000000d01be84b > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.800078:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000831faa42 00000080:00200000:3.0:1788201558.800079:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 53. 00000080:00200000:3.0:1788201558.800083:0:23731:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 53, from 0, to 2301 prio 0 00000008:00010000:3.0:1788201558.800108:0:23731:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000dc1150d4 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201558.800140:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459f75f8, count 15, dirtied 15 00000080:00200000:3.0:1788201558.800159:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459f75f8, count 15, dirtied 15 00000080:00200000:3.0:1788201558.800172:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459f75f8, count 15, dirtied 15 00000080:00200000:3.0:1788201558.800182:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459f75f8, count 8, dirtied 8 00000080:00200000:3.0:1788201558.800186:0:23731:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 53 pages 215293 bytes, tot: 215293 00000080:00200000:3.0:1788201558.800190:0:23731:0:(vvp_io.c:1358:vvp_io_write_start()) sanity-lfsck.sh: write bytes 0, result: 215293 00000020:00010000:3.0:1788201558.800298:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460e6d58 (ffff8bc1460e9368/0) at cl_lock_release():245 00000020:00010000:3.0:1788201558.800303:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460e6d58 (ffff8bc1460e9368/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201558.800307:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1440082b0 (ffff8bc1460e9248/1) at cl_lock_cancel():142 00010000:00010000:3.0:1788201558.800314:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.800327:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1788201558.800342:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460e6d58 (ffff8bc1460e9368/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201558.800346:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1440082b0 (ffff8bc1460e9368/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201558.800421:0:23731:0:(vvp_io.c:533:vvp_io_advance()) advancing 215293 bytes 00000080:00200000:3.0:1788201558.800431:0:23731:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 52] 00000080:00200000:3.0:1788201558.800461:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x121:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201558.800465:0:23731:0:(file.c:2238:ll_file_io_generic()) sanity-lfsck.sh: 2 io complete with rc: 0, result: 215293, restart: 0 00000080:00200000:3.0:1788201558.800474:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x121:0x0] updating i_size 215293 i_blocks 1 00000080:00200000:3.0:1788201558.800479:0:23731:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 215293 00000080:00200008:3.0:1788201558.800519:0:23731:0:(file.c:479:ll_file_release()) START file sanity-lfsck.sh:[0x200000bd7:0x121:0x0](ffff8bc1459f7448), flags 100001 00000002:00100000:3.0:1788201558.800575:0:23731:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc14415b800 x1875064727850112/t8589937105(8589937105) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201574 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1788201558.800586:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1788201558.800592:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146c59880 x1875064727850752/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1788201558.800616:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c59880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727850752:192.168.201.143@tcp:35:cp.0 00000100:00100000:3.0:1788201558.800944:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1450a6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201558.803699:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727850496:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201558.806054:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c59880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727850752:192.168.201.143@tcp:35:cp.0 00000002:00100000:3.0:1788201558.806091:0:23731:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc14415b800 x1875064727850112/t8589937105(8589937105) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201574 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201558.806176:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201558.806196:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201558.806224:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 243 lru_type: 1 00010000:00010000:3.0:1788201558.806238:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 243 lru_type: 1 00000080:00200000:3.0:1788201558.806247:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201558.806253:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201558.806257:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201558.806265:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201558.806269:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 243 lru_type: 1 00010000:00010000:3.0:1788201558.806279:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 244 lru_type: 1 00000080:00200000:3.0:1788201558.806294:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201558.806302:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201558.806307:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201558.806311:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-lfsck.sh, flags=8 00000080:00200008:3.0:1788201558.806318:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file sanity-lfsck.sh:[0x200000bd7:0x121:0x0](ffff8bc1459f7448), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201558.806323:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x121:0x0](ffff8bc1459f7448),name=sanity-lfsck.sh 00000002:00010000:3.0:1788201558.806336:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x121:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201558.806344:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6200/0xd138388016f6ea82 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x121:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094d6c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201558.806363:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6200/0xd138388016f6ea82 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x121:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094d6c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201558.806370:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201558.806375:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x121:0x0](ffff8bc1459f7448) 00000080:00010000:3.0:1788201558.806377:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x121:0x0](ffff8bc1459f7448) for lock 0xd138388016f6ea82 00000080:00010000:3.0:1788201558.806382:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ea82 from it ffffadd1c7da3cb8 00010000:00010000:3.0:1788201558.806385:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6200/0xd138388016f6ea82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x121:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094d6c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201558.806393:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6200/0xd138388016f6ea82 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x121:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094d6c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201558.806443:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x121:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201558.806455:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x121:0x0] 00000008:00010000:3.0:1788201558.806489:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201558.806493:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1440082b0, osc lock ffff8bc14691ad10, flags 0x400001002 00010000:00010000:3.0:1788201558.806510:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x197:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.806522:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:3.0:1788201558.806534:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1788201558.806538:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.806547:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1788201558.806557:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1788201558.806565:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x121:0x0] updating i_size 215293 i_blocks 1 00000020:00010000:3.0:1788201558.806568:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc72e0 (ffff8bc1460e9368/0) at cl_lock_release():245 00000020:00010000:3.0:1788201558.806570:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc72e0 (ffff8bc1460e9368/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201558.806572:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1440082b0 (ffff8bc1460e9248/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201558.806575:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc72e0 (ffff8bc1460e9368/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201558.806577:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1440082b0 (ffff8bc1460e9368/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201558.806602:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x121:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201558.806642:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201558.806647:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201558.806652:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 244 lru_type: 1 00010000:00010000:3.0:1788201558.806658:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 244 lru_type: 1 00000080:00200000:3.0:1788201558.806662:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201558.806665:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201558.806666:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201558.806669:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201558.806671:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 244 lru_type: 1 00010000:00010000:3.0:1788201558.806675:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 245 lru_type: 1 00000080:00200000:3.0:1788201558.806680:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201558.806683:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201558.806685:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201558.806695:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-lnet.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=9 00000080:00200000:3.0:1788201558.806698:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-lnet.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:3.0:1788201558.806704:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-lnet.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201558.806741:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d000/0xd138388016f6ea97 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.806748:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d000/0xd138388016f6ea97 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.807359:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d000/0xd138388016f6ea97 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201558.807387:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c5ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727850880:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201558.807491:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1450a6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201558.818489:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727851392:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201558.820639:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f0cf06e3/0xd138388016f6eaac lrc: 6/2,0 mode: --/PR res: [0x280000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.820658:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f0cf06e3/0xd138388016f6eaac lrc: 6/2,0 mode: --/PR res: [0x280000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094dd5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.820669:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f0cf06e3/0xd138388016f6eaac lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094dd5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.820679:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f0cf06e3/0xd138388016f6eaac lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094dd5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201558.820689:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f0cf06e3/0xd138388016f6eaac lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094dd5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201558.820701:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1788201558.820714:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f0cf06e3/0xd138388016f6eaac lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094dd5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.820720:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f0cf06e3/0xd138388016f6eaac lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094dd5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.820725:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f0cf06e3/0xd138388016f6eaac lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094dd5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.820731:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f0cf06e3/0xd138388016f6eaac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171094dd5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201558.820749:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727851392:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201558.824505:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743442688 00000100:00100000:1.0:1788201558.824515:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743442688 00000100:00100000:1.0:1788201558.824620:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 586 00000100:00100000:1.0:1788201558.824631:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14415aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23131:x1875064743442688:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201558.824651:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f0cf06e3/0xd138388016f6eaac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x198:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094dd5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.824747:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201558.825282:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14415aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23131:x1875064743442688:12345-192.168.201.143@tcp:104: Request processed in 126us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201558.825302:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 586 00000100:00100000:3.0:1788201558.828520:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:3.0:1788201558.830354:0:23731:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000012c9f1c0/0xd138388016f6eab3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094ddc expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.830370:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000012c9f1c0/0xd138388016f6eab3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094ddc expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.830387:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000012c9f1c0/0xd138388016f6eab3 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171094ddc expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201558.830401:0:23731:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000012c9f1c0/0xd138388016f6eab3 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171094ddc expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.830414:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000012c9f1c0/0xd138388016f6eab3 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094ddc expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.830422:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000012c9f1c0/0xd138388016f6eab3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094ddc expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201558.830454:0:23731:0:(vvp_io.c:1292:vvp_io_write_start()) sanity-lnet.sh: write [0, 199288) append 0 append lockpos 0 00000080:00200000:3.0:1788201558.830473:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.830522:0:23731:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:3.0:1788201558.830534:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000d3947cda[3 0000000043426732 2 1 0000000044063476 0 0 0] 00000080:00200000:3.0:1788201558.830539:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000001b76d4ae 17ffffc0001001 3:0 ffff8bc1727fc540 0 lru 00000080:00200000:3.0:1788201558.830546:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000a7baa3cb 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.830548:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000d3947cda 00000080:00200000:3.0:1788201558.830550:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201558.830553:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.830583:0:23731:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:3.0:1788201558.830588:0:23731:0:(rw26.c:956:ll_write_end()) page@000000002520c8cd[3 0000000043426732 2 1 0000000044063476 0 0 1] 00000080:00200000:3.0:1788201558.830591:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000006dd58ff 17ffffc0001021 2:0 ffff8bc1727fca80 1 lru 00000080:00200000:3.0:1788201558.830596:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000de2ae482 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.830598:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000002520c8cd 00000080:00200000:3.0:1788201558.830600:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:3.0:1788201558.830602:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.830617:0:23731:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:3.0:1788201558.830621:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000047488b2f[3 0000000043426732 2 1 0000000044063476 0 0 2] 00000080:00200000:3.0:1788201558.830624:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000009e31f733 17ffffc0001001 3:0 ffff8bc17274de00 2 lru 00000080:00200000:3.0:1788201558.830629:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000003fa14416 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.830632:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000047488b2f 00000080:00200000:3.0:1788201558.830633:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:3.0:1788201558.830634:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.830647:0:23731:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:3.0:1788201558.830651:0:23731:0:(rw26.c:956:ll_write_end()) page@000000002af44379[3 0000000043426732 2 1 0000000044063476 0 0 3] 00000080:00200000:3.0:1788201558.830654:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000067a7ce0 17ffffc0001001 3:0 ffff8bc17274d8c0 3 lru 00000080:00200000:3.0:1788201558.830660:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000186885d2 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.830662:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000002af44379 00000080:00200000:3.0:1788201558.830663:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:3.0:1788201558.830665:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.830679:0:23731:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:3.0:1788201558.830684:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000814910f0[3 0000000043426732 2 1 0000000044063476 0 0 4] 00000080:00200000:3.0:1788201558.830687:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000812f078d 17ffffc0001001 3:0 ffff8bc17274d540 4 lru 00000080:00200000:3.0:1788201558.830692:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000fd1cb32f 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.830695:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000814910f0 00000080:00200000:3.0:1788201558.830696:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:3.0:1788201558.830697:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.830712:0:23731:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:3.0:1788201558.830716:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000eea99b3d[3 0000000043426732 2 1 0000000044063476 0 0 5] 00000080:00200000:3.0:1788201558.830719:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000000badd9ec 17ffffc0001001 3:0 ffff8bc17274da80 5 lru 00000080:00200000:3.0:1788201558.830724:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000001c06cc8e 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.830726:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000eea99b3d 00000080:00200000:3.0:1788201558.830728:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:3.0:1788201558.830743:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.830759:0:23731:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:3.0:1788201558.830762:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000a3afb600[3 0000000043426732 2 1 0000000044063476 0 0 6] 00000080:00200000:3.0:1788201558.830765:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000fdb63f4e 17ffffc0001001 3:0 ffff8bc17274dc40 6 lru 00000080:00200000:3.0:1788201558.830770:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000c51ca129 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.830772:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000a3afb600 00000080:00200000:3.0:1788201558.830773:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:3.0:1788201558.830774:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.830785:0:23731:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:3.0:1788201558.831538:0:23731:0:(rw26.c:956:ll_write_end()) page@000000002a1a14cf[3 0000000043426732 2 1 0000000044063476 0 0 7] 00000080:00200000:3.0:1788201558.831543:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000002bd4b345 17ffffc0001001 3:0 ffff8bc17274d9a0 7 lru 00000080:00200000:3.0:1788201558.831549:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000009153de9a 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.831552:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000002a1a14cf 00000080:00200000:3.0:1788201558.831553:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:3.0:1788201558.831557:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.831582:0:23731:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:3.0:1788201558.831586:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000001ff64f9[3 0000000043426732 2 1 0000000044063476 0 0 8] 00000080:00200000:3.0:1788201558.831589:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000f2b3caf0 17ffffc0001001 3:0 ffff8bc17274d0e0 8 lru 00000080:00200000:3.0:1788201558.831594:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000001d88983b 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.831596:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000001ff64f9 00000080:00200000:3.0:1788201558.831597:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:3.0:1788201558.831599:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.831613:0:23731:0:(rw26.c:898:ll_write_end()) pos 36864, len 4096, copied 4096 00000080:00200000:3.0:1788201558.831617:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000079c1c848[3 0000000043426732 2 1 0000000044063476 0 0 9] 00000080:00200000:3.0:1788201558.831620:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000081fada22 17ffffc0001001 3:0 ffff8bc17274d1c0 9 lru 00000080:00200000:3.0:1788201558.831625:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000057bcd049 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.831627:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000079c1c848 00000080:00200000:3.0:1788201558.831628:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:3.0:1788201558.831630:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 10 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.831645:0:23731:0:(rw26.c:898:ll_write_end()) pos 40960, len 4096, copied 4096 00000080:00200000:3.0:1788201558.831649:0:23731:0:(rw26.c:956:ll_write_end()) page@000000009134c7c6[3 0000000043426732 2 1 0000000044063476 0 0 10] 00000080:00200000:3.0:1788201558.831652:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000b40ef6c8 17ffffc0001001 3:0 ffff8bc17274d380 10 lru 00000080:00200000:3.0:1788201558.831657:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000003307a555 10: 1< 0 - - > 2< 40960 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.831659:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000009134c7c6 00000080:00200000:3.0:1788201558.831660:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 11. 00000080:00200000:3.0:1788201558.831663:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 11 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.831683:0:23731:0:(rw26.c:898:ll_write_end()) pos 45056, len 4096, copied 4096 00000080:00200000:3.0:1788201558.831688:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000068b72282[3 0000000043426732 2 1 0000000044063476 0 0 11] 00000080:00200000:3.0:1788201558.831691:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000003b4da940 17ffffc0001001 3:0 ffff8bc17274d000 11 lru 00000080:00200000:3.0:1788201558.831696:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b024a495 11: 1< 0 - - > 2< 45056 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.831697:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000068b72282 00000080:00200000:3.0:1788201558.831698:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 12. 00000080:00200000:3.0:1788201558.831700:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 12 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.831712:0:23731:0:(rw26.c:898:ll_write_end()) pos 49152, len 4096, copied 4096 00000080:00200000:3.0:1788201558.831716:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000071b4311[3 0000000043426732 2 1 0000000044063476 0 0 12] 00000080:00200000:3.0:1788201558.831719:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000008f3d56b1 17ffffc0001001 3:0 ffff8bc17274dd20 12 lru 00000080:00200000:3.0:1788201558.831723:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000816ac1dd 12: 1< 0 - - > 2< 49152 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.831725:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000071b4311 00000080:00200000:3.0:1788201558.831726:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 13. 00000080:00200000:3.0:1788201558.831728:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 13 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.832665:0:23731:0:(rw26.c:898:ll_write_end()) pos 53248, len 4096, copied 4096 00000080:00200000:3.0:1788201558.832672:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000754c6bf4[3 0000000043426732 2 1 0000000044063476 0 0 13] 00000080:00200000:3.0:1788201558.832675:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000007346173b 17ffffc0001001 3:0 ffff8bc17274d460 13 lru 00000080:00200000:3.0:1788201558.832682:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000005dcb9879 13: 1< 0 - - > 2< 53248 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.832684:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000754c6bf4 00000080:00200000:3.0:1788201558.832685:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 14. 00000080:00200000:3.0:1788201558.832688:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 14 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.832704:0:23731:0:(rw26.c:898:ll_write_end()) pos 57344, len 4096, copied 4096 00000080:00200000:3.0:1788201558.832708:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000132f621a[3 0000000043426732 2 1 0000000044063476 0 0 14] 00000080:00200000:3.0:1788201558.832711:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000047c9f231 17ffffc0001001 3:0 ffff8bc17274d2a0 14 lru 00000080:00200000:3.0:1788201558.832716:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000008a4964da 14: 1< 0 - - > 2< 57344 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.832718:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000132f621a 00000080:00200000:3.0:1788201558.832719:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 15. 00000080:00200000:3.0:1788201558.832721:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 15 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.832735:0:23731:0:(rw26.c:898:ll_write_end()) pos 61440, len 4096, copied 4096 00000080:00200000:3.0:1788201558.832750:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000833ae086[3 0000000043426732 2 1 0000000044063476 0 0 15] 00000080:00200000:3.0:1788201558.832753:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000006d6bf759 17ffffc0001001 3:0 ffff8bc17274db60 15 lru 00000080:00200000:3.0:1788201558.832766:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000df00ca82 15: 1< 0 - - > 2< 61440 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.832768:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000833ae086 00000080:00200000:3.0:1788201558.832769:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 16. 00000080:00200000:3.0:1788201558.832772:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 16 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.832808:0:23731:0:(rw26.c:898:ll_write_end()) pos 65536, len 4096, copied 4096 00000080:00200000:3.0:1788201558.832813:0:23731:0:(rw26.c:956:ll_write_end()) page@000000005798ab71[3 0000000043426732 2 1 0000000044063476 0 0 16] 00000080:00200000:3.0:1788201558.832816:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000cfc36300 17ffffc0001021 2:0 ffff8bc17274d700 16 lru 00000080:00200000:3.0:1788201558.832821:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000008647b0bb 16: 1< 0 - - > 2< 65536 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.832823:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000005798ab71 00000080:00200000:3.0:1788201558.832824:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 17. 00000080:00200000:3.0:1788201558.832826:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 17 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.832839:0:23731:0:(rw26.c:898:ll_write_end()) pos 69632, len 4096, copied 4096 00000080:00200000:3.0:1788201558.832842:0:23731:0:(rw26.c:956:ll_write_end()) page@000000004d19b61f[3 0000000043426732 2 1 0000000044063476 0 0 17] 00000080:00200000:3.0:1788201558.832845:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000fd3186ab 17ffffc0001001 3:0 ffff8bc17274d7e0 17 lru 00000080:00200000:3.0:1788201558.832850:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000902c81c5 17: 1< 0 - - > 2< 69632 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.832852:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000004d19b61f 00000080:00200000:3.0:1788201558.832853:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 18. 00000080:00200000:3.0:1788201558.832854:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 18 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.832866:0:23731:0:(rw26.c:898:ll_write_end()) pos 73728, len 4096, copied 4096 00000080:00200000:3.0:1788201558.832870:0:23731:0:(rw26.c:956:ll_write_end()) page@000000007caa6978[3 0000000043426732 2 1 0000000044063476 0 0 18] 00000080:00200000:3.0:1788201558.832873:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000470c426b 17ffffc0001001 3:0 ffff8bc17274d620 18 lru 00000080:00200000:3.0:1788201558.832878:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000000bbc8b16 18: 1< 0 - - > 2< 73728 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.832880:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000007caa6978 00000080:00200000:3.0:1788201558.832882:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 19. 00000080:00200000:3.0:1788201558.832883:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 19 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.832894:0:23731:0:(rw26.c:898:ll_write_end()) pos 77824, len 4096, copied 4096 00000080:00200000:3.0:1788201558.832898:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000046264e06[3 0000000043426732 2 1 0000000044063476 0 0 19] 00000080:00200000:3.0:1788201558.832901:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000007a113ac5 17ffffc0001001 3:0 ffff8bc17274dee0 19 lru 00000080:00200000:3.0:1788201558.832906:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000008fe1990d 19: 1< 0 - - > 2< 77824 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.832908:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000046264e06 00000080:00200000:3.0:1788201558.832909:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 20. 00000080:00200000:3.0:1788201558.832910:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 20 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.832925:0:23731:0:(rw26.c:898:ll_write_end()) pos 81920, len 4096, copied 4096 00000080:00200000:3.0:1788201558.832928:0:23731:0:(rw26.c:956:ll_write_end()) page@000000007890569d[3 0000000043426732 2 1 0000000044063476 0 0 20] 00000080:00200000:3.0:1788201558.832930:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000ed7a778c 17ffffc0001001 3:0 ffff8bc1726291c0 20 lru 00000080:00200000:3.0:1788201558.832936:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000f5b54ca2 20: 1< 0 - - > 2< 81920 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.832938:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000007890569d 00000080:00200000:3.0:1788201558.832940:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 21. 00000080:00200000:3.0:1788201558.832941:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 21 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.832956:0:23731:0:(rw26.c:898:ll_write_end()) pos 86016, len 4096, copied 4096 00000080:00200000:3.0:1788201558.832959:0:23731:0:(rw26.c:956:ll_write_end()) page@000000001d795f09[3 0000000043426732 2 1 0000000044063476 0 0 21] 00000080:00200000:3.0:1788201558.832962:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000f8e5d7c6 17ffffc0001001 3:0 ffff8bc172629380 21 lru 00000080:00200000:3.0:1788201558.832967:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000207d139f 21: 1< 0 - - > 2< 86016 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.832969:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000001d795f09 00000080:00200000:3.0:1788201558.832982:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 22. 00000080:00200000:3.0:1788201558.832984:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 22 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.832999:0:23731:0:(rw26.c:898:ll_write_end()) pos 90112, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833003:0:23731:0:(rw26.c:956:ll_write_end()) page@000000003d226dc2[3 0000000043426732 2 1 0000000044063476 0 0 22] 00000080:00200000:3.0:1788201558.833005:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000005f4ef390 17ffffc0001001 3:0 ffff8bc172629000 22 lru 00000080:00200000:3.0:1788201558.833010:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000016234c8b 22: 1< 0 - - > 2< 90112 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833013:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000003d226dc2 00000080:00200000:3.0:1788201558.833014:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 23. 00000080:00200000:3.0:1788201558.833015:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 23 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.833028:0:23731:0:(rw26.c:898:ll_write_end()) pos 94208, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833032:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000d8b70338[3 0000000043426732 2 1 0000000044063476 0 0 23] 00000080:00200000:3.0:1788201558.833034:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000003ecf2abe 17ffffc0001001 3:0 ffff8bc172629d20 23 lru 00000080:00200000:3.0:1788201558.833039:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000002fc00c4c 23: 1< 0 - - > 2< 94208 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833042:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000d8b70338 00000080:00200000:3.0:1788201558.833043:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 24. 00000080:00200000:3.0:1788201558.833044:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 24 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.833056:0:23731:0:(rw26.c:898:ll_write_end()) pos 98304, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833060:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000cc24c43b[3 0000000043426732 2 1 0000000044063476 0 0 24] 00000080:00200000:3.0:1788201558.833063:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000049da1e47 17ffffc0001001 3:0 ffff8bc172629460 24 lru 00000080:00200000:3.0:1788201558.833068:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000050b72d2c 24: 1< 0 - - > 2< 98304 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833070:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000cc24c43b 00000080:00200000:3.0:1788201558.833071:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 25. 00000080:00200000:3.0:1788201558.833073:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 25 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.833084:0:23731:0:(rw26.c:898:ll_write_end()) pos 102400, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833088:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000476363e2[3 0000000043426732 2 1 0000000044063476 0 0 25] 00000080:00200000:3.0:1788201558.833091:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000b7f33d2f 17ffffc0001001 3:0 ffff8bc1726292a0 25 lru 00000080:00200000:3.0:1788201558.833095:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000ba88aad5 25: 1< 0 - - > 2< 102400 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833097:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000476363e2 00000080:00200000:3.0:1788201558.833098:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 26. 00000080:00200000:3.0:1788201558.833099:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 26 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.833111:0:23731:0:(rw26.c:898:ll_write_end()) pos 106496, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833114:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000cbbc0411[3 0000000043426732 2 1 0000000044063476 0 0 26] 00000080:00200000:3.0:1788201558.833117:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000003f9ed31e 17ffffc0001001 3:0 ffff8bc172629b60 26 lru 00000080:00200000:3.0:1788201558.833121:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000001910f276 26: 1< 0 - - > 2< 106496 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833123:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000cbbc0411 00000080:00200000:3.0:1788201558.833124:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 27. 00000080:00200000:3.0:1788201558.833126:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 27 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.833140:0:23731:0:(rw26.c:898:ll_write_end()) pos 110592, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833145:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000092f2d223[3 0000000043426732 2 1 0000000044063476 0 0 27] 00000080:00200000:3.0:1788201558.833155:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000bb8bf80a 17ffffc0001001 3:0 ffff8bc172629700 27 lru 00000080:00200000:3.0:1788201558.833161:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000ece4322e 27: 1< 0 - - > 2< 110592 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833163:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000092f2d223 00000080:00200000:3.0:1788201558.833165:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 28. 00000080:00200000:3.0:1788201558.833167:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 28 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.833182:0:23731:0:(rw26.c:898:ll_write_end()) pos 114688, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833187:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000c6834efd[3 0000000043426732 2 1 0000000044063476 0 0 28] 00000080:00200000:3.0:1788201558.833190:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000d54a76f6 17ffffc0001001 3:0 ffff8bc1726297e0 28 lru 00000080:00200000:3.0:1788201558.833195:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000fc075ed3 28: 1< 0 - - > 2< 114688 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833197:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000c6834efd 00000080:00200000:3.0:1788201558.833198:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 29. 00000080:00200000:3.0:1788201558.833200:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 29 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.833214:0:23731:0:(rw26.c:898:ll_write_end()) pos 118784, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833219:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000d4077a30[3 0000000043426732 2 1 0000000044063476 0 0 29] 00000080:00200000:3.0:1788201558.833222:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000007cecd95 17ffffc0001001 3:0 ffff8bc172629620 29 lru 00000080:00200000:3.0:1788201558.833227:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000004e13de70 29: 1< 0 - - > 2< 118784 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833229:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000d4077a30 00000080:00200000:3.0:1788201558.833230:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 30. 00000080:00200000:3.0:1788201558.833232:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 30 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.833246:0:23731:0:(rw26.c:898:ll_write_end()) pos 122880, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833250:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000c911f58f[3 0000000043426732 2 1 0000000044063476 0 0 30] 00000080:00200000:3.0:1788201558.833253:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000072fc6928 17ffffc0001001 3:0 ffff8bc172629ee0 30 lru 00000080:00200000:3.0:1788201558.833258:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000696b8666 30: 1< 0 - - > 2< 122880 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833260:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000c911f58f 00000080:00200000:3.0:1788201558.833261:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 31. 00000080:00200000:3.0:1788201558.833262:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 31 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.833281:0:23731:0:(rw26.c:898:ll_write_end()) pos 126976, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833285:0:23731:0:(rw26.c:956:ll_write_end()) page@000000009379284f[3 0000000043426732 2 1 0000000044063476 0 0 31] 00000080:00200000:3.0:1788201558.833299:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000004b08395f 17ffffc0001021 2:0 ffff8bc172629e00 31 lru 00000080:00200000:3.0:1788201558.833304:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000003576cf 31: 1< 0 - - > 2< 126976 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833307:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000009379284f 00000080:00200000:3.0:1788201558.833308:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 32. 00000080:00200000:3.0:1788201558.833310:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 32 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.833325:0:23731:0:(rw26.c:898:ll_write_end()) pos 131072, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833329:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000a01d9e92[3 0000000043426732 2 1 0000000044063476 0 0 32] 00000080:00200000:3.0:1788201558.833332:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000be8e2b78 17ffffc0001001 3:0 ffff8bc1726298c0 32 lru 00000080:00200000:3.0:1788201558.833337:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000001602aced 32: 1< 0 - - > 2< 131072 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833339:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000a01d9e92 00000080:00200000:3.0:1788201558.833341:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 33. 00000080:00200000:3.0:1788201558.833342:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 33 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.833356:0:23731:0:(rw26.c:898:ll_write_end()) pos 135168, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833360:0:23731:0:(rw26.c:956:ll_write_end()) page@000000005f4a0438[3 0000000043426732 2 1 0000000044063476 0 0 33] 00000080:00200000:3.0:1788201558.833363:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000143f817f 17ffffc0001001 3:0 ffff8bc172629540 33 lru 00000080:00200000:3.0:1788201558.833368:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000743f0e41 33: 1< 0 - - > 2< 135168 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833370:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000005f4a0438 00000080:00200000:3.0:1788201558.833371:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 34. 00000080:00200000:3.0:1788201558.833373:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 34 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.833389:0:23731:0:(rw26.c:898:ll_write_end()) pos 139264, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833393:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000049b13dda[3 0000000043426732 2 1 0000000044063476 0 0 34] 00000080:00200000:3.0:1788201558.833395:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000031d18c1f 17ffffc0001001 3:0 ffff8bc172629a80 34 lru 00000080:00200000:3.0:1788201558.833400:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000043b2ad0b 34: 1< 0 - - > 2< 139264 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833402:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000049b13dda 00000080:00200000:3.0:1788201558.833404:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 35. 00000080:00200000:3.0:1788201558.833405:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 35 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.833419:0:23731:0:(rw26.c:898:ll_write_end()) pos 143360, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833424:0:23731:0:(rw26.c:956:ll_write_end()) page@000000008bcc7b5c[3 0000000043426732 2 1 0000000044063476 0 0 35] 00000080:00200000:3.0:1788201558.833426:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000017beb564 17ffffc0001001 3:0 ffff8bc172629c40 35 lru 00000080:00200000:3.0:1788201558.833430:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000009ee3cc07 35: 1< 0 - - > 2< 143360 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833432:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000008bcc7b5c 00000080:00200000:3.0:1788201558.833433:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 36. 00000080:00200000:3.0:1788201558.833435:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 36 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.833450:0:23731:0:(rw26.c:898:ll_write_end()) pos 147456, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833454:0:23731:0:(rw26.c:956:ll_write_end()) page@000000003ca18406[3 0000000043426732 2 1 0000000044063476 0 0 36] 00000080:00200000:3.0:1788201558.833456:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000db2e5aae 17ffffc0001001 3:0 ffff8bc1726299a0 36 lru 00000080:00200000:3.0:1788201558.833461:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000006fde31b5 36: 1< 0 - - > 2< 147456 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833462:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000003ca18406 00000080:00200000:3.0:1788201558.833463:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 37. 00000080:00200000:3.0:1788201558.833465:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 37 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.833477:0:23731:0:(rw26.c:898:ll_write_end()) pos 151552, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833482:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000582f8055[3 0000000043426732 2 1 0000000044063476 0 0 37] 00000080:00200000:3.0:1788201558.833484:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000004a4db596 17ffffc0001001 3:0 ffff8bc1726290e0 37 lru 00000080:00200000:3.0:1788201558.833488:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000000688fbd8 37: 1< 0 - - > 2< 151552 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833490:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000582f8055 00000080:00200000:3.0:1788201558.833491:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 38. 00000080:00200000:3.0:1788201558.833493:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 38 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.833506:0:23731:0:(rw26.c:898:ll_write_end()) pos 155648, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833511:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000fbf05110[3 0000000043426732 2 1 0000000044063476 0 0 38] 00000080:00200000:3.0:1788201558.833513:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000002692f463 17ffffc0001001 3:0 ffff8bc17266b460 38 lru 00000080:00200000:3.0:1788201558.833517:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000008809cbf2 38: 1< 0 - - > 2< 155648 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833519:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000fbf05110 00000080:00200000:3.0:1788201558.833520:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 39. 00000080:00200000:3.0:1788201558.833522:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 39 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.833536:0:23731:0:(rw26.c:898:ll_write_end()) pos 159744, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833540:0:23731:0:(rw26.c:956:ll_write_end()) page@000000003cab624d[3 0000000043426732 2 1 0000000044063476 0 0 39] 00000080:00200000:3.0:1788201558.833543:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000e5ea6ba1 17ffffc0001001 3:0 ffff8bc17266b2a0 39 lru 00000080:00200000:3.0:1788201558.833547:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000cd1cc05b 39: 1< 0 - - > 2< 159744 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833549:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000003cab624d 00000080:00200000:3.0:1788201558.833550:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 40. 00000080:00200000:3.0:1788201558.833552:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 40 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.833566:0:23731:0:(rw26.c:898:ll_write_end()) pos 163840, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833570:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000bef00e86[3 0000000043426732 2 1 0000000044063476 0 0 40] 00000080:00200000:3.0:1788201558.833573:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000019c50e35 17ffffc0001001 3:0 ffff8bc17266bb60 40 lru 00000080:00200000:3.0:1788201558.833577:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000a9971d95 40: 1< 0 - - > 2< 163840 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833580:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000bef00e86 00000080:00200000:3.0:1788201558.833582:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 41. 00000080:00200000:3.0:1788201558.833583:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 41 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.833599:0:23731:0:(rw26.c:898:ll_write_end()) pos 167936, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833603:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000ed3e0ba1[3 0000000043426732 2 1 0000000044063476 0 0 41] 00000080:00200000:3.0:1788201558.833606:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000fa1f85d1 17ffffc0001001 3:0 ffff8bc17266b700 41 lru 00000080:00200000:3.0:1788201558.833611:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000007d5c67e5 41: 1< 0 - - > 2< 167936 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833613:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000ed3e0ba1 00000080:00200000:3.0:1788201558.833615:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 42. 00000080:00200000:3.0:1788201558.833617:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 42 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.833631:0:23731:0:(rw26.c:898:ll_write_end()) pos 172032, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833634:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000074f2dd5d[3 0000000043426732 2 1 0000000044063476 0 0 42] 00000080:00200000:3.0:1788201558.833637:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000009eb30401 17ffffc0001001 3:0 ffff8bc17266b7e0 42 lru 00000080:00200000:3.0:1788201558.833642:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000557f8c21 42: 1< 0 - - > 2< 172032 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833644:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000074f2dd5d 00000080:00200000:3.0:1788201558.833645:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 43. 00000080:00200000:3.0:1788201558.833647:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 43 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.833660:0:23731:0:(rw26.c:898:ll_write_end()) pos 176128, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833664:0:23731:0:(rw26.c:956:ll_write_end()) page@000000008f0e92a0[3 0000000043426732 2 1 0000000044063476 0 0 43] 00000080:00200000:3.0:1788201558.833666:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000000d42df9d 17ffffc0001001 3:0 ffff8bc17266b620 43 lru 00000080:00200000:3.0:1788201558.833671:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000008cfed214 43: 1< 0 - - > 2< 176128 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833673:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000008f0e92a0 00000080:00200000:3.0:1788201558.833674:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 44. 00000080:00200000:3.0:1788201558.833676:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 44 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.833687:0:23731:0:(rw26.c:898:ll_write_end()) pos 180224, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833691:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000d201375c[3 0000000043426732 2 1 0000000044063476 0 0 44] 00000080:00200000:3.0:1788201558.833693:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000095b6e296 17ffffc0001001 3:0 ffff8bc17266bee0 44 lru 00000080:00200000:3.0:1788201558.833698:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000861bdc62 44: 1< 0 - - > 2< 180224 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833699:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000d201375c 00000080:00200000:3.0:1788201558.833701:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 45. 00000080:00200000:3.0:1788201558.833702:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 45 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.833716:0:23731:0:(rw26.c:898:ll_write_end()) pos 184320, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833720:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000c33b952e[3 0000000043426732 2 1 0000000044063476 0 0 45] 00000080:00200000:3.0:1788201558.833723:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000abba02ab 17ffffc0001001 3:0 ffff8bc17266be00 45 lru 00000080:00200000:3.0:1788201558.833727:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000008dcbba0 45: 1< 0 - - > 2< 184320 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833729:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000c33b952e 00000080:00200000:3.0:1788201558.833730:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 46. 00000080:00200000:3.0:1788201558.833731:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 46 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.833748:0:23731:0:(rw26.c:898:ll_write_end()) pos 188416, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833752:0:23731:0:(rw26.c:956:ll_write_end()) page@000000001195d930[3 0000000043426732 2 1 0000000044063476 0 0 46] 00000080:00200000:3.0:1788201558.833755:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000001ee4a30e 17ffffc0001021 2:0 ffff8bc17266b8c0 46 lru 00000080:00200000:3.0:1788201558.833759:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000065b1e5ee 46: 1< 0 - - > 2< 188416 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833761:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000001195d930 00000080:00200000:3.0:1788201558.833762:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 47. 00000080:00200000:3.0:1788201558.833764:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 47 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.833778:0:23731:0:(rw26.c:898:ll_write_end()) pos 192512, len 4096, copied 4096 00000080:00200000:3.0:1788201558.833782:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000008d7088b[3 0000000043426732 2 1 0000000044063476 0 0 47] 00000080:00200000:3.0:1788201558.833785:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000e831a4d1 17ffffc0001001 3:0 ffff8bc17266b540 47 lru 00000080:00200000:3.0:1788201558.833815:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000001224dc52 47: 1< 0 - - > 2< 192512 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833818:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000008d7088b 00000080:00200000:3.0:1788201558.833819:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 48. 00000080:00200000:3.0:1788201558.833821:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 48 of 0 to 2680 bytes 00000080:00200000:3.0:1788201558.833847:0:23731:0:(rw26.c:898:ll_write_end()) pos 196608, len 2680, copied 2680 00000080:00200000:3.0:1788201558.833851:0:23731:0:(rw26.c:956:ll_write_end()) page@000000007fa2cc86[3 0000000043426732 2 1 0000000044063476 0 0 48] 00000080:00200000:3.0:1788201558.833854:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000b7e84f15 17ffffc0001001 3:0 ffff8bc17266ba80 48 lru 00000080:00200000:3.0:1788201558.833859:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000d7f7bc4e 48: 1< 0 - - > 2< 196608 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.833861:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000007fa2cc86 00000080:00200000:3.0:1788201558.833862:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 49. 00000080:00200000:3.0:1788201558.833866:0:23731:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 49, from 0, to 2680 prio 0 00000008:00010000:3.0:1788201558.833895:0:23731:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000f9bccc34 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000012c9f1c0/0xd138388016f6eab3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094ddc expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201558.833949:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459f2378, count 15, dirtied 15 00000080:00200000:3.0:1788201558.833968:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459f2378, count 15, dirtied 15 00000080:00200000:3.0:1788201558.833991:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459f2378, count 15, dirtied 15 00000080:00200000:3.0:1788201558.833997:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459f2378, count 4, dirtied 4 00000080:00200000:3.0:1788201558.834000:0:23731:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 49 pages 199288 bytes, tot: 199288 00000080:00200000:3.0:1788201558.834004:0:23731:0:(vvp_io.c:1358:vvp_io_write_start()) sanity-lnet.sh: write bytes 0, result: 199288 00000020:00010000:3.0:1788201558.834020:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc149844128 (ffff8bc146919518/0) at cl_lock_release():245 00000020:00010000:3.0:1788201558.834023:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149844128 (ffff8bc146919518/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201558.834027:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d330 (ffff8bc146919e18/1) at cl_lock_cancel():142 00010000:00010000:3.0:1788201558.834035:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000012c9f1c0/0xd138388016f6eab3 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094ddc expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.834046:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000012c9f1c0/0xd138388016f6eab3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094ddc expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1788201558.834062:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149844128 (ffff8bc146919518/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201558.834065:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d330 (ffff8bc146919518/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201558.834074:0:23731:0:(vvp_io.c:533:vvp_io_advance()) advancing 199288 bytes 00000080:00200000:3.0:1788201558.834082:0:23731:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 48] 00000080:00200000:3.0:1788201558.834120:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x122:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201558.834125:0:23731:0:(file.c:2238:ll_file_io_generic()) sanity-lnet.sh: 2 io complete with rc: 0, result: 199288, restart: 0 00000080:00200000:3.0:1788201558.834132:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x122:0x0] updating i_size 199288 i_blocks 1 00000080:00200000:3.0:1788201558.834137:0:23731:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 199288 00000080:00200008:3.0:1788201558.834182:0:23731:0:(file.c:479:ll_file_release()) START file sanity-lnet.sh:[0x200000bd7:0x122:0x0](ffff8bc1459f21c8), flags 100001 00000002:00100000:3.0:1788201558.834238:0:23731:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc14415ad80 x1875064727851264/t8589937107(8589937107) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201574 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1788201558.834249:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1788201558.834255:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146c58a80 x1875064727851904/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1788201558.834277:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c58a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727851904:192.168.201.143@tcp:35:cp.0 00000100:00100000:3.0:1788201558.837638:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1450a6300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201558.838685:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727851648:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201558.845883:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144159880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727852032:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201558.845904:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645da00/0xd138388016f6eaba lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.845915:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645da00/0xd138388016f6eaba lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.845920:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645da00/0xd138388016f6eaba lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.845924:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645da00/0xd138388016f6eaba lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.845931:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645da00/0xd138388016f6eaba lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.845935:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc16645da00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201558.845938:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645da00/0xd138388016f6eaba lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.845942:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645da00/0xd138388016f6eaba lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.845947:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645da00/0xd138388016f6eaba lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.845952:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201558.845956:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645da00/0xd138388016f6eaba lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.845960:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645da00/0xd138388016f6eaba lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201558.845983:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc144159880 x1875064727852032/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201574 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201558.845998:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201558.846019:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:3.0:1788201558.846068:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201558.846079:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201558.846086:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 249 lru_type: 1 00010000:00010000:3.0:1788201558.846205:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 249 lru_type: 1 00000080:00200000:3.0:1788201558.846215:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201558.846221:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201558.846225:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201558.846231:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201558.846235:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 249 lru_type: 1 00010000:00010000:3.0:1788201558.846243:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 250 lru_type: 1 00000080:00200000:3.0:1788201558.846259:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201558.846266:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201558.846272:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201558.846283:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-lsnapshot.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=8 00000080:00200000:3.0:1788201558.846288:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-lsnapshot.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:3.0:1788201558.846300:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-lsnapshot.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201558.846338:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eac1 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.846345:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eac1 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.846355:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eac1 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201558.846375:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c5a300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727852160:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201558.846490:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1450a6300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201558.849088:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c5a300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727852160:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201558.849219:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eac1 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.849231:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eac1 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.849238:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eac1 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.849245:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eac1 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.849256:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eac1 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.849261:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14400c600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201558.849265:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eac1 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.849269:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eac1 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.849274:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eac1 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.849279:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201558.849283:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eac1 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.849287:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eac1 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201558.849300:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc146c5a300 x1875064727852160/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201574 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201558.849312:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201558.849334:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:3.0:1788201558.849428:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201558.849443:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201558.849452:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 250 lru_type: 1 00010000:00010000:3.0:1788201558.849467:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 250 lru_type: 1 00000080:00200000:3.0:1788201558.849471:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201558.849475:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201558.849478:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201558.849482:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3bf8 00010000:00010000:3.0:1788201558.849485:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 250 lru_type: 1 00010000:00010000:3.0:1788201558.849490:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 251 lru_type: 1 00000080:00200000:3.0:1788201558.849501:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201558.849506:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201558.849510:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201558.849519:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:3.0:1788201558.849522:0:23731:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sanity-lsnapshot.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), file ffff8bc143847680, open_flags 80c1, mode 81ed opened 0 00000080:00200000:3.0:1788201558.849527:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-lsnapshot.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000002:00010000:3.0:1788201558.849542:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-lsnapshot.sh,[0x200000bd7:0x123:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open|creat flags 0100302 00010000:00010000:3.0:1788201558.849578:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.849583:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1788201558.849594:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1788201558.849599:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146c5a300 x1875064727852416/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1788201558.849605:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201558.849620:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c5a300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727852416:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201558.849967:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1450a6300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201558.853460:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c5a300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727852416:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201558.853489:0:23731:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.853510:0:23731:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x123:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.853517:0:23731:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.853529:0:23731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.853539:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.853552:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.853564:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.853571:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201558.853581:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc146c5a300 x1875064727852416/t8589937109(8589937109) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201574 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1788201558.853608:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc146c5a300 x1875064727852416/t8589937109(8589937109) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201574 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201558.853623:0:23731:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1788201558.853637:0:23731:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.853647:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/291 (0 0) 00000080:00200000:3.0:1788201558.853654:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1788201558.853669:0:23731:0:(namei.c:1628:ll_create_it()) VFS Op:name=sanity-lsnapshot.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000080:00200000:3.0:1788201558.853706:0:23731:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x123:0x0](ffff8bc1459d2a08) 00000080:00200000:3.0:1788201558.853894:0:23731:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x123:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1788201558.853902:0:23731:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x123:0x0](ffff8bc1459d2a08) 00000080:00010000:3.0:1788201558.853904:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x123:0x0](ffff8bc1459d2a08) for lock 0xd138388016f6eac8 00000080:00010000:3.0:1788201558.853912:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x123:0x0](ffff8bc1459d2a08) 00000080:00200008:3.0:1788201558.853923:0:23731:0:(file.c:1090:ll_file_open()) START file sanity-lsnapshot.sh:[0x200000bd7:0x123:0x0](ffff8bc1459d2a08), flags 100301 00000002:00100000:3.0:1788201558.853939:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc146c5a300 x1875064727852416/t8589937109(8589937109) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201574 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1788201558.853986:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eac8 from it ffff8bc148c9bc00 00010000:00010000:3.0:1788201558.853992:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.854006:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201558.854030:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x123:0x0](ffff8bc1459d2a08), inode mode 81ed mask 40 00000080:00200008:3.0:1788201558.854056:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file sanity-lsnapshot.sh:[0x200000bd7:0x123:0x0](ffff8bc1459d2a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201558.854062:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x123:0x0](ffff8bc1459d2a08),name=sanity-lsnapshot.sh 00000002:00010000:3.0:1788201558.854080:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x123:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201558.854091:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.854103:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201558.854110:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201558.854114:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x123:0x0](ffff8bc1459d2a08) 00000080:00010000:3.0:1788201558.854118:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x123:0x0](ffff8bc1459d2a08) for lock 0xd138388016f6eac8 00000080:00010000:3.0:1788201558.854122:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eac8 from it ffffadd1c7da3cd8 00010000:00010000:3.0:1788201558.854125:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.854133:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201558.854525:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x123:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201558.854536:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x123:0x0] 00000008:00010000:3.0:1788201558.854566:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201558.854570:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc144008e30, osc lock ffff8bc14691ad10, flags 0x400001002 00010000:00010000:3.0:1788201558.854617:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eacf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.854628:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eacf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201558.854705:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727852544:192.168.201.143@tcp:101:cp.0 00000020:00200000:3.0:1788201558.854910:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1788201558.857444:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x123:0x0] updating i_size 0 i_blocks 1 00000020:00010000:3.0:1788201558.857450:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc72e0 (ffff8bc1460e9368/0) at cl_lock_release():245 00000020:00010000:3.0:1788201558.857454:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc72e0 (ffff8bc1460e9368/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201558.857459:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc144008e30 (ffff8bc1460e9248/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201558.857463:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc72e0 (ffff8bc1460e9368/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201558.857466:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc144008e30 (ffff8bc1460e9368/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201558.857500:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x123:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1788201558.857555:0:23731:0:(file.c:2638:do_file_write_iter()) START file sanity-lsnapshot.sh:[0x200000bd7:0x123:0x0], ppos: 0, count: 10934 00000080:00200000:3.0:1788201558.857580:0:23731:0:(file.c:2090:ll_file_io_generic()) sanity-lsnapshot.sh: write ppos: 0, bytes: 10934 00000080:00200000:3.0:1788201558.857586:0:23731:0:(file.c:1848:ll_io_set_mirror()) sanity-lsnapshot.sh: desiginated mirror: 0 00000020:00200000:3.0:1788201558.857592:0:23731:0:(cl_io.c:214:cl_io_rw_init()) header@00000000d9263f38[0x110, 1, [0x200000bd7:0x123:0x0] hash] 00000020:00200000:3.0:1788201558.857594:0:23731:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 10934) 0 0 00000080:00200000:3.0:1788201558.857598:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x123:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201558.857610:0:23731:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 2] 00020000:00200000:3.0:1788201558.857618:0:23731:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 10934) 10934, 10934 00020000:00200000:3.0:1788201558.857622:0:23731:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1788201558.857647:0:23731:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 2] 00000008:00010000:3.0:1788201558.857658:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1788201558.857662:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc144008e30, osc lock ffff8bc14691ad10, flags 0x0 00010000:00010000:3.0:1788201558.857674:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/408 (0 12287) 00010000:00010000:3.0:1788201558.857705:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x198:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.857715:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x198:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.857725:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x198:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201558.857949:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c5ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727852672:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201558.858034:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201558.862677:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743442944 00000100:00100000:1.0:1788201558.862688:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743442944 00000100:00100000:1.0:1788201558.862749:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 588 00000100:00100000:1.0:1788201558.862967:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17270aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23413:x1875064743442944:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201558.862992:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eacf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x198:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094e30 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.863106:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201558.863113:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17270aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23413:x1875064743442944:12345-192.168.201.143@tcp:104: Request processed in 355us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201558.863121:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 588 00000100:00100000:3.0:1788201558.863404:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727852800:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201558.866379:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c5ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727852672:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201558.866410:0:23731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.866424:0:23731:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.866432:0:23731:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201558.866682:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743443072 00000100:00100000:1.0:1788201558.866689:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743443072 00000100:00100000:1.0:1788201558.866741:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 589 00000100:00100000:1.0:1788201558.866750:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172708e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743443072:12345-192.168.201.143@tcp:105: 00010000:00010000:1.0:1788201558.866760:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.866770:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.866780:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.866817:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.866826:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.866836:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.866858:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc143a48a00) 00000100:00100000:1.0:1788201558.866921:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172708e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743443072:12345-192.168.201.143@tcp:105: Request processed in 172us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201558.866929:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 589 00010000:00010000:3.0:1788201558.867392:0:23731:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.867403:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.867419:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201558.867432:0:23731:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.867445:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.867453:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201558.867485:0:23731:0:(vvp_io.c:1292:vvp_io_write_start()) sanity-lsnapshot.sh: write [0, 10934) append 0 append lockpos 0 00000080:00200000:3.0:1788201558.867504:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.867558:0:23731:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:3.0:1788201558.867570:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000f8d49f45[3 000000009ebe4eab 2 1 00000000a46cf215 0 0 0] 00000080:00200000:3.0:1788201558.867574:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000c6ea4f1c 17ffffc0001001 3:0 ffff8bc17266bc40 0 lru 00000080:00200000:3.0:1788201558.867582:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000009a3dbd19 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000362ed8c6 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.867584:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000f8d49f45 00000080:00200000:3.0:1788201558.867585:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201558.867591:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.867613:0:23731:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:3.0:1788201558.867617:0:23731:0:(rw26.c:956:ll_write_end()) page@000000008dd03b8c[3 000000009ebe4eab 2 1 00000000a46cf215 0 0 1] 00000080:00200000:3.0:1788201558.867621:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000d1d92a74 17ffffc0001001 3:0 ffff8bc17266b9a0 1 lru 00000080:00200000:3.0:1788201558.867626:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000005a5d9d0d 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 00000000362ed8c6 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.867628:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000008dd03b8c 00000080:00200000:3.0:1788201558.867630:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:3.0:1788201558.867632:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 2742 bytes 00000080:00200000:3.0:1788201558.867649:0:23731:0:(rw26.c:898:ll_write_end()) pos 8192, len 2742, copied 2742 00000080:00200000:3.0:1788201558.867653:0:23731:0:(rw26.c:956:ll_write_end()) page@000000003f8a8c86[3 000000009ebe4eab 2 1 00000000a46cf215 0 0 2] 00000080:00200000:3.0:1788201558.867655:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000fbe42de6 17ffffc0001001 3:0 ffff8bc17266b0e0 2 lru 00000080:00200000:3.0:1788201558.867661:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000abd09cfa 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000000ce25486 00000000362ed8c6 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.867663:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000003f8a8c86 00000080:00200000:3.0:1788201558.867664:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:3.0:1788201558.867667:0:23731:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 3, from 0, to 2742 prio 0 00000008:00010000:3.0:1788201558.867688:0:23731:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000f007d240 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201558.867707:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d2bb8, count 3, dirtied 3 00000080:00200000:3.0:1788201558.867713:0:23731:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 3 pages 10934 bytes, tot: 10934 00000080:00200000:3.0:1788201558.867716:0:23731:0:(vvp_io.c:1358:vvp_io_write_start()) sanity-lsnapshot.sh: write bytes 0, result: 10934 00000020:00010000:3.0:1788201558.867730:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460e6d58 (ffff8bc1460e9368/0) at cl_lock_release():245 00000020:00010000:3.0:1788201558.867743:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460e6d58 (ffff8bc1460e9368/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201558.867746:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc144008e30 (ffff8bc1460e9248/1) at cl_lock_cancel():142 00010000:00010000:3.0:1788201558.867751:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.867761:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1788201558.867775:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460e6d58 (ffff8bc1460e9368/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201558.867779:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc144008e30 (ffff8bc1460e9368/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201558.867788:0:23731:0:(vvp_io.c:533:vvp_io_advance()) advancing 10934 bytes 00000080:00200000:3.0:1788201558.868115:0:23731:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 2] 00000080:00200000:3.0:1788201558.868163:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x123:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201558.868168:0:23731:0:(file.c:2238:ll_file_io_generic()) sanity-lsnapshot.sh: 2 io complete with rc: 0, result: 10934, restart: 0 00000100:00100000:1.0:1788201558.870323:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727852800:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201558.901379:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727853696:192.168.201.143@tcp:101:cp.0 00000080:00200000:3.0:1788201558.905589:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x124:0x0] updating i_size 0 i_blocks 1 00000020:00010000:3.0:1788201558.905596:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc146005280 (ffff8bc146919908/0) at cl_lock_release():245 00000020:00010000:3.0:1788201558.905600:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146005280 (ffff8bc146919908/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201558.905609:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d930 (ffff8bc146919368/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201558.905614:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146005280 (ffff8bc146919908/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201558.905616:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d930 (ffff8bc146919908/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201558.905661:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x124:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1788201558.905856:0:23731:0:(file.c:2638:do_file_write_iter()) START file sanityn.sh:[0x200000bd7:0x124:0x0], ppos: 0, count: 227516 00000080:00200000:3.0:1788201558.905889:0:23731:0:(file.c:2090:ll_file_io_generic()) sanityn.sh: write ppos: 0, bytes: 227516 00000080:00200000:3.0:1788201558.905894:0:23731:0:(file.c:1848:ll_io_set_mirror()) sanityn.sh: desiginated mirror: 0 00000020:00200000:3.0:1788201558.905900:0:23731:0:(cl_io.c:214:cl_io_rw_init()) header@0000000044b8a69f[0x110, 1, [0x200000bd7:0x124:0x0] hash] 00000020:00200000:3.0:1788201558.905902:0:23731:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 227516) 0 0 00000080:00200000:3.0:1788201558.905906:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x124:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201558.905919:0:23731:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 55] 00020000:00200000:3.0:1788201558.905928:0:23731:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 227516) 227516, 227516 00020000:00200000:3.0:1788201558.905933:0:23731:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1788201558.905965:0:23731:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 55] 00000008:00010000:3.0:1788201558.905989:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1788201558.905994:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc144008e30, osc lock ffff8bc14691ad10, flags 0x0 00010000:00010000:3.0:1788201558.906010:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/409 (0 229375) 00010000:00010000:3.0:1788201558.906048:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x199:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.906057:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x199:0x0].0x0 rrc: 3 type: EXT [0->229375] (req 0->229375) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.906072:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x199:0x0].0x0 rrc: 3 type: EXT [0->229375] (req 0->229375) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201558.906093:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c5ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727853824:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201558.906195:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201558.910693:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743443200 00000100:00100000:1.0:1788201558.910702:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743443200 00000100:00100000:1.0:1788201558.910765:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 590 00000100:00100000:1.0:1788201558.910776:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14415a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:28099:x1875064743443200:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201558.910830:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000800b6d4e/0xd138388016f6eaf2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x199:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094e8b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201558.911115:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201558.911123:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14415a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:28099:x1875064743443200:12345-192.168.201.143@tcp:104: Request processed in 349us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201558.911131:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 590 00000100:00100000:3.0:1788201558.916185:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727853952:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201558.927373:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c5ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727853824:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201558.927396:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.927416:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201558.927430:0:23731:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.927444:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.927462:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201558.927494:0:23731:0:(vvp_io.c:1292:vvp_io_write_start()) sanityn.sh: write [0, 227516) append 0 append lockpos 0 00000080:00200000:3.0:1788201558.927512:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.927560:0:23731:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:3.0:1788201558.927572:0:23731:0:(rw26.c:956:ll_write_end()) page@000000009bb0116d[3 0000000021951b30 2 1 00000000aedd57cb 0 0 0] 00000080:00200000:3.0:1788201558.927576:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000051ff6d10 17ffffc0001001 3:0 ffff8bc17266b1c0 0 lru 00000080:00200000:3.0:1788201558.927583:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000007ac1b3a3 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.927585:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000009bb0116d 00000080:00200000:3.0:1788201558.927587:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201558.927590:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.927613:0:23731:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:3.0:1788201558.927618:0:23731:0:(rw26.c:956:ll_write_end()) page@000000002e3bd07e[3 0000000021951b30 2 1 00000000aedd57cb 0 0 1] 00000080:00200000:3.0:1788201558.927621:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000001346aac6 17ffffc0001001 3:0 ffff8bc17266b380 1 lru 00000080:00200000:3.0:1788201558.927626:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000005ba7a024 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.927628:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000002e3bd07e 00000080:00200000:3.0:1788201558.927629:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:3.0:1788201558.927631:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.927648:0:23731:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:3.0:1788201558.927653:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000664eb600[3 0000000021951b30 2 1 00000000aedd57cb 0 0 2] 00000080:00200000:3.0:1788201558.927656:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000016592921 17ffffc0001001 3:0 ffff8bc17266b000 2 lru 00000080:00200000:3.0:1788201558.927661:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000079cae703 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.927663:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000664eb600 00000080:00200000:3.0:1788201558.927664:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:3.0:1788201558.927666:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.927682:0:23731:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:3.0:1788201558.927687:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000225ccdf0[3 0000000021951b30 2 1 00000000aedd57cb 0 0 3] 00000080:00200000:3.0:1788201558.927690:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000e985a02b 17ffffc0001001 3:0 ffff8bc17266bd20 3 lru 00000080:00200000:3.0:1788201558.927695:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000ca1106f2 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.927697:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000225ccdf0 00000080:00200000:3.0:1788201558.927698:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:3.0:1788201558.927700:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.927715:0:23731:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:3.0:1788201558.927719:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000000f861cc[3 0000000021951b30 2 1 00000000aedd57cb 0 0 4] 00000080:00200000:3.0:1788201558.927722:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000061403663 17ffffc0001001 3:0 ffff8bc143eed460 4 lru 00000080:00200000:3.0:1788201558.928197:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000076a05f91 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.928309:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000000f861cc 00000080:00200000:3.0:1788201558.928312:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:3.0:1788201558.928314:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.928337:0:23731:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:3.0:1788201558.928342:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000f0df03db[3 0000000021951b30 2 1 00000000aedd57cb 0 0 5] 00000080:00200000:3.0:1788201558.928345:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000de5bbb4a 17ffffc0001001 3:0 ffff8bc143eed2a0 5 lru 00000080:00200000:3.0:1788201558.928362:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000005af92133 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.928365:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000f0df03db 00000080:00200000:3.0:1788201558.928366:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:3.0:1788201558.928368:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.928385:0:23731:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:3.0:1788201558.928389:0:23731:0:(rw26.c:956:ll_write_end()) page@000000009058b28e[3 0000000021951b30 2 1 00000000aedd57cb 0 0 6] 00000080:00200000:3.0:1788201558.928392:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000bc58a62c 17ffffc0001001 3:0 ffff8bc143eedb60 6 lru 00000080:00200000:3.0:1788201558.928398:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000007bd4118a 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.928400:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000009058b28e 00000080:00200000:3.0:1788201558.928401:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:3.0:1788201558.928403:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.928416:0:23731:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:3.0:1788201558.928421:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000c055c8e7[3 0000000021951b30 2 1 00000000aedd57cb 0 0 7] 00000080:00200000:3.0:1788201558.928424:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000613031eb 17ffffc0001001 3:0 ffff8bc143eed700 7 lru 00000080:00200000:3.0:1788201558.928429:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000055a39867 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.928432:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000c055c8e7 00000080:00200000:3.0:1788201558.928433:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:3.0:1788201558.928435:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.928446:0:23731:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:3.0:1788201558.928451:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000053748183[3 0000000021951b30 2 1 00000000aedd57cb 0 0 8] 00000080:00200000:3.0:1788201558.928453:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000be1b33be 17ffffc0001001 3:0 ffff8bc143eed7e0 8 lru 00000080:00200000:3.0:1788201558.928458:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000005ba1a62a 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.928460:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000053748183 00000080:00200000:3.0:1788201558.928461:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:3.0:1788201558.928464:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.928483:0:23731:0:(rw26.c:898:ll_write_end()) pos 36864, len 4096, copied 4096 00000080:00200000:3.0:1788201558.928488:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000004189a46[3 0000000021951b30 2 1 00000000aedd57cb 0 0 9] 00000080:00200000:3.0:1788201558.928491:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000df2811b6 17ffffc0001021 2:0 ffff8bc143eed620 9 lru 00000080:00200000:3.0:1788201558.928496:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000099b28825 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.928499:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000004189a46 00000080:00200000:3.0:1788201558.928500:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:3.0:1788201558.928502:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 10 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.928518:0:23731:0:(rw26.c:898:ll_write_end()) pos 40960, len 4096, copied 4096 00000080:00200000:3.0:1788201558.928522:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000006e5673d[3 0000000021951b30 2 1 00000000aedd57cb 0 0 10] 00000080:00200000:3.0:1788201558.928525:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000003dce96a6 17ffffc0001001 3:0 ffff8bc143eedee0 10 lru 00000080:00200000:3.0:1788201558.928530:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000001b7aec53 10: 1< 0 - - > 2< 40960 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.928532:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000006e5673d 00000080:00200000:3.0:1788201558.928533:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 11. 00000080:00200000:3.0:1788201558.928535:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 11 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.928549:0:23731:0:(rw26.c:898:ll_write_end()) pos 45056, len 4096, copied 4096 00000080:00200000:3.0:1788201558.928553:0:23731:0:(rw26.c:956:ll_write_end()) page@000000004ad832e8[3 0000000021951b30 2 1 00000000aedd57cb 0 0 11] 00000080:00200000:3.0:1788201558.928556:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000924f18d5 17ffffc0001001 3:0 ffff8bc143eede00 11 lru 00000080:00200000:3.0:1788201558.928561:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000dbc2a9dc 11: 1< 0 - - > 2< 45056 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.928563:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000004ad832e8 00000080:00200000:3.0:1788201558.928564:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 12. 00000080:00200000:3.0:1788201558.928566:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 12 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.928581:0:23731:0:(rw26.c:898:ll_write_end()) pos 49152, len 4096, copied 4096 00000080:00200000:3.0:1788201558.928585:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000094b1d157[3 0000000021951b30 2 1 00000000aedd57cb 0 0 12] 00000080:00200000:3.0:1788201558.928588:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000093ba4dcb 17ffffc0001001 3:0 ffff8bc143eed8c0 12 lru 00000080:00200000:3.0:1788201558.928593:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000073c5eab1 12: 1< 0 - - > 2< 49152 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.928596:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000094b1d157 00000080:00200000:3.0:1788201558.928597:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 13. 00000080:00200000:3.0:1788201558.928599:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 13 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.928614:0:23731:0:(rw26.c:898:ll_write_end()) pos 53248, len 4096, copied 4096 00000080:00200000:3.0:1788201558.928619:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000054d8ee2b[3 0000000021951b30 2 1 00000000aedd57cb 0 0 13] 00000080:00200000:3.0:1788201558.928622:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000007d0234ce 17ffffc0001001 3:0 ffff8bc143eed540 13 lru 00000080:00200000:3.0:1788201558.928628:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000d9593a0f 13: 1< 0 - - > 2< 53248 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.928630:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000054d8ee2b 00000080:00200000:3.0:1788201558.928632:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 14. 00000080:00200000:3.0:1788201558.928634:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 14 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.928648:0:23731:0:(rw26.c:898:ll_write_end()) pos 57344, len 4096, copied 4096 00000080:00200000:3.0:1788201558.928653:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000caf07fd9[3 0000000021951b30 2 1 00000000aedd57cb 0 0 14] 00000080:00200000:3.0:1788201558.928655:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000ce232827 17ffffc0001001 3:0 ffff8bc143eeda80 14 lru 00000080:00200000:3.0:1788201558.928661:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000004f4b7dc7 14: 1< 0 - - > 2< 57344 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.928663:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000caf07fd9 00000080:00200000:3.0:1788201558.928665:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 15. 00000080:00200000:3.0:1788201558.928667:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 15 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.928681:0:23731:0:(rw26.c:898:ll_write_end()) pos 61440, len 4096, copied 4096 00000080:00200000:3.0:1788201558.928686:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000bfec721a[3 0000000021951b30 2 1 00000000aedd57cb 0 0 15] 00000080:00200000:3.0:1788201558.928689:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000039bdd4c1 17ffffc0001001 3:0 ffff8bc143eedc40 15 lru 00000080:00200000:3.0:1788201558.928695:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000006e3e793 15: 1< 0 - - > 2< 61440 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.928697:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000bfec721a 00000080:00200000:3.0:1788201558.928698:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 16. 00000080:00200000:3.0:1788201558.928700:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 16 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.928715:0:23731:0:(rw26.c:898:ll_write_end()) pos 65536, len 4096, copied 4096 00000080:00200000:3.0:1788201558.928720:0:23731:0:(rw26.c:956:ll_write_end()) page@000000002ae25873[3 0000000021951b30 2 1 00000000aedd57cb 0 0 16] 00000080:00200000:3.0:1788201558.928723:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000234aab53 17ffffc0001001 3:0 ffff8bc143eed9a0 16 lru 00000080:00200000:3.0:1788201558.930343:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000005386b465 16: 1< 0 - - > 2< 65536 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.930362:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000002ae25873 00000080:00200000:3.0:1788201558.930364:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 17. 00000080:00200000:3.0:1788201558.930370:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 17 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.930414:0:23731:0:(rw26.c:898:ll_write_end()) pos 69632, len 4096, copied 4096 00000080:00200000:3.0:1788201558.930421:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000ce698628[3 0000000021951b30 2 1 00000000aedd57cb 0 0 17] 00000080:00200000:3.0:1788201558.930424:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000f9748197 17ffffc0001001 3:0 ffff8bc143eed0e0 17 lru 00000080:00200000:3.0:1788201558.930431:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000003eb7a22d 17: 1< 0 - - > 2< 69632 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.930434:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000ce698628 00000080:00200000:3.0:1788201558.930435:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 18. 00000080:00200000:3.0:1788201558.930438:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 18 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.930454:0:23731:0:(rw26.c:898:ll_write_end()) pos 73728, len 4096, copied 4096 00000080:00200000:3.0:1788201558.930459:0:23731:0:(rw26.c:956:ll_write_end()) page@000000002afd3346[3 0000000021951b30 2 1 00000000aedd57cb 0 0 18] 00000080:00200000:3.0:1788201558.930463:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000003e229abb 17ffffc0001001 3:0 ffff8bc143eed1c0 18 lru 00000080:00200000:3.0:1788201558.930468:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000002eb7c8b9 18: 1< 0 - - > 2< 73728 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.930470:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000002afd3346 00000080:00200000:3.0:1788201558.930471:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 19. 00000080:00200000:3.0:1788201558.930474:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 19 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.930486:0:23731:0:(rw26.c:898:ll_write_end()) pos 77824, len 4096, copied 4096 00000080:00200000:3.0:1788201558.930490:0:23731:0:(rw26.c:956:ll_write_end()) page@000000008c29354c[3 0000000021951b30 2 1 00000000aedd57cb 0 0 19] 00000080:00200000:3.0:1788201558.930493:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000001cdd405f 17ffffc0001001 3:0 ffff8bc143eed380 19 lru 00000080:00200000:3.0:1788201558.930498:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000006704cdcb 19: 1< 0 - - > 2< 77824 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.930501:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000008c29354c 00000080:00200000:3.0:1788201558.930502:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 20. 00000080:00200000:3.0:1788201558.930504:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 20 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.930517:0:23731:0:(rw26.c:898:ll_write_end()) pos 81920, len 4096, copied 4096 00000080:00200000:3.0:1788201558.930522:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000dfeb011b[3 0000000021951b30 2 1 00000000aedd57cb 0 0 20] 00000080:00200000:3.0:1788201558.930525:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000008aeeb3d7 17ffffc0001001 3:0 ffff8bc143eed000 20 lru 00000080:00200000:3.0:1788201558.930531:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000762dd019 20: 1< 0 - - > 2< 81920 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.930534:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000dfeb011b 00000080:00200000:3.0:1788201558.930535:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 21. 00000080:00200000:3.0:1788201558.930537:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 21 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.930549:0:23731:0:(rw26.c:898:ll_write_end()) pos 86016, len 4096, copied 4096 00000080:00200000:3.0:1788201558.930553:0:23731:0:(rw26.c:956:ll_write_end()) page@000000003d10d73f[3 0000000021951b30 2 1 00000000aedd57cb 0 0 21] 00000080:00200000:3.0:1788201558.930556:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000ef685503 17ffffc0001001 3:0 ffff8bc143eedd20 21 lru 00000080:00200000:3.0:1788201558.930562:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000081c674ef 21: 1< 0 - - > 2< 86016 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.930564:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000003d10d73f 00000080:00200000:3.0:1788201558.930565:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 22. 00000080:00200000:3.0:1788201558.930567:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 22 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.930581:0:23731:0:(rw26.c:898:ll_write_end()) pos 90112, len 4096, copied 4096 00000080:00200000:3.0:1788201558.930586:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000c05ce104[3 0000000021951b30 2 1 00000000aedd57cb 0 0 22] 00000080:00200000:3.0:1788201558.930589:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000008060cb08 17ffffc0001001 3:0 ffff8bc150734ee0 22 lru 00000080:00200000:3.0:1788201558.930608:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000077424d18 22: 1< 0 - - > 2< 90112 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.930610:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000c05ce104 00000080:00200000:3.0:1788201558.930611:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 23. 00000080:00200000:3.0:1788201558.930613:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 23 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.930630:0:23731:0:(rw26.c:898:ll_write_end()) pos 94208, len 4096, copied 4096 00000080:00200000:3.0:1788201558.930635:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000c94a3fc1[3 0000000021951b30 2 1 00000000aedd57cb 0 0 23] 00000080:00200000:3.0:1788201558.930638:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000dcbf8809 17ffffc0001001 3:0 ffff8bc150734e00 23 lru 00000080:00200000:3.0:1788201558.930643:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000d550b848 23: 1< 0 - - > 2< 94208 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.930645:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000c94a3fc1 00000080:00200000:3.0:1788201558.930646:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 24. 00000080:00200000:3.0:1788201558.930648:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 24 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.930672:0:23731:0:(rw26.c:898:ll_write_end()) pos 98304, len 4096, copied 4096 00000080:00200000:3.0:1788201558.930677:0:23731:0:(rw26.c:956:ll_write_end()) page@000000002067b86d[3 0000000021951b30 2 1 00000000aedd57cb 0 0 24] 00000080:00200000:3.0:1788201558.930680:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000003c5edc72 17ffffc0001021 2:0 ffff8bc1507348c0 24 lru 00000080:00200000:3.0:1788201558.930686:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000f923d6f4 24: 1< 0 - - > 2< 98304 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.930687:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000002067b86d 00000080:00200000:3.0:1788201558.930689:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 25. 00000080:00200000:3.0:1788201558.930690:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 25 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.930706:0:23731:0:(rw26.c:898:ll_write_end()) pos 102400, len 4096, copied 4096 00000080:00200000:3.0:1788201558.930710:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000ffacbb57[3 0000000021951b30 2 1 00000000aedd57cb 0 0 25] 00000080:00200000:3.0:1788201558.930713:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000008d0c6b9 17ffffc0001001 3:0 ffff8bc150734540 25 lru 00000080:00200000:3.0:1788201558.930719:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000002d55b1dc 25: 1< 0 - - > 2< 102400 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.930721:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000ffacbb57 00000080:00200000:3.0:1788201558.930723:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 26. 00000080:00200000:3.0:1788201558.930724:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 26 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.937478:0:23731:0:(rw26.c:898:ll_write_end()) pos 106496, len 4096, copied 4096 00000080:00200000:3.0:1788201558.937495:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000fad1ea9b[3 0000000021951b30 2 1 00000000aedd57cb 0 0 26] 00000080:00200000:3.0:1788201558.937499:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000004232b729 17ffffc0001001 3:0 ffff8bc150734a80 26 lru 00000080:00200000:3.0:1788201558.937506:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000001aba1d4 26: 1< 0 - - > 2< 106496 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.937508:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000fad1ea9b 00000080:00200000:3.0:1788201558.937511:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 27. 00000080:00200000:3.0:1788201558.937515:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 27 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.937532:0:23731:0:(rw26.c:898:ll_write_end()) pos 110592, len 4096, copied 4096 00000080:00200000:3.0:1788201558.937537:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000031c33824[3 0000000021951b30 2 1 00000000aedd57cb 0 0 27] 00000080:00200000:3.0:1788201558.937540:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000bff5452c 17ffffc0001001 3:0 ffff8bc150734c40 27 lru 00000080:00200000:3.0:1788201558.937546:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000045b246cb 27: 1< 0 - - > 2< 110592 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.937548:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000031c33824 00000080:00200000:3.0:1788201558.937549:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 28. 00000080:00200000:3.0:1788201558.937552:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 28 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.937568:0:23731:0:(rw26.c:898:ll_write_end()) pos 114688, len 4096, copied 4096 00000080:00200000:3.0:1788201558.937573:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000825690d9[3 0000000021951b30 2 1 00000000aedd57cb 0 0 28] 00000080:00200000:3.0:1788201558.937576:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000009e0a16b 17ffffc0001001 3:0 ffff8bc1507349a0 28 lru 00000080:00200000:3.0:1788201558.937582:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000aa8c64a2 28: 1< 0 - - > 2< 114688 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.937584:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000825690d9 00000080:00200000:3.0:1788201558.937585:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 29. 00000080:00200000:3.0:1788201558.937587:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 29 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.937601:0:23731:0:(rw26.c:898:ll_write_end()) pos 118784, len 4096, copied 4096 00000080:00200000:3.0:1788201558.937605:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000d86290d2[3 0000000021951b30 2 1 00000000aedd57cb 0 0 29] 00000080:00200000:3.0:1788201558.937608:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000009caf76e9 17ffffc0001001 3:0 ffff8bc1507340e0 29 lru 00000080:00200000:3.0:1788201558.937613:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b8604b2a 29: 1< 0 - - > 2< 118784 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.937616:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000d86290d2 00000080:00200000:3.0:1788201558.937617:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 30. 00000080:00200000:3.0:1788201558.937619:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 30 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.937634:0:23731:0:(rw26.c:898:ll_write_end()) pos 122880, len 4096, copied 4096 00000080:00200000:3.0:1788201558.937639:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000cff48e6f[3 0000000021951b30 2 1 00000000aedd57cb 0 0 30] 00000080:00200000:3.0:1788201558.937642:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000004dbc8a3a 17ffffc0001001 3:0 ffff8bc1507341c0 30 lru 00000080:00200000:3.0:1788201558.937648:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000014bba292 30: 1< 0 - - > 2< 122880 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.937651:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000cff48e6f 00000080:00200000:3.0:1788201558.937652:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 31. 00000080:00200000:3.0:1788201558.937654:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 31 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.937672:0:23731:0:(rw26.c:898:ll_write_end()) pos 126976, len 4096, copied 4096 00000080:00200000:3.0:1788201558.937676:0:23731:0:(rw26.c:956:ll_write_end()) page@000000006c11b185[3 0000000021951b30 2 1 00000000aedd57cb 0 0 31] 00000080:00200000:3.0:1788201558.937680:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000007e0cd988 17ffffc0001001 3:0 ffff8bc150734380 31 lru 00000080:00200000:3.0:1788201558.937685:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000f11fd4b4 31: 1< 0 - - > 2< 126976 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.937687:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000006c11b185 00000080:00200000:3.0:1788201558.937688:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 32. 00000080:00200000:3.0:1788201558.937690:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 32 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.937705:0:23731:0:(rw26.c:898:ll_write_end()) pos 131072, len 4096, copied 4096 00000080:00200000:3.0:1788201558.937710:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000d633d4c6[3 0000000021951b30 2 1 00000000aedd57cb 0 0 32] 00000080:00200000:3.0:1788201558.937713:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000ad2d825c 17ffffc0001001 3:0 ffff8bc150734000 32 lru 00000080:00200000:3.0:1788201558.937719:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000728afcf3 32: 1< 0 - - > 2< 131072 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.937721:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000d633d4c6 00000080:00200000:3.0:1788201558.937722:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 33. 00000080:00200000:3.0:1788201558.937724:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 33 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.937737:0:23731:0:(rw26.c:898:ll_write_end()) pos 135168, len 4096, copied 4096 00000080:00200000:3.0:1788201558.937743:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000045574335[3 0000000021951b30 2 1 00000000aedd57cb 0 0 33] 00000080:00200000:3.0:1788201558.937746:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000404ebea4 17ffffc0001001 3:0 ffff8bc150734d20 33 lru 00000080:00200000:3.0:1788201558.937752:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000000ae4f1e6 33: 1< 0 - - > 2< 135168 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.937754:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000045574335 00000080:00200000:3.0:1788201558.937755:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 34. 00000080:00200000:3.0:1788201558.937757:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 34 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.937773:0:23731:0:(rw26.c:898:ll_write_end()) pos 139264, len 4096, copied 4096 00000080:00200000:3.0:1788201558.937777:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000085ac3fc5[3 0000000021951b30 2 1 00000000aedd57cb 0 0 34] 00000080:00200000:3.0:1788201558.937780:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000001a71cc15 17ffffc0001001 3:0 ffff8bc150734460 34 lru 00000080:00200000:3.0:1788201558.937786:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000053e7ac90 34: 1< 0 - - > 2< 139264 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.937811:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000085ac3fc5 00000080:00200000:3.0:1788201558.937813:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 35. 00000080:00200000:3.0:1788201558.937815:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 35 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.937831:0:23731:0:(rw26.c:898:ll_write_end()) pos 143360, len 4096, copied 4096 00000080:00200000:3.0:1788201558.937835:0:23731:0:(rw26.c:956:ll_write_end()) page@000000005b11b544[3 0000000021951b30 2 1 00000000aedd57cb 0 0 35] 00000080:00200000:3.0:1788201558.937838:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000037bd6df1 17ffffc0001001 3:0 ffff8bc1507342a0 35 lru 00000080:00200000:3.0:1788201558.937844:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000946c32b9 35: 1< 0 - - > 2< 143360 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.937846:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000005b11b544 00000080:00200000:3.0:1788201558.937848:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 36. 00000080:00200000:3.0:1788201558.937851:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 36 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.937880:0:23731:0:(rw26.c:898:ll_write_end()) pos 147456, len 4096, copied 4096 00000080:00200000:3.0:1788201558.937893:0:23731:0:(rw26.c:956:ll_write_end()) page@000000006ca75685[3 0000000021951b30 2 1 00000000aedd57cb 0 0 36] 00000080:00200000:3.0:1788201558.937896:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000002bf29933 17ffffc0001001 3:0 ffff8bc150734b60 36 lru 00000080:00200000:3.0:1788201558.937901:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000345c297b 36: 1< 0 - - > 2< 147456 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.937903:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000006ca75685 00000080:00200000:3.0:1788201558.937905:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 37. 00000080:00200000:3.0:1788201558.937907:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 37 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.937920:0:23731:0:(rw26.c:898:ll_write_end()) pos 151552, len 4096, copied 4096 00000080:00200000:3.0:1788201558.937924:0:23731:0:(rw26.c:956:ll_write_end()) page@000000008f530e19[3 0000000021951b30 2 1 00000000aedd57cb 0 0 37] 00000080:00200000:3.0:1788201558.937927:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000008e0d47cd 17ffffc0001001 3:0 ffff8bc150734700 37 lru 00000080:00200000:3.0:1788201558.937932:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000005ac47bf3 37: 1< 0 - - > 2< 151552 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.937934:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000008f530e19 00000080:00200000:3.0:1788201558.937935:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 38. 00000080:00200000:3.0:1788201558.937936:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 38 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.937947:0:23731:0:(rw26.c:898:ll_write_end()) pos 155648, len 4096, copied 4096 00000080:00200000:3.0:1788201558.937951:0:23731:0:(rw26.c:956:ll_write_end()) page@000000006bf42ead[3 0000000021951b30 2 1 00000000aedd57cb 0 0 38] 00000080:00200000:3.0:1788201558.937953:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000095894e7f 17ffffc0001001 3:0 ffff8bc1507347e0 38 lru 00000080:00200000:3.0:1788201558.937958:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000050fb84dd 38: 1< 0 - - > 2< 155648 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.937959:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000006bf42ead 00000080:00200000:3.0:1788201558.937960:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 39. 00000080:00200000:3.0:1788201558.937961:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 39 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.937989:0:23731:0:(rw26.c:898:ll_write_end()) pos 159744, len 4096, copied 4096 00000080:00200000:3.0:1788201558.937995:0:23731:0:(rw26.c:956:ll_write_end()) page@000000003c2e820b[3 0000000021951b30 2 1 00000000aedd57cb 0 0 39] 00000080:00200000:3.0:1788201558.937998:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000782deb75 17ffffc0001021 2:0 ffff8bc150734620 39 lru 00000080:00200000:3.0:1788201558.938003:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000bcffdcd4 39: 1< 0 - - > 2< 159744 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.938005:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000003c2e820b 00000080:00200000:3.0:1788201558.938006:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 40. 00000080:00200000:3.0:1788201558.938008:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 40 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.938020:0:23731:0:(rw26.c:898:ll_write_end()) pos 163840, len 4096, copied 4096 00000080:00200000:3.0:1788201558.938024:0:23731:0:(rw26.c:956:ll_write_end()) page@000000001d7e865e[3 0000000021951b30 2 1 00000000aedd57cb 0 0 40] 00000080:00200000:3.0:1788201558.938027:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000004cdea4cb 17ffffc0001001 3:0 ffff8bc1724d7000 40 lru 00000080:00200000:3.0:1788201558.938033:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000f09b7f92 40: 1< 0 - - > 2< 163840 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.938035:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000001d7e865e 00000080:00200000:3.0:1788201558.938036:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 41. 00000080:00200000:3.0:1788201558.938037:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 41 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.938047:0:23731:0:(rw26.c:898:ll_write_end()) pos 167936, len 4096, copied 4096 00000080:00200000:3.0:1788201558.938050:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000c418f56c[3 0000000021951b30 2 1 00000000aedd57cb 0 0 41] 00000080:00200000:3.0:1788201558.938052:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000008b6f52f2 17ffffc0001001 3:0 ffff8bc1724d7d20 41 lru 00000080:00200000:3.0:1788201558.938057:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000663f6cc4 41: 1< 0 - - > 2< 167936 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.938059:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000c418f56c 00000080:00200000:3.0:1788201558.938060:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 42. 00000080:00200000:3.0:1788201558.938062:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 42 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.938071:0:23731:0:(rw26.c:898:ll_write_end()) pos 172032, len 4096, copied 4096 00000080:00200000:3.0:1788201558.938075:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000065789b31[3 0000000021951b30 2 1 00000000aedd57cb 0 0 42] 00000080:00200000:3.0:1788201558.938078:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000c3997696 17ffffc0001001 3:0 ffff8bc1724d7460 42 lru 00000080:00200000:3.0:1788201558.938083:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000ea7303a5 42: 1< 0 - - > 2< 172032 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.938085:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000065789b31 00000080:00200000:3.0:1788201558.938086:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 43. 00000080:00200000:3.0:1788201558.938087:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 43 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.938096:0:23731:0:(rw26.c:898:ll_write_end()) pos 176128, len 4096, copied 4096 00000080:00200000:3.0:1788201558.938099:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000067083f4b[3 0000000021951b30 2 1 00000000aedd57cb 0 0 43] 00000080:00200000:3.0:1788201558.938101:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000c375356e 17ffffc0001001 3:0 ffff8bc1724d72a0 43 lru 00000080:00200000:3.0:1788201558.938106:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000004e00c155 43: 1< 0 - - > 2< 176128 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.938108:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000067083f4b 00000080:00200000:3.0:1788201558.938109:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 44. 00000080:00200000:3.0:1788201558.938110:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 44 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.938122:0:23731:0:(rw26.c:898:ll_write_end()) pos 180224, len 4096, copied 4096 00000080:00200000:3.0:1788201558.938126:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000d86bcdb6[3 0000000021951b30 2 1 00000000aedd57cb 0 0 44] 00000080:00200000:3.0:1788201558.938129:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000d8267354 17ffffc0001001 3:0 ffff8bc1724d7b60 44 lru 00000080:00200000:3.0:1788201558.938134:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000e17027ba 44: 1< 0 - - > 2< 180224 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.938136:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000d86bcdb6 00000080:00200000:3.0:1788201558.938138:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 45. 00000080:00200000:3.0:1788201558.938139:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 45 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.938156:0:23731:0:(rw26.c:898:ll_write_end()) pos 184320, len 4096, copied 4096 00000080:00200000:3.0:1788201558.938161:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000037af4c4f[3 0000000021951b30 2 1 00000000aedd57cb 0 0 45] 00000080:00200000:3.0:1788201558.938164:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000007b0f0b19 17ffffc0001001 3:0 ffff8bc1724d7700 45 lru 00000080:00200000:3.0:1788201558.938169:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000786c0dd4 45: 1< 0 - - > 2< 184320 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.938171:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000037af4c4f 00000080:00200000:3.0:1788201558.938172:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 46. 00000080:00200000:3.0:1788201558.938174:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 46 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.938188:0:23731:0:(rw26.c:898:ll_write_end()) pos 188416, len 4096, copied 4096 00000080:00200000:3.0:1788201558.938192:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000588b756c[3 0000000021951b30 2 1 00000000aedd57cb 0 0 46] 00000080:00200000:3.0:1788201558.938195:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000ca4c9b7b 17ffffc0001001 3:0 ffff8bc1724d77e0 46 lru 00000080:00200000:3.0:1788201558.938201:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000a560b67e 46: 1< 0 - - > 2< 188416 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.938203:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000588b756c 00000080:00200000:3.0:1788201558.938204:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 47. 00000080:00200000:3.0:1788201558.938206:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 47 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.938220:0:23731:0:(rw26.c:898:ll_write_end()) pos 192512, len 4096, copied 4096 00000080:00200000:3.0:1788201558.938224:0:23731:0:(rw26.c:956:ll_write_end()) page@000000005591541e[3 0000000021951b30 2 1 00000000aedd57cb 0 0 47] 00000080:00200000:3.0:1788201558.938227:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000088fcf05a 17ffffc0001001 3:0 ffff8bc1724d7620 47 lru 00000080:00200000:3.0:1788201558.938232:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000003877c0a1 47: 1< 0 - - > 2< 192512 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.938234:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000005591541e 00000080:00200000:3.0:1788201558.938235:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 48. 00000080:00200000:3.0:1788201558.938237:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 48 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.938250:0:23731:0:(rw26.c:898:ll_write_end()) pos 196608, len 4096, copied 4096 00000080:00200000:3.0:1788201558.938255:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000b5daf315[3 0000000021951b30 2 1 00000000aedd57cb 0 0 48] 00000080:00200000:3.0:1788201558.938258:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000cbc0b3b1 17ffffc0001001 3:0 ffff8bc1724d7ee0 48 lru 00000080:00200000:3.0:1788201558.938263:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000001124ec3b 48: 1< 0 - - > 2< 196608 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.938266:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000b5daf315 00000080:00200000:3.0:1788201558.938267:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 49. 00000080:00200000:3.0:1788201558.938269:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 49 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.938282:0:23731:0:(rw26.c:898:ll_write_end()) pos 200704, len 4096, copied 4096 00000080:00200000:3.0:1788201558.938286:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000119cc930[3 0000000021951b30 2 1 00000000aedd57cb 0 0 49] 00000080:00200000:3.0:1788201558.938290:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000bdf3681a 17ffffc0001001 3:0 ffff8bc1724d7e00 49 lru 00000080:00200000:3.0:1788201558.938295:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b8ef8cfd 49: 1< 0 - - > 2< 200704 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.938297:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000119cc930 00000080:00200000:3.0:1788201558.938298:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 50. 00000080:00200000:3.0:1788201558.938300:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 50 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.938313:0:23731:0:(rw26.c:898:ll_write_end()) pos 204800, len 4096, copied 4096 00000080:00200000:3.0:1788201558.938317:0:23731:0:(rw26.c:956:ll_write_end()) page@000000008403a592[3 0000000021951b30 2 1 00000000aedd57cb 0 0 50] 00000080:00200000:3.0:1788201558.938320:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000002fd03423 17ffffc0001001 3:0 ffff8bc1724d78c0 50 lru 00000080:00200000:3.0:1788201558.938325:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000008513dcb2 50: 1< 0 - - > 2< 204800 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.938327:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000008403a592 00000080:00200000:3.0:1788201558.938328:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 51. 00000080:00200000:3.0:1788201558.938330:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 51 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.938344:0:23731:0:(rw26.c:898:ll_write_end()) pos 208896, len 4096, copied 4096 00000080:00200000:3.0:1788201558.938349:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000031956304[3 0000000021951b30 2 1 00000000aedd57cb 0 0 51] 00000080:00200000:3.0:1788201558.938352:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000d02aedf3 17ffffc0001001 3:0 ffff8bc1724d7540 51 lru 00000080:00200000:3.0:1788201558.938358:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000010c04eeb 51: 1< 0 - - > 2< 208896 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.938360:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000031956304 00000080:00200000:3.0:1788201558.938361:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 52. 00000080:00200000:3.0:1788201558.938363:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 52 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.938380:0:23731:0:(rw26.c:898:ll_write_end()) pos 212992, len 4096, copied 4096 00000080:00200000:3.0:1788201558.938384:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000f8409f5a[3 0000000021951b30 2 1 00000000aedd57cb 0 0 52] 00000080:00200000:3.0:1788201558.938387:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000001a33a3bf 17ffffc0001001 3:0 ffff8bc1724d7a80 52 lru 00000080:00200000:3.0:1788201558.938392:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000030fc3c0d 52: 1< 0 - - > 2< 212992 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.938394:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000f8409f5a 00000080:00200000:3.0:1788201558.938395:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 53. 00000080:00200000:3.0:1788201558.938397:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 53 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.938411:0:23731:0:(rw26.c:898:ll_write_end()) pos 217088, len 4096, copied 4096 00000080:00200000:3.0:1788201558.938415:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000161fe99a[3 0000000021951b30 2 1 00000000aedd57cb 0 0 53] 00000080:00200000:3.0:1788201558.938418:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000741133ce 17ffffc0001001 3:0 ffff8bc1724d7c40 53 lru 00000080:00200000:3.0:1788201558.938423:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000065f7f91f 53: 1< 0 - - > 2< 217088 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.938425:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000161fe99a 00000080:00200000:3.0:1788201558.938427:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 54. 00000080:00200000:3.0:1788201558.938428:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 54 of 0 to 4096 bytes 00000080:00200000:3.0:1788201558.938448:0:23731:0:(rw26.c:898:ll_write_end()) pos 221184, len 4096, copied 4096 00000080:00200000:3.0:1788201558.938453:0:23731:0:(rw26.c:956:ll_write_end()) page@000000000cff5c5f[3 0000000021951b30 2 1 00000000aedd57cb 0 0 54] 00000080:00200000:3.0:1788201558.938455:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000e8ea8437 17ffffc0001021 2:0 ffff8bc1724d79a0 54 lru 00000080:00200000:3.0:1788201558.938461:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000055c96e94 54: 1< 0 - - > 2< 221184 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.938463:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000000cff5c5f 00000080:00200000:3.0:1788201558.938465:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 55. 00000080:00200000:3.0:1788201558.938466:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 55 of 0 to 2236 bytes 00000080:00200000:3.0:1788201558.938484:0:23731:0:(rw26.c:898:ll_write_end()) pos 225280, len 2236, copied 2236 00000080:00200000:3.0:1788201558.938488:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000064d5b3c4[3 0000000021951b30 2 1 00000000aedd57cb 0 0 55] 00000080:00200000:3.0:1788201558.938491:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000007162e517 17ffffc0001001 3:0 ffff8bc1724d70e0 55 lru 00000080:00200000:3.0:1788201558.938496:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000027c02d6d 55: 1< 0 - - > 2< 225280 0 0 0x0 0x0 | 000000008930e75a 00000000325effe3 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201558.938498:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000064d5b3c4 00000080:00200000:3.0:1788201558.938499:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 56. 00000080:00200000:3.0:1788201558.938503:0:23731:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 56, from 0, to 2236 prio 0 00000008:00010000:3.0:1788201558.938531:0:23731:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000a1d91876 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201558.938564:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459f6db8, count 15, dirtied 15 00000080:00200000:3.0:1788201558.938581:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459f6db8, count 15, dirtied 15 00000080:00200000:3.0:1788201558.938594:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459f6db8, count 15, dirtied 15 00000080:00200000:3.0:1788201558.938605:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459f6db8, count 11, dirtied 11 00000080:00200000:3.0:1788201558.938609:0:23731:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 56 pages 227516 bytes, tot: 227516 00000080:00200000:3.0:1788201558.938613:0:23731:0:(vvp_io.c:1358:vvp_io_write_start()) sanityn.sh: write bytes 0, result: 227516 00000020:00010000:3.0:1788201558.938631:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460e6c68 (ffff8bc1460e9248/0) at cl_lock_release():245 00000020:00010000:3.0:1788201558.938635:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460e6c68 (ffff8bc1460e9248/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201558.938639:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc144008e30 (ffff8bc1460e9d88/1) at cl_lock_cancel():142 00010000:00010000:3.0:1788201558.938647:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.938665:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1788201558.938682:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460e6c68 (ffff8bc1460e9248/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201558.938685:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc144008e30 (ffff8bc1460e9248/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201558.938694:0:23731:0:(vvp_io.c:533:vvp_io_advance()) advancing 227516 bytes 00000080:00200000:3.0:1788201558.938702:0:23731:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 55] 00000080:00200000:3.0:1788201558.938735:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x124:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201558.938739:0:23731:0:(file.c:2238:ll_file_io_generic()) sanityn.sh: 2 io complete with rc: 0, result: 227516, restart: 0 00000080:00200000:3.0:1788201558.938747:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x124:0x0] updating i_size 227516 i_blocks 1 00000080:00200000:3.0:1788201558.938751:0:23731:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 227516 00000080:00200008:3.0:1788201558.938819:0:23731:0:(file.c:479:ll_file_release()) START file sanityn.sh:[0x200000bd7:0x124:0x0](ffff8bc1459f6c08), flags 100001 00000002:00100000:3.0:1788201558.938871:0:23731:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc14415a680 x1875064727853568/t8589937111(8589937111) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201574 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1788201558.938883:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1788201558.938889:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146c5ad80 x1875064727854208/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1788201558.938913:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c5ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727854208:192.168.201.143@tcp:35:cp.0 00000100:00100000:3.0:1788201558.940060:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201558.943614:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c5ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727854208:192.168.201.143@tcp:35:cp.0 00000002:00100000:3.0:1788201558.943645:0:23731:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc14415a680 x1875064727853568/t8589937111(8589937111) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201574 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201558.943715:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201558.943733:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201558.943753:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201558.943768:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201558.943777:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201558.943783:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201558.943787:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201558.943839:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201558.943844:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201558.943854:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201558.943880:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201558.943887:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201558.943893:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201558.943897:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanityn.sh, flags=8 00000080:00200008:3.0:1788201558.943904:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file sanityn.sh:[0x200000bd7:0x124:0x0](ffff8bc1459f6c08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201558.943910:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x124:0x0](ffff8bc1459f6c08),name=sanityn.sh 00000002:00010000:3.0:1788201558.943921:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x124:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201558.943929:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645d000/0xd138388016f6eaeb lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x124:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094e7d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201558.943939:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645d000/0xd138388016f6eaeb lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x124:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094e7d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201558.943952:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201558.943956:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x124:0x0](ffff8bc1459f6c08) 00000080:00010000:3.0:1788201558.943958:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x124:0x0](ffff8bc1459f6c08) for lock 0xd138388016f6eaeb 00000080:00010000:3.0:1788201558.943962:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eaeb from it ffffadd1c7da3cb8 00010000:00010000:3.0:1788201558.943965:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645d000/0xd138388016f6eaeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x124:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094e7d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201558.943983:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645d000/0xd138388016f6eaeb lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x124:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094e7d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201558.944030:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x124:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201558.944041:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x124:0x0] 00000008:00010000:3.0:1788201558.944077:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201558.944081:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc144008e30, osc lock ffff8bc14691ad10, flags 0x400001002 00010000:00010000:3.0:1788201558.944099:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x199:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.944112:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:3.0:1788201558.944126:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1788201558.944130:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.944139:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1788201558.944156:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1788201558.944165:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x124:0x0] updating i_size 227516 i_blocks 1 00000020:00010000:3.0:1788201558.944169:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc6500 (ffff8bc1460e9248/0) at cl_lock_release():245 00000020:00010000:3.0:1788201558.944172:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc6500 (ffff8bc1460e9248/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201558.944176:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc144008e30 (ffff8bc1460e9d88/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201558.944179:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc6500 (ffff8bc1460e9248/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201558.944182:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc144008e30 (ffff8bc1460e9248/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201558.944214:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x124:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201558.944441:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201558.944452:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201558.944460:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201558.944469:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201558.944476:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201558.944480:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201558.944483:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201558.944487:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201558.944490:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201558.944498:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201558.944511:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201558.944516:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201558.944520:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201558.944533:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-pcc.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=9 00000080:00200000:3.0:1788201558.944538:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-pcc.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:3.0:1788201558.944548:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-pcc.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201558.944592:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb00 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.944600:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb00 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.944610:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb00 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201558.944631:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c58e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727854336:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201558.944777:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201558.961175:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c58e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727854336:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201558.961204:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb00 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.961219:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb00 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.961227:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb00 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.961235:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb00 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.961246:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb00 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.961253:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14400c600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201558.961269:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb00 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.961277:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb00 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.961286:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb00 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.961294:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201558.961300:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb00 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.961307:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb00 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201558.961328:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc146c58e00 x1875064727854336/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201574 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201558.961344:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201558.961414:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:3.0:1788201558.961493:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201558.961513:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201558.961524:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201558.961543:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201558.961551:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201558.961556:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201558.961560:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201558.961566:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201558.961570:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201558.961580:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201558.961597:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201558.961606:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201558.961612:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201558.961627:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-pcc.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=8 00000080:00200000:3.0:1788201558.961632:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-pcc.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:3.0:1788201558.961644:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-pcc.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201558.961686:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9800/0xd138388016f6eb07 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.961695:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9800/0xd138388016f6eb07 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.961704:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9800/0xd138388016f6eb07 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201558.961728:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c58e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727854464:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201558.961953:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201558.979204:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c58e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727854464:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201558.979230:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9800/0xd138388016f6eb07 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.979245:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9800/0xd138388016f6eb07 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.979264:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9800/0xd138388016f6eb07 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.979273:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9800/0xd138388016f6eb07 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.979283:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9800/0xd138388016f6eb07 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.979288:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1727c9800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201558.979292:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9800/0xd138388016f6eb07 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.979297:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9800/0xd138388016f6eb07 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.979301:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9800/0xd138388016f6eb07 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.979306:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201558.979312:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9800/0xd138388016f6eb07 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.979317:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9800/0xd138388016f6eb07 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201558.979332:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc146c58e00 x1875064727854464/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201574 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201558.979344:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201558.979369:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:3.0:1788201558.979472:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201558.979486:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201558.979493:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201558.979504:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201558.979509:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201558.979513:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201558.979515:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201558.979520:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3bf8 00010000:00010000:3.0:1788201558.979523:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201558.979528:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201558.979541:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201558.979548:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201558.979553:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201558.979562:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:3.0:1788201558.979566:0:23731:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sanity-pcc.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), file ffff8bc143846a80, open_flags 80c1, mode 81ed opened 0 00000080:00200000:3.0:1788201558.979571:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-pcc.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000002:00010000:3.0:1788201558.979587:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-pcc.sh,[0x200000bd7:0x125:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open|creat flags 0100302 00010000:00010000:3.0:1788201558.979626:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.979631:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1788201558.979640:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1788201558.979644:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146c58e00 x1875064727854720/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1788201558.979650:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201558.979666:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c58e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727854720:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201558.980038:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144e8cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201558.988918:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c58e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727854720:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201558.988949:0:23731:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.988984:0:23731:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x125:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.988994:0:23731:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.989007:0:23731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.989018:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.989032:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.989040:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.989048:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201558.989060:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc146c58e00 x1875064727854720/t8589937113(8589937113) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201574 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1788201558.989073:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc146c58e00 x1875064727854720/t8589937113(8589937113) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201574 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201558.989087:0:23731:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1788201558.989100:0:23731:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.989111:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/293 (0 0) 00000080:00200000:3.0:1788201558.989119:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1788201558.989133:0:23731:0:(namei.c:1628:ll_create_it()) VFS Op:name=sanity-pcc.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000080:00200000:3.0:1788201558.989166:0:23731:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x125:0x0](ffff8bc1459d7448) 00000080:00200000:3.0:1788201558.989532:0:23731:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x125:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1788201558.989544:0:23731:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x125:0x0](ffff8bc1459d7448) 00000080:00010000:3.0:1788201558.989547:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x125:0x0](ffff8bc1459d7448) for lock 0xd138388016f6eb0e 00000080:00010000:3.0:1788201558.989559:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x125:0x0](ffff8bc1459d7448) 00000080:00200008:3.0:1788201558.989573:0:23731:0:(file.c:1090:ll_file_open()) START file sanity-pcc.sh:[0x200000bd7:0x125:0x0](ffff8bc1459d7448), flags 100301 00000002:00100000:3.0:1788201558.989593:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc146c58e00 x1875064727854720/t8589937113(8589937113) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201574 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1788201558.989634:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eb0e from it ffff8bc148c9b480 00010000:00010000:3.0:1788201558.989639:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.989659:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201558.989681:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x125:0x0](ffff8bc1459d7448), inode mode 81ed mask 40 00000080:00200008:3.0:1788201558.989708:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file sanity-pcc.sh:[0x200000bd7:0x125:0x0](ffff8bc1459d7448), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201558.989716:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x125:0x0](ffff8bc1459d7448),name=sanity-pcc.sh 00000002:00010000:3.0:1788201558.989744:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x125:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201558.989754:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.989770:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201558.989783:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201558.989788:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x125:0x0](ffff8bc1459d7448) 00000080:00010000:3.0:1788201558.989832:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x125:0x0](ffff8bc1459d7448) for lock 0xd138388016f6eb0e 00000080:00010000:3.0:1788201558.989836:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eb0e from it ffffadd1c7da3cd8 00010000:00010000:3.0:1788201558.989840:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201558.989847:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201558.989902:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x125:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201558.989912:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x125:0x0] 00000008:00010000:3.0:1788201558.989938:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201558.989942:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc144008330, osc lock ffff8bc14691ad10, flags 0x400001002 00010000:00010000:3.0:1788201558.989996:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6eb15 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.990006:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6eb15 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201558.990049:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1788201558.990105:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201558.990134:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727854848:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201558.993136:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6eb15 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.993178:0:10054:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6eb15 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094ee6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.993195:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6eb15 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094ee6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.993209:0:10054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6eb15 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094ee6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201558.993226:0:10054:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6eb15 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094ee6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201558.993239:0:10054:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1788201558.993255:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6eb15 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094ee6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.993265:0:10054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6eb15 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094ee6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.993280:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6eb15 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094ee6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201558.993289:0:10054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6eb15 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171094ee6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201558.993311:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727854848:192.168.201.143@tcp:101:cp.0 00000080:00200000:3.0:1788201558.993461:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x125:0x0] updating i_size 0 i_blocks 1 00000020:00010000:3.0:1788201558.993468:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc6500 (ffff8bc1460e9248/0) at cl_lock_release():245 00000020:00010000:3.0:1788201558.993472:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc6500 (ffff8bc1460e9248/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201558.993478:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc144008330 (ffff8bc1460e9d88/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201558.993482:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc6500 (ffff8bc1460e9248/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201558.993485:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc144008330 (ffff8bc1460e9248/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201558.993523:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x125:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1788201558.993642:0:23731:0:(file.c:2638:do_file_write_iter()) START file sanity-pcc.sh:[0x200000bd7:0x125:0x0], ppos: 0, count: 159678 00000080:00200000:3.0:1788201558.993668:0:23731:0:(file.c:2090:ll_file_io_generic()) sanity-pcc.sh: write ppos: 0, bytes: 159678 00000080:00200000:3.0:1788201558.993673:0:23731:0:(file.c:1848:ll_io_set_mirror()) sanity-pcc.sh: desiginated mirror: 0 00000020:00200000:3.0:1788201558.993679:0:23731:0:(cl_io.c:214:cl_io_rw_init()) header@000000008f037294[0x110, 1, [0x200000bd7:0x125:0x0] hash] 00000020:00200000:3.0:1788201558.993681:0:23731:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 159678) 0 0 00000080:00200000:3.0:1788201558.993685:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x125:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201558.993697:0:23731:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 38] 00020000:00200000:3.0:1788201558.993704:0:23731:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 159678) 159678, 159678 00020000:00200000:3.0:1788201558.993708:0:23731:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1788201558.994020:0:23731:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 38] 00000008:00010000:3.0:1788201558.994035:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1788201558.994040:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc144008330, osc lock ffff8bc14691ad10, flags 0x0 00010000:00010000:3.0:1788201558.994058:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/409 (0 159743) 00010000:00010000:3.0:1788201558.994100:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x199:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.994121:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x199:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201558.994132:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x199:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201558.994156:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146c59180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727854976:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201558.994247:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1520ad0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.008869:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743443456 00000100:00100000:1.0:1788201559.008882:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743443456 00000100:00100000:1.0:1788201559.008955:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 592 00000100:00100000:1.0:1788201559.008966:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc144158e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23390:x1875064743443456:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201559.008998:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6eb15 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x199:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094ee6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.009124:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201559.009132:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc144158e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23390:x1875064743443456:12345-192.168.201.143@tcp:104: Request processed in 169us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201559.009141:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 592 00010000:00010000:3.0:1788201559.009310:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201559.009318:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6eb15 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x199:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094ee6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201559.011261:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14400c600 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201559.011271:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6eb15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x199:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171094ee6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201559.011343:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x125:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201559.011360:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x125:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201559.011438:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6eb15 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x199:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094ee6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201559.011446:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201559.011599:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6eb15 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x199:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094ee6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201559.011608:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000062aa95c3/0xd138388016f6eb15 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x199:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171094ee6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201559.011629:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201559.011631:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201559.011633:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201559.011712:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727855104:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201559.016402:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146c59180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727854976:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201559.016436:0:23731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171094eed expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.016461:0:23731:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094eed expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.016470:0:23731:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094eed expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.016741:0:21781:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788201559.016763:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743443584 00000100:00100000:1.0:1788201559.016770:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743443584 00000100:00100000:1.0:1788201559.016837:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 593 00000100:00100000:1.0:1788201559.016847:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc143d02450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23412:x1875064743443584:12345-192.168.201.143@tcp:105: 00010000:00010000:1.0:1788201559.016859:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 5/0,1 mode: --/PW res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094eed expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.016870:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 5/0,1 mode: --/PW res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094eed expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.016880:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 5/0,1 mode: --/PW res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171094eed expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.016890:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171094eed expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.016899:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171094eed expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.016910:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171094eed expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.016941:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1727c9800) 00000100:00100000:1.0:1788201559.017020:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc143d02450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23412:x1875064743443584:12345-192.168.201.143@tcp:105: Request processed in 174us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201559.017028:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 593 00010000:00010000:3.0:1788201559.017224:0:23731:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094eed expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.017234:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094eed expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.017250:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171094eed expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201559.017263:0:23731:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171094eed expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.017275:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094eed expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.017284:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094eed expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201559.017315:0:23731:0:(vvp_io.c:1292:vvp_io_write_start()) sanity-pcc.sh: write [0, 159678) append 0 append lockpos 0 00000080:00200000:3.0:1788201559.017338:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.017387:0:23731:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:3.0:1788201559.017397:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000043157d20[3 00000000266c69b2 2 1 00000000aedd57cb 0 0 0] 00000080:00200000:3.0:1788201559.017450:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000005fa1b5db 17ffffc0001001 3:0 ffff8bc1724d71c0 0 lru 00000080:00200000:3.0:1788201559.017460:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000052500b05 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000938931ac > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.017462:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000043157d20 00000080:00200000:3.0:1788201559.017464:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201559.017468:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.017492:0:23731:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:3.0:1788201559.017497:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000087204d70[3 00000000266c69b2 2 1 00000000aedd57cb 0 0 1] 00000080:00200000:3.0:1788201559.017501:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000008b178a2 17ffffc0001001 3:0 ffff8bc1724d7380 1 lru 00000080:00200000:3.0:1788201559.017506:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000305bc74a 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 00000000938931ac > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.017508:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000087204d70 00000080:00200000:3.0:1788201559.017510:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:3.0:1788201559.017512:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.017529:0:23731:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:3.0:1788201559.017539:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000e54e4cd1[3 00000000266c69b2 2 1 00000000aedd57cb 0 0 2] 00000080:00200000:3.0:1788201559.017542:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000018e4bf1f 17ffffc0001001 3:0 ffff8bc146dabd20 2 lru 00000080:00200000:3.0:1788201559.017549:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000005f1ac171 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000000ce25486 00000000938931ac > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.017550:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000e54e4cd1 00000080:00200000:3.0:1788201559.017551:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:3.0:1788201559.017553:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.017572:0:23731:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:3.0:1788201559.017575:0:23731:0:(rw26.c:956:ll_write_end()) page@000000004f907fa7[3 00000000266c69b2 2 1 00000000aedd57cb 0 0 3] 00000080:00200000:3.0:1788201559.017578:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000004c4b22fa 17ffffc0001001 3:0 ffff8bc146dab460 3 lru 00000080:00200000:3.0:1788201559.017582:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000009837448d 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000000ce25486 00000000938931ac > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.017584:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000004f907fa7 00000080:00200000:3.0:1788201559.017585:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:3.0:1788201559.017587:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.017599:0:23731:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:3.0:1788201559.017603:0:23731:0:(rw26.c:956:ll_write_end()) page@000000000f12bc4b[3 00000000266c69b2 2 1 00000000aedd57cb 0 0 4] 00000080:00200000:3.0:1788201559.017606:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000006f90ecb3 17ffffc0001001 3:0 ffff8bc146dab2a0 4 lru 00000080:00200000:3.0:1788201559.017610:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000038128c4d 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000000ce25486 00000000938931ac > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.017612:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000000f12bc4b 00000080:00200000:3.0:1788201559.017614:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:3.0:1788201559.017615:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.017631:0:23731:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:3.0:1788201559.017635:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000034b6ec3f[3 00000000266c69b2 2 1 00000000aedd57cb 0 0 5] 00000080:00200000:3.0:1788201559.017638:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000001cefaa47 17ffffc0001001 3:0 ffff8bc146dabb60 5 lru 00000080:00200000:3.0:1788201559.017643:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b0dccfe6 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000000ce25486 00000000938931ac > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.017645:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000034b6ec3f 00000080:00200000:3.0:1788201559.017646:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:3.0:1788201559.017647:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.017661:0:23731:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:3.0:1788201559.017665:0:23731:0:(rw26.c:956:ll_write_end()) page@000000007818b2b1[3 00000000266c69b2 2 1 00000000aedd57cb 0 0 6] 00000080:00200000:3.0:1788201559.017668:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000009d9b0ed5 17ffffc0001001 3:0 ffff8bc146dab700 6 lru 00000080:00200000:3.0:1788201559.017685:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000043f6b038 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000000ce25486 00000000938931ac > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.017688:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000007818b2b1 00000080:00200000:3.0:1788201559.017689:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:3.0:1788201559.017691:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.017707:0:23731:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:3.0:1788201559.017711:0:23731:0:(rw26.c:956:ll_write_end()) page@000000002c0f8f1e[3 00000000266c69b2 2 1 00000000aedd57cb 0 0 7] 00000080:00200000:3.0:1788201559.017713:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000bbddd4c2 17ffffc0001001 3:0 ffff8bc146dab7e0 7 lru 00000080:00200000:3.0:1788201559.017718:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000007858f7e5 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000000ce25486 00000000938931ac > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.017720:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000002c0f8f1e 00000080:00200000:3.0:1788201559.017721:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:3.0:1788201559.017723:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.017746:0:23731:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:3.0:1788201559.017751:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000265fc58d[3 00000000266c69b2 2 1 00000000aedd57cb 0 0 8] 00000080:00200000:3.0:1788201559.017753:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000e98333fd 17ffffc0001001 3:0 ffff8bc146dab620 8 lru 00000080:00200000:3.0:1788201559.017758:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000bdf978b8 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000000ce25486 00000000938931ac > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.017760:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000265fc58d 00000080:00200000:3.0:1788201559.017761:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:3.0:1788201559.017763:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.017777:0:23731:0:(rw26.c:898:ll_write_end()) pos 36864, len 4096, copied 4096 00000080:00200000:3.0:1788201559.017781:0:23731:0:(rw26.c:956:ll_write_end()) page@000000003e5d3bd5[3 00000000266c69b2 2 1 00000000aedd57cb 0 0 9] 00000080:00200000:3.0:1788201559.017784:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000391db314 17ffffc0001001 3:0 ffff8bc146dabee0 9 lru 00000080:00200000:3.0:1788201559.017820:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000004197581e 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000000ce25486 00000000938931ac > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.017823:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000003e5d3bd5 00000080:00200000:3.0:1788201559.017824:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:3.0:1788201559.017827:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 10 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.017845:0:23731:0:(rw26.c:898:ll_write_end()) pos 40960, len 4096, copied 4096 00000080:00200000:3.0:1788201559.017849:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000eae28d23[3 00000000266c69b2 2 1 00000000aedd57cb 0 0 10] 00000080:00200000:3.0:1788201559.017852:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000006feaf69d 17ffffc0001001 3:0 ffff8bc146dabe00 10 lru 00000080:00200000:3.0:1788201559.017858:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000002110b3d0 10: 1< 0 - - > 2< 40960 0 0 0x0 0x0 | 000000000ce25486 00000000938931ac > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.017860:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000eae28d23 00000080:00200000:3.0:1788201559.017861:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 11. 00000080:00200000:3.0:1788201559.017863:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 11 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.017877:0:23731:0:(rw26.c:898:ll_write_end()) pos 45056, len 4096, copied 4096 00000080:00200000:3.0:1788201559.017882:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000a00d5f3e[3 00000000266c69b2 2 1 00000000aedd57cb 0 0 11] 00000080:00200000:3.0:1788201559.017885:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000097d9a7ea 17ffffc0001001 3:0 ffff8bc146dab8c0 11 lru 00000080:00200000:3.0:1788201559.017889:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000fa451221 11: 1< 0 - - > 2< 45056 0 0 0x0 0x0 | 000000000ce25486 00000000938931ac > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.017891:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000a00d5f3e 00000080:00200000:3.0:1788201559.017892:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 12. 00000080:00200000:3.0:1788201559.017894:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 12 of 0 to 4096 bytes 00000100:00100000:1.0:1788201559.019739:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727855104:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201559.046623:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144159880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727855872:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201559.046655:0:23731:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645c600/0xd138388016f6eb31 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094f33 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.046680:0:23731:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645c600/0xd138388016f6eb31 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x126:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094f33 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.046690:0:23731:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645c600/0xd138388016f6eb31 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x126:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094f33 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.046701:0:23731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645c600/0xd138388016f6eb31 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x126:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094f33 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.046713:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645c600/0xd138388016f6eb31 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x126:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094f33 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.046733:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645c600/0xd138388016f6eb31 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x126:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094f33 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.046742:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645c600/0xd138388016f6eb31 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x126:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094f33 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.046751:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645c600/0xd138388016f6eb31 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x126:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094f33 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201559.047946:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc144159880 x1875064727855872/t8589937116(8589937116) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201575 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1788201559.047966:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc144159880 x1875064727855872/t8589937116(8589937116) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201575 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201559.047994:0:23731:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645c600/0xd138388016f6eb31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x126:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094f33 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.049469:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727856000:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201559.052780:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e8ce3076/0xd138388016f6eb38 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.052946:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e8ce3076/0xd138388016f6eb38 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094f41 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.052962:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e8ce3076/0xd138388016f6eb38 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094f41 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.052988:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e8ce3076/0xd138388016f6eb38 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094f41 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201559.053003:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e8ce3076/0xd138388016f6eb38 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094f41 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201559.053016:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1788201559.053071:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e8ce3076/0xd138388016f6eb38 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094f41 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.053082:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e8ce3076/0xd138388016f6eb38 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094f41 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.053318:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e8ce3076/0xd138388016f6eb38 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094f41 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.053330:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e8ce3076/0xd138388016f6eb38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171094f41 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201559.053426:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727856000:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201559.058709:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201559.059329:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 594 00000100:00100000:1.0:1788201559.059340:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc151ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23416:x1875064743443712:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201559.059367:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e8ce3076/0xd138388016f6eb38 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x19a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094f41 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.059446:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201559.059453:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc151ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23416:x1875064743443712:12345-192.168.201.143@tcp:104: Request processed in 115us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201559.059460:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 594 00000100:00100000:1.0:1788201559.065577:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201559.065839:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 595 00000100:00100000:3.0:1788201559.065854:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743443840:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201559.065870:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000aeeedc3c/0xd138388016f6eb3f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->90111] (req 0->90111) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094f48 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.065884:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000aeeedc3c/0xd138388016f6eb3f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->90111] (req 0->90111) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094f48 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.065900:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000aeeedc3c/0xd138388016f6eb3f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094f48 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.065911:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000aeeedc3c/0xd138388016f6eb3f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171094f48 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.065922:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000aeeedc3c/0xd138388016f6eb3f lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171094f48 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.065934:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000aeeedc3c/0xd138388016f6eb3f lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171094f48 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.065953:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc16645dc00) 00000100:00100000:3.0:1788201559.066027:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743443840:12345-192.168.201.143@tcp:105: Request processed in 177us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201559.066035:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 595 00000100:00100000:1.0:1788201559.069316:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727856256:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201559.093086:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172709880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727856768:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201559.093108:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6eb4d lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.093121:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6eb4d lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.093127:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6eb4d lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.093134:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6eb4d lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.093158:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6eb4d lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.093165:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3d800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201559.093169:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6eb4d lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.093177:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6eb4d lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.093184:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6eb4d lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.093191:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201559.093197:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6eb4d lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.093204:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6eb4d lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201559.093222:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc172709880 x1875064727856768/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201575 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201559.093237:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201559.093262:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:1.0:1788201559.093459:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.093474:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.093483:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.093499:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.093505:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.093510:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.093514:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.093518:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3bf8 00010000:00010000:1.0:1788201559.093522:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.093531:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.093543:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.093550:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201559.093556:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.093568:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.093572:0:23731:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sanity-quota.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), file ffff8bc153aa9200, open_flags 80c1, mode 81ed opened 0 00000080:00200000:1.0:1788201559.093579:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-quota.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000002:00010000:1.0:1788201559.093595:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-quota.sh,[0x200000bd7:0x127:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201559.093640:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778e00/0xd138388016f6eb54 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.093647:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778e00/0xd138388016f6eb54 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201559.093657:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201559.093663:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b2680 x1875064727857024/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201559.093672:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778e00/0xd138388016f6eb54 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.093689:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b2680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727857024:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.093868:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc148a80780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.101856:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17270bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727857152:192.168.201.143@tcp:101:cp.0 00000080:00200000:1.0:1788201559.104363:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x127:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201559.104370:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449da750 (ffff8bc1499c4a28/0) at cl_lock_release():245 00000020:00010000:1.0:1788201559.104373:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449da750 (ffff8bc1499c4a28/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.104379:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146f0a6b0 (ffff8bc1499c45a8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.104383:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449da750 (ffff8bc1499c4a28/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201559.104386:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146f0a6b0 (ffff8bc1499c4a28/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201559.104422:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x127:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201559.104578:0:23731:0:(file.c:2638:do_file_write_iter()) START file sanity-quota.sh:[0x200000bd7:0x127:0x0], ppos: 0, count: 254129 00000080:00200000:1.0:1788201559.104608:0:23731:0:(file.c:2090:ll_file_io_generic()) sanity-quota.sh: write ppos: 0, bytes: 254129 00000080:00200000:1.0:1788201559.104614:0:23731:0:(file.c:1848:ll_io_set_mirror()) sanity-quota.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201559.104619:0:23731:0:(cl_io.c:214:cl_io_rw_init()) header@000000006c993823[0x110, 1, [0x200000bd7:0x127:0x0] hash] 00000020:00200000:1.0:1788201559.104621:0:23731:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 254129) 0 0 00000080:00200000:1.0:1788201559.104624:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x127:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201559.104636:0:23731:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 62] 00020000:00200000:1.0:1788201559.104644:0:23731:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 254129) 254129, 254129 00020000:00200000:1.0:1788201559.104649:0:23731:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201559.104675:0:23731:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 62] 00000008:00010000:1.0:1788201559.104688:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201559.104693:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc151a503b0, osc lock ffff8bc145d09690, flags 0x0 00010000:00010000:1.0:1788201559.104707:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/410 (0 258047) 00010000:00010000:1.0:1788201559.104739:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6eb62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.104748:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6eb62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19a:0x0].0x0 rrc: 3 type: EXT [0->258047] (req 0->258047) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.104756:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6eb62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19a:0x0].0x0 rrc: 3 type: EXT [0->258047] (req 0->258047) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.104774:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b3b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727857280:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.105660:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc148a80780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201559.108598:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201559.108708:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743443968 00000100:00100000:1.0:1788201559.108720:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743443968 00000100:00100000:1.0:1788201559.109049:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 596 00000100:00100000:1.0:1788201559.109060:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc151ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23131:x1875064743443968:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201559.109081:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6eb5b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094f9c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.109360:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201559.109369:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc151ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23131:x1875064743443968:12345-192.168.201.143@tcp:104: Request processed in 309us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201559.109375:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 596 00000100:00100000:1.0:1788201559.109747:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727857408:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201559.115603:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b3b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727857280:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201559.115635:0:23731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6eb62 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->258047] (req 0->258047) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171094fa3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.115657:0:23731:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6eb62 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->258047] (req 0->258047) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094fa3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.115665:0:23731:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6eb62 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->258047] (req 0->258047) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171094fa3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.127743:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727857408:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201559.128282:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144158700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727857664:192.168.201.143@tcp:35:cp.0 00000002:00100000:3.0:1788201559.128311:0:23731:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1725b2680 x1875064727857024/t8589937118(8589937118) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201575 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201559.128455:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201559.128475:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201559.128494:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201559.128513:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201559.128521:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201559.128529:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201559.128532:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201559.128539:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201559.128543:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201559.128551:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201559.128566:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201559.128574:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201559.128580:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201559.128583:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-quota.sh, flags=8 00000080:00200008:3.0:1788201559.128591:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file sanity-quota.sh:[0x200000bd7:0x127:0x0](ffff8bc145952a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201559.128596:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x127:0x0](ffff8bc145952a08),name=sanity-quota.sh 00000002:00010000:3.0:1788201559.128606:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x127:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201559.128614:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778e00/0xd138388016f6eb54 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x127:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094f8e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201559.128622:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778e00/0xd138388016f6eb54 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x127:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094f8e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201559.128633:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201559.128637:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x127:0x0](ffff8bc145952a08) 00000080:00010000:3.0:1788201559.128639:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x127:0x0](ffff8bc145952a08) for lock 0xd138388016f6eb54 00000080:00010000:3.0:1788201559.128643:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eb54 from it ffffadd1c7da3cb8 00010000:00010000:3.0:1788201559.128646:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778e00/0xd138388016f6eb54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x127:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094f8e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201559.128653:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778e00/0xd138388016f6eb54 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x127:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094f8e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201559.128701:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x127:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201559.128711:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x127:0x0] 00000008:00010000:3.0:1788201559.129054:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201559.129060:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc144008330, osc lock ffff8bc14691a130, flags 0x400001002 00010000:00010000:3.0:1788201559.129083:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6eb62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094fa3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201559.129096:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6eb62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094fa3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:3.0:1788201559.129111:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1788201559.129116:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6eb62 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094fa3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201559.129125:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6eb62 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094fa3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1788201559.129153:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1788201559.129166:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x127:0x0] updating i_size 254129 i_blocks 1 00000020:00010000:3.0:1788201559.129171:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_release():245 00000020:00010000:3.0:1788201559.129175:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201559.129177:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc144008330 (ffff8bc1460e9098/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201559.129182:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201559.129184:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc144008330 (ffff8bc1460e9bd8/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201559.129215:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x127:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201559.129275:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201559.129285:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201559.129294:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201559.129302:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201559.129309:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201559.129314:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201559.129316:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201559.129321:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201559.129325:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201559.129333:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201559.129427:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201559.129433:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201559.129438:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201559.129453:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-scrub.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=9 00000080:00200000:3.0:1788201559.129458:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-scrub.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:3.0:1788201559.129470:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-scrub.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201559.129521:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb69 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.129529:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb69 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.129539:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb69 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201559.129564:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff4e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727857792:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201559.129675:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1520ad0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201559.133634:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff4e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727857792:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201559.133659:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb69 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.133673:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb69 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.133680:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb69 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.133688:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb69 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.133698:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb69 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.133705:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14400c600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201559.133710:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb69 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.133718:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb69 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.133725:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb69 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.133733:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201559.133739:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb69 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.133746:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c600/0xd138388016f6eb69 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201559.133778:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc151ff4e00 x1875064727857792/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201575 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201559.133960:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201559.133997:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:3.0:1788201559.134061:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201559.134085:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201559.134095:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201559.134110:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201559.134116:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201559.134121:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201559.134125:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201559.134130:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:3.0:1788201559.134135:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201559.134152:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201559.134173:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201559.134182:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201559.134188:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201559.134200:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-scrub.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=8 00000080:00200000:3.0:1788201559.134204:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-scrub.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:3.0:1788201559.134216:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-scrub.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201559.134259:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722a00/0xd138388016f6eb70 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.134266:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722a00/0xd138388016f6eb70 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.134275:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722a00/0xd138388016f6eb70 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201559.134303:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff4e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727857920:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201559.134449:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1520ad0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201559.139495:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff4e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727857920:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201559.139518:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722a00/0xd138388016f6eb70 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.139532:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722a00/0xd138388016f6eb70 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.139539:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722a00/0xd138388016f6eb70 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.139547:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722a00/0xd138388016f6eb70 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.139556:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722a00/0xd138388016f6eb70 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.139562:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172722a00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201559.139566:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722a00/0xd138388016f6eb70 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.139573:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722a00/0xd138388016f6eb70 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.139580:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722a00/0xd138388016f6eb70 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.139587:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201559.139593:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722a00/0xd138388016f6eb70 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.139599:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722a00/0xd138388016f6eb70 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201559.139616:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc151ff4e00 x1875064727857920/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201575 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201559.139630:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201559.139654:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:3.0:1788201559.139751:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201559.139765:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201559.139774:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201559.139785:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201559.139829:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201559.139834:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201559.139839:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201559.139844:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3bf8 00010000:00010000:3.0:1788201559.139848:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201559.139857:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201559.139874:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201559.139882:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201559.139888:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201559.139900:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:3.0:1788201559.139905:0:23731:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sanity-scrub.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), file ffff8bc143847e00, open_flags 80c1, mode 81ed opened 0 00000080:00200000:3.0:1788201559.139913:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-scrub.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000002:00010000:3.0:1788201559.139933:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-scrub.sh,[0x200000bd7:0x128:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open|creat flags 0100302 00010000:00010000:3.0:1788201559.139995:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031800/0xd138388016f6eb77 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.140002:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031800/0xd138388016f6eb77 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1788201559.140014:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1788201559.140021:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc151ff4e00 x1875064727858176/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1788201559.140030:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031800/0xd138388016f6eb77 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201559.140050:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff4e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727858176:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201559.140241:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1520ad0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201559.146624:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff4e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727858176:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201559.146652:0:23731:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031800/0xd138388016f6eb77 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094fe9 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.146676:0:23731:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031800/0xd138388016f6eb77 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x128:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094fe9 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.146685:0:23731:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031800/0xd138388016f6eb77 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x128:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094fe9 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.146697:0:23731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031800/0xd138388016f6eb77 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x128:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094fe9 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.146708:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031800/0xd138388016f6eb77 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x128:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094fe9 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.146721:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031800/0xd138388016f6eb77 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x128:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094fe9 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.146740:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031800/0xd138388016f6eb77 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x128:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094fe9 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.146754:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031800/0xd138388016f6eb77 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x128:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094fe9 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201559.146765:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc151ff4e00 x1875064727858176/t8589937120(8589937120) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201575 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1788201559.146780:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc151ff4e00 x1875064727858176/t8589937120(8589937120) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201575 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201559.146975:0:23731:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031800/0xd138388016f6eb77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x128:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094fe9 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1788201559.146992:0:23731:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031800/0xd138388016f6eb77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x128:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094fe9 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.147004:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/296 (0 0) 00000080:00200000:3.0:1788201559.147012:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1788201559.147029:0:23731:0:(namei.c:1628:ll_create_it()) VFS Op:name=sanity-scrub.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000080:00200000:3.0:1788201559.147068:0:23731:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x128:0x0](ffff8bc1459d6c08) 00000080:00200000:3.0:1788201559.147262:0:23731:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x128:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1788201559.147272:0:23731:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x128:0x0](ffff8bc1459d6c08) 00000080:00010000:3.0:1788201559.147276:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x128:0x0](ffff8bc1459d6c08) for lock 0xd138388016f6eb77 00000080:00010000:3.0:1788201559.147286:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x128:0x0](ffff8bc1459d6c08) 00000080:00200008:3.0:1788201559.147300:0:23731:0:(file.c:1090:ll_file_open()) START file sanity-scrub.sh:[0x200000bd7:0x128:0x0](ffff8bc1459d6c08), flags 100301 00000002:00100000:3.0:1788201559.147321:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc151ff4e00 x1875064727858176/t8589937120(8589937120) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201575 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1788201559.147496:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eb77 from it ffff8bc148c9b180 00010000:00010000:3.0:1788201559.147502:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031800/0xd138388016f6eb77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x128:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094fe9 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.147512:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031800/0xd138388016f6eb77 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x128:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094fe9 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201559.149063:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17270bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727858304:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201559.153075:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6eb7e lrc: 6/2,0 mode: --/PR res: [0x280000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.153269:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6eb7e lrc: 6/2,0 mode: --/PR res: [0x280000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094ff7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.153286:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6eb7e lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171094ff7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.153299:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6eb7e lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171094ff7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201559.153313:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6eb7e lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094ff7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201559.153332:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1788201559.153445:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6eb7e lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094ff7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.153455:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6eb7e lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094ff7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.153463:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6eb7e lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171094ff7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.153473:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6eb7e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171094ff7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201559.153493:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17270bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727858304:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.158295:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743444224 00000100:00100000:1.0:1788201559.158304:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743444224 00000100:00100000:1.0:1788201559.158438:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 598 00000100:00100000:1.0:1788201559.158449:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14415b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23413:x1875064743444224:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201559.158469:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6eb7e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x19b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171094ff7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.158554:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201559.158561:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14415b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23413:x1875064743444224:12345-192.168.201.143@tcp:104: Request processed in 114us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201559.158568:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 598 00000100:00100000:1.0:1788201559.214599:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743444480 00000100:00100000:1.0:1788201559.214609:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743444480 00000100:00100000:1.0:1788201559.214660:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 600 00000100:00100000:1.0:1788201559.214667:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14415a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:28099:x1875064743444480:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201559.214682:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000800b6d4e/0xd138388016f6eba1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171095052 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.214773:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201559.214779:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14415a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:28099:x1875064743444480:12345-192.168.201.143@tcp:104: Request processed in 112us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201559.214786:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 600 00000100:00100000:1.0:1788201559.215228:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201559.215244:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727859712:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201559.217683:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415b480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727859584:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201559.217714:0:23731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004b4e8b7f/0xd138388016f6eba8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->430079] (req 0->430079) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171095059 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.217728:0:23731:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004b4e8b7f/0xd138388016f6eba8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->430079] (req 0->430079) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171095059 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.217737:0:23731:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004b4e8b7f/0xd138388016f6eba8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->430079] (req 0->430079) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171095059 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.223900:0:23731:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004b4e8b7f/0xd138388016f6eba8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171095059 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.223913:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004b4e8b7f/0xd138388016f6eba8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171095059 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.223930:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004b4e8b7f/0xd138388016f6eba8 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171095059 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201559.223943:0:23731:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004b4e8b7f/0xd138388016f6eba8 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171095059 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.223955:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004b4e8b7f/0xd138388016f6eba8 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171095059 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.223963:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004b4e8b7f/0xd138388016f6eba8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171095059 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201559.224015:0:23731:0:(vvp_io.c:1292:vvp_io_write_start()) sanity-sec.sh: write [0, 429670) append 0 append lockpos 0 00000080:00200000:3.0:1788201559.224036:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.224100:0:23731:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:3.0:1788201559.224114:0:23731:0:(rw26.c:956:ll_write_end()) page@000000008a8af0af[3 00000000e6711095 2 1 00000000c3444ba1 0 0 0] 00000080:00200000:3.0:1788201559.224118:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000580660ac 17ffffc0001021 2:0 ffff8bc146dab540 0 lru 00000080:00200000:3.0:1788201559.224126:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000009f803ec7 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.224128:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000008a8af0af 00000080:00200000:3.0:1788201559.224130:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201559.224134:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.224266:0:23731:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:3.0:1788201559.224271:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000ce0ed2bf[3 00000000e6711095 2 1 00000000c3444ba1 0 0 1] 00000080:00200000:3.0:1788201559.224274:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000c4ce9287 17ffffc0001001 3:0 ffff8bc146daba80 1 lru 00000080:00200000:3.0:1788201559.224280:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000063740fa 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.224282:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000ce0ed2bf 00000080:00200000:3.0:1788201559.224283:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:3.0:1788201559.224285:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.224301:0:23731:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:3.0:1788201559.224306:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000c43a8ec5[3 00000000e6711095 2 1 00000000c3444ba1 0 0 2] 00000080:00200000:3.0:1788201559.224308:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000e5bf8cbd 17ffffc0001001 3:0 ffff8bc146dabc40 2 lru 00000080:00200000:3.0:1788201559.224314:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000927bb568 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.224316:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000c43a8ec5 00000080:00200000:3.0:1788201559.224317:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:3.0:1788201559.224319:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.224332:0:23731:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:3.0:1788201559.224336:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000017fdf081[3 00000000e6711095 2 1 00000000c3444ba1 0 0 3] 00000080:00200000:3.0:1788201559.224339:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000045e7850b 17ffffc0001001 3:0 ffff8bc146dab9a0 3 lru 00000080:00200000:3.0:1788201559.224355:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b62d796c 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.224358:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000017fdf081 00000080:00200000:3.0:1788201559.224359:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:3.0:1788201559.224362:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.224378:0:23731:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:3.0:1788201559.224381:0:23731:0:(rw26.c:956:ll_write_end()) page@000000007295952d[3 00000000e6711095 2 1 00000000c3444ba1 0 0 4] 00000080:00200000:3.0:1788201559.224384:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000026649053 17ffffc0001001 3:0 ffff8bc146dab0e0 4 lru 00000080:00200000:3.0:1788201559.224389:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000e6ef6ba8 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.224390:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000007295952d 00000080:00200000:3.0:1788201559.224391:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:3.0:1788201559.224393:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.224407:0:23731:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:3.0:1788201559.224411:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000016e7d724[3 00000000e6711095 2 1 00000000c3444ba1 0 0 5] 00000080:00200000:3.0:1788201559.224413:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000004e686e67 17ffffc0001001 3:0 ffff8bc146dab1c0 5 lru 00000080:00200000:3.0:1788201559.224418:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000bc74bfa5 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.224420:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000016e7d724 00000080:00200000:3.0:1788201559.224421:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:3.0:1788201559.224423:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.224436:0:23731:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:3.0:1788201559.224440:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000a4037bf6[3 00000000e6711095 2 1 00000000c3444ba1 0 0 6] 00000080:00200000:3.0:1788201559.224442:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000007dfaea3 17ffffc0001001 3:0 ffff8bc146dab380 6 lru 00000080:00200000:3.0:1788201559.224447:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000004ec4416e 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.224448:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000a4037bf6 00000080:00200000:3.0:1788201559.224450:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:3.0:1788201559.224451:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.224464:0:23731:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:3.0:1788201559.224468:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000056629307[3 00000000e6711095 2 1 00000000c3444ba1 0 0 7] 00000080:00200000:3.0:1788201559.224471:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000ea8ff753 17ffffc0001001 3:0 ffff8bc146dab000 7 lru 00000080:00200000:3.0:1788201559.224475:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000c519000d 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.224477:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000056629307 00000080:00200000:3.0:1788201559.224478:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:3.0:1788201559.224480:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.224495:0:23731:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:3.0:1788201559.224499:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000b04c83f2[3 00000000e6711095 2 1 00000000c3444ba1 0 0 8] 00000080:00200000:3.0:1788201559.224501:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000000f632d4 17ffffc0001001 3:0 ffff8bc150adba80 8 lru 00000080:00200000:3.0:1788201559.224506:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000006338fccc 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.224509:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000b04c83f2 00000080:00200000:3.0:1788201559.224510:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:3.0:1788201559.224512:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.224526:0:23731:0:(rw26.c:898:ll_write_end()) pos 36864, len 4096, copied 4096 00000080:00200000:3.0:1788201559.224531:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000d1dbe0f2[3 00000000e6711095 2 1 00000000c3444ba1 0 0 9] 00000080:00200000:3.0:1788201559.224533:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000002ff5b9a6 17ffffc0001001 3:0 ffff8bc150adb9a0 9 lru 00000080:00200000:3.0:1788201559.224538:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000a559e2d3 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.224539:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000d1dbe0f2 00000080:00200000:3.0:1788201559.224540:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:3.0:1788201559.224543:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 10 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.224556:0:23731:0:(rw26.c:898:ll_write_end()) pos 40960, len 4096, copied 4096 00000080:00200000:3.0:1788201559.224560:0:23731:0:(rw26.c:956:ll_write_end()) page@000000004b32b25d[3 00000000e6711095 2 1 00000000c3444ba1 0 0 10] 00000080:00200000:3.0:1788201559.224563:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000a23d70b1 17ffffc0001001 3:0 ffff8bc150adbc40 10 lru 00000080:00200000:3.0:1788201559.224567:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000050daa950 10: 1< 0 - - > 2< 40960 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.224569:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000004b32b25d 00000080:00200000:3.0:1788201559.224570:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 11. 00000080:00200000:3.0:1788201559.224572:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 11 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.224584:0:23731:0:(rw26.c:898:ll_write_end()) pos 45056, len 4096, copied 4096 00000080:00200000:3.0:1788201559.224588:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000e9fb2993[3 00000000e6711095 2 1 00000000c3444ba1 0 0 11] 00000080:00200000:3.0:1788201559.224590:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000004d279c01 17ffffc0001001 3:0 ffff8bc150adb1c0 11 lru 00000080:00200000:3.0:1788201559.224595:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000983f8e79 11: 1< 0 - - > 2< 45056 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.224596:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000e9fb2993 00000080:00200000:3.0:1788201559.224597:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 12. 00000080:00200000:3.0:1788201559.224599:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 12 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.224609:0:23731:0:(rw26.c:898:ll_write_end()) pos 49152, len 4096, copied 4096 00000080:00200000:3.0:1788201559.224613:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000035285140[3 00000000e6711095 2 1 00000000c3444ba1 0 0 12] 00000080:00200000:3.0:1788201559.224615:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000212d5244 17ffffc0001001 3:0 ffff8bc150adb0e0 12 lru 00000080:00200000:3.0:1788201559.224619:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000017a06f13 12: 1< 0 - - > 2< 49152 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.224621:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000035285140 00000080:00200000:3.0:1788201559.224622:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 13. 00000080:00200000:3.0:1788201559.224623:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 13 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.224635:0:23731:0:(rw26.c:898:ll_write_end()) pos 53248, len 4096, copied 4096 00000080:00200000:3.0:1788201559.224639:0:23731:0:(rw26.c:956:ll_write_end()) page@000000003a837f18[3 00000000e6711095 2 1 00000000c3444ba1 0 0 13] 00000080:00200000:3.0:1788201559.224641:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000004b7cd8b0 17ffffc0001001 3:0 ffff8bc150adb540 13 lru 00000080:00200000:3.0:1788201559.224645:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000047051797 13: 1< 0 - - > 2< 53248 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.224647:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000003a837f18 00000080:00200000:3.0:1788201559.224648:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 14. 00000080:00200000:3.0:1788201559.224649:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 14 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.224660:0:23731:0:(rw26.c:898:ll_write_end()) pos 57344, len 4096, copied 4096 00000080:00200000:3.0:1788201559.224664:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000f763d75a[3 00000000e6711095 2 1 00000000c3444ba1 0 0 14] 00000080:00200000:3.0:1788201559.224666:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000021f3235c 17ffffc0001001 3:0 ffff8bc150adb8c0 14 lru 00000080:00200000:3.0:1788201559.224671:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000005fce7ab7 14: 1< 0 - - > 2< 57344 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.224673:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000f763d75a 00000080:00200000:3.0:1788201559.224674:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 15. 00000080:00200000:3.0:1788201559.224676:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 15 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.224691:0:23731:0:(rw26.c:898:ll_write_end()) pos 61440, len 4096, copied 4096 00000080:00200000:3.0:1788201559.224695:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000118603a2[3 00000000e6711095 2 1 00000000c3444ba1 0 0 15] 00000080:00200000:3.0:1788201559.224698:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000444e7346 17ffffc0001021 2:0 ffff8bc150adbe00 15 lru 00000080:00200000:3.0:1788201559.224703:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000bddca677 15: 1< 0 - - > 2< 61440 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.224705:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000118603a2 00000080:00200000:3.0:1788201559.224706:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 16. 00000080:00200000:3.0:1788201559.224708:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 16 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.224722:0:23731:0:(rw26.c:898:ll_write_end()) pos 65536, len 4096, copied 4096 00000080:00200000:3.0:1788201559.224726:0:23731:0:(rw26.c:956:ll_write_end()) page@000000009b34332b[3 00000000e6711095 2 1 00000000c3444ba1 0 0 16] 00000080:00200000:3.0:1788201559.224729:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000039e91e7a 17ffffc0001001 3:0 ffff8bc150adbee0 16 lru 00000080:00200000:3.0:1788201559.224734:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b62d480c 16: 1< 0 - - > 2< 65536 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.224736:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000009b34332b 00000080:00200000:3.0:1788201559.224737:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 17. 00000080:00200000:3.0:1788201559.224738:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 17 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.224752:0:23731:0:(rw26.c:898:ll_write_end()) pos 69632, len 4096, copied 4096 00000080:00200000:3.0:1788201559.224756:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000a10601d9[3 00000000e6711095 2 1 00000000c3444ba1 0 0 17] 00000080:00200000:3.0:1788201559.224758:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000fb371513 17ffffc0001001 3:0 ffff8bc150adb620 17 lru 00000080:00200000:3.0:1788201559.224762:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000f0fc70cb 17: 1< 0 - - > 2< 69632 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.224764:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000a10601d9 00000080:00200000:3.0:1788201559.224765:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 18. 00000080:00200000:3.0:1788201559.224767:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 18 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.224781:0:23731:0:(rw26.c:898:ll_write_end()) pos 73728, len 4096, copied 4096 00000080:00200000:3.0:1788201559.224786:0:23731:0:(rw26.c:956:ll_write_end()) page@000000006bd22b06[3 00000000e6711095 2 1 00000000c3444ba1 0 0 18] 00000080:00200000:3.0:1788201559.224788:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000005922f1b4 17ffffc0001001 3:0 ffff8bc150adb7e0 18 lru 00000080:00200000:3.0:1788201559.224841:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000001cfb6df4 18: 1< 0 - - > 2< 73728 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.224843:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000006bd22b06 00000080:00200000:3.0:1788201559.224844:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 19. 00000080:00200000:3.0:1788201559.224847:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 19 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.224870:0:23731:0:(rw26.c:898:ll_write_end()) pos 77824, len 4096, copied 4096 00000080:00200000:3.0:1788201559.224875:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000c5c95d69[3 00000000e6711095 2 1 00000000c3444ba1 0 0 19] 00000080:00200000:3.0:1788201559.224877:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000a84452c9 17ffffc0001001 3:0 ffff8bc150adb700 19 lru 00000080:00200000:3.0:1788201559.224882:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b1520685 19: 1< 0 - - > 2< 77824 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.224884:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000c5c95d69 00000080:00200000:3.0:1788201559.224885:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 20. 00000080:00200000:3.0:1788201559.224887:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 20 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.224901:0:23731:0:(rw26.c:898:ll_write_end()) pos 81920, len 4096, copied 4096 00000080:00200000:3.0:1788201559.224905:0:23731:0:(rw26.c:956:ll_write_end()) page@000000007769c743[3 00000000e6711095 2 1 00000000c3444ba1 0 0 20] 00000080:00200000:3.0:1788201559.224908:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000086451e10 17ffffc0001001 3:0 ffff8bc150adbb60 20 lru 00000080:00200000:3.0:1788201559.224912:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000030dc07fe 20: 1< 0 - - > 2< 81920 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.224914:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000007769c743 00000080:00200000:3.0:1788201559.224915:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 21. 00000080:00200000:3.0:1788201559.224917:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 21 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.224930:0:23731:0:(rw26.c:898:ll_write_end()) pos 86016, len 4096, copied 4096 00000080:00200000:3.0:1788201559.224934:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000b0198f2e[3 00000000e6711095 2 1 00000000c3444ba1 0 0 21] 00000080:00200000:3.0:1788201559.224937:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000035f89a27 17ffffc0001001 3:0 ffff8bc150adb2a0 21 lru 00000080:00200000:3.0:1788201559.224943:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000006ff22200 21: 1< 0 - - > 2< 86016 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.224945:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000b0198f2e 00000080:00200000:3.0:1788201559.224946:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 22. 00000080:00200000:3.0:1788201559.224948:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 22 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.224962:0:23731:0:(rw26.c:898:ll_write_end()) pos 90112, len 4096, copied 4096 00000080:00200000:3.0:1788201559.224976:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000025541d9b[3 00000000e6711095 2 1 00000000c3444ba1 0 0 22] 00000080:00200000:3.0:1788201559.224978:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000598ffbaf 17ffffc0001001 3:0 ffff8bc150adb460 22 lru 00000080:00200000:3.0:1788201559.224983:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000f3b2cc80 22: 1< 0 - - > 2< 90112 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.224986:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000025541d9b 00000080:00200000:3.0:1788201559.224987:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 23. 00000080:00200000:3.0:1788201559.224989:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 23 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.225017:0:23731:0:(rw26.c:898:ll_write_end()) pos 94208, len 4096, copied 4096 00000080:00200000:3.0:1788201559.225021:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000791f47a3[3 00000000e6711095 2 1 00000000c3444ba1 0 0 23] 00000080:00200000:3.0:1788201559.225024:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000b50c81a3 17ffffc0001001 3:0 ffff8bc150adbd20 23 lru 00000080:00200000:3.0:1788201559.225030:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000077a8f68b 23: 1< 0 - - > 2< 94208 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.225032:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000791f47a3 00000080:00200000:3.0:1788201559.225033:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 24. 00000080:00200000:3.0:1788201559.225035:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 24 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.225050:0:23731:0:(rw26.c:898:ll_write_end()) pos 98304, len 4096, copied 4096 00000080:00200000:3.0:1788201559.225054:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000b605003c[3 00000000e6711095 2 1 00000000c3444ba1 0 0 24] 00000080:00200000:3.0:1788201559.225056:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000006171f755 17ffffc0001001 3:0 ffff8bc150adb000 24 lru 00000080:00200000:3.0:1788201559.225062:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000f68ca7b0 24: 1< 0 - - > 2< 98304 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.225064:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000b605003c 00000080:00200000:3.0:1788201559.225065:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 25. 00000080:00200000:3.0:1788201559.225067:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 25 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.225083:0:23731:0:(rw26.c:898:ll_write_end()) pos 102400, len 4096, copied 4096 00000080:00200000:3.0:1788201559.225086:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000dfd46231[3 00000000e6711095 2 1 00000000c3444ba1 0 0 25] 00000080:00200000:3.0:1788201559.225089:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000b070ca59 17ffffc0001001 3:0 ffff8bc150adb380 25 lru 00000080:00200000:3.0:1788201559.225095:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000afaa791d 25: 1< 0 - - > 2< 102400 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.225097:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000dfd46231 00000080:00200000:3.0:1788201559.225098:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 26. 00000080:00200000:3.0:1788201559.225100:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 26 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.225114:0:23731:0:(rw26.c:898:ll_write_end()) pos 106496, len 4096, copied 4096 00000080:00200000:3.0:1788201559.225118:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000082124a81[3 00000000e6711095 2 1 00000000c3444ba1 0 0 26] 00000080:00200000:3.0:1788201559.225121:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000ef192e0f 17ffffc0001001 3:0 ffff8bc146d34000 26 lru 00000080:00200000:3.0:1788201559.225125:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b618da3e 26: 1< 0 - - > 2< 106496 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.225128:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000082124a81 00000080:00200000:3.0:1788201559.225129:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 27. 00000080:00200000:3.0:1788201559.225130:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 27 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.225687:0:23731:0:(rw26.c:898:ll_write_end()) pos 110592, len 4096, copied 4096 00000080:00200000:3.0:1788201559.225695:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000d801ba73[3 00000000e6711095 2 1 00000000c3444ba1 0 0 27] 00000080:00200000:3.0:1788201559.225698:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000cc0dcab1 17ffffc0001001 3:0 ffff8bc146d34c40 27 lru 00000080:00200000:3.0:1788201559.225703:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000001d605ea3 27: 1< 0 - - > 2< 110592 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.225705:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000d801ba73 00000080:00200000:3.0:1788201559.225707:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 28. 00000080:00200000:3.0:1788201559.225709:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 28 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.225723:0:23731:0:(rw26.c:898:ll_write_end()) pos 114688, len 4096, copied 4096 00000080:00200000:3.0:1788201559.225727:0:23731:0:(rw26.c:956:ll_write_end()) page@000000004c053c52[3 00000000e6711095 2 1 00000000c3444ba1 0 0 28] 00000080:00200000:3.0:1788201559.225730:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000af9e2ac7 17ffffc0001001 3:0 ffff8bc146d34a80 28 lru 00000080:00200000:3.0:1788201559.225735:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000007b38b66a 28: 1< 0 - - > 2< 114688 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.225737:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000004c053c52 00000080:00200000:3.0:1788201559.225738:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 29. 00000080:00200000:3.0:1788201559.225740:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 29 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.225756:0:23731:0:(rw26.c:898:ll_write_end()) pos 118784, len 4096, copied 4096 00000080:00200000:3.0:1788201559.225760:0:23731:0:(rw26.c:956:ll_write_end()) page@000000009ab306f4[3 00000000e6711095 2 1 00000000c3444ba1 0 0 29] 00000080:00200000:3.0:1788201559.225763:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000c6e4a291 17ffffc0001001 3:0 ffff8bc146d34e00 29 lru 00000080:00200000:3.0:1788201559.225767:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000fafd994e 29: 1< 0 - - > 2< 118784 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.225769:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000009ab306f4 00000080:00200000:3.0:1788201559.225770:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 30. 00000080:00200000:3.0:1788201559.225771:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 30 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.225819:0:23731:0:(rw26.c:898:ll_write_end()) pos 122880, len 4096, copied 4096 00000080:00200000:3.0:1788201559.225825:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000a4c0c594[3 00000000e6711095 2 1 00000000c3444ba1 0 0 30] 00000080:00200000:3.0:1788201559.225828:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000001788747d 17ffffc0001021 2:0 ffff8bc146d348c0 30 lru 00000080:00200000:3.0:1788201559.225834:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000fc03d38a 30: 1< 0 - - > 2< 122880 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.225836:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000a4c0c594 00000080:00200000:3.0:1788201559.225837:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 31. 00000080:00200000:3.0:1788201559.225839:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 31 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.225854:0:23731:0:(rw26.c:898:ll_write_end()) pos 126976, len 4096, copied 4096 00000080:00200000:3.0:1788201559.225858:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000f224c0a0[3 00000000e6711095 2 1 00000000c3444ba1 0 0 31] 00000080:00200000:3.0:1788201559.225861:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000d39ad1ca 17ffffc0001001 3:0 ffff8bc146d34d20 31 lru 00000080:00200000:3.0:1788201559.225867:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000bbd8df0f 31: 1< 0 - - > 2< 126976 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.225869:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000f224c0a0 00000080:00200000:3.0:1788201559.225870:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 32. 00000080:00200000:3.0:1788201559.225872:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 32 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.225886:0:23731:0:(rw26.c:898:ll_write_end()) pos 131072, len 4096, copied 4096 00000080:00200000:3.0:1788201559.225889:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000088ecdb79[3 00000000e6711095 2 1 00000000c3444ba1 0 0 32] 00000080:00200000:3.0:1788201559.225892:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000000da7905a 17ffffc0001001 3:0 ffff8bc146d34540 32 lru 00000080:00200000:3.0:1788201559.225897:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000735ee451 32: 1< 0 - - > 2< 131072 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.225899:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000088ecdb79 00000080:00200000:3.0:1788201559.225900:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 33. 00000080:00200000:3.0:1788201559.225901:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 33 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.225914:0:23731:0:(rw26.c:898:ll_write_end()) pos 135168, len 4096, copied 4096 00000080:00200000:3.0:1788201559.225918:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000d0d77a2d[3 00000000e6711095 2 1 00000000c3444ba1 0 0 33] 00000080:00200000:3.0:1788201559.225921:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000be6b74b8 17ffffc0001001 3:0 ffff8bc146d347e0 33 lru 00000080:00200000:3.0:1788201559.225926:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b4861270 33: 1< 0 - - > 2< 135168 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.225928:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000d0d77a2d 00000080:00200000:3.0:1788201559.225929:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 34. 00000080:00200000:3.0:1788201559.225931:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 34 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.225944:0:23731:0:(rw26.c:898:ll_write_end()) pos 139264, len 4096, copied 4096 00000080:00200000:3.0:1788201559.225948:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000b174b22d[3 00000000e6711095 2 1 00000000c3444ba1 0 0 34] 00000080:00200000:3.0:1788201559.225951:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000fce738cf 17ffffc0001001 3:0 ffff8bc146d34620 34 lru 00000080:00200000:3.0:1788201559.225957:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000426051ec 34: 1< 0 - - > 2< 139264 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.225959:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000b174b22d 00000080:00200000:3.0:1788201559.225960:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 35. 00000080:00200000:3.0:1788201559.225961:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 35 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.225986:0:23731:0:(rw26.c:898:ll_write_end()) pos 143360, len 4096, copied 4096 00000080:00200000:3.0:1788201559.225991:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000833ca3d7[3 00000000e6711095 2 1 00000000c3444ba1 0 0 35] 00000080:00200000:3.0:1788201559.225994:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000004d1aba57 17ffffc0001001 3:0 ffff8bc146d34b60 35 lru 00000080:00200000:3.0:1788201559.225999:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000003877159c 35: 1< 0 - - > 2< 143360 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.226523:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000833ca3d7 00000080:00200000:3.0:1788201559.226524:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 36. 00000080:00200000:3.0:1788201559.226527:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 36 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.226548:0:23731:0:(rw26.c:898:ll_write_end()) pos 147456, len 4096, copied 4096 00000080:00200000:3.0:1788201559.226553:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000081ace4fa[3 00000000e6711095 2 1 00000000c3444ba1 0 0 36] 00000080:00200000:3.0:1788201559.226556:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000006243580a 17ffffc0001001 3:0 ffff8bc146d34700 36 lru 00000080:00200000:3.0:1788201559.226562:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000012318ddf 36: 1< 0 - - > 2< 147456 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.226564:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000081ace4fa 00000080:00200000:3.0:1788201559.226565:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 37. 00000080:00200000:3.0:1788201559.226567:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 37 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.226582:0:23731:0:(rw26.c:898:ll_write_end()) pos 151552, len 4096, copied 4096 00000080:00200000:3.0:1788201559.226586:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000c96299e8[3 00000000e6711095 2 1 00000000c3444ba1 0 0 37] 00000080:00200000:3.0:1788201559.226589:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000effcb865 17ffffc0001001 3:0 ffff8bc146d34380 37 lru 00000080:00200000:3.0:1788201559.226594:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000d7c94e0b 37: 1< 0 - - > 2< 151552 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.226596:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000c96299e8 00000080:00200000:3.0:1788201559.226597:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 38. 00000080:00200000:3.0:1788201559.226599:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 38 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.226614:0:23731:0:(rw26.c:898:ll_write_end()) pos 155648, len 4096, copied 4096 00000080:00200000:3.0:1788201559.226618:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000090385016[3 00000000e6711095 2 1 00000000c3444ba1 0 0 38] 00000080:00200000:3.0:1788201559.226621:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000c40ea0eb 17ffffc0001001 3:0 ffff8bc146d341c0 38 lru 00000080:00200000:3.0:1788201559.226627:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000d60b76fa 38: 1< 0 - - > 2< 155648 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.226629:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000090385016 00000080:00200000:3.0:1788201559.226630:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 39. 00000080:00200000:3.0:1788201559.226631:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 39 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.226644:0:23731:0:(rw26.c:898:ll_write_end()) pos 159744, len 4096, copied 4096 00000080:00200000:3.0:1788201559.226648:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000d1258f41[3 00000000e6711095 2 1 00000000c3444ba1 0 0 39] 00000080:00200000:3.0:1788201559.226650:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000008ca556f0 17ffffc0001001 3:0 ffff8bc146d340e0 39 lru 00000080:00200000:3.0:1788201559.226656:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000c8b67bd0 39: 1< 0 - - > 2< 159744 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.226658:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000d1258f41 00000080:00200000:3.0:1788201559.226659:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 40. 00000080:00200000:3.0:1788201559.226661:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 40 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.226672:0:23731:0:(rw26.c:898:ll_write_end()) pos 163840, len 4096, copied 4096 00000080:00200000:3.0:1788201559.226675:0:23731:0:(rw26.c:956:ll_write_end()) page@000000001846ce72[3 00000000e6711095 2 1 00000000c3444ba1 0 0 40] 00000080:00200000:3.0:1788201559.226678:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000fa8d2c5d 17ffffc0001001 3:0 ffff8bc146d349a0 40 lru 00000080:00200000:3.0:1788201559.226683:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000000fd602ed 40: 1< 0 - - > 2< 163840 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.226686:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000001846ce72 00000080:00200000:3.0:1788201559.226687:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 41. 00000080:00200000:3.0:1788201559.226689:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 41 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.226704:0:23731:0:(rw26.c:898:ll_write_end()) pos 167936, len 4096, copied 4096 00000080:00200000:3.0:1788201559.226709:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000084e4a2e0[3 00000000e6711095 2 1 00000000c3444ba1 0 0 41] 00000080:00200000:3.0:1788201559.226712:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000ee08c691 17ffffc0001001 3:0 ffff8bc146d34460 41 lru 00000080:00200000:3.0:1788201559.226717:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000009abc59a4 41: 1< 0 - - > 2< 167936 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.226719:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000084e4a2e0 00000080:00200000:3.0:1788201559.226720:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 42. 00000080:00200000:3.0:1788201559.226722:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 42 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.226735:0:23731:0:(rw26.c:898:ll_write_end()) pos 172032, len 4096, copied 4096 00000080:00200000:3.0:1788201559.226739:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000087636226[3 00000000e6711095 2 1 00000000c3444ba1 0 0 42] 00000080:00200000:3.0:1788201559.226742:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000b475f5d8 17ffffc0001001 3:0 ffff8bc146d342a0 42 lru 00000080:00200000:3.0:1788201559.226747:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000f651c280 42: 1< 0 - - > 2< 172032 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.226749:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000087636226 00000080:00200000:3.0:1788201559.226751:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 43. 00000080:00200000:3.0:1788201559.226753:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 43 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.226766:0:23731:0:(rw26.c:898:ll_write_end()) pos 176128, len 4096, copied 4096 00000080:00200000:3.0:1788201559.226771:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000870bf190[3 00000000e6711095 2 1 00000000c3444ba1 0 0 43] 00000080:00200000:3.0:1788201559.226774:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000959773c3 17ffffc0001001 3:0 ffff8bc146d34ee0 43 lru 00000080:00200000:3.0:1788201559.226779:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000d798cc74 43: 1< 0 - - > 2< 176128 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.226781:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000870bf190 00000080:00200000:3.0:1788201559.226782:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 44. 00000080:00200000:3.0:1788201559.226785:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 44 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.226881:0:23731:0:(rw26.c:898:ll_write_end()) pos 180224, len 4096, copied 4096 00000080:00200000:3.0:1788201559.226887:0:23731:0:(rw26.c:956:ll_write_end()) page@000000008a7fc96f[3 00000000e6711095 2 1 00000000c3444ba1 0 0 44] 00000080:00200000:3.0:1788201559.226890:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000000deeab87 17ffffc0001001 3:0 ffff8bc172459460 44 lru 00000080:00200000:3.0:1788201559.226896:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000e426b213 44: 1< 0 - - > 2< 180224 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.226898:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000008a7fc96f 00000080:00200000:3.0:1788201559.226899:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 45. 00000080:00200000:3.0:1788201559.226901:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 45 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.226923:0:23731:0:(rw26.c:898:ll_write_end()) pos 184320, len 4096, copied 4096 00000080:00200000:3.0:1788201559.226928:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000e5494c1f[3 00000000e6711095 2 1 00000000c3444ba1 0 0 45] 00000080:00200000:3.0:1788201559.226931:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000397e3e7d 17ffffc0001021 2:0 ffff8bc1724592a0 45 lru 00000080:00200000:3.0:1788201559.226936:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000070124175 45: 1< 0 - - > 2< 184320 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.226938:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000e5494c1f 00000080:00200000:3.0:1788201559.226940:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 46. 00000080:00200000:3.0:1788201559.226941:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 46 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.226956:0:23731:0:(rw26.c:898:ll_write_end()) pos 188416, len 4096, copied 4096 00000080:00200000:3.0:1788201559.226960:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000064b0ccf8[3 00000000e6711095 2 1 00000000c3444ba1 0 0 46] 00000080:00200000:3.0:1788201559.226963:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000e2146ac2 17ffffc0001001 3:0 ffff8bc172459b60 46 lru 00000080:00200000:3.0:1788201559.226979:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000001a9413af 46: 1< 0 - - > 2< 188416 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.226981:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000064b0ccf8 00000080:00200000:3.0:1788201559.226982:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 47. 00000080:00200000:3.0:1788201559.226984:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 47 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.227243:0:23731:0:(rw26.c:898:ll_write_end()) pos 192512, len 4096, copied 4096 00000080:00200000:3.0:1788201559.227249:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000f7daadff[3 00000000e6711095 2 1 00000000c3444ba1 0 0 47] 00000080:00200000:3.0:1788201559.227252:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000c68eda28 17ffffc0001001 3:0 ffff8bc172459700 47 lru 00000080:00200000:3.0:1788201559.227257:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000005c2a4b06 47: 1< 0 - - > 2< 192512 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.227259:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000f7daadff 00000080:00200000:3.0:1788201559.227260:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 48. 00010000:00010000:1.0:1788201559.248837:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:1.0:1788201559.248939:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.248956:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.248976:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.248988:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.248994:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.249008:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.249013:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.249019:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3bf8 00010000:00010000:1.0:1788201559.249023:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.249032:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.249049:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.249057:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201559.249063:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.249078:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.249083:0:23731:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sanity-selinux.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), file ffff8bc153aa8d80, open_flags 80c1, mode 81ed opened 0 00000080:00200000:1.0:1788201559.249090:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-selinux.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000002:00010000:1.0:1788201559.249113:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-selinux.sh,[0x200000bd7:0x12a:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201559.249167:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.249175:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201559.249186:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201559.249194:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b0a80 x1875064727860480/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201559.249203:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.249224:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b0a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727860480:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.249383:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc153a8d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.254441:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b0a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727860480:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201559.254472:0:23731:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.254495:0:23731:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.254502:0:23731:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.254513:0:23731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.254524:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.254538:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.254546:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.254553:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201559.254564:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1725b0a80 x1875064727860480/t8589937124(8589937124) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201575 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201559.254577:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725b0a80 x1875064727860480/t8589937124(8589937124) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201575 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201559.254591:0:23731:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201559.254603:0:23731:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.254613:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/298 (0 0) 00000080:00200000:1.0:1788201559.254619:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201559.254633:0:23731:0:(namei.c:1628:ll_create_it()) VFS Op:name=sanity-selinux.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000080:00200000:1.0:1788201559.254664:0:23731:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x12a:0x0](ffff8bc14465ba88) 00000080:00200000:1.0:1788201559.254937:0:23731:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x12a:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201559.254950:0:23731:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x12a:0x0](ffff8bc14465ba88) 00000080:00010000:1.0:1788201559.254953:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x12a:0x0](ffff8bc14465ba88) for lock 0xd138388016f6ebbd 00000080:00010000:1.0:1788201559.254974:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x12a:0x0](ffff8bc14465ba88) 00000080:00200008:1.0:1788201559.254990:0:23731:0:(file.c:1090:ll_file_open()) START file sanity-selinux.sh:[0x200000bd7:0x12a:0x0](ffff8bc14465ba88), flags 100301 00000002:00100000:1.0:1788201559.255011:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725b0a80 x1875064727860480/t8589937124(8589937124) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201575 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201559.255051:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ebbd from it ffff8bc144cb5060 00010000:00010000:1.0:1788201559.255056:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.255066:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201559.255089:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x12a:0x0](ffff8bc14465ba88), inode mode 81ed mask 40 00000080:00200008:1.0:1788201559.255286:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file sanity-selinux.sh:[0x200000bd7:0x12a:0x0](ffff8bc14465ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201559.255294:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x12a:0x0](ffff8bc14465ba88),name=sanity-selinux.sh 00000002:00010000:1.0:1788201559.255314:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x12a:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.255325:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.255336:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201559.255343:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.255426:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x12a:0x0](ffff8bc14465ba88) 00000080:00010000:1.0:1788201559.255430:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x12a:0x0](ffff8bc14465ba88) for lock 0xd138388016f6ebbd 00000080:00010000:1.0:1788201559.255435:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ebbd from it ffffadd1c7da3cd8 00010000:00010000:1.0:1788201559.255438:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.255447:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201559.255478:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x12a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201559.255489:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x12a:0x0] 00000008:00010000:1.0:1788201559.255517:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201559.255520:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc151a503b0, osc lock ffff8bc145d084c0, flags 0x400001002 00010000:00010000:1.0:1788201559.255573:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007ee77d9e/0xd138388016f6ebc4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.255584:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007ee77d9e/0xd138388016f6ebc4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201559.256009:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:1.0:1788201559.261591:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x12a:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201559.261601:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e25280 (ffff8bc148e3bea8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201559.261605:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e25280 (ffff8bc148e3bea8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.261611:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151a503b0 (ffff8bc148e3b1b8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.261616:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e25280 (ffff8bc148e3bea8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201559.261619:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151a503b0 (ffff8bc148e3bea8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201559.261657:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x12a:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201559.261726:0:23731:0:(file.c:2638:do_file_write_iter()) START file sanity-selinux.sh:[0x200000bd7:0x12a:0x0], ppos: 0, count: 26716 00000080:00200000:1.0:1788201559.261768:0:23731:0:(file.c:2090:ll_file_io_generic()) sanity-selinux.sh: write ppos: 0, bytes: 26716 00000080:00200000:1.0:1788201559.261775:0:23731:0:(file.c:1848:ll_io_set_mirror()) sanity-selinux.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201559.261782:0:23731:0:(cl_io.c:214:cl_io_rw_init()) header@00000000c78a3cb3[0x110, 1, [0x200000bd7:0x12a:0x0] hash] 00000020:00200000:1.0:1788201559.261784:0:23731:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 26716) 0 0 00000080:00200000:1.0:1788201559.262069:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x12a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201559.262086:0:23731:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 6] 00020000:00200000:1.0:1788201559.262108:0:23731:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 26716) 26716, 26716 00020000:00200000:1.0:1788201559.262113:0:23731:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201559.262274:0:23731:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 6] 00000008:00010000:1.0:1788201559.262291:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201559.262296:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc151a503b0, osc lock ffff8bc145d084c0, flags 0x0 00010000:00010000:1.0:1788201559.262313:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/412 (0 28671) 00010000:00010000:1.0:1788201559.262426:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.262438:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.262451:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.262477:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b3b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727860736:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.262581:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc153a8d540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201559.266010:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201559.266439:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743444736 00000100:00100000:1.0:1788201559.266450:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743444736 00000100:00100000:1.0:1788201559.266511:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 602 00000100:00100000:1.0:1788201559.266523:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc151ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23390:x1875064743444736:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201559.266542:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007ee77d9e/0xd138388016f6ebc4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x19c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710950ad expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.266995:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201559.267004:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc151ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23390:x1875064743444736:12345-192.168.201.143@tcp:104: Request processed in 483us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201559.267012:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 602 00000100:00100000:1.0:1788201559.269834:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b3b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727860736:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201559.269868:0:23731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.269883:0:23731:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.269892:0:23731:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201559.276285:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:3.0:1788201559.278358:0:23731:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.278377:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.278394:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201559.278408:0:23731:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.278420:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.278429:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201559.278460:0:23731:0:(vvp_io.c:1292:vvp_io_write_start()) sanity-selinux.sh: write [0, 26716) append 0 append lockpos 0 00000080:00200000:3.0:1788201559.278481:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.278533:0:23731:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:3.0:1788201559.278547:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000ca88bd67[3 0000000021519e3e 2 1 00000000b8d441ae 0 0 0] 00000080:00200000:3.0:1788201559.278551:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000009877aba7 17ffffc0001001 3:0 ffff8bc1724597e0 0 lru 00000080:00200000:3.0:1788201559.279058:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000001711a22e 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 0000000026a3eafc > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.279062:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000ca88bd67 00000080:00200000:3.0:1788201559.279064:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201559.279069:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.279261:0:23731:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:3.0:1788201559.279266:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000524233d0[3 0000000021519e3e 2 1 00000000b8d441ae 0 0 1] 00000080:00200000:3.0:1788201559.279268:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000045dab9d0 17ffffc0001001 3:0 ffff8bc172459620 1 lru 00000080:00200000:3.0:1788201559.279272:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000009679f5dc 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 0000000026a3eafc > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.279274:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000524233d0 00000080:00200000:3.0:1788201559.279275:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:3.0:1788201559.279276:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.279289:0:23731:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:3.0:1788201559.279292:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000384374ac[3 0000000021519e3e 2 1 00000000b8d441ae 0 0 2] 00000080:00200000:3.0:1788201559.279294:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000028769bb2 17ffffc0001001 3:0 ffff8bc172459ee0 2 lru 00000080:00200000:3.0:1788201559.279298:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000cb8982ad 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000008930e75a 0000000026a3eafc > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.279299:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000384374ac 00000080:00200000:3.0:1788201559.279300:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:3.0:1788201559.279301:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.279309:0:23731:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:3.0:1788201559.279311:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000d5650d07[3 0000000021519e3e 2 1 00000000b8d441ae 0 0 3] 00000080:00200000:3.0:1788201559.279312:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000000e89e12c 17ffffc0001001 3:0 ffff8bc172459e00 3 lru 00000080:00200000:3.0:1788201559.279316:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000ba1963f8 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000008930e75a 0000000026a3eafc > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.279318:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000d5650d07 00000080:00200000:3.0:1788201559.279319:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:3.0:1788201559.279320:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.279328:0:23731:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:3.0:1788201559.279330:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000083d1637f[3 0000000021519e3e 2 1 00000000b8d441ae 0 0 4] 00000080:00200000:3.0:1788201559.279331:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000003321fe95 17ffffc0001001 3:0 ffff8bc1724598c0 4 lru 00000080:00200000:3.0:1788201559.279334:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000007bd41dc4 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000008930e75a 0000000026a3eafc > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.279336:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000083d1637f 00000080:00200000:3.0:1788201559.279337:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:3.0:1788201559.279338:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.279405:0:23731:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:3.0:1788201559.279409:0:23731:0:(rw26.c:956:ll_write_end()) page@000000002e57b637[3 0000000021519e3e 2 1 00000000b8d441ae 0 0 5] 00000080:00200000:3.0:1788201559.279410:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000043ff4c05 17ffffc0001001 3:0 ffff8bc172459540 5 lru 00000080:00200000:3.0:1788201559.279414:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000394360d4 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000008930e75a 0000000026a3eafc > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.279416:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000002e57b637 00000080:00200000:3.0:1788201559.279416:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:3.0:1788201559.279418:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 2140 bytes 00000080:00200000:3.0:1788201559.279434:0:23731:0:(rw26.c:898:ll_write_end()) pos 24576, len 2140, copied 2140 00000080:00200000:3.0:1788201559.279437:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000095ddc254[3 0000000021519e3e 2 1 00000000b8d441ae 0 0 6] 00000080:00200000:3.0:1788201559.279438:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000dc07de76 17ffffc0001001 3:0 ffff8bc172459a80 6 lru 00000080:00200000:3.0:1788201559.279442:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000000323c9cc 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000008930e75a 0000000026a3eafc > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.279443:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000095ddc254 00000080:00200000:3.0:1788201559.279444:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:3.0:1788201559.279447:0:23731:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 7, from 0, to 2140 prio 0 00000008:00010000:3.0:1788201559.279463:0:23731:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000354268d1 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201559.279480:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc14465bc38, count 7, dirtied 7 00000080:00200000:3.0:1788201559.279485:0:23731:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 7 pages 26716 bytes, tot: 26716 00000080:00200000:3.0:1788201559.279487:0:23731:0:(vvp_io.c:1358:vvp_io_write_start()) sanity-selinux.sh: write bytes 0, result: 26716 00000020:00010000:3.0:1788201559.279502:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c45d8 (ffff8bc148e3bea8/0) at cl_lock_release():245 00000020:00010000:3.0:1788201559.279504:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c45d8 (ffff8bc148e3bea8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201559.279507:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151a503b0 (ffff8bc148e3b1b8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1788201559.279511:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.279518:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1788201559.279530:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c45d8 (ffff8bc148e3bea8/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201559.279532:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151a503b0 (ffff8bc148e3bea8/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201559.279537:0:23731:0:(vvp_io.c:533:vvp_io_advance()) advancing 26716 bytes 00000080:00200000:3.0:1788201559.279543:0:23731:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 6] 00000080:00200000:3.0:1788201559.279569:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x12a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201559.279572:0:23731:0:(file.c:2238:ll_file_io_generic()) sanity-selinux.sh: 2 io complete with rc: 0, result: 26716, restart: 0 00000080:00200000:3.0:1788201559.279577:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x12a:0x0] updating i_size 26716 i_blocks 1 00000080:00200000:3.0:1788201559.279581:0:23731:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 26716 00000080:00200008:3.0:1788201559.279618:0:23731:0:(file.c:479:ll_file_release()) START file sanity-selinux.sh:[0x200000bd7:0x12a:0x0](ffff8bc14465ba88), flags 100001 00000002:00100000:3.0:1788201559.279659:0:23731:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1725b0a80 x1875064727860480/t8589937124(8589937124) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201575 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1788201559.279668:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1788201559.279672:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc151ff7b80 x1875064727861120/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1788201559.279688:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff7b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727861120:192.168.201.143@tcp:35:cp.0 00000100:00100000:3.0:1788201559.279909:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1520ad600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.284083:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff7b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727861120:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201559.284127:0:23731:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1725b0a80 x1875064727860480/t8589937124(8589937124) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201575 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201559.284202:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.284222:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.284241:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.284256:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.284265:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.284270:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.284273:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.284280:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201559.284283:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.284290:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.284302:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.284308:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201559.284312:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.284314:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-selinux.sh, flags=8 00000080:00200008:1.0:1788201559.284320:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file sanity-selinux.sh:[0x200000bd7:0x12a:0x0](ffff8bc14465ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201559.284323:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x12a:0x0](ffff8bc14465ba88),name=sanity-selinux.sh 00000002:00010000:1.0:1788201559.284332:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x12a:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.284339:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201559.284346:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201559.284352:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.284356:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x12a:0x0](ffff8bc14465ba88) 00000080:00010000:1.0:1788201559.284358:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x12a:0x0](ffff8bc14465ba88) for lock 0xd138388016f6ebbd 00000080:00010000:1.0:1788201559.284362:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ebbd from it ffffadd1c7da3cb8 00010000:00010000:1.0:1788201559.284365:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201559.284372:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201559.284420:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x12a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201559.284429:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x12a:0x0] 00000008:00010000:1.0:1788201559.284453:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201559.284455:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc142dec7b0, osc lock ffff8bc145d09300, flags 0x400001002 00010000:00010000:1.0:1788201559.284470:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.284479:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201559.284488:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201559.284491:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.284497:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201559.284504:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201559.284511:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x12a:0x0] updating i_size 26716 i_blocks 1 00000020:00010000:1.0:1788201559.284514:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e27090 (ffff8bc148e3b758/0) at cl_lock_release():245 00000020:00010000:1.0:1788201559.284516:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e27090 (ffff8bc148e3b758/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.284517:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc142dec7b0 (ffff8bc148e3bf38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.284520:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e27090 (ffff8bc148e3b758/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201559.284522:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc142dec7b0 (ffff8bc148e3b758/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201559.284546:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x12a:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201559.284584:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.284589:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.284594:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.284599:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.284603:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.284606:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.284607:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.284610:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201559.284612:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.284620:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.284625:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.284627:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201559.284629:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.284639:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=9 00000080:00200000:1.0:1788201559.284642:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:1.0:1788201559.284648:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201559.284679:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6ebd2 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.284684:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6ebd2 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.284691:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6ebd2 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.284705:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727861248:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.284851:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc148a80780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.288331:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727861248:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201559.288401:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6ebd2 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.288412:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6ebd2 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.288419:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6ebd2 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.288424:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6ebd2 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.288430:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6ebd2 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.288434:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14a778800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201559.288437:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6ebd2 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.288441:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6ebd2 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.288446:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6ebd2 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.288451:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201559.288455:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6ebd2 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.288459:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6ebd2 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201559.288472:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1725b1880 x1875064727861248/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201575 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201559.288484:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201559.288504:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:1.0:1788201559.288553:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.288564:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.288569:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.288577:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.288581:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.288584:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.288587:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.288590:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201559.288592:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.288597:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.288608:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.288613:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201559.288617:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.288628:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=8 00000080:00200000:1.0:1788201559.288631:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:1.0:1788201559.288639:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201559.288665:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6ebd9 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.288670:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6ebd9 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.288677:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6ebd9 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.288693:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727861376:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.288779:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc148a80780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.291449:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727861376:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201559.291467:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6ebd9 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.291477:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6ebd9 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.291481:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6ebd9 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.291486:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6ebd9 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.291491:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6ebd9 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.291495:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14a778000 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201559.291498:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6ebd9 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.291502:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6ebd9 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.291507:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6ebd9 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.291512:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201559.291516:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6ebd9 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.291520:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6ebd9 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201559.291532:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1725b1880 x1875064727861376/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201575 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201559.291544:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201559.291567:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:1.0:1788201559.291668:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.291682:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.291689:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.291697:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.291702:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.291705:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.291708:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.291711:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3bf8 00010000:00010000:1.0:1788201559.291713:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.291719:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.291734:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.291741:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201559.291746:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.291757:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.291762:0:23731:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sanity.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), file ffff8bc153aa9e00, open_flags 80c1, mode 81ed opened 0 00000080:00200000:1.0:1788201559.291770:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000002:00010000:1.0:1788201559.291787:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity.sh,[0x200000bd7:0x12b:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201559.291874:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.291883:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201559.291894:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201559.291899:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b1880 x1875064727861632/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201559.291906:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.291922:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727861632:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.292100:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc148a80780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.296402:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727861632:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201559.296429:0:23731:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.296446:0:23731:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.296452:0:23731:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.296459:0:23731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.296467:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.296476:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.296481:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.296487:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201559.296494:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1725b1880 x1875064727861632/t8589937126(8589937126) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201575 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201559.296503:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725b1880 x1875064727861632/t8589937126(8589937126) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201575 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201559.296513:0:23731:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201559.296521:0:23731:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.296529:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/299 (0 0) 00000080:00200000:1.0:1788201559.296534:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201559.296546:0:23731:0:(namei.c:1628:ll_create_it()) VFS Op:name=sanity.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000080:00200000:1.0:1788201559.296576:0:23731:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x12b:0x0](ffff8bc14465ec08) 00000080:00200000:1.0:1788201559.296677:0:23731:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x12b:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201559.296683:0:23731:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x12b:0x0](ffff8bc14465ec08) 00000080:00010000:1.0:1788201559.296685:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x12b:0x0](ffff8bc14465ec08) for lock 0xd138388016f6ebe0 00000080:00010000:1.0:1788201559.296692:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x12b:0x0](ffff8bc14465ec08) 00000080:00200008:1.0:1788201559.296704:0:23731:0:(file.c:1090:ll_file_open()) START file sanity.sh:[0x200000bd7:0x12b:0x0](ffff8bc14465ec08), flags 100301 00000002:00100000:1.0:1788201559.296719:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725b1880 x1875064727861632/t8589937126(8589937126) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201575 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201559.296766:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ebe0 from it ffff8bc144cb5e40 00010000:00010000:1.0:1788201559.296771:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.296780:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201559.296831:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x12b:0x0](ffff8bc14465ec08), inode mode 81ed mask 40 00000080:00200008:1.0:1788201559.296859:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file sanity.sh:[0x200000bd7:0x12b:0x0](ffff8bc14465ec08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201559.296866:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x12b:0x0](ffff8bc14465ec08),name=sanity.sh 00000002:00010000:1.0:1788201559.296882:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x12b:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.296889:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.296900:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201559.296904:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.296908:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x12b:0x0](ffff8bc14465ec08) 00000080:00010000:1.0:1788201559.296910:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x12b:0x0](ffff8bc14465ec08) for lock 0xd138388016f6ebe0 00000080:00010000:1.0:1788201559.296913:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ebe0 from it ffffadd1c7da3cd8 00010000:00010000:1.0:1788201559.296915:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.296920:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201559.296938:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x12b:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201559.296947:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x12b:0x0] 00000008:00010000:1.0:1788201559.296979:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201559.296984:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc142dec130, osc lock ffff8bc145d09300, flags 0x400001002 00010000:00010000:1.0:1788201559.297032:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ebe7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.297041:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ebe7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201559.297081:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1788201559.297219:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201559.297237:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727861760:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201559.299310:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ebe7 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.299328:0:10054:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ebe7 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095108 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.299340:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ebe7 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095108 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.299358:0:10054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ebe7 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095108 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201559.299370:0:10054:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ebe7 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095108 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201559.299378:0:10054:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201559.299388:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ebe7 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171095108 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.299396:0:10054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ebe7 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171095108 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.299404:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ebe7 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171095108 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.299418:0:10054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ebe7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171095108 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201559.299422:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x12b:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201559.299428:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e27090 (ffff8bc148e3b758/0) at cl_lock_release():245 00000020:00010000:1.0:1788201559.299431:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e27090 (ffff8bc148e3b758/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.299436:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc142dec130 (ffff8bc148e3bf38/1) at cl_lock_cancel():142 00000100:00100000:3.0:1788201559.299436:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727861760:192.168.201.143@tcp:101:cp.0 00000020:00010000:1.0:1788201559.299441:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e27090 (ffff8bc148e3b758/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201559.299443:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc142dec130 (ffff8bc148e3b758/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201559.299482:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x12b:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201559.302396:0:23731:0:(file.c:2638:do_file_write_iter()) START file sanity.sh:[0x200000bd7:0x12b:0x0], ppos: 0, count: 1181558 00000080:00200000:1.0:1788201559.302441:0:23731:0:(file.c:2090:ll_file_io_generic()) sanity.sh: write ppos: 0, bytes: 1181558 00000080:00200000:1.0:1788201559.302447:0:23731:0:(file.c:1848:ll_io_set_mirror()) sanity.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201559.302454:0:23731:0:(cl_io.c:214:cl_io_rw_init()) header@00000000fba9d342[0x110, 1, [0x200000bd7:0x12b:0x0] hash] 00000020:00200000:1.0:1788201559.302457:0:23731:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 1181558) 0 0 00000080:00200000:1.0:1788201559.302462:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x12b:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201559.302477:0:23731:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 288] 00020000:00200000:1.0:1788201559.302485:0:23731:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 1181558) 1181558, 1181558 00020000:00200000:1.0:1788201559.302490:0:23731:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201559.302519:0:23731:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 288] 00000008:00010000:1.0:1788201559.302534:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201559.302539:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc142dec130, osc lock ffff8bc145d09300, flags 0x0 00010000:00010000:1.0:1788201559.302556:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/412 (0 1183743) 00010000:00010000:1.0:1788201559.302603:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.302613:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 3 type: EXT [0->1183743] (req 0->1183743) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.302623:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 3 type: EXT [0->1183743] (req 0->1183743) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.302646:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727861888:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.302744:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc148a80cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1788201559.312063:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201559.312070:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ebe7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171095108 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.312080:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bc800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201559.312086:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ebe7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171095108 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201559.312157:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x12b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201559.312171:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x12b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201559.312238:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ebe7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171095108 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.312246:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201559.312274:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ebe7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x19c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171095108 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.312281:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ebe7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171095108 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.312296:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201559.312297:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201559.312299:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201559.312902:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727862016:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201559.315833:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727861888:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201559.315863:0:23731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 4/0,1 mode: --/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->1183743] (req 0->1183743) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.315878:0:23731:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 4/0,1 mode: --/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->1183743] (req 0->1183743) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.315888:0:23731:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 4/0,1 mode: --/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->1183743] (req 0->1183743) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.316283:0:21781:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788201559.316304:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743445120 00000100:00100000:1.0:1788201559.316311:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743445120 00000100:00100000:1.0:1788201559.316580:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 605 00000100:00100000:1.0:1788201559.316589:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc143d01850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23418:x1875064743445120:12345-192.168.201.143@tcp:105: 00010000:00010000:1.0:1788201559.316599:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 5/0,1 mode: --/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->1183743] (req 0->1183743) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.316607:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 5/0,1 mode: --/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->1183743] (req 0->1183743) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.316613:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 5/0,1 mode: --/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.316620:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.316625:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.316631:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.316651:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1460bda00) 00000100:00100000:1.0:1788201559.316704:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc143d01850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23418:x1875064743445120:12345-192.168.201.143@tcp:105: Request processed in 117us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201559.316709:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 605 00010000:00010000:3.0:1788201559.319450:0:23731:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.319473:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.319491:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201559.319505:0:23731:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.319518:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.319525:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201559.319556:0:23731:0:(vvp_io.c:1292:vvp_io_write_start()) sanity.sh: write [0, 1181558) append 0 append lockpos 0 00000080:00200000:3.0:1788201559.319576:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.319636:0:23731:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:3.0:1788201559.319648:0:23731:0:(rw26.c:956:ll_write_end()) page@000000003d7abdce[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 0] 00000080:00200000:3.0:1788201559.319651:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000f50153d0 17ffffc0001001 3:0 ffff8bc172459c40 0 lru 00000080:00200000:3.0:1788201559.319658:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000e84de55e 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.319660:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000003d7abdce 00000080:00200000:3.0:1788201559.319661:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201559.319665:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.319688:0:23731:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:3.0:1788201559.319692:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000c1036b20[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 1] 00000080:00200000:3.0:1788201559.319695:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000059247254 17ffffc0001001 3:0 ffff8bc172459380 1 lru 00000080:00200000:3.0:1788201559.319700:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000069e3d97c 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.319701:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000c1036b20 00000080:00200000:3.0:1788201559.319703:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:3.0:1788201559.319704:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.319720:0:23731:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:3.0:1788201559.319725:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000031091ddb[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 2] 00000080:00200000:3.0:1788201559.319728:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000076d23fd6 17ffffc0001001 3:0 ffff8bc1724599a0 2 lru 00000080:00200000:3.0:1788201559.319733:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000f245429b 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.319735:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000031091ddb 00000080:00200000:3.0:1788201559.319737:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:3.0:1788201559.319739:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.319754:0:23731:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:3.0:1788201559.319759:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000057f9c20f[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 3] 00000080:00200000:3.0:1788201559.319762:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000003eca3dfd 17ffffc0001001 3:0 ffff8bc1724591c0 3 lru 00000080:00200000:3.0:1788201559.319767:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000022b04875 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.319769:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000057f9c20f 00000080:00200000:3.0:1788201559.319771:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:3.0:1788201559.319773:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.319806:0:23731:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:3.0:1788201559.319812:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000b7a7c925[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 4] 00000080:00200000:3.0:1788201559.319814:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000037507f41 17ffffc0001001 3:0 ffff8bc172459000 4 lru 00000080:00200000:3.0:1788201559.319819:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000aa8c7b46 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.319821:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000b7a7c925 00000080:00200000:3.0:1788201559.319822:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:3.0:1788201559.319824:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.319858:0:23731:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:3.0:1788201559.319862:0:23731:0:(rw26.c:956:ll_write_end()) page@000000003ae2af9b[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 5] 00000080:00200000:3.0:1788201559.319865:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000009f4c56b4 17ffffc0001021 2:0 ffff8bc172459d20 5 lru 00000080:00200000:3.0:1788201559.319870:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b48849a3 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.319873:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000003ae2af9b 00000080:00200000:3.0:1788201559.319874:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:3.0:1788201559.319876:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.319891:0:23731:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:3.0:1788201559.319896:0:23731:0:(rw26.c:956:ll_write_end()) page@000000000b713fed[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 6] 00000080:00200000:3.0:1788201559.319899:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000001af26bdb 17ffffc0001001 3:0 ffff8bc1724590e0 6 lru 00000080:00200000:3.0:1788201559.319903:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000f78ad422 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.319905:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000000b713fed 00000080:00200000:3.0:1788201559.319907:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:3.0:1788201559.319909:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.319926:0:23731:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:3.0:1788201559.319930:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000249f5c0b[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 7] 00000080:00200000:3.0:1788201559.319933:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000008d366271 17ffffc0001001 3:0 ffff8bc144e3cd20 7 lru 00000080:00200000:3.0:1788201559.319938:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000d2218164 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.319940:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000249f5c0b 00000080:00200000:3.0:1788201559.319941:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:3.0:1788201559.319943:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.319960:0:23731:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:3.0:1788201559.319974:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000031155973[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 8] 00000080:00200000:3.0:1788201559.319977:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000008ef6301d 17ffffc0001001 3:0 ffff8bc144e3c000 8 lru 00000080:00200000:3.0:1788201559.319982:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000a81715b4 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.319984:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000031155973 00000080:00200000:3.0:1788201559.319985:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:3.0:1788201559.319987:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320002:0:23731:0:(rw26.c:898:ll_write_end()) pos 36864, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320006:0:23731:0:(rw26.c:956:ll_write_end()) page@000000004097ce52[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 9] 00000080:00200000:3.0:1788201559.320008:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000080c1a996 17ffffc0001001 3:0 ffff8bc144e3c380 9 lru 00000080:00200000:3.0:1788201559.320014:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000006204cbcb 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320016:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000004097ce52 00000080:00200000:3.0:1788201559.320017:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:3.0:1788201559.320019:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 10 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320033:0:23731:0:(rw26.c:898:ll_write_end()) pos 40960, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320037:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000223f22c3[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 10] 00000080:00200000:3.0:1788201559.320040:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000b6c2678c 17ffffc0001001 3:0 ffff8bc144e3c540 10 lru 00000080:00200000:3.0:1788201559.320045:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000000061a8f 10: 1< 0 - - > 2< 40960 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320047:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000223f22c3 00000080:00200000:3.0:1788201559.320048:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 11. 00000080:00200000:3.0:1788201559.320050:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 11 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320064:0:23731:0:(rw26.c:898:ll_write_end()) pos 45056, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320068:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000adf46a09[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 11] 00000080:00200000:3.0:1788201559.320071:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000008219be85 17ffffc0001001 3:0 ffff8bc144e3c8c0 11 lru 00000080:00200000:3.0:1788201559.320076:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000082dc38f6 11: 1< 0 - - > 2< 45056 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320078:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000adf46a09 00000080:00200000:3.0:1788201559.320079:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 12. 00000080:00200000:3.0:1788201559.320081:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 12 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320097:0:23731:0:(rw26.c:898:ll_write_end()) pos 49152, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320101:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000d43dff41[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 12] 00000080:00200000:3.0:1788201559.320104:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000b3363541 17ffffc0001001 3:0 ffff8bc144e3c1c0 12 lru 00000080:00200000:3.0:1788201559.320109:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000038fd324f 12: 1< 0 - - > 2< 49152 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320112:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000d43dff41 00000080:00200000:3.0:1788201559.320113:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 13. 00000080:00200000:3.0:1788201559.320115:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 13 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320130:0:23731:0:(rw26.c:898:ll_write_end()) pos 53248, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320134:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000ac4b2eef[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 13] 00000080:00200000:3.0:1788201559.320137:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000d54ea479 17ffffc0001001 3:0 ffff8bc144e3c0e0 13 lru 00000080:00200000:3.0:1788201559.320153:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000a7afe467 13: 1< 0 - - > 2< 53248 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320156:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000ac4b2eef 00000080:00200000:3.0:1788201559.320157:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 14. 00000080:00200000:3.0:1788201559.320159:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 14 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320174:0:23731:0:(rw26.c:898:ll_write_end()) pos 57344, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320179:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000cf1c04e3[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 14] 00000080:00200000:3.0:1788201559.320181:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000dcd7be6e 17ffffc0001001 3:0 ffff8bc144e3c9a0 14 lru 00000080:00200000:3.0:1788201559.320186:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000003ed100bf 14: 1< 0 - - > 2< 57344 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320188:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000cf1c04e3 00000080:00200000:3.0:1788201559.320189:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 15. 00000080:00200000:3.0:1788201559.320190:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 15 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320204:0:23731:0:(rw26.c:898:ll_write_end()) pos 61440, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320209:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000a298902c[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 15] 00000080:00200000:3.0:1788201559.320211:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000004c56cdb1 17ffffc0001001 3:0 ffff8bc144e3cb60 15 lru 00000080:00200000:3.0:1788201559.320216:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000d3d45002 15: 1< 0 - - > 2< 61440 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320218:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000a298902c 00000080:00200000:3.0:1788201559.320219:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 16. 00000080:00200000:3.0:1788201559.320220:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 16 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320233:0:23731:0:(rw26.c:898:ll_write_end()) pos 65536, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320237:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000df533996[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 16] 00000080:00200000:3.0:1788201559.320240:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000af0c2172 17ffffc0001001 3:0 ffff8bc144e3ce00 16 lru 00000080:00200000:3.0:1788201559.320246:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000030c001f2 16: 1< 0 - - > 2< 65536 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320247:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000df533996 00000080:00200000:3.0:1788201559.320249:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 17. 00000080:00200000:3.0:1788201559.320250:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 17 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320263:0:23731:0:(rw26.c:898:ll_write_end()) pos 69632, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320267:0:23731:0:(rw26.c:956:ll_write_end()) page@000000000c7702f7[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 17] 00000080:00200000:3.0:1788201559.320270:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000f72d5ad4 17ffffc0001001 3:0 ffff8bc144e3c2a0 17 lru 00000080:00200000:3.0:1788201559.320275:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000008f35ee36 17: 1< 0 - - > 2< 69632 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320277:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000000c7702f7 00000080:00200000:3.0:1788201559.320278:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 18. 00000080:00200000:3.0:1788201559.320279:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 18 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320292:0:23731:0:(rw26.c:898:ll_write_end()) pos 73728, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320296:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000026ed2221[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 18] 00000080:00200000:3.0:1788201559.320298:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000006b9996ca 17ffffc0001001 3:0 ffff8bc144e3c460 18 lru 00000080:00200000:3.0:1788201559.320303:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000071f5c6bc 18: 1< 0 - - > 2< 73728 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320305:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000026ed2221 00000080:00200000:3.0:1788201559.320306:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 19. 00000080:00200000:3.0:1788201559.320307:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 19 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320323:0:23731:0:(rw26.c:898:ll_write_end()) pos 77824, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320327:0:23731:0:(rw26.c:956:ll_write_end()) page@000000003d226871[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 19] 00000080:00200000:3.0:1788201559.320330:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000de057212 17ffffc0001001 3:0 ffff8bc144e3ca80 19 lru 00000080:00200000:3.0:1788201559.320335:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000002a1895df 19: 1< 0 - - > 2< 77824 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320337:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000003d226871 00000080:00200000:3.0:1788201559.320338:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 20. 00000080:00200000:3.0:1788201559.320339:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 20 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320356:0:23731:0:(rw26.c:898:ll_write_end()) pos 81920, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320361:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000042ebd3cb[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 20] 00000080:00200000:3.0:1788201559.320364:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000579286df 17ffffc0001021 2:0 ffff8bc144e3cee0 20 lru 00000080:00200000:3.0:1788201559.320368:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000003cbe5bd9 20: 1< 0 - - > 2< 81920 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320370:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000042ebd3cb 00000080:00200000:3.0:1788201559.320371:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 21. 00000080:00200000:3.0:1788201559.320373:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 21 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320387:0:23731:0:(rw26.c:898:ll_write_end()) pos 86016, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320391:0:23731:0:(rw26.c:956:ll_write_end()) page@000000004ed21ee7[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 21] 00000080:00200000:3.0:1788201559.320394:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000f88dcc2e 17ffffc0001001 3:0 ffff8bc144e3c620 21 lru 00000080:00200000:3.0:1788201559.320398:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b27f80b4 21: 1< 0 - - > 2< 86016 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320401:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000004ed21ee7 00000080:00200000:3.0:1788201559.320402:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 22. 00000080:00200000:3.0:1788201559.320403:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 22 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320415:0:23731:0:(rw26.c:898:ll_write_end()) pos 90112, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320419:0:23731:0:(rw26.c:956:ll_write_end()) page@000000002c84b8df[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 22] 00000080:00200000:3.0:1788201559.320422:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000003e869b47 17ffffc0001001 3:0 ffff8bc144e3cc40 22 lru 00000080:00200000:3.0:1788201559.320427:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000710baa00 22: 1< 0 - - > 2< 90112 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320429:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000002c84b8df 00000080:00200000:3.0:1788201559.320430:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 23. 00000080:00200000:3.0:1788201559.320431:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 23 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320445:0:23731:0:(rw26.c:898:ll_write_end()) pos 94208, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320449:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000082a33a0c[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 23] 00000080:00200000:3.0:1788201559.320451:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000006f4a049 17ffffc0001001 3:0 ffff8bc144e3c7e0 23 lru 00000080:00200000:3.0:1788201559.320456:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000083676fb4 23: 1< 0 - - > 2< 94208 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320458:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000082a33a0c 00000080:00200000:3.0:1788201559.320459:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 24. 00000080:00200000:3.0:1788201559.320460:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 24 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320473:0:23731:0:(rw26.c:898:ll_write_end()) pos 98304, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320478:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000f61fe509[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 24] 00000080:00200000:3.0:1788201559.320480:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000006d1575b8 17ffffc0001001 3:0 ffff8bc144e3c700 24 lru 00000080:00200000:3.0:1788201559.320485:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000a774f0a4 24: 1< 0 - - > 2< 98304 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320487:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000f61fe509 00000080:00200000:3.0:1788201559.320488:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 25. 00000080:00200000:3.0:1788201559.320490:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 25 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320516:0:23731:0:(rw26.c:898:ll_write_end()) pos 102400, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320521:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000e6e8254b[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 25] 00000080:00200000:3.0:1788201559.320523:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000002e1acd8 17ffffc0001001 3:0 ffff8bc1443b7620 25 lru 00000080:00200000:3.0:1788201559.320529:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000a19bfc90 25: 1< 0 - - > 2< 102400 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320531:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000e6e8254b 00000080:00200000:3.0:1788201559.320532:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 26. 00000080:00200000:3.0:1788201559.320535:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 26 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320552:0:23731:0:(rw26.c:898:ll_write_end()) pos 106496, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320556:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000021d8e0d[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 26] 00000080:00200000:3.0:1788201559.320558:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000005d3fd6de 17ffffc0001001 3:0 ffff8bc1443b77e0 26 lru 00000080:00200000:3.0:1788201559.320563:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000055a839e5 26: 1< 0 - - > 2< 106496 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320565:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000021d8e0d 00000080:00200000:3.0:1788201559.320566:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 27. 00000080:00200000:3.0:1788201559.320568:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 27 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320582:0:23731:0:(rw26.c:898:ll_write_end()) pos 110592, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320586:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000c0fad136[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 27] 00000080:00200000:3.0:1788201559.320588:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000007c990871 17ffffc0001001 3:0 ffff8bc1443b7700 27 lru 00000080:00200000:3.0:1788201559.320593:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000e373c2c2 27: 1< 0 - - > 2< 110592 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320595:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000c0fad136 00000080:00200000:3.0:1788201559.320596:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 28. 00000080:00200000:3.0:1788201559.320598:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 28 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320609:0:23731:0:(rw26.c:898:ll_write_end()) pos 114688, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320613:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000007157da1[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 28] 00000080:00200000:3.0:1788201559.320616:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000c56a94a5 17ffffc0001001 3:0 ffff8bc1443b7b60 28 lru 00000080:00200000:3.0:1788201559.320621:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000e8ffc98d 28: 1< 0 - - > 2< 114688 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320622:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000007157da1 00000080:00200000:3.0:1788201559.320623:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 29. 00000080:00200000:3.0:1788201559.320625:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 29 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320636:0:23731:0:(rw26.c:898:ll_write_end()) pos 118784, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320640:0:23731:0:(rw26.c:956:ll_write_end()) page@000000008b5d43b2[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 29] 00000080:00200000:3.0:1788201559.320642:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000008165b626 17ffffc0001001 3:0 ffff8bc1443b72a0 29 lru 00000080:00200000:3.0:1788201559.320647:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000e22417f9 29: 1< 0 - - > 2< 118784 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320649:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000008b5d43b2 00000080:00200000:3.0:1788201559.320651:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 30. 00000080:00200000:3.0:1788201559.320652:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 30 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320664:0:23731:0:(rw26.c:898:ll_write_end()) pos 122880, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320668:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000bf2ce021[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 30] 00000080:00200000:3.0:1788201559.320670:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000001cd19c3d 17ffffc0001001 3:0 ffff8bc1443b7460 30 lru 00000080:00200000:3.0:1788201559.320675:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000f813703c 30: 1< 0 - - > 2< 122880 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320677:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000bf2ce021 00000080:00200000:3.0:1788201559.320678:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 31. 00000080:00200000:3.0:1788201559.320679:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 31 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320692:0:23731:0:(rw26.c:898:ll_write_end()) pos 126976, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320695:0:23731:0:(rw26.c:956:ll_write_end()) page@000000007fdc0e77[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 31] 00000080:00200000:3.0:1788201559.320697:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000a859d0bf 17ffffc0001001 3:0 ffff8bc1443b7d20 31 lru 00000080:00200000:3.0:1788201559.320701:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000009a2ee037 31: 1< 0 - - > 2< 126976 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320703:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000007fdc0e77 00000080:00200000:3.0:1788201559.320703:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 32. 00000080:00200000:3.0:1788201559.320705:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 32 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320716:0:23731:0:(rw26.c:898:ll_write_end()) pos 131072, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320721:0:23731:0:(rw26.c:956:ll_write_end()) page@000000007fa69ec6[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 32] 00000080:00200000:3.0:1788201559.320723:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000dba9b3bb 17ffffc0001001 3:0 ffff8bc1443b7000 32 lru 00000080:00200000:3.0:1788201559.320728:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000e4c52cfa 32: 1< 0 - - > 2< 131072 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320730:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000007fa69ec6 00000080:00200000:3.0:1788201559.320731:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 33. 00000080:00200000:3.0:1788201559.320733:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 33 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320749:0:23731:0:(rw26.c:898:ll_write_end()) pos 135168, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320753:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000d6ec6200[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 33] 00000080:00200000:3.0:1788201559.320756:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000a1ef74a0 17ffffc0001001 3:0 ffff8bc1443b7380 33 lru 00000080:00200000:3.0:1788201559.320761:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000e7a805c7 33: 1< 0 - - > 2< 135168 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320763:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000d6ec6200 00000080:00200000:3.0:1788201559.320764:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 34. 00000080:00200000:3.0:1788201559.320766:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 34 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320779:0:23731:0:(rw26.c:898:ll_write_end()) pos 139264, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320784:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000067ddda91[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 34] 00000080:00200000:3.0:1788201559.320787:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000578514fb 17ffffc0001001 3:0 ffff8bc1443b71c0 34 lru 00000080:00200000:3.0:1788201559.320819:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000039134dbb 34: 1< 0 - - > 2< 139264 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320821:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000067ddda91 00000080:00200000:3.0:1788201559.320823:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 35. 00000080:00200000:3.0:1788201559.320825:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 35 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320845:0:23731:0:(rw26.c:898:ll_write_end()) pos 143360, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320849:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000a0f59075[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 35] 00000080:00200000:3.0:1788201559.320852:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000077e2e1ad 17ffffc0001021 2:0 ffff8bc1443b70e0 35 lru 00000080:00200000:3.0:1788201559.320858:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b8d9299f 35: 1< 0 - - > 2< 143360 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320860:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000a0f59075 00000080:00200000:3.0:1788201559.320862:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 36. 00000080:00200000:3.0:1788201559.320864:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 36 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320878:0:23731:0:(rw26.c:898:ll_write_end()) pos 147456, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320883:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000026ac39ec[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 36] 00000080:00200000:3.0:1788201559.320886:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000000cd30074 17ffffc0001001 3:0 ffff8bc1443b79a0 36 lru 00000080:00200000:3.0:1788201559.320891:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000db1db7d8 36: 1< 0 - - > 2< 147456 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320892:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000026ac39ec 00000080:00200000:3.0:1788201559.320894:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 37. 00000080:00200000:3.0:1788201559.320896:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 37 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320911:0:23731:0:(rw26.c:898:ll_write_end()) pos 151552, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320915:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000eed580f5[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 37] 00000080:00200000:3.0:1788201559.320917:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000009c6ce37c 17ffffc0001001 3:0 ffff8bc1443b7c40 37 lru 00000080:00200000:3.0:1788201559.320922:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000882d948a 37: 1< 0 - - > 2< 151552 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320924:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000eed580f5 00000080:00200000:3.0:1788201559.320925:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 38. 00000080:00200000:3.0:1788201559.320927:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 38 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320940:0:23731:0:(rw26.c:898:ll_write_end()) pos 155648, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320945:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000f1c9615e[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 38] 00000080:00200000:3.0:1788201559.320948:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000aabde0e8 17ffffc0001001 3:0 ffff8bc1443b7a80 38 lru 00000080:00200000:3.0:1788201559.320954:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000e46ad673 38: 1< 0 - - > 2< 155648 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320956:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000f1c9615e 00000080:00200000:3.0:1788201559.320957:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 39. 00000080:00200000:3.0:1788201559.320959:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 39 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.320986:0:23731:0:(rw26.c:898:ll_write_end()) pos 159744, len 4096, copied 4096 00000080:00200000:3.0:1788201559.320990:0:23731:0:(rw26.c:956:ll_write_end()) page@000000002b118a5a[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 39] 00000080:00200000:3.0:1788201559.320993:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000a4ee654f 17ffffc0001001 3:0 ffff8bc1443b7540 39 lru 00000080:00200000:3.0:1788201559.320997:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000ec37162e 39: 1< 0 - - > 2< 159744 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.320999:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000002b118a5a 00000080:00200000:3.0:1788201559.321001:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 40. 00000080:00200000:3.0:1788201559.321002:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 40 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321018:0:23731:0:(rw26.c:898:ll_write_end()) pos 163840, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321022:0:23731:0:(rw26.c:956:ll_write_end()) page@000000007f193468[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 40] 00000080:00200000:3.0:1788201559.321026:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000009b29188 17ffffc0001001 3:0 ffff8bc1443b78c0 40 lru 00000080:00200000:3.0:1788201559.321031:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000e82cbb01 40: 1< 0 - - > 2< 163840 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321033:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000007f193468 00000080:00200000:3.0:1788201559.321034:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 41. 00000080:00200000:3.0:1788201559.321035:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 41 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321050:0:23731:0:(rw26.c:898:ll_write_end()) pos 167936, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321054:0:23731:0:(rw26.c:956:ll_write_end()) page@000000003a5753e8[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 41] 00000080:00200000:3.0:1788201559.321057:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000035cd833c 17ffffc0001001 3:0 ffff8bc1443b7e00 41 lru 00000080:00200000:3.0:1788201559.321062:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000328230ad 41: 1< 0 - - > 2< 167936 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321064:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000003a5753e8 00000080:00200000:3.0:1788201559.321065:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 42. 00000080:00200000:3.0:1788201559.321067:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 42 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321080:0:23731:0:(rw26.c:898:ll_write_end()) pos 172032, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321084:0:23731:0:(rw26.c:956:ll_write_end()) page@000000002800261a[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 42] 00000080:00200000:3.0:1788201559.321087:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000b148be2c 17ffffc0001001 3:0 ffff8bc1443b7ee0 42 lru 00000080:00200000:3.0:1788201559.321092:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000006aaf07e2 42: 1< 0 - - > 2< 172032 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321094:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000002800261a 00000080:00200000:3.0:1788201559.321095:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 43. 00000080:00200000:3.0:1788201559.321096:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 43 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321119:0:23731:0:(rw26.c:898:ll_write_end()) pos 176128, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321123:0:23731:0:(rw26.c:956:ll_write_end()) page@000000003a934893[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 43] 00000080:00200000:3.0:1788201559.321127:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000087f07e99 17ffffc0001001 3:0 ffff8bc1726588c0 43 lru 00000080:00200000:3.0:1788201559.321133:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000089e339e4 43: 1< 0 - - > 2< 176128 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321135:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000003a934893 00000080:00200000:3.0:1788201559.321136:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 44. 00000080:00200000:3.0:1788201559.321138:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 44 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321152:0:23731:0:(rw26.c:898:ll_write_end()) pos 180224, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321156:0:23731:0:(rw26.c:956:ll_write_end()) page@000000009b681ef4[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 44] 00000080:00200000:3.0:1788201559.321159:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000001491a98b 17ffffc0001001 3:0 ffff8bc172658e00 44 lru 00000080:00200000:3.0:1788201559.321165:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000c7a411b4 44: 1< 0 - - > 2< 180224 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321167:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000009b681ef4 00000080:00200000:3.0:1788201559.321168:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 45. 00000080:00200000:3.0:1788201559.321170:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 45 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321185:0:23731:0:(rw26.c:898:ll_write_end()) pos 184320, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321189:0:23731:0:(rw26.c:956:ll_write_end()) page@000000004170955b[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 45] 00000080:00200000:3.0:1788201559.321191:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000010ecb5b9 17ffffc0001001 3:0 ffff8bc172658ee0 45 lru 00000080:00200000:3.0:1788201559.321196:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000a569aca1 45: 1< 0 - - > 2< 184320 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321199:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000004170955b 00000080:00200000:3.0:1788201559.321200:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 46. 00000080:00200000:3.0:1788201559.321202:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 46 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321215:0:23731:0:(rw26.c:898:ll_write_end()) pos 188416, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321219:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000153b488a[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 46] 00000080:00200000:3.0:1788201559.321222:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000184612e0 17ffffc0001001 3:0 ffff8bc172658620 46 lru 00000080:00200000:3.0:1788201559.321227:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000002210be4a 46: 1< 0 - - > 2< 188416 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321229:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000153b488a 00000080:00200000:3.0:1788201559.321230:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 47. 00000080:00200000:3.0:1788201559.321232:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 47 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321248:0:23731:0:(rw26.c:898:ll_write_end()) pos 192512, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321251:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000f756095f[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 47] 00000080:00200000:3.0:1788201559.321254:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000be565bda 17ffffc0001001 3:0 ffff8bc1726587e0 47 lru 00000080:00200000:3.0:1788201559.321259:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000006aeaf857 47: 1< 0 - - > 2< 192512 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321261:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000f756095f 00000080:00200000:3.0:1788201559.321262:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 48. 00000080:00200000:3.0:1788201559.321264:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 48 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321278:0:23731:0:(rw26.c:898:ll_write_end()) pos 196608, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321282:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000d7a9a30e[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 48] 00000080:00200000:3.0:1788201559.321285:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000003296d612 17ffffc0001001 3:0 ffff8bc172658700 48 lru 00000080:00200000:3.0:1788201559.321289:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000082f02949 48: 1< 0 - - > 2< 196608 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321291:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000d7a9a30e 00000080:00200000:3.0:1788201559.321293:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 49. 00000080:00200000:3.0:1788201559.321295:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 49 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321308:0:23731:0:(rw26.c:898:ll_write_end()) pos 200704, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321312:0:23731:0:(rw26.c:956:ll_write_end()) page@000000007623fc0d[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 49] 00000080:00200000:3.0:1788201559.321315:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000fa68987c 17ffffc0001001 3:0 ffff8bc172658b60 49 lru 00000080:00200000:3.0:1788201559.321320:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000009e0095e 49: 1< 0 - - > 2< 200704 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321322:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000007623fc0d 00000080:00200000:3.0:1788201559.321323:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 50. 00000080:00200000:3.0:1788201559.321324:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 50 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321342:0:23731:0:(rw26.c:898:ll_write_end()) pos 204800, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321346:0:23731:0:(rw26.c:956:ll_write_end()) page@000000008007cd55[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 50] 00000080:00200000:3.0:1788201559.321349:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000002bdfd6a3 17ffffc0001021 2:0 ffff8bc1726582a0 50 lru 00000080:00200000:3.0:1788201559.321354:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000005574ef36 50: 1< 0 - - > 2< 204800 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321356:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000008007cd55 00000080:00200000:3.0:1788201559.321357:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 51. 00000080:00200000:3.0:1788201559.321359:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 51 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321373:0:23731:0:(rw26.c:898:ll_write_end()) pos 208896, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321377:0:23731:0:(rw26.c:956:ll_write_end()) page@000000001968811e[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 51] 00000080:00200000:3.0:1788201559.321381:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000b8bcc6eb 17ffffc0001001 3:0 ffff8bc172658460 51 lru 00000080:00200000:3.0:1788201559.321386:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000001e627197 51: 1< 0 - - > 2< 208896 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321388:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000001968811e 00000080:00200000:3.0:1788201559.321390:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 52. 00000080:00200000:3.0:1788201559.321392:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 52 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321406:0:23731:0:(rw26.c:898:ll_write_end()) pos 212992, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321410:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000251b2ad1[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 52] 00000080:00200000:3.0:1788201559.321414:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000fdbc8a27 17ffffc0001001 3:0 ffff8bc172658d20 52 lru 00000080:00200000:3.0:1788201559.321418:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b67510d4 52: 1< 0 - - > 2< 212992 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321420:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000251b2ad1 00000080:00200000:3.0:1788201559.321421:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 53. 00000080:00200000:3.0:1788201559.321423:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 53 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321435:0:23731:0:(rw26.c:898:ll_write_end()) pos 217088, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321439:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000004530703[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 53] 00000080:00200000:3.0:1788201559.321442:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000166367f2 17ffffc0001001 3:0 ffff8bc172658000 53 lru 00000080:00200000:3.0:1788201559.321446:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000f1b0ead7 53: 1< 0 - - > 2< 217088 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321447:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000004530703 00000080:00200000:3.0:1788201559.321449:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 54. 00000080:00200000:3.0:1788201559.321450:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 54 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321463:0:23731:0:(rw26.c:898:ll_write_end()) pos 221184, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321467:0:23731:0:(rw26.c:956:ll_write_end()) page@000000004a6117ea[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 54] 00000080:00200000:3.0:1788201559.321470:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000009efe1e04 17ffffc0001001 3:0 ffff8bc172658380 54 lru 00000080:00200000:3.0:1788201559.321474:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000a50f8d79 54: 1< 0 - - > 2< 221184 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321475:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000004a6117ea 00000080:00200000:3.0:1788201559.321476:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 55. 00000080:00200000:3.0:1788201559.321478:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 55 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321491:0:23731:0:(rw26.c:898:ll_write_end()) pos 225280, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321494:0:23731:0:(rw26.c:956:ll_write_end()) page@000000009892ce6c[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 55] 00000080:00200000:3.0:1788201559.321497:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000002359c044 17ffffc0001001 3:0 ffff8bc1726581c0 55 lru 00000080:00200000:3.0:1788201559.321501:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000017c4046f 55: 1< 0 - - > 2< 225280 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321503:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000009892ce6c 00000080:00200000:3.0:1788201559.321504:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 56. 00000080:00200000:3.0:1788201559.321506:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 56 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321518:0:23731:0:(rw26.c:898:ll_write_end()) pos 229376, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321522:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000c9f328a6[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 56] 00000080:00200000:3.0:1788201559.321525:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000070080466 17ffffc0001001 3:0 ffff8bc1726580e0 56 lru 00000080:00200000:3.0:1788201559.321530:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000001d161b57 56: 1< 0 - - > 2< 229376 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321532:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000c9f328a6 00000080:00200000:3.0:1788201559.321533:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 57. 00000080:00200000:3.0:1788201559.321535:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 57 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321549:0:23731:0:(rw26.c:898:ll_write_end()) pos 233472, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321554:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000889edebf[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 57] 00000080:00200000:3.0:1788201559.321556:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000c745f726 17ffffc0001001 3:0 ffff8bc1726589a0 57 lru 00000080:00200000:3.0:1788201559.321562:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000339ffb61 57: 1< 0 - - > 2< 233472 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321565:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000889edebf 00000080:00200000:3.0:1788201559.321567:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 58. 00000080:00200000:3.0:1788201559.321569:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 58 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321583:0:23731:0:(rw26.c:898:ll_write_end()) pos 237568, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321587:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000097171dbe[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 58] 00000080:00200000:3.0:1788201559.321591:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000c9112ba7 17ffffc0001001 3:0 ffff8bc172658c40 58 lru 00000080:00200000:3.0:1788201559.321595:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000f4b172ef 58: 1< 0 - - > 2< 237568 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321598:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000097171dbe 00000080:00200000:3.0:1788201559.321599:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 59. 00000080:00200000:3.0:1788201559.321600:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 59 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321615:0:23731:0:(rw26.c:898:ll_write_end()) pos 241664, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321619:0:23731:0:(rw26.c:956:ll_write_end()) page@000000005ba2b57b[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 59] 00000080:00200000:3.0:1788201559.321622:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000361dc9cf 17ffffc0001001 3:0 ffff8bc172658a80 59 lru 00000080:00200000:3.0:1788201559.321627:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000eb1ab213 59: 1< 0 - - > 2< 241664 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321629:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000005ba2b57b 00000080:00200000:3.0:1788201559.321630:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 60. 00000080:00200000:3.0:1788201559.321632:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 60 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321647:0:23731:0:(rw26.c:898:ll_write_end()) pos 245760, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321652:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000a560196f[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 60] 00000080:00200000:3.0:1788201559.321654:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000000518eb7e 17ffffc0001001 3:0 ffff8bc172658540 60 lru 00000080:00200000:3.0:1788201559.321659:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000005d7ba54f 60: 1< 0 - - > 2< 245760 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321661:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000a560196f 00000080:00200000:3.0:1788201559.321662:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 61. 00000080:00200000:3.0:1788201559.321664:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 61 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321686:0:23731:0:(rw26.c:898:ll_write_end()) pos 249856, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321691:0:23731:0:(rw26.c:956:ll_write_end()) page@000000007afea692[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 61] 00000080:00200000:3.0:1788201559.321694:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000358e834a 17ffffc0001001 3:0 ffff8bc153b077e0 61 lru 00000080:00200000:3.0:1788201559.321699:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000035ee91b8 61: 1< 0 - - > 2< 249856 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321701:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000007afea692 00000080:00200000:3.0:1788201559.321702:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 62. 00000080:00200000:3.0:1788201559.321704:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 62 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321717:0:23731:0:(rw26.c:898:ll_write_end()) pos 253952, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321721:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000dfc655ad[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 62] 00000080:00200000:3.0:1788201559.321724:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000926adb64 17ffffc0001001 3:0 ffff8bc153b07700 62 lru 00000080:00200000:3.0:1788201559.321729:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000003979853 62: 1< 0 - - > 2< 253952 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321731:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000dfc655ad 00000080:00200000:3.0:1788201559.321732:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 63. 00000080:00200000:3.0:1788201559.321734:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 63 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321748:0:23731:0:(rw26.c:898:ll_write_end()) pos 258048, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321752:0:23731:0:(rw26.c:956:ll_write_end()) page@000000002a543899[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 63] 00000080:00200000:3.0:1788201559.321755:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000007a9a2c0f 17ffffc0001001 3:0 ffff8bc153b07b60 63 lru 00000080:00200000:3.0:1788201559.321760:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000c8443eb8 63: 1< 0 - - > 2< 258048 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321762:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000002a543899 00000080:00200000:3.0:1788201559.321763:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 64. 00000080:00200000:3.0:1788201559.321765:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 64 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321813:0:23731:0:(rw26.c:898:ll_write_end()) pos 262144, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321819:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000056c6e7b3[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 64] 00000080:00200000:3.0:1788201559.321822:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000168c32a9 17ffffc0001001 3:0 ffff8bc153b072a0 64 lru 00000080:00200000:3.0:1788201559.321828:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000000809ae17 64: 1< 0 - - > 2< 262144 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321830:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000056c6e7b3 00000080:00200000:3.0:1788201559.321831:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 65. 00000080:00200000:3.0:1788201559.321833:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 65 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321853:0:23731:0:(rw26.c:898:ll_write_end()) pos 266240, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321857:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000064953d42[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 65] 00000080:00200000:3.0:1788201559.321860:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000f4538468 17ffffc0001021 2:0 ffff8bc153b07460 65 lru 00000080:00200000:3.0:1788201559.321865:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000087fde517 65: 1< 0 - - > 2< 266240 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321867:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000064953d42 00000080:00200000:3.0:1788201559.321868:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 66. 00000080:00200000:3.0:1788201559.321870:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 66 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321884:0:23731:0:(rw26.c:898:ll_write_end()) pos 270336, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321888:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000d81f4a3f[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 66] 00000080:00200000:3.0:1788201559.321891:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000004d98090b 17ffffc0001001 3:0 ffff8bc153b07d20 66 lru 00000080:00200000:3.0:1788201559.321896:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000008b7bb150 66: 1< 0 - - > 2< 270336 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321898:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000d81f4a3f 00000080:00200000:3.0:1788201559.321899:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 67. 00000080:00200000:3.0:1788201559.321901:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 67 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321915:0:23731:0:(rw26.c:898:ll_write_end()) pos 274432, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321920:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000fd6fcd2f[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 67] 00000080:00200000:3.0:1788201559.321922:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000007f56848e 17ffffc0001001 3:0 ffff8bc153b07000 67 lru 00000080:00200000:3.0:1788201559.321926:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000009af71711 67: 1< 0 - - > 2< 274432 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321927:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000fd6fcd2f 00000080:00200000:3.0:1788201559.321928:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 68. 00000080:00200000:3.0:1788201559.321929:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 68 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321939:0:23731:0:(rw26.c:898:ll_write_end()) pos 278528, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321942:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000e8e3895b[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 68] 00000080:00200000:3.0:1788201559.321943:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000007ba27a1e 17ffffc0001001 3:0 ffff8bc153b07380 68 lru 00000080:00200000:3.0:1788201559.321947:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000459d743b 68: 1< 0 - - > 2< 278528 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321948:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000e8e3895b 00000080:00200000:3.0:1788201559.321949:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 69. 00000080:00200000:3.0:1788201559.321949:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 69 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321957:0:23731:0:(rw26.c:898:ll_write_end()) pos 282624, len 4096, copied 4096 00000080:00200000:3.0:1788201559.321959:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000671abd92[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 69] 00000080:00200000:3.0:1788201559.321961:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000deaa289a 17ffffc0001001 3:0 ffff8bc153b071c0 69 lru 00000080:00200000:3.0:1788201559.321978:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000915ebcc7 69: 1< 0 - - > 2< 282624 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.321980:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000671abd92 00000080:00200000:3.0:1788201559.321981:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 70. 00000080:00200000:3.0:1788201559.321983:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 70 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.321998:0:23731:0:(rw26.c:898:ll_write_end()) pos 286720, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322002:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000c8751fa5[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 70] 00000080:00200000:3.0:1788201559.322005:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000179a804b 17ffffc0001001 3:0 ffff8bc153b070e0 70 lru 00000080:00200000:3.0:1788201559.322010:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000ab6444fc 70: 1< 0 - - > 2< 286720 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322012:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000c8751fa5 00000080:00200000:3.0:1788201559.322013:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 71. 00000080:00200000:3.0:1788201559.322014:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 71 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322030:0:23731:0:(rw26.c:898:ll_write_end()) pos 290816, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322033:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000098b7f44[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 71] 00000080:00200000:3.0:1788201559.322036:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000075d257e3 17ffffc0001001 3:0 ffff8bc153b079a0 71 lru 00000080:00200000:3.0:1788201559.322040:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000acfdd56c 71: 1< 0 - - > 2< 290816 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322042:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000098b7f44 00000080:00200000:3.0:1788201559.322043:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 72. 00000080:00200000:3.0:1788201559.322045:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 72 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322057:0:23731:0:(rw26.c:898:ll_write_end()) pos 294912, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322061:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000096897e24[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 72] 00000080:00200000:3.0:1788201559.322064:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000de0c407f 17ffffc0001001 3:0 ffff8bc153b07c40 72 lru 00000080:00200000:3.0:1788201559.322069:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000010ae3f02 72: 1< 0 - - > 2< 294912 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322071:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000096897e24 00000080:00200000:3.0:1788201559.322072:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 73. 00000080:00200000:3.0:1788201559.322074:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 73 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322088:0:23731:0:(rw26.c:898:ll_write_end()) pos 299008, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322092:0:23731:0:(rw26.c:956:ll_write_end()) page@000000006424f82c[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 73] 00000080:00200000:3.0:1788201559.322095:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000001840051a 17ffffc0001001 3:0 ffff8bc153b07a80 73 lru 00000080:00200000:3.0:1788201559.322101:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000a5d0b029 73: 1< 0 - - > 2< 299008 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322103:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000006424f82c 00000080:00200000:3.0:1788201559.322104:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 74. 00000080:00200000:3.0:1788201559.322106:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 74 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322124:0:23731:0:(rw26.c:898:ll_write_end()) pos 303104, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322129:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000d9eeba24[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 74] 00000080:00200000:3.0:1788201559.322132:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000880d04df 17ffffc0001001 3:0 ffff8bc153b07540 74 lru 00000080:00200000:3.0:1788201559.322137:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000cc0c93b5 74: 1< 0 - - > 2< 303104 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322139:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000d9eeba24 00000080:00200000:3.0:1788201559.322140:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 75. 00000080:00200000:3.0:1788201559.322142:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 75 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322158:0:23731:0:(rw26.c:898:ll_write_end()) pos 307200, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322162:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000ad4f7583[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 75] 00000080:00200000:3.0:1788201559.322164:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000092deba50 17ffffc0001001 3:0 ffff8bc153b078c0 75 lru 00000080:00200000:3.0:1788201559.322169:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000f70c31b8 75: 1< 0 - - > 2< 307200 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322171:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000ad4f7583 00000080:00200000:3.0:1788201559.322172:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 76. 00000080:00200000:3.0:1788201559.322173:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 76 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322187:0:23731:0:(rw26.c:898:ll_write_end()) pos 311296, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322191:0:23731:0:(rw26.c:956:ll_write_end()) page@000000008e8e6ecb[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 76] 00000080:00200000:3.0:1788201559.322193:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000001d41be77 17ffffc0001001 3:0 ffff8bc153b07e00 76 lru 00000080:00200000:3.0:1788201559.322197:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000000185d69a 76: 1< 0 - - > 2< 311296 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322199:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000008e8e6ecb 00000080:00200000:3.0:1788201559.322200:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 77. 00000080:00200000:3.0:1788201559.322202:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 77 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322214:0:23731:0:(rw26.c:898:ll_write_end()) pos 315392, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322219:0:23731:0:(rw26.c:956:ll_write_end()) page@000000007c6598c8[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 77] 00000080:00200000:3.0:1788201559.322222:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000030e86edb 17ffffc0001001 3:0 ffff8bc153b07ee0 77 lru 00000080:00200000:3.0:1788201559.322225:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b6539b32 77: 1< 0 - - > 2< 315392 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322227:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000007c6598c8 00000080:00200000:3.0:1788201559.322228:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 78. 00000080:00200000:3.0:1788201559.322229:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 78 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322242:0:23731:0:(rw26.c:898:ll_write_end()) pos 319488, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322246:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000049f0e87a[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 78] 00000080:00200000:3.0:1788201559.322248:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000001f545ca4 17ffffc0001001 3:0 ffff8bc153b07620 78 lru 00000080:00200000:3.0:1788201559.322253:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000001efcb8e9 78: 1< 0 - - > 2< 319488 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322254:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000049f0e87a 00000080:00200000:3.0:1788201559.322255:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 79. 00000080:00200000:3.0:1788201559.322257:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 79 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322277:0:23731:0:(rw26.c:898:ll_write_end()) pos 323584, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322281:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000dd679595[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 79] 00000080:00200000:3.0:1788201559.322284:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000016c384d6 17ffffc0001001 3:0 ffff8bc17261f460 79 lru 00000080:00200000:3.0:1788201559.322288:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000057411153 79: 1< 0 - - > 2< 323584 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322291:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000dd679595 00000080:00200000:3.0:1788201559.322292:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 80. 00000080:00200000:3.0:1788201559.322294:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 80 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322310:0:23731:0:(rw26.c:898:ll_write_end()) pos 327680, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322314:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000cf1db854[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 80] 00000080:00200000:3.0:1788201559.322317:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000009cb3dc7a 17ffffc0001021 2:0 ffff8bc17261fd20 80 lru 00000080:00200000:3.0:1788201559.322321:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000007cd419f9 80: 1< 0 - - > 2< 327680 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322323:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000cf1db854 00000080:00200000:3.0:1788201559.322325:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 81. 00000080:00200000:3.0:1788201559.322327:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 81 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322340:0:23731:0:(rw26.c:898:ll_write_end()) pos 331776, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322345:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000175d495c[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 81] 00000080:00200000:3.0:1788201559.322348:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000000c37c48b 17ffffc0001001 3:0 ffff8bc17261f000 81 lru 00000080:00200000:3.0:1788201559.322352:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000082526a16 81: 1< 0 - - > 2< 331776 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322354:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000175d495c 00000080:00200000:3.0:1788201559.322355:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 82. 00000080:00200000:3.0:1788201559.322357:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 82 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322372:0:23731:0:(rw26.c:898:ll_write_end()) pos 335872, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322375:0:23731:0:(rw26.c:956:ll_write_end()) page@000000001947d3d6[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 82] 00000080:00200000:3.0:1788201559.322378:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000b52b13fa 17ffffc0001001 3:0 ffff8bc17261f380 82 lru 00000080:00200000:3.0:1788201559.322382:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000099ccd26b 82: 1< 0 - - > 2< 335872 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322385:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000001947d3d6 00000080:00200000:3.0:1788201559.322386:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 83. 00000080:00200000:3.0:1788201559.322387:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 83 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322401:0:23731:0:(rw26.c:898:ll_write_end()) pos 339968, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322405:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000037070cc[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 83] 00000080:00200000:3.0:1788201559.322408:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000d6425ac4 17ffffc0001001 3:0 ffff8bc17261f1c0 83 lru 00000080:00200000:3.0:1788201559.322413:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000041de98cb 83: 1< 0 - - > 2< 339968 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322415:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000037070cc 00000080:00200000:3.0:1788201559.322417:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 84. 00000080:00200000:3.0:1788201559.322419:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 84 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322433:0:23731:0:(rw26.c:898:ll_write_end()) pos 344064, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322442:0:23731:0:(rw26.c:956:ll_write_end()) page@000000007576f06c[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 84] 00000080:00200000:3.0:1788201559.322445:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000506fea51 17ffffc0001001 3:0 ffff8bc17261f0e0 84 lru 00000080:00200000:3.0:1788201559.322450:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000058cf5798 84: 1< 0 - - > 2< 344064 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322451:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000007576f06c 00000080:00200000:3.0:1788201559.322453:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 85. 00000080:00200000:3.0:1788201559.322455:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 85 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322468:0:23731:0:(rw26.c:898:ll_write_end()) pos 348160, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322472:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000046c9757e[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 85] 00000080:00200000:3.0:1788201559.322474:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000062a0a626 17ffffc0001001 3:0 ffff8bc17261f9a0 85 lru 00000080:00200000:3.0:1788201559.322479:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000f4f7ff6d 85: 1< 0 - - > 2< 348160 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322481:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000046c9757e 00000080:00200000:3.0:1788201559.322482:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 86. 00000080:00200000:3.0:1788201559.322484:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 86 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322496:0:23731:0:(rw26.c:898:ll_write_end()) pos 352256, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322499:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000096221712[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 86] 00000080:00200000:3.0:1788201559.322502:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000046e16435 17ffffc0001001 3:0 ffff8bc17261fc40 86 lru 00000080:00200000:3.0:1788201559.322506:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000c031fbf4 86: 1< 0 - - > 2< 352256 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322508:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000096221712 00000080:00200000:3.0:1788201559.322509:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 87. 00000080:00200000:3.0:1788201559.322511:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 87 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322524:0:23731:0:(rw26.c:898:ll_write_end()) pos 356352, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322528:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000036b24c05[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 87] 00000080:00200000:3.0:1788201559.322530:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000071e60f4b 17ffffc0001001 3:0 ffff8bc17261fa80 87 lru 00000080:00200000:3.0:1788201559.322536:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000ee592004 87: 1< 0 - - > 2< 356352 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322537:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000036b24c05 00000080:00200000:3.0:1788201559.322538:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 88. 00000080:00200000:3.0:1788201559.322541:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 88 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322558:0:23731:0:(rw26.c:898:ll_write_end()) pos 360448, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322562:0:23731:0:(rw26.c:956:ll_write_end()) page@000000003660f6c2[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 88] 00000080:00200000:3.0:1788201559.322565:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000093714055 17ffffc0001001 3:0 ffff8bc17261f540 88 lru 00000080:00200000:3.0:1788201559.322570:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000000d6c2c5e 88: 1< 0 - - > 2< 360448 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322571:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000003660f6c2 00000080:00200000:3.0:1788201559.322573:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 89. 00000080:00200000:3.0:1788201559.322574:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 89 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322588:0:23731:0:(rw26.c:898:ll_write_end()) pos 364544, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322591:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000d6942fdb[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 89] 00000080:00200000:3.0:1788201559.322592:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000ea4b294c 17ffffc0001001 3:0 ffff8bc17261f8c0 89 lru 00000080:00200000:3.0:1788201559.322596:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000eba8ce0d 89: 1< 0 - - > 2< 364544 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322597:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000d6942fdb 00000080:00200000:3.0:1788201559.322598:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 90. 00000080:00200000:3.0:1788201559.322599:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 90 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322607:0:23731:0:(rw26.c:898:ll_write_end()) pos 368640, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322609:0:23731:0:(rw26.c:956:ll_write_end()) page@000000007d98314c[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 90] 00000080:00200000:3.0:1788201559.322611:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000cb52c2cf 17ffffc0001001 3:0 ffff8bc17261fe00 90 lru 00000080:00200000:3.0:1788201559.322614:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b6b6db07 90: 1< 0 - - > 2< 368640 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322615:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000007d98314c 00000080:00200000:3.0:1788201559.322616:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 91. 00000080:00200000:3.0:1788201559.322617:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 91 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322624:0:23731:0:(rw26.c:898:ll_write_end()) pos 372736, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322626:0:23731:0:(rw26.c:956:ll_write_end()) page@000000000c2c349e[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 91] 00000080:00200000:3.0:1788201559.322628:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000062843da2 17ffffc0001001 3:0 ffff8bc17261fee0 91 lru 00000080:00200000:3.0:1788201559.322631:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000059eb135c 91: 1< 0 - - > 2< 372736 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322632:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000000c2c349e 00000080:00200000:3.0:1788201559.322633:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 92. 00000080:00200000:3.0:1788201559.322634:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 92 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322641:0:23731:0:(rw26.c:898:ll_write_end()) pos 376832, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322644:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000060257618[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 92] 00000080:00200000:3.0:1788201559.322645:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000b1691476 17ffffc0001001 3:0 ffff8bc17261f620 92 lru 00000080:00200000:3.0:1788201559.322648:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000063d3357 92: 1< 0 - - > 2< 376832 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322649:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000060257618 00000080:00200000:3.0:1788201559.322651:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 93. 00000080:00200000:3.0:1788201559.322652:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 93 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322659:0:23731:0:(rw26.c:898:ll_write_end()) pos 380928, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322661:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000059354b77[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 93] 00000080:00200000:3.0:1788201559.322663:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000f69f3470 17ffffc0001001 3:0 ffff8bc17261f7e0 93 lru 00000080:00200000:3.0:1788201559.322666:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000eb3b33ab 93: 1< 0 - - > 2< 380928 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322667:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000059354b77 00000080:00200000:3.0:1788201559.322668:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 94. 00000080:00200000:3.0:1788201559.322669:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 94 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322676:0:23731:0:(rw26.c:898:ll_write_end()) pos 385024, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322678:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000051def724[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 94] 00000080:00200000:3.0:1788201559.322681:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000c15fcec4 17ffffc0001001 3:0 ffff8bc17261f700 94 lru 00000080:00200000:3.0:1788201559.322684:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000004bba819d 94: 1< 0 - - > 2< 385024 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322685:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000051def724 00000080:00200000:3.0:1788201559.322686:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 95. 00000080:00200000:3.0:1788201559.322686:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 95 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322696:0:23731:0:(rw26.c:898:ll_write_end()) pos 389120, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322698:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000094f77e6c[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 95] 00000080:00200000:3.0:1788201559.322700:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000002a57404b 17ffffc0001021 2:0 ffff8bc17261fb60 95 lru 00000080:00200000:3.0:1788201559.322703:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000033c358ea 95: 1< 0 - - > 2< 389120 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322704:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000094f77e6c 00000080:00200000:3.0:1788201559.322705:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 96. 00000080:00200000:3.0:1788201559.322706:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 96 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322714:0:23731:0:(rw26.c:898:ll_write_end()) pos 393216, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322716:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000066cd5543[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 96] 00000080:00200000:3.0:1788201559.322718:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000091b15224 17ffffc0001001 3:0 ffff8bc17261f2a0 96 lru 00000080:00200000:3.0:1788201559.322722:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000008eda6e3a 96: 1< 0 - - > 2< 393216 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322723:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000066cd5543 00000080:00200000:3.0:1788201559.322724:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 97. 00000080:00200000:3.0:1788201559.322726:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 97 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322745:0:23731:0:(rw26.c:898:ll_write_end()) pos 397312, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322749:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000647f8d49[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 97] 00000080:00200000:3.0:1788201559.322752:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000039d8388f 17ffffc0001001 3:0 ffff8bc146072700 97 lru 00000080:00200000:3.0:1788201559.322757:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000711ae6b2 97: 1< 0 - - > 2< 397312 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.322759:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000647f8d49 00000080:00200000:3.0:1788201559.322760:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 98. 00000080:00200000:3.0:1788201559.322762:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 98 of 0 to 4096 bytes 00000080:00200000:3.0:1788201559.322775:0:23731:0:(rw26.c:898:ll_write_end()) pos 401408, len 4096, copied 4096 00000080:00200000:3.0:1788201559.322779:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000cf8939bb[3 00000000b5a6099d 2 1 00000000aeb2063c 0 0 98] 00000080:00200000:3.0:1788201559.322782:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000000042a036 17ffffc0001001 3:0 ffff8bc146072b60 98 lru 00000080:00200000:3.0:1788201559.322787:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000098b9fac6 98: 1< 0 - - > 2< 401408 0 0 0x0 0x0 | 000000000ce25486 00000000bd10aa6a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201559.326354:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000cf8939bb 00000080:00200000:3.0:1788201559.326358:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 99. 00000100:00100000:3.0:1788201559.326668:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727862016:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201559.341349:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727862400:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201559.341385:0:23731:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1725b1880 x1875064727861632/t8589937126(8589937126) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201575 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201559.341463:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.341481:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.341500:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.341514:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.341524:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.341529:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.341533:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.341541:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201559.341545:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.341555:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.341570:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.341577:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201559.341582:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.341586:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity.sh, flags=8 00000080:00200008:1.0:1788201559.341594:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file sanity.sh:[0x200000bd7:0x12b:0x0](ffff8bc14465ec08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201559.341599:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x12b:0x0](ffff8bc14465ec08),name=sanity.sh 00000002:00010000:1.0:1788201559.341610:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x12b:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.341619:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201559.341633:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201559.341639:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.341643:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x12b:0x0](ffff8bc14465ec08) 00000080:00010000:1.0:1788201559.341646:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x12b:0x0](ffff8bc14465ec08) for lock 0xd138388016f6ebe0 00000080:00010000:1.0:1788201559.341649:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ebe0 from it ffffadd1c7da3cb8 00010000:00010000:1.0:1788201559.341652:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201559.341661:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201559.341708:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x12b:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201559.341718:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x12b:0x0] 00000008:00010000:1.0:1788201559.341748:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201559.341753:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc142dec830, osc lock ffff8bc145d08d10, flags 0x400001002 00010000:00010000:1.0:1788201559.341768:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.341779:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201559.341898:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201559.341903:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 7/0,1 mode: PW/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.341918:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201559.341930:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201559.341940:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x12b:0x0] updating i_size 1181558 i_blocks 1 00000020:00010000:1.0:1788201559.341943:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e262b0 (ffff8bc148e3b2d8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201559.341947:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e262b0 (ffff8bc148e3b2d8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.341950:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc142dec830 (ffff8bc148e3b908/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.341955:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e262b0 (ffff8bc148e3b2d8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201559.341958:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc142dec830 (ffff8bc148e3b2d8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201559.341999:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x12b:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201559.342051:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.342058:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.342065:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.342073:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.342080:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.342084:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.342087:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.342091:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201559.342094:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.342106:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.342115:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.342119:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201559.342122:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.342135:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=scrub-performance.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=9 00000080:00200000:1.0:1788201559.342345:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=scrub-performance.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:1.0:1788201559.342360:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: scrub-performance.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201559.342402:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ebf5 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.342410:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ebf5 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.342420:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ebf5 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.342443:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b3b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727862528:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.342584:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc153a8d540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201559.375571:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727863040:192.168.201.143@tcp:101:cp.0 00000080:00200000:1.0:1788201559.382054:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x12c:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201559.382061:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc146006e40 (ffff8bc1469192d8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201559.382064:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146006e40 (ffff8bc1469192d8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.382069:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d2b0 (ffff8bc146919ea8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.382073:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146006e40 (ffff8bc1469192d8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201559.382075:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d2b0 (ffff8bc1469192d8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201559.382126:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x12c:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201559.382193:0:23731:0:(file.c:2638:do_file_write_iter()) START file scrub-performance.sh:[0x200000bd7:0x12c:0x0], ppos: 0, count: 5105 00000080:00200000:1.0:1788201559.382224:0:23731:0:(file.c:2090:ll_file_io_generic()) scrub-performance.sh: write ppos: 0, bytes: 5105 00000080:00200000:1.0:1788201559.382230:0:23731:0:(file.c:1848:ll_io_set_mirror()) scrub-performance.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201559.382236:0:23731:0:(cl_io.c:214:cl_io_rw_init()) header@0000000041abb8c9[0x110, 1, [0x200000bd7:0x12c:0x0] hash] 00000020:00200000:1.0:1788201559.382239:0:23731:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5105) 0 0 00000080:00200000:1.0:1788201559.382242:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x12c:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201559.382255:0:23731:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 1] 00020000:00200000:1.0:1788201559.382263:0:23731:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5105) 5105, 5105 00020000:00200000:1.0:1788201559.382268:0:23731:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201559.382296:0:23731:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 1] 00000008:00010000:1.0:1788201559.382310:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201559.382315:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc142dec830, osc lock ffff8bc145d08d10, flags 0x0 00010000:00010000:1.0:1788201559.382328:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/413 (0 8191) 00010000:00010000:1.0:1788201559.382363:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000090432167/0xd138388016f6ec11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.382372:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000090432167/0xd138388016f6ec11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19d:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.382383:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000090432167/0xd138388016f6ec11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19d:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.382402:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b2a00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727863168:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.382489:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc153a8d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.385008:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:3.0:1788201559.385910:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201559.385918:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001ff635c8/0xd138388016f6ec0a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x19d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171095163 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201559.385926:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc15c12a400 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201559.385932:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001ff635c8/0xd138388016f6ec0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171095163 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201559.385994:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x12c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201559.386006:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x12c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201559.386060:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001ff635c8/0xd138388016f6ec0a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x19d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171095163 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201559.386067:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201559.386101:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001ff635c8/0xd138388016f6ec0a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x19d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171095163 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201559.386108:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001ff635c8/0xd138388016f6ec0a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x19d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171095163 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201559.386123:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201559.386125:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201559.386126:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201559.386212:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201559.386230:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727863296:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201559.394394:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201559.394496:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743445376 00000100:00100000:3.0:1788201559.394508:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743445376 00000100:00100000:3.0:1788201559.394570:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 607 00000100:00100000:3.0:1788201559.394580:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743445376:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201559.394597:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000090432167/0xd138388016f6ec11 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109516a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.394611:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000090432167/0xd138388016f6ec11 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109516a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.394621:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000090432167/0xd138388016f6ec11 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109516a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.394632:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000090432167/0xd138388016f6ec11 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e217109516a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.394642:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000090432167/0xd138388016f6ec11 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e217109516a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.394659:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000090432167/0xd138388016f6ec11 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e217109516a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.394678:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1460bc200) 00000100:00100000:3.0:1788201559.394757:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743445376:12345-192.168.201.143@tcp:105: Request processed in 177us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201559.394765:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 607 00000100:00100000:1.0:1788201559.398784:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727863296:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201559.405631:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727863680:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201559.405652:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6ec18 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.405665:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6ec18 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.405672:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6ec18 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.405680:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6ec18 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.405689:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6ec18 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.405695:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc15c12b400 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201559.405700:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6ec18 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.405706:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6ec18 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.405713:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6ec18 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.405720:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201559.405726:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6ec18 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.405733:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6ec18 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201559.405760:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1726cea00 x1875064727863680/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201575 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201559.405776:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201559.405819:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:1.0:1788201559.405876:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.405889:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.405896:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.405907:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.405914:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.405919:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.405922:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.405927:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201559.405931:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.405939:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.405952:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.405958:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201559.405973:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.405986:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=setup-cifs.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=8 00000080:00200000:1.0:1788201559.405990:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=setup-cifs.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:1.0:1788201559.406000:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: setup-cifs.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201559.406037:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ec1f lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.406045:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ec1f lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.406055:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ec1f lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.406076:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727863808:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.406217:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc153a8d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.410698:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727863808:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201559.410719:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ec1f lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.410731:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ec1f lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.410737:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ec1f lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.410743:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ec1f lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.411242:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ec1f lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.411248:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bc400 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201559.411254:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ec1f lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.411261:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ec1f lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.411268:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ec1f lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.411274:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201559.411280:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ec1f lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.411286:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ec1f lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201559.411304:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1725b1180 x1875064727863808/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201575 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201559.411318:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201559.411341:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:1.0:1788201559.411441:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.411457:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.411465:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.411476:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.411482:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.411487:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.411491:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.411496:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3bf8 00010000:00010000:1.0:1788201559.411499:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.411506:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.411520:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.411526:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201559.411530:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.411542:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.411546:0:23731:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=setup-cifs.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), file ffff8bc153aa9e00, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:1.0:1788201559.411552:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=setup-cifs.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000002:00010000:1.0:1788201559.411569:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: setup-cifs.sh,[0x200000bd7:0x12d:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201559.411611:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.411617:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201559.411627:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201559.411633:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b1180 x1875064727864064/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201559.411641:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.411659:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727864064:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.411995:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc153a8d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.416321:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727864064:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201559.416349:0:23731:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.416373:0:23731:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.416381:0:23731:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.416393:0:23731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.416405:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.416420:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.416429:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.416437:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201559.416449:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1725b1180 x1875064727864064/t8589937130(8589937130) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201575 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201559.416463:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725b1180 x1875064727864064/t8589937130(8589937130) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201575 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201559.416478:0:23731:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201559.416492:0:23731:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.416502:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/301 (0 0) 00000080:00200000:1.0:1788201559.416509:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201559.416523:0:23731:0:(namei.c:1628:ll_create_it()) VFS Op:name=setup-cifs.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000080:00200000:1.0:1788201559.416555:0:23731:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x12d:0x0](ffff8bc14465db88) 00000080:00200000:1.0:1788201559.416671:0:23731:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x12d:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201559.416680:0:23731:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x12d:0x0](ffff8bc14465db88) 00000080:00010000:1.0:1788201559.416683:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x12d:0x0](ffff8bc14465db88) for lock 0xd138388016f6ec26 00000080:00010000:1.0:1788201559.416691:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x12d:0x0](ffff8bc14465db88) 00000080:00200008:1.0:1788201559.416704:0:23731:0:(file.c:1090:ll_file_open()) START file setup-cifs.sh:[0x200000bd7:0x12d:0x0](ffff8bc14465db88), flags 100301 00000002:00100000:1.0:1788201559.416721:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725b1180 x1875064727864064/t8589937130(8589937130) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201575 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201559.416756:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ec26 from it ffff8bc144cb57e0 00010000:00010000:1.0:1788201559.416760:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.416769:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201559.416823:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x12d:0x0](ffff8bc14465db88), inode mode 81a4 mask 40 00000080:00200008:1.0:1788201559.416846:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file setup-cifs.sh:[0x200000bd7:0x12d:0x0](ffff8bc14465db88), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201559.416852:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x12d:0x0](ffff8bc14465db88),name=setup-cifs.sh 00000002:00010000:1.0:1788201559.416867:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x12d:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.416876:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.416885:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201559.416891:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.416894:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x12d:0x0](ffff8bc14465db88) 00000080:00010000:1.0:1788201559.416897:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x12d:0x0](ffff8bc14465db88) for lock 0xd138388016f6ec26 00000080:00010000:1.0:1788201559.416900:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ec26 from it ffffadd1c7da3cd8 00010000:00010000:1.0:1788201559.416903:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.416910:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201559.416932:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x12d:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201559.416940:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x12d:0x0] 00000008:00010000:1.0:1788201559.416978:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201559.416981:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc142dec130, osc lock ffff8bc145d08130, flags 0x400001002 00010000:00010000:1.0:1788201559.417021:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ea153166/0xd138388016f6ec2d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.417034:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ea153166/0xd138388016f6ec2d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201559.417071:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:1.0:1788201559.420493:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x12d:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201559.420499:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e27530 (ffff8bc148e3b128/0) at cl_lock_release():245 00000020:00010000:1.0:1788201559.420503:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e27530 (ffff8bc148e3b128/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.420508:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc142dec130 (ffff8bc148e3be18/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.420512:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e27530 (ffff8bc148e3b128/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201559.420515:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc142dec130 (ffff8bc148e3b128/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201559.420553:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x12d:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201559.420609:0:23731:0:(file.c:2638:do_file_write_iter()) START file setup-cifs.sh:[0x200000bd7:0x12d:0x0], ppos: 0, count: 2475 00000080:00200000:1.0:1788201559.420622:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 2475 bytes 00000080:00200000:1.0:1788201559.420627:0:23731:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 2475 00000080:00200000:1.0:1788201559.420649:0:23731:0:(file.c:2090:ll_file_io_generic()) setup-cifs.sh: write ppos: 0, bytes: 2475 00000080:00200000:1.0:1788201559.420654:0:23731:0:(file.c:1848:ll_io_set_mirror()) setup-cifs.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201559.420660:0:23731:0:(cl_io.c:214:cl_io_rw_init()) header@00000000d706e1ac[0x110, 1, [0x200000bd7:0x12d:0x0] hash] 00000020:00200000:1.0:1788201559.420662:0:23731:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 2475) 0 0 00000080:00200000:1.0:1788201559.420665:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x12d:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201559.420679:0:23731:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1788201559.420688:0:23731:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 2475) 2475, 2475 00020000:00200000:1.0:1788201559.420692:0:23731:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201559.420722:0:23731:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1788201559.420735:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201559.420739:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc142dec130, osc lock ffff8bc145d08130, flags 0x0 00010000:00010000:1.0:1788201559.420753:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/413 (0 4095) 00010000:00010000:1.0:1788201559.420821:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.420835:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.420844:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.420865:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b2a00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727864320:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.420940:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.423462:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201559.424302:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201559.426022:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727864448:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201559.430163:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:1.0:1788201559.430867:0:23731:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.430876:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.430889:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201559.430900:0:23731:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.430911:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.430923:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201559.430951:0:23731:0:(vvp_io.c:1292:vvp_io_write_start()) setup-cifs.sh: write [0, 2475) append 0 append lockpos 0 00000080:00200000:1.0:1788201559.430980:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 2475 bytes 00000080:00200000:1.0:1788201559.431034:0:23731:0:(rw26.c:898:ll_write_end()) pos 0, len 2475, copied 2475 00000080:00200000:1.0:1788201559.431045:0:23731:0:(rw26.c:956:ll_write_end()) page@000000009837ac42[3 0000000083117bbb 2 1 000000000235009b 0 0 0] 00000080:00200000:1.0:1788201559.431048:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000004b6fb827 17ffffc0001001 3:0 ffff8bc1474180e0 0 lru 00000080:00200000:1.0:1788201559.431055:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000000f0f7e2 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000e2279ad9 > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.431057:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000009837ac42 00000080:00200000:1.0:1788201559.431058:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201559.431062:0:23731:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 2475 prio 0 00000008:00010000:1.0:1788201559.431081:0:23731:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000436963de ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201559.431109:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc14465dd38, count 1, dirtied 1 00000080:00200000:1.0:1788201559.431115:0:23731:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 2475 bytes, tot: 2475 00000080:00200000:1.0:1788201559.431117:0:23731:0:(vvp_io.c:1358:vvp_io_write_start()) setup-cifs.sh: write bytes 0, result: 2475 00000020:00010000:1.0:1788201559.431133:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c4128 (ffff8bc148e3b128/0) at cl_lock_release():245 00000020:00010000:1.0:1788201559.431141:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c4128 (ffff8bc148e3b128/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.431145:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc142dec130 (ffff8bc148e3be18/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201559.431150:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.431158:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201559.431178:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c4128 (ffff8bc148e3b128/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201559.431181:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc142dec130 (ffff8bc148e3b128/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201559.431188:0:23731:0:(vvp_io.c:533:vvp_io_advance()) advancing 2475 bytes 00000080:00200000:1.0:1788201559.431196:0:23731:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1788201559.431223:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x12d:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201559.431227:0:23731:0:(file.c:2238:ll_file_io_generic()) setup-cifs.sh: 2 io complete with rc: 0, result: 2475, restart: 0 00000080:00200000:1.0:1788201559.431233:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x12d:0x0] updating i_size 2475 i_blocks 1 00000080:00200000:1.0:1788201559.431237:0:23731:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 2475 00000080:00200008:1.0:1788201559.431279:0:23731:0:(file.c:479:ll_file_release()) START file setup-cifs.sh:[0x200000bd7:0x12d:0x0](ffff8bc14465db88), flags 100001 00000002:00100000:1.0:1788201559.431331:0:23731:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1725b1180 x1875064727864064/t8589937130(8589937130) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201575 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201559.431341:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201559.431346:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b2a00 x1875064727864704/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201559.431365:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b2a00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727864704:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201559.431424:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc4900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201559.438989:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727864448:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201559.439954:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b2a00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727864704:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201559.439996:0:23731:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1725b1180 x1875064727864064/t8589937130(8589937130) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201575 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201559.440066:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.440084:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.440113:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.440131:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.440141:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.440146:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.440149:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.440156:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201559.440160:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.440168:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.440182:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.440188:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201559.440194:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.440197:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=setup-cifs.sh, flags=8 00000080:00200008:1.0:1788201559.440203:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file setup-cifs.sh:[0x200000bd7:0x12d:0x0](ffff8bc14465db88), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201559.440207:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x12d:0x0](ffff8bc14465db88),name=setup-cifs.sh 00000002:00010000:1.0:1788201559.440217:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x12d:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.440224:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201559.440231:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201559.440242:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.440245:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x12d:0x0](ffff8bc14465db88) 00000080:00010000:1.0:1788201559.440247:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x12d:0x0](ffff8bc14465db88) for lock 0xd138388016f6ec26 00000080:00010000:1.0:1788201559.440251:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ec26 from it ffffadd1c7da3cb8 00010000:00010000:1.0:1788201559.440254:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201559.440262:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201559.440310:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x12d:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201559.440321:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x12d:0x0] 00000008:00010000:1.0:1788201559.440350:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201559.440353:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc142dec130, osc lock ffff8bc145d08130, flags 0x400001002 00010000:00010000:1.0:1788201559.440369:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.440379:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201559.440390:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201559.440394:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.440402:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201559.440418:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201559.440427:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x12d:0x0] updating i_size 2475 i_blocks 1 00000020:00010000:1.0:1788201559.440431:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e27530 (ffff8bc148e3b128/0) at cl_lock_release():245 00000020:00010000:1.0:1788201559.440434:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e27530 (ffff8bc148e3b128/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.440437:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc142dec130 (ffff8bc148e3be18/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.440442:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e27530 (ffff8bc148e3b128/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201559.440444:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc142dec130 (ffff8bc148e3b128/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201559.440472:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x12d:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201559.440519:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.440526:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.440533:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.440540:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.440545:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.440549:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.440551:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.440555:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201559.440558:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.440565:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.440577:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.440580:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201559.440583:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.440595:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=setup_kerberos.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=9 00000080:00200000:1.0:1788201559.440600:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=setup_kerberos.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:1.0:1788201559.440607:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: setup_kerberos.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201559.440649:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ec3b lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.440655:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ec3b lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.440664:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ec3b lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.440682:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17275bb80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727864832:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.440766:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc4900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.458486:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727865344:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201559.462301:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec50 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.462327:0:10054:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec50 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095219 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.462341:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec50 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095219 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.462358:0:10054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec50 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095219 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201559.462373:0:10054:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec50 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095219 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201559.462384:0:10054:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1788201559.462403:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec50 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171095219 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.462410:0:10054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec50 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171095219 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.462417:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec50 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171095219 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.462426:0:10054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec50 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171095219 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201559.462445:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727865344:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201559.465680:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743445760 00000100:00100000:3.0:1788201559.465690:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743445760 00000100:00100000:3.0:1788201559.465760:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 610 00000100:00100000:3.0:1788201559.465770:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172708e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:28099:x1875064743445760:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201559.465828:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec50 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x19e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171095219 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201559.465921:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201559.465928:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172708e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:28099:x1875064743445760:12345-192.168.201.143@tcp:104: Request processed in 160us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201559.465935:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 610 00010000:00010000:1.0:1788201559.466431:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201559.466439:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec50 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x19e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171095219 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.466454:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc15c12b200 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201559.466460:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171095219 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201559.466512:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x12e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201559.466523:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x12e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201559.466578:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec50 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x19e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171095219 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.466583:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201559.466609:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec50 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x19e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171095219 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.466615:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec50 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x19e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171095219 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.466626:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201559.466627:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201559.466628:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201559.469776:0:20877:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788201559.469823:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743445888 00000100:00100000:1.0:1788201559.469832:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743445888 00000100:00100000:1.0:1788201559.469883:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 611 00000100:00100000:1.0:1788201559.469892:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc15c0ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23418:x1875064743445888:12345-192.168.201.143@tcp:105: 00010000:00010000:1.0:1788201559.469906:0:20877:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6ec57 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095220 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.469919:0:20877:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6ec57 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095220 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.469927:0:20877:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6ec57 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095220 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.469937:0:20877:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6ec57 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171095220 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.469946:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6ec57 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171095220 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.469956:0:20877:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6ec57 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171095220 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.469983:0:20877:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc15c12ba00) 00000100:00100000:1.0:1788201559.470030:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc15c0ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23418:x1875064743445888:12345-192.168.201.143@tcp:105: Request processed in 139us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201559.470037:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 611 00000100:00100000:3.0:1788201559.488387:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727866496:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201559.492134:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec73 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.492162:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec73 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095274 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.492177:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec73 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095274 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.492188:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec73 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095274 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201559.492202:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec73 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095274 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201559.492212:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201559.492232:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec73 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171095274 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.492241:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec73 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171095274 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.492249:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec73 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171095274 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.492258:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec73 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171095274 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201559.492294:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727866496:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201559.497205:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201559.497215:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec73 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171095274 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201559.497227:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc15c12b200 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201559.497233:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6ec73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171095274 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201559.497619:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727866752:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201559.501446:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743446144 00000100:00100000:3.0:1788201559.501453:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743446144 00000100:00100000:3.0:1788201559.501539:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 613 00000100:00100000:3.0:1788201559.501550:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17270a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743446144:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201559.501562:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 5/0,1 mode: --/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.501573:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 5/0,1 mode: --/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.501582:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 5/0,1 mode: --/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.501592:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.501606:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.501614:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.501639:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc15c12b400) 00000100:00100000:3.0:1788201559.501716:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17270a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743446144:12345-192.168.201.143@tcp:105: Request processed in 169us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201559.501721:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 613 00010000:00010000:1.0:1788201559.501823:0:23731:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.501830:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.501852:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201559.501861:0:23731:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.501870:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.501876:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201559.501899:0:23731:0:(vvp_io.c:1292:vvp_io_write_start()) setup-nfs.sh: write [0, 1611) append 0 append lockpos 0 00000080:00200000:1.0:1788201559.501915:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 1611 bytes 00000080:00200000:1.0:1788201559.501977:0:23731:0:(rw26.c:898:ll_write_end()) pos 0, len 1611, copied 1611 00000080:00200000:1.0:1788201559.501989:0:23731:0:(rw26.c:956:ll_write_end()) page@000000001ec54dc0[3 00000000fe382fe4 2 1 00000000bab2d509 0 0 0] 00000080:00200000:1.0:1788201559.501993:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000009c8e53bd 17ffffc0001001 3:0 ffff8bc1474189a0 0 lru 00000080:00200000:1.0:1788201559.501999:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000097f818a0 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.502001:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000001ec54dc0 00000080:00200000:1.0:1788201559.502002:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201559.502006:0:23731:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 1611 prio 0 00000008:00010000:1.0:1788201559.502027:0:23731:0:(osc_cache.c:857:osc_extent_find()) ### extent: 000000003886946a ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201559.502052:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459f4cb8, count 1, dirtied 1 00000080:00200000:1.0:1788201559.502058:0:23731:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 1611 bytes, tot: 1611 00000080:00200000:1.0:1788201559.502061:0:23731:0:(vvp_io.c:1358:vvp_io_write_start()) setup-nfs.sh: write bytes 0, result: 1611 00000020:00010000:1.0:1788201559.502079:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc149844038 (ffff8bc146919758/0) at cl_lock_release():245 00000020:00010000:1.0:1788201559.502083:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149844038 (ffff8bc146919758/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.502086:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d1b0 (ffff8bc146919f38/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201559.502183:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.502195:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201559.502209:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149844038 (ffff8bc146919758/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201559.502213:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d1b0 (ffff8bc146919758/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201559.502222:0:23731:0:(vvp_io.c:533:vvp_io_advance()) advancing 1611 bytes 00000080:00200000:1.0:1788201559.502230:0:23731:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1788201559.502261:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x12f:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201559.502265:0:23731:0:(file.c:2238:ll_file_io_generic()) setup-nfs.sh: 2 io complete with rc: 0, result: 1611, restart: 0 00000080:00200000:1.0:1788201559.502273:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x12f:0x0] updating i_size 1611 i_blocks 1 00000080:00200000:1.0:1788201559.502868:0:23731:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 1611 00000080:00200008:1.0:1788201559.502927:0:23731:0:(file.c:479:ll_file_release()) START file setup-nfs.sh:[0x200000bd7:0x12f:0x0](ffff8bc1459f4b08), flags 100001 00000002:00100000:1.0:1788201559.502986:0:23731:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1726cdf80 x1875064727866368/t8589937134(8589937134) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201575 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201559.502999:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201559.503004:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172758380 x1875064727867008/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201559.503027:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172758380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727867008:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201559.503134:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.503406:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727866752:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201559.505274:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172758380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727867008:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201559.505304:0:23731:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1726cdf80 x1875064727866368/t8589937134(8589937134) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201575 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201559.505373:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.505392:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.505410:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.505423:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.505430:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.505436:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.505439:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.505445:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201559.505448:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.505457:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.505472:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.505478:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201559.505484:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.505488:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=setup-nfs.sh, flags=8 00000080:00200008:1.0:1788201559.505495:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file setup-nfs.sh:[0x200000bd7:0x12f:0x0](ffff8bc1459f4b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201559.505500:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x12f:0x0](ffff8bc1459f4b08),name=setup-nfs.sh 00000002:00010000:1.0:1788201559.505512:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x12f:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.505520:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a400/0xd138388016f6ec6c lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x12f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095266 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201559.505529:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a400/0xd138388016f6ec6c lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x12f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095266 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201559.505537:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.505541:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x12f:0x0](ffff8bc1459f4b08) 00000080:00010000:1.0:1788201559.505544:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x12f:0x0](ffff8bc1459f4b08) for lock 0xd138388016f6ec6c 00000080:00010000:1.0:1788201559.505547:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ec6c from it ffffadd1c7da3cb8 00010000:00010000:1.0:1788201559.505551:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a400/0xd138388016f6ec6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095266 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201559.505559:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a400/0xd138388016f6ec6c lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095266 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201559.505606:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x12f:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201559.505617:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x12f:0x0] 00000008:00010000:1.0:1788201559.505648:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201559.505652:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc142dec130, osc lock ffff8bc145d08130, flags 0x400001002 00010000:00010000:1.0:1788201559.505669:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.505680:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201559.505693:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201559.505697:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.505705:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201559.505715:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201559.505725:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x12f:0x0] updating i_size 1611 i_blocks 1 00000020:00010000:1.0:1788201559.505728:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e27530 (ffff8bc148e3b128/0) at cl_lock_release():245 00000020:00010000:1.0:1788201559.506016:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e27530 (ffff8bc148e3b128/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.506020:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc142dec130 (ffff8bc148e3be18/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.506025:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e27530 (ffff8bc148e3b128/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201559.506028:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc142dec130 (ffff8bc148e3b128/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201559.506057:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x12f:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201559.506111:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.506120:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.506128:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.506149:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.506157:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.506162:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.506165:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.506170:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201559.506173:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.506182:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.506192:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.506197:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201559.506201:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.506216:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sgpdd-survey.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=9 00000080:00200000:1.0:1788201559.506220:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sgpdd-survey.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:1.0:1788201559.506231:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sgpdd-survey.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201559.506274:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec81 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.506283:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec81 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.506293:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec81 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.506316:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172758e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727867136:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.506413:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.511334:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172758e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727867136:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201559.511360:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec81 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.511374:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec81 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.511384:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec81 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.511391:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec81 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.511400:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec81 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.511407:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bdc00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201559.511411:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec81 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.511419:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec81 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.511426:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec81 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.511432:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201559.511438:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec81 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.511444:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec81 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201559.511462:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc172758e00 x1875064727867136/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201575 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201559.511476:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201559.511499:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:1.0:1788201559.511564:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.511579:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.511588:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.511598:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.511604:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.511609:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.511613:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.511618:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201559.511622:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.511629:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.511646:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.511653:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201559.511658:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.511674:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sgpdd-survey.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=8 00000080:00200000:1.0:1788201559.511678:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sgpdd-survey.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:1.0:1788201559.511690:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sgpdd-survey.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201559.511730:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6ec88 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.511737:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6ec88 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.511758:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6ec88 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.511781:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172758e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727867264:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.511951:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.523208:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172758e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727867264:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201559.523232:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6ec88 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.523246:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6ec88 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.523253:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6ec88 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.523260:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6ec88 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.523270:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6ec88 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.523276:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bca00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201559.523281:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6ec88 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.523288:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6ec88 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.523296:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6ec88 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.523304:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201559.523311:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6ec88 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.523318:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6ec88 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201559.523336:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc172758e00 x1875064727867264/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201575 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201559.523351:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201559.523375:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:1.0:1788201559.523481:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.523497:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.523507:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.523519:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.523532:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.523539:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.523542:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.523548:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3bf8 00010000:00010000:1.0:1788201559.523552:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.523560:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.523576:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.523584:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201559.523590:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.523605:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.523609:0:23731:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sgpdd-survey.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), file ffff8bc153aa9e00, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:1.0:1788201559.523616:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sgpdd-survey.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000002:00010000:1.0:1788201559.523638:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sgpdd-survey.sh,[0x200000bd7:0x130:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201559.523705:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.523712:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201559.523724:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201559.523730:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172758e00 x1875064727867520/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201559.523738:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.523758:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172758e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727867520:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.523989:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.534725:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172758e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727867520:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201559.534756:0:23731:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710952c1 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.534807:0:23731:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x130:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710952c1 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.534818:0:23731:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710952c1 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.534828:0:23731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710952c1 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.534850:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710952c1 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.534865:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710952c1 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.534874:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710952c1 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.534881:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710952c1 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201559.534894:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc172758e00 x1875064727867520/t8589937136(8589937136) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201575 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201559.534908:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc172758e00 x1875064727867520/t8589937136(8589937136) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201575 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201559.534924:0:23731:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710952c1 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201559.534938:0:23731:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710952c1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.534949:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/304 (0 0) 00000080:00200000:1.0:1788201559.534956:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201559.534983:0:23731:0:(namei.c:1628:ll_create_it()) VFS Op:name=sgpdd-survey.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000080:00200000:1.0:1788201559.535017:0:23731:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x130:0x0](ffff8bc14465d348) 00000080:00200000:1.0:1788201559.535508:0:23731:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x130:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201559.535522:0:23731:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x130:0x0](ffff8bc14465d348) 00000080:00010000:1.0:1788201559.535525:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x130:0x0](ffff8bc14465d348) for lock 0xd138388016f6ec8f 00000080:00010000:1.0:1788201559.535536:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x130:0x0](ffff8bc14465d348) 00000080:00200008:1.0:1788201559.535551:0:23731:0:(file.c:1090:ll_file_open()) START file sgpdd-survey.sh:[0x200000bd7:0x130:0x0](ffff8bc14465d348), flags 100301 00000002:00100000:1.0:1788201559.535571:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc172758e00 x1875064727867520/t8589937136(8589937136) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201575 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201559.535611:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ec8f from it ffff8bc144cb5780 00010000:00010000:1.0:1788201559.535617:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710952c1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.535625:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710952c1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201559.535647:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x130:0x0](ffff8bc14465d348), inode mode 81a4 mask 40 00000080:00200008:1.0:1788201559.535672:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file sgpdd-survey.sh:[0x200000bd7:0x130:0x0](ffff8bc14465d348), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201559.535678:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x130:0x0](ffff8bc14465d348),name=sgpdd-survey.sh 00000002:00010000:1.0:1788201559.535695:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x130:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.535707:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710952c1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.535721:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710952c1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201559.535728:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.535732:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x130:0x0](ffff8bc14465d348) 00000080:00010000:1.0:1788201559.535735:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x130:0x0](ffff8bc14465d348) for lock 0xd138388016f6ec8f 00000080:00010000:1.0:1788201559.535738:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ec8f from it ffffadd1c7da3cd8 00010000:00010000:1.0:1788201559.535740:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710952c1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.535747:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710952c1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201559.535770:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x130:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201559.535788:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x130:0x0] 00000008:00010000:1.0:1788201559.536351:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201559.536356:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc14bb78fb0, osc lock ffff8bc145d08130, flags 0x400001002 00010000:00010000:1.0:1788201559.536404:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ec96 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.536415:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ec96 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201559.536457:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1788201559.536616:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17275a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727867648:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201559.545327:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ec96 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.545357:0:10054:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ec96 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710952cf expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.545372:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ec96 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710952cf expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.545385:0:10054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ec96 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710952cf expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201559.545402:0:10054:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ec96 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710952cf expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201559.545416:0:10054:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201559.545485:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ec96 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710952cf expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.545495:0:10054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ec96 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710952cf expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.545503:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ec96 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710952cf expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201559.545513:0:10054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ec96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e21710952cf expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201559.545536:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727867648:192.168.201.143@tcp:101:cp.0 00000080:00200000:1.0:1788201559.546394:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x130:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201559.546401:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e27530 (ffff8bc148e3b128/0) at cl_lock_release():245 00000020:00010000:1.0:1788201559.546405:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e27530 (ffff8bc148e3b128/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.546411:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc14bb78fb0 (ffff8bc148e3be18/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.546415:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e27530 (ffff8bc148e3b128/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201559.546418:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc14bb78fb0 (ffff8bc148e3b128/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201559.546459:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x130:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201559.546516:0:23731:0:(file.c:2638:do_file_write_iter()) START file sgpdd-survey.sh:[0x200000bd7:0x130:0x0], ppos: 0, count: 1765 00000080:00200000:1.0:1788201559.546529:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 1765 bytes 00000080:00200000:1.0:1788201559.546535:0:23731:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 1765 00000080:00200000:1.0:1788201559.546560:0:23731:0:(file.c:2090:ll_file_io_generic()) sgpdd-survey.sh: write ppos: 0, bytes: 1765 00000080:00200000:1.0:1788201559.546565:0:23731:0:(file.c:1848:ll_io_set_mirror()) sgpdd-survey.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201559.546571:0:23731:0:(cl_io.c:214:cl_io_rw_init()) header@00000000175fae3f[0x110, 1, [0x200000bd7:0x130:0x0] hash] 00000020:00200000:1.0:1788201559.546573:0:23731:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 1765) 0 0 00000080:00200000:1.0:1788201559.546577:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x130:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201559.546591:0:23731:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1788201559.546599:0:23731:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 1765) 1765, 1765 00020000:00200000:1.0:1788201559.546603:0:23731:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201559.546631:0:23731:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1788201559.546645:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201559.546649:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc14bb78fb0, osc lock ffff8bc145d08130, flags 0x0 00010000:00010000:1.0:1788201559.546666:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/415 (0 4095) 00010000:00010000:1.0:1788201559.546709:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.546718:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.546901:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.546928:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17275b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727867776:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.547100:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.551352:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743446272 00000100:00100000:1.0:1788201559.551362:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743446272 00000100:00100000:1.0:1788201559.551425:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 614 00000100:00100000:1.0:1788201559.551435:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17270b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23416:x1875064743446272:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201559.551454:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ec96 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x19f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710952cf expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.551555:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201559.551565:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17270b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23416:x1875064743446272:12345-192.168.201.143@tcp:104: Request processed in 129us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201559.551573:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 614 00010000:00010000:3.0:1788201559.551642:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201559.551650:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ec96 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x19f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710952cf expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201559.551663:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bca00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201559.551672:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ec96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e21710952cf expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201559.551752:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x130:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201559.551768:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x130:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201559.551875:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ec96 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x19f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710952cf expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201559.551884:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201559.551910:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ec96 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x19f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710952cf expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201559.551920:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ec96 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x19f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710952cf expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201559.551939:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201559.551941:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201559.551943:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201559.551967:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201559.551987:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727867904:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201559.555905:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201559.556011:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743446400 00000100:00100000:1.0:1788201559.556023:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743446400 00000100:00100000:1.0:1788201559.556072:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 615 00000100:00100000:1.0:1788201559.556082:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc151ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21004:x1875064743446400:12345-192.168.201.143@tcp:105: 00010000:00010000:1.0:1788201559.556102:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.556115:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.556124:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.556134:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.556161:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.556172:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.556189:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1460bc800) 00000100:00100000:1.0:1788201559.556260:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc151ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21004:x1875064743446400:12345-192.168.201.143@tcp:105: Request processed in 178us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201559.556268:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 615 00000100:00100000:1.0:1788201559.562245:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727867776:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201559.562276:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.562298:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201559.562311:0:23731:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.562321:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.562327:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201559.562356:0:23731:0:(vvp_io.c:1292:vvp_io_write_start()) sgpdd-survey.sh: write [0, 1765) append 0 append lockpos 0 00000080:00200000:1.0:1788201559.562373:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 1765 bytes 00000080:00200000:1.0:1788201559.562429:0:23731:0:(rw26.c:898:ll_write_end()) pos 0, len 1765, copied 1765 00000080:00200000:1.0:1788201559.562441:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000a6e62bbb[3 000000002f2ca9b7 2 1 000000000235009b 0 0 0] 00000080:00200000:1.0:1788201559.562444:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000eec2bbeb 17ffffc0001001 3:0 ffff8bc147418ee0 0 lru 00000080:00200000:1.0:1788201559.562450:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000d18c8c75 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 00000000f549e6dd > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.562452:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000a6e62bbb 00000080:00200000:1.0:1788201559.562453:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201559.562456:0:23731:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 1765 prio 0 00000008:00010000:1.0:1788201559.562475:0:23731:0:(osc_cache.c:857:osc_extent_find()) ### extent: 0000000022ba4270 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201559.562491:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc14465d4f8, count 1, dirtied 1 00000080:00200000:1.0:1788201559.562496:0:23731:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 1765 bytes, tot: 1765 00000080:00200000:1.0:1788201559.562498:0:23731:0:(vvp_io.c:1358:vvp_io_write_start()) sgpdd-survey.sh: write bytes 0, result: 1765 00000020:00010000:1.0:1788201559.562512:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c4128 (ffff8bc148e3b128/0) at cl_lock_release():245 00000020:00010000:1.0:1788201559.562514:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c4128 (ffff8bc148e3b128/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.562517:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc14bb78fb0 (ffff8bc148e3be18/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201559.562520:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.562527:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201559.562539:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c4128 (ffff8bc148e3b128/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201559.562541:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc14bb78fb0 (ffff8bc148e3b128/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201559.562547:0:23731:0:(vvp_io.c:533:vvp_io_advance()) advancing 1765 bytes 00000080:00200000:1.0:1788201559.562553:0:23731:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1788201559.562578:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x130:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201559.562581:0:23731:0:(file.c:2238:ll_file_io_generic()) sgpdd-survey.sh: 2 io complete with rc: 0, result: 1765, restart: 0 00000080:00200000:1.0:1788201559.562587:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x130:0x0] updating i_size 1765 i_blocks 1 00000080:00200000:1.0:1788201559.562591:0:23731:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 1765 00000080:00200008:1.0:1788201559.562627:0:23731:0:(file.c:479:ll_file_release()) START file sgpdd-survey.sh:[0x200000bd7:0x130:0x0](ffff8bc14465d348), flags 100001 00000002:00100000:1.0:1788201559.562676:0:23731:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc172758e00 x1875064727867520/t8589937136(8589937136) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201575 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201559.562688:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201559.562693:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc17275b100 x1875064727868160/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201559.562715:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17275b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727868160:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201559.562851:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201559.564018:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727867904:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201559.567331:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727868160:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201559.567366:0:23731:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc172758e00 x1875064727867520/t8589937136(8589937136) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201575 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201559.567446:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.567466:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.567486:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.567501:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.567509:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.567515:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.567519:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.567528:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201559.567532:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.567541:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.567560:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.567567:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201559.567574:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.567578:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sgpdd-survey.sh, flags=8 00000080:00200008:1.0:1788201559.568362:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file sgpdd-survey.sh:[0x200000bd7:0x130:0x0](ffff8bc14465d348), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201559.568370:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x130:0x0](ffff8bc14465d348),name=sgpdd-survey.sh 00000002:00010000:1.0:1788201559.568385:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x130:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.568402:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710952c1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201559.568410:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710952c1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201559.568415:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.568420:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x130:0x0](ffff8bc14465d348) 00000080:00010000:1.0:1788201559.568422:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x130:0x0](ffff8bc14465d348) for lock 0xd138388016f6ec8f 00000080:00010000:1.0:1788201559.568426:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ec8f from it ffffadd1c7da3cb8 00010000:00010000:1.0:1788201559.568428:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710952c1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201559.568435:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710952c1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201559.568479:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x130:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201559.568487:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x130:0x0] 00000008:00010000:1.0:1788201559.568512:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201559.568515:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc144a94c30, osc lock ffff8bc145d08130, flags 0x400001002 00010000:00010000:1.0:1788201559.568529:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.568536:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201559.568546:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201559.568548:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.568554:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201559.568560:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201559.568569:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x130:0x0] updating i_size 1765 i_blocks 1 00000020:00010000:1.0:1788201559.568571:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e27530 (ffff8bc148e3b128/0) at cl_lock_release():245 00000020:00010000:1.0:1788201559.568573:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e27530 (ffff8bc148e3b128/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.568575:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc144a94c30 (ffff8bc148e3be18/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.568578:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e27530 (ffff8bc148e3b128/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201559.568580:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc144a94c30 (ffff8bc148e3b128/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201559.568603:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x130:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201559.568649:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.568654:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.568659:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.568665:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.568669:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.568671:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.568673:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.568675:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201559.568677:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.568682:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.568687:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.568690:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201559.568692:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.568702:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=test-framework.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=9 00000080:00200000:1.0:1788201559.568705:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=test-framework.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:1.0:1788201559.568712:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: test-framework.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201559.568761:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6eca4 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.568767:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6eca4 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.568778:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6eca4 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.568823:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172758000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727868288:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.568920:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.575285:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172758000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727868288:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201559.575311:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6eca4 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.575325:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6eca4 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.575670:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6eca4 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.575680:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6eca4 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.575689:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6eca4 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.575695:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bca00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201559.575700:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6eca4 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.575706:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6eca4 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.575713:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6eca4 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.575721:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201559.575728:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6eca4 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.576020:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bca00/0xd138388016f6eca4 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201559.576042:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc172758000 x1875064727868288/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201575 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201559.576057:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201559.576089:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:1.0:1788201559.576226:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.576244:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.576255:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.576266:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.576273:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.576279:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.576282:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.576288:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201559.576292:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.576299:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.576315:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.576323:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201559.576329:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.576344:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=test-framework.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=8 00000080:00200000:1.0:1788201559.576348:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=test-framework.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:1.0:1788201559.576360:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: test-framework.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201559.576469:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ecab lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.576477:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ecab lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.576488:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ecab lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.576509:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172758000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727868416:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.576669:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.580351:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172758000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727868416:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201559.580374:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ecab lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.580387:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ecab lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.580404:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ecab lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.580413:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ecab lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.580423:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ecab lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.580429:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bd000 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201559.580433:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ecab lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.580440:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ecab lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.580446:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ecab lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.580453:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201559.580459:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ecab lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.580465:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ecab lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201559.580485:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc172758000 x1875064727868416/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201575 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201559.580500:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201559.580524:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:1.0:1788201559.580635:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.580649:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.580657:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.580669:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.580673:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.580677:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.580680:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.580684:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3bf8 00010000:00010000:1.0:1788201559.580686:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.580691:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.580703:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.580708:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201559.580713:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.580722:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.580726:0:23731:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=test-framework.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), file ffff8bc153aa9e00, open_flags 80c1, mode 81ed opened 0 00000080:00200000:1.0:1788201559.580742:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=test-framework.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000002:00010000:1.0:1788201559.580761:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: test-framework.sh,[0x200000bd7:0x131:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201559.580850:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.580858:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201559.580870:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201559.580877:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172758000 x1875064727868672/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201559.580887:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.580907:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172758000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727868672:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.581075:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.592347:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172758000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727868672:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201559.592378:0:23731:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109531c expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.592406:0:23731:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x131:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109531c expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.592415:0:23731:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109531c expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.592428:0:23731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109531c expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.592439:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109531c expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.592454:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109531c expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.592463:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109531c expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.592475:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109531c expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201559.592487:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc172758000 x1875064727868672/t8589937138(8589937138) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201575 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201559.592502:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc172758000 x1875064727868672/t8589937138(8589937138) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201575 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201559.592518:0:23731:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109531c expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201559.592531:0:23731:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109531c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.592542:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/305 (0 0) 00000080:00200000:1.0:1788201559.592549:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201559.592565:0:23731:0:(namei.c:1628:ll_create_it()) VFS Op:name=test-framework.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000080:00200000:1.0:1788201559.592598:0:23731:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x131:0x0](ffff8bc14465aa08) 00000080:00200000:1.0:1788201559.592726:0:23731:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x131:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201559.592738:0:23731:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x131:0x0](ffff8bc14465aa08) 00000080:00010000:1.0:1788201559.592742:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x131:0x0](ffff8bc14465aa08) for lock 0xd138388016f6ecb2 00000080:00010000:1.0:1788201559.592751:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x131:0x0](ffff8bc14465aa08) 00000080:00200008:1.0:1788201559.592766:0:23731:0:(file.c:1090:ll_file_open()) START file test-framework.sh:[0x200000bd7:0x131:0x0](ffff8bc14465aa08), flags 100301 00000002:00100000:1.0:1788201559.592784:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc172758000 x1875064727868672/t8589937138(8589937138) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201575 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201559.592844:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ecb2 from it ffff8bc144cb5780 00010000:00010000:1.0:1788201559.592849:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109531c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.592858:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109531c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201559.592883:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x131:0x0](ffff8bc14465aa08), inode mode 81ed mask 40 00000080:00200008:1.0:1788201559.592907:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file test-framework.sh:[0x200000bd7:0x131:0x0](ffff8bc14465aa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201559.592914:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x131:0x0](ffff8bc14465aa08),name=test-framework.sh 00000002:00010000:1.0:1788201559.592932:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x131:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.592942:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109531c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.592954:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109531c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201559.592972:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.592977:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x131:0x0](ffff8bc14465aa08) 00000080:00010000:1.0:1788201559.592981:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x131:0x0](ffff8bc14465aa08) for lock 0xd138388016f6ecb2 00000080:00010000:1.0:1788201559.592985:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ecb2 from it ffffadd1c7da3cd8 00010000:00010000:1.0:1788201559.592988:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109531c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.592996:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109531c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201559.593021:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x131:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201559.593032:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x131:0x0] 00000008:00010000:1.0:1788201559.593059:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201559.593063:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc14bb78fb0, osc lock ffff8bc145d08130, flags 0x400001002 00010000:00010000:1.0:1788201559.593111:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8c7a9dd/0xd138388016f6ecb9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.593121:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8c7a9dd/0xd138388016f6ecb9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201559.593172:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:1.0:1788201559.604766:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x131:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201559.604773:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e27530 (ffff8bc148e3b128/0) at cl_lock_release():245 00000020:00010000:1.0:1788201559.604776:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e27530 (ffff8bc148e3b128/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.604783:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc14bb78fb0 (ffff8bc148e3be18/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.604788:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e27530 (ffff8bc148e3b128/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201559.604832:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc14bb78fb0 (ffff8bc148e3b128/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201559.604883:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x131:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201559.605816:0:23731:0:(file.c:2638:do_file_write_iter()) START file test-framework.sh:[0x200000bd7:0x131:0x0], ppos: 0, count: 317150 00000080:00200000:1.0:1788201559.606002:0:23731:0:(file.c:2090:ll_file_io_generic()) test-framework.sh: write ppos: 0, bytes: 317150 00000080:00200000:1.0:1788201559.606009:0:23731:0:(file.c:1848:ll_io_set_mirror()) test-framework.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201559.606017:0:23731:0:(cl_io.c:214:cl_io_rw_init()) header@0000000056c199c3[0x110, 1, [0x200000bd7:0x131:0x0] hash] 00000020:00200000:1.0:1788201559.606019:0:23731:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 317150) 0 0 00000080:00200000:1.0:1788201559.606025:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x131:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201559.606039:0:23731:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 77] 00020000:00200000:1.0:1788201559.606048:0:23731:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 317150) 317150, 317150 00020000:00200000:1.0:1788201559.606053:0:23731:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201559.606083:0:23731:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 77] 00000008:00010000:1.0:1788201559.606097:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201559.606102:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc14bb78fb0, osc lock ffff8bc145d08130, flags 0x0 00010000:00010000:1.0:1788201559.606120:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/415 (0 319487) 00010000:00010000:1.0:1788201559.606529:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.606543:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 3 type: EXT [0->319487] (req 0->319487) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.606554:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 3 type: EXT [0->319487] (req 0->319487) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.606582:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17275a680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727868928:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.606687:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc4480 going to sleep for 11 seconds 00010000:00010000:3.0:1788201559.611999:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201559.612007:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8c7a9dd/0xd138388016f6ecb9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109532a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201559.612017:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bd000 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201559.612023:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8c7a9dd/0xd138388016f6ecb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e217109532a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201559.612084:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x131:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201559.612109:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x131:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201559.612187:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8c7a9dd/0xd138388016f6ecb9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109532a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201559.612195:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201559.612217:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8c7a9dd/0xd138388016f6ecb9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x19f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109532a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201559.612225:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8c7a9dd/0xd138388016f6ecb9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109532a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201559.612239:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201559.612241:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201559.612243:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201559.612251:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201559.612265:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727869056:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201559.617227:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201559.618952:0:21781:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788201559.619003:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743446656 00000100:00100000:1.0:1788201559.619011:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743446656 00000100:00100000:1.0:1788201559.619067:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 617 00000100:00100000:1.0:1788201559.619077:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc149fa7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23418:x1875064743446656:12345-192.168.201.143@tcp:105: 00010000:00010000:1.0:1788201559.619105:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->319487] (req 0->319487) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.619118:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->319487] (req 0->319487) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.619127:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.619457:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.619475:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.619485:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.619502:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1460bca00) 00000100:00100000:1.0:1788201559.619578:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc149fa7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23418:x1875064743446656:12345-192.168.201.143@tcp:105: Request processed in 502us (2394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201559.619587:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 617 00000100:00100000:1.0:1788201559.619676:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275a680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727868928:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201559.619693:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.619709:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201559.619720:0:23731:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.619935:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.619965:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201559.620010:0:23731:0:(vvp_io.c:1292:vvp_io_write_start()) test-framework.sh: write [0, 317150) append 0 append lockpos 0 00000080:00200000:1.0:1788201559.620031:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.620479:0:23731:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:1.0:1788201559.620502:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000044a3c580[3 00000000048617aa 2 1 000000000235009b 0 0 0] 00000080:00200000:1.0:1788201559.620506:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000000b79ff6e 17ffffc0001001 3:0 ffff8bc147418e00 0 lru 00000080:00200000:1.0:1788201559.620513:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000726af7e2 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.620526:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000044a3c580 00000080:00200000:1.0:1788201559.620528:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201559.620532:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.620578:0:23731:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:1.0:1788201559.620583:0:23731:0:(rw26.c:956:ll_write_end()) page@000000004d18e611[3 00000000048617aa 2 1 000000000235009b 0 0 1] 00000080:00200000:1.0:1788201559.620586:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000afeb4d52 17ffffc0001001 3:0 ffff8bc1474188c0 1 lru 00000080:00200000:1.0:1788201559.620592:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000090724fc0 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.620594:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000004d18e611 00000080:00200000:1.0:1788201559.620595:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:1.0:1788201559.620597:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.620614:0:23731:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:1.0:1788201559.620618:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000adcbceb3[3 00000000048617aa 2 1 000000000235009b 0 0 2] 00000080:00200000:1.0:1788201559.620621:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000b646f799 17ffffc0001001 3:0 ffff8bc147418540 2 lru 00000080:00200000:1.0:1788201559.620627:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000ada99ecf 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.620628:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000adcbceb3 00000080:00200000:1.0:1788201559.620630:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:1.0:1788201559.620632:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.620649:0:23731:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:1.0:1788201559.620653:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000c47db777[3 00000000048617aa 2 1 000000000235009b 0 0 3] 00000080:00200000:1.0:1788201559.620655:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000aac53cc1 17ffffc0001001 3:0 ffff8bc147418a80 3 lru 00000080:00200000:1.0:1788201559.620660:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000733a0a3f 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.620662:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000c47db777 00000080:00200000:1.0:1788201559.620663:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:1.0:1788201559.620665:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.620681:0:23731:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:1.0:1788201559.620685:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000c326e3b9[3 00000000048617aa 2 1 000000000235009b 0 0 4] 00000080:00200000:1.0:1788201559.620688:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000b14e2dbb 17ffffc0001001 3:0 ffff8bc147418c40 4 lru 00000080:00200000:1.0:1788201559.620693:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b08bc452 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.620695:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000c326e3b9 00000080:00200000:1.0:1788201559.620696:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:1.0:1788201559.620698:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.620713:0:23731:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:1.0:1788201559.620717:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000afa04f4a[3 00000000048617aa 2 1 000000000235009b 0 0 5] 00000080:00200000:1.0:1788201559.620720:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000e0db0023 17ffffc0001001 3:0 ffff8bc147418620 5 lru 00000080:00200000:1.0:1788201559.620725:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000e9a30b4a 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.620727:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000afa04f4a 00000080:00200000:1.0:1788201559.620728:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:1.0:1788201559.620730:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000100:00100000:3.0:1788201559.623378:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727869056:192.168.201.143@tcp:103:ldlm_bl.0 00000080:00200000:1.0:1788201559.623605:0:23731:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:1.0:1788201559.623617:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000044665f3a[3 00000000048617aa 2 1 000000000235009b 0 0 6] 00000080:00200000:1.0:1788201559.623620:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000274f40e9 17ffffc0001001 3:0 ffff8bc1474187e0 6 lru 00000080:00200000:1.0:1788201559.623627:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000550c1566 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.623630:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000044665f3a 00000080:00200000:1.0:1788201559.623631:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:1.0:1788201559.623635:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.623652:0:23731:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:1.0:1788201559.623657:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000033d49d74[3 00000000048617aa 2 1 000000000235009b 0 0 7] 00000080:00200000:1.0:1788201559.623660:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000ac18dcf2 17ffffc0001001 3:0 ffff8bc147418700 7 lru 00000080:00200000:1.0:1788201559.623664:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000005ad40686 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.623667:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000033d49d74 00000080:00200000:1.0:1788201559.623668:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:1.0:1788201559.623670:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.623685:0:23731:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:1.0:1788201559.623690:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000e7e1b172[3 00000000048617aa 2 1 000000000235009b 0 0 8] 00000080:00200000:1.0:1788201559.623692:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000006416e318 17ffffc0001001 3:0 ffff8bc147418b60 8 lru 00000080:00200000:1.0:1788201559.623698:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000476eb4cf 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.623700:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000e7e1b172 00000080:00200000:1.0:1788201559.623701:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:1.0:1788201559.623703:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.623717:0:23731:0:(rw26.c:898:ll_write_end()) pos 36864, len 4096, copied 4096 00000080:00200000:1.0:1788201559.623721:0:23731:0:(rw26.c:956:ll_write_end()) page@000000009a34ddec[3 00000000048617aa 2 1 000000000235009b 0 0 9] 00000080:00200000:1.0:1788201559.623723:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000b74e9523 17ffffc0001001 3:0 ffff8bc1474182a0 9 lru 00000080:00200000:1.0:1788201559.623727:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000c7741ec4 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.624152:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000009a34ddec 00000080:00200000:1.0:1788201559.624155:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:1.0:1788201559.624158:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 10 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.624182:0:23731:0:(rw26.c:898:ll_write_end()) pos 40960, len 4096, copied 4096 00000080:00200000:1.0:1788201559.624187:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000f65f25a3[3 00000000048617aa 2 1 000000000235009b 0 0 10] 00000080:00200000:1.0:1788201559.624190:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000906295f0 17ffffc0001001 3:0 ffff8bc147418460 10 lru 00000080:00200000:1.0:1788201559.624195:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000d8a2ec70 10: 1< 0 - - > 2< 40960 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.624197:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000f65f25a3 00000080:00200000:1.0:1788201559.624198:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 11. 00000080:00200000:1.0:1788201559.624200:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 11 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.624226:0:23731:0:(rw26.c:898:ll_write_end()) pos 45056, len 4096, copied 4096 00000080:00200000:1.0:1788201559.624230:0:23731:0:(rw26.c:956:ll_write_end()) page@000000007924fd63[3 00000000048617aa 2 1 000000000235009b 0 0 11] 00000080:00200000:1.0:1788201559.624233:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000004e032cbb 17ffffc0001021 2:0 ffff8bc1506b38c0 11 lru 00000080:00200000:1.0:1788201559.624238:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000bac22446 11: 1< 0 - - > 2< 45056 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.624240:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000007924fd63 00000080:00200000:1.0:1788201559.624241:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 12. 00000080:00200000:1.0:1788201559.624243:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 12 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.624259:0:23731:0:(rw26.c:898:ll_write_end()) pos 49152, len 4096, copied 4096 00000080:00200000:1.0:1788201559.624263:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000fa03972b[3 00000000048617aa 2 1 000000000235009b 0 0 12] 00000080:00200000:1.0:1788201559.624266:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000bcec9b5c 17ffffc0001001 3:0 ffff8bc1506b3540 12 lru 00000080:00200000:1.0:1788201559.624271:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000905e9bfe 12: 1< 0 - - > 2< 49152 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.624273:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000fa03972b 00000080:00200000:1.0:1788201559.624274:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 13. 00000080:00200000:1.0:1788201559.624287:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 13 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.624302:0:23731:0:(rw26.c:898:ll_write_end()) pos 53248, len 4096, copied 4096 00000080:00200000:1.0:1788201559.624307:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000a438f740[3 00000000048617aa 2 1 000000000235009b 0 0 13] 00000080:00200000:1.0:1788201559.624309:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000016c14ee 17ffffc0001001 3:0 ffff8bc1506b3a80 13 lru 00000080:00200000:1.0:1788201559.624314:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000022fcf13 13: 1< 0 - - > 2< 53248 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.624316:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000a438f740 00000080:00200000:1.0:1788201559.624317:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 14. 00000080:00200000:1.0:1788201559.624319:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 14 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.624333:0:23731:0:(rw26.c:898:ll_write_end()) pos 57344, len 4096, copied 4096 00000080:00200000:1.0:1788201559.624337:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000051cf82d4[3 00000000048617aa 2 1 000000000235009b 0 0 14] 00000080:00200000:1.0:1788201559.624340:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000032b77fe7 17ffffc0001001 3:0 ffff8bc1506b3c40 14 lru 00000080:00200000:1.0:1788201559.624345:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000ac1d81ce 14: 1< 0 - - > 2< 57344 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.624347:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000051cf82d4 00000080:00200000:1.0:1788201559.624348:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 15. 00000080:00200000:1.0:1788201559.624350:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 15 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.624363:0:23731:0:(rw26.c:898:ll_write_end()) pos 61440, len 4096, copied 4096 00000080:00200000:1.0:1788201559.624367:0:23731:0:(rw26.c:956:ll_write_end()) page@000000002469d46e[3 00000000048617aa 2 1 000000000235009b 0 0 15] 00000080:00200000:1.0:1788201559.624370:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000dce6c3df 17ffffc0001001 3:0 ffff8bc1506b39a0 15 lru 00000080:00200000:1.0:1788201559.624375:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000ef7c36f1 15: 1< 0 - - > 2< 61440 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.624377:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000002469d46e 00000080:00200000:1.0:1788201559.624378:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 16. 00000080:00200000:1.0:1788201559.624380:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 16 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.624395:0:23731:0:(rw26.c:898:ll_write_end()) pos 65536, len 4096, copied 4096 00000080:00200000:1.0:1788201559.624400:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000186e9d3d[3 00000000048617aa 2 1 000000000235009b 0 0 16] 00000080:00200000:1.0:1788201559.624402:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000006641bb51 17ffffc0001001 3:0 ffff8bc1506b30e0 16 lru 00000080:00200000:1.0:1788201559.624407:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000062a244d4 16: 1< 0 - - > 2< 65536 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.624410:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000186e9d3d 00000080:00200000:1.0:1788201559.624410:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 17. 00000080:00200000:1.0:1788201559.624413:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 17 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.624429:0:23731:0:(rw26.c:898:ll_write_end()) pos 69632, len 4096, copied 4096 00000080:00200000:1.0:1788201559.624433:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000049e9e29f[3 00000000048617aa 2 1 000000000235009b 0 0 17] 00000080:00200000:1.0:1788201559.624436:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000f1a73023 17ffffc0001001 3:0 ffff8bc1506b31c0 17 lru 00000080:00200000:1.0:1788201559.624443:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000041a620ac 17: 1< 0 - - > 2< 69632 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.624445:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000049e9e29f 00000080:00200000:1.0:1788201559.624446:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 18. 00000080:00200000:1.0:1788201559.624448:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 18 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.624464:0:23731:0:(rw26.c:898:ll_write_end()) pos 73728, len 4096, copied 4096 00000080:00200000:1.0:1788201559.624468:0:23731:0:(rw26.c:956:ll_write_end()) page@000000007d2a916e[3 00000000048617aa 2 1 000000000235009b 0 0 18] 00000080:00200000:1.0:1788201559.624471:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000f02003b4 17ffffc0001001 3:0 ffff8bc1506b3380 18 lru 00000080:00200000:1.0:1788201559.624476:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000f09b96ea 18: 1< 0 - - > 2< 73728 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.624479:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000007d2a916e 00000080:00200000:1.0:1788201559.624480:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 19. 00000080:00200000:1.0:1788201559.624482:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 19 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.624497:0:23731:0:(rw26.c:898:ll_write_end()) pos 77824, len 4096, copied 4096 00000080:00200000:1.0:1788201559.624501:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000e310a5f4[3 00000000048617aa 2 1 000000000235009b 0 0 19] 00000080:00200000:1.0:1788201559.624503:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000003b148947 17ffffc0001001 3:0 ffff8bc1506b3000 19 lru 00000080:00200000:1.0:1788201559.624509:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000e88d3623 19: 1< 0 - - > 2< 77824 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.624511:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000e310a5f4 00000080:00200000:1.0:1788201559.624512:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 20. 00000080:00200000:1.0:1788201559.624514:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 20 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.624528:0:23731:0:(rw26.c:898:ll_write_end()) pos 81920, len 4096, copied 4096 00000080:00200000:1.0:1788201559.624532:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000930bf6b8[3 00000000048617aa 2 1 000000000235009b 0 0 20] 00000080:00200000:1.0:1788201559.624535:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000a36d48a6 17ffffc0001001 3:0 ffff8bc1506b3d20 20 lru 00000080:00200000:1.0:1788201559.624540:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000007ab8f9fb 20: 1< 0 - - > 2< 81920 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.624542:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000930bf6b8 00000080:00200000:1.0:1788201559.624544:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 21. 00000080:00200000:1.0:1788201559.624545:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 21 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.624559:0:23731:0:(rw26.c:898:ll_write_end()) pos 86016, len 4096, copied 4096 00000080:00200000:1.0:1788201559.624564:0:23731:0:(rw26.c:956:ll_write_end()) page@000000006d655b4a[3 00000000048617aa 2 1 000000000235009b 0 0 21] 00000080:00200000:1.0:1788201559.624567:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000bed9e1b6 17ffffc0001001 3:0 ffff8bc1506b3460 21 lru 00000080:00200000:1.0:1788201559.624572:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000000074e965 21: 1< 0 - - > 2< 86016 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.624574:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000006d655b4a 00000080:00200000:1.0:1788201559.624575:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 22. 00000080:00200000:1.0:1788201559.624577:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 22 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.624591:0:23731:0:(rw26.c:898:ll_write_end()) pos 90112, len 4096, copied 4096 00000080:00200000:1.0:1788201559.624596:0:23731:0:(rw26.c:956:ll_write_end()) page@000000005a4f37b0[3 00000000048617aa 2 1 000000000235009b 0 0 22] 00000080:00200000:1.0:1788201559.624599:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000076c7e48b 17ffffc0001001 3:0 ffff8bc1506b32a0 22 lru 00000080:00200000:1.0:1788201559.624605:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000a8742f6e 22: 1< 0 - - > 2< 90112 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.624607:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000005a4f37b0 00000080:00200000:1.0:1788201559.624608:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 23. 00000080:00200000:1.0:1788201559.624609:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 23 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.624622:0:23731:0:(rw26.c:898:ll_write_end()) pos 94208, len 4096, copied 4096 00000080:00200000:1.0:1788201559.624627:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000083416958[3 00000000048617aa 2 1 000000000235009b 0 0 23] 00000080:00200000:1.0:1788201559.624630:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000008b970a50 17ffffc0001001 3:0 ffff8bc1506b3b60 23 lru 00000080:00200000:1.0:1788201559.624635:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000d4377136 23: 1< 0 - - > 2< 94208 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.624637:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000083416958 00000080:00200000:1.0:1788201559.624638:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 24. 00000080:00200000:1.0:1788201559.624639:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 24 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.624655:0:23731:0:(rw26.c:898:ll_write_end()) pos 98304, len 4096, copied 4096 00000080:00200000:1.0:1788201559.624659:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000b939155f[3 00000000048617aa 2 1 000000000235009b 0 0 24] 00000080:00200000:1.0:1788201559.624661:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000006ec08242 17ffffc0001001 3:0 ffff8bc1506b3700 24 lru 00000080:00200000:1.0:1788201559.624665:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000007dc81fd0 24: 1< 0 - - > 2< 98304 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.624667:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000b939155f 00000080:00200000:1.0:1788201559.624668:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 25. 00000080:00200000:1.0:1788201559.624669:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 25 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.624681:0:23731:0:(rw26.c:898:ll_write_end()) pos 102400, len 4096, copied 4096 00000080:00200000:1.0:1788201559.624686:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000037a95e99[3 00000000048617aa 2 1 000000000235009b 0 0 25] 00000080:00200000:1.0:1788201559.624688:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000001d43653f 17ffffc0001001 3:0 ffff8bc1506b37e0 25 lru 00000080:00200000:1.0:1788201559.624693:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b0629ac6 25: 1< 0 - - > 2< 102400 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.624695:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000037a95e99 00000080:00200000:1.0:1788201559.624695:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 26. 00000080:00200000:1.0:1788201559.624697:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 26 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.624714:0:23731:0:(rw26.c:898:ll_write_end()) pos 106496, len 4096, copied 4096 00000080:00200000:1.0:1788201559.624719:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000a59edefa[3 00000000048617aa 2 1 000000000235009b 0 0 26] 00000080:00200000:1.0:1788201559.624722:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000da0d238d 17ffffc0001021 2:0 ffff8bc1506b3620 26 lru 00000080:00200000:1.0:1788201559.624727:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b014317e 26: 1< 0 - - > 2< 106496 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.624746:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000a59edefa 00000080:00200000:1.0:1788201559.624748:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 27. 00000080:00200000:1.0:1788201559.624750:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 27 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.624765:0:23731:0:(rw26.c:898:ll_write_end()) pos 110592, len 4096, copied 4096 00000080:00200000:1.0:1788201559.624770:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000ad7c38e5[3 00000000048617aa 2 1 000000000235009b 0 0 27] 00000080:00200000:1.0:1788201559.624772:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000871cf9e2 17ffffc0001001 3:0 ffff8bc1506b3ee0 27 lru 00000080:00200000:1.0:1788201559.624777:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000a59ab763 27: 1< 0 - - > 2< 110592 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.624780:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000ad7c38e5 00000080:00200000:1.0:1788201559.624781:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 28. 00000080:00200000:1.0:1788201559.624783:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 28 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.624826:0:23731:0:(rw26.c:898:ll_write_end()) pos 114688, len 4096, copied 4096 00000080:00200000:1.0:1788201559.624830:0:23731:0:(rw26.c:956:ll_write_end()) page@000000000964670e[3 00000000048617aa 2 1 000000000235009b 0 0 28] 00000080:00200000:1.0:1788201559.624833:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000008f8a6c12 17ffffc0001001 3:0 ffff8bc1506b3e00 28 lru 00000080:00200000:1.0:1788201559.624838:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000005c7ac1cf 28: 1< 0 - - > 2< 114688 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.624840:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000000964670e 00000080:00200000:1.0:1788201559.624841:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 29. 00000080:00200000:1.0:1788201559.624843:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 29 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.624858:0:23731:0:(rw26.c:898:ll_write_end()) pos 118784, len 4096, copied 4096 00000080:00200000:1.0:1788201559.624863:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000d12960cb[3 00000000048617aa 2 1 000000000235009b 0 0 29] 00000080:00200000:1.0:1788201559.624866:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000cccbe809 17ffffc0001001 3:0 ffff8bc146c50c40 29 lru 00000080:00200000:1.0:1788201559.624871:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000f825f803 29: 1< 0 - - > 2< 118784 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.624873:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000d12960cb 00000080:00200000:1.0:1788201559.624875:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 30. 00000080:00200000:1.0:1788201559.624877:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 30 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.624893:0:23731:0:(rw26.c:898:ll_write_end()) pos 122880, len 4096, copied 4096 00000080:00200000:1.0:1788201559.624897:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000086c2102b[3 00000000048617aa 2 1 000000000235009b 0 0 30] 00000080:00200000:1.0:1788201559.624900:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000056ccd3be 17ffffc0001001 3:0 ffff8bc146c509a0 30 lru 00000080:00200000:1.0:1788201559.624905:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000009200733c 30: 1< 0 - - > 2< 122880 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.624907:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000086c2102b 00000080:00200000:1.0:1788201559.624908:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 31. 00000080:00200000:1.0:1788201559.624910:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 31 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.624927:0:23731:0:(rw26.c:898:ll_write_end()) pos 126976, len 4096, copied 4096 00000080:00200000:1.0:1788201559.624932:0:23731:0:(rw26.c:956:ll_write_end()) page@000000005c6cce63[3 00000000048617aa 2 1 000000000235009b 0 0 31] 00000080:00200000:1.0:1788201559.624934:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000053d007e5 17ffffc0001001 3:0 ffff8bc146c500e0 31 lru 00000080:00200000:1.0:1788201559.624940:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000003c3bdc5b 31: 1< 0 - - > 2< 126976 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.624942:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000005c6cce63 00000080:00200000:1.0:1788201559.624943:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 32. 00000080:00200000:1.0:1788201559.624944:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 32 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.624968:0:23731:0:(rw26.c:898:ll_write_end()) pos 131072, len 4096, copied 4096 00000080:00200000:1.0:1788201559.624973:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000b01f9ba6[3 00000000048617aa 2 1 000000000235009b 0 0 32] 00000080:00200000:1.0:1788201559.624976:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000c09b86cd 17ffffc0001001 3:0 ffff8bc146c501c0 32 lru 00000080:00200000:1.0:1788201559.624982:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b271fb2b 32: 1< 0 - - > 2< 131072 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.624984:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000b01f9ba6 00000080:00200000:1.0:1788201559.624985:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 33. 00000080:00200000:1.0:1788201559.624987:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 33 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625007:0:23731:0:(rw26.c:898:ll_write_end()) pos 135168, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625012:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000aea38469[3 00000000048617aa 2 1 000000000235009b 0 0 33] 00000080:00200000:1.0:1788201559.625015:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000dd90c55e 17ffffc0001001 3:0 ffff8bc146c50380 33 lru 00000080:00200000:1.0:1788201559.625020:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000061176e94 33: 1< 0 - - > 2< 135168 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625022:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000aea38469 00000080:00200000:1.0:1788201559.625023:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 34. 00000080:00200000:1.0:1788201559.625025:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 34 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625039:0:23731:0:(rw26.c:898:ll_write_end()) pos 139264, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625043:0:23731:0:(rw26.c:956:ll_write_end()) page@000000000dfb0704[3 00000000048617aa 2 1 000000000235009b 0 0 34] 00000080:00200000:1.0:1788201559.625046:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000008941a3a 17ffffc0001001 3:0 ffff8bc146c50000 34 lru 00000080:00200000:1.0:1788201559.625050:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000172f8878 34: 1< 0 - - > 2< 139264 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625052:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000000dfb0704 00000080:00200000:1.0:1788201559.625053:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 35. 00000080:00200000:1.0:1788201559.625055:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 35 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625069:0:23731:0:(rw26.c:898:ll_write_end()) pos 143360, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625073:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000b2d43ded[3 00000000048617aa 2 1 000000000235009b 0 0 35] 00000080:00200000:1.0:1788201559.625076:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000f087338c 17ffffc0001001 3:0 ffff8bc146c50d20 35 lru 00000080:00200000:1.0:1788201559.625081:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000002433f04d 35: 1< 0 - - > 2< 143360 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625083:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000b2d43ded 00000080:00200000:1.0:1788201559.625084:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 36. 00000080:00200000:1.0:1788201559.625086:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 36 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625101:0:23731:0:(rw26.c:898:ll_write_end()) pos 147456, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625105:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000095b71d36[3 00000000048617aa 2 1 000000000235009b 0 0 36] 00000080:00200000:1.0:1788201559.625108:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000f8b6694e 17ffffc0001001 3:0 ffff8bc146c50460 36 lru 00000080:00200000:1.0:1788201559.625113:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000012d59d55 36: 1< 0 - - > 2< 147456 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625115:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000095b71d36 00000080:00200000:1.0:1788201559.625116:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 37. 00000080:00200000:1.0:1788201559.625118:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 37 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625132:0:23731:0:(rw26.c:898:ll_write_end()) pos 151552, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625137:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000e2fcc607[3 00000000048617aa 2 1 000000000235009b 0 0 37] 00000080:00200000:1.0:1788201559.625139:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000091b71e5d 17ffffc0001001 3:0 ffff8bc146c502a0 37 lru 00000080:00200000:1.0:1788201559.625145:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000001c5e27c0 37: 1< 0 - - > 2< 151552 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625147:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000e2fcc607 00000080:00200000:1.0:1788201559.625148:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 38. 00000080:00200000:1.0:1788201559.625149:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 38 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625165:0:23731:0:(rw26.c:898:ll_write_end()) pos 155648, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625169:0:23731:0:(rw26.c:956:ll_write_end()) page@000000002b271eb6[3 00000000048617aa 2 1 000000000235009b 0 0 38] 00000080:00200000:1.0:1788201559.625172:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000d553a6c1 17ffffc0001001 3:0 ffff8bc146c50b60 38 lru 00000080:00200000:1.0:1788201559.625177:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000ed48053c 38: 1< 0 - - > 2< 155648 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625179:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000002b271eb6 00000080:00200000:1.0:1788201559.625180:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 39. 00000080:00200000:1.0:1788201559.625182:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 39 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625196:0:23731:0:(rw26.c:898:ll_write_end()) pos 159744, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625200:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000097a0d55d[3 00000000048617aa 2 1 000000000235009b 0 0 39] 00000080:00200000:1.0:1788201559.625203:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000006d9b835f 17ffffc0001001 3:0 ffff8bc146c50700 39 lru 00000080:00200000:1.0:1788201559.625209:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000022441281 39: 1< 0 - - > 2< 159744 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625211:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000097a0d55d 00000080:00200000:1.0:1788201559.625212:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 40. 00000080:00200000:1.0:1788201559.625214:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 40 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625228:0:23731:0:(rw26.c:898:ll_write_end()) pos 163840, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625233:0:23731:0:(rw26.c:956:ll_write_end()) page@000000003503bb0d[3 00000000048617aa 2 1 000000000235009b 0 0 40] 00000080:00200000:1.0:1788201559.625235:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000001d3d4728 17ffffc0001001 3:0 ffff8bc146c507e0 40 lru 00000080:00200000:1.0:1788201559.625240:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000097541d24 40: 1< 0 - - > 2< 163840 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625242:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000003503bb0d 00000080:00200000:1.0:1788201559.625243:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 41. 00000080:00200000:1.0:1788201559.625245:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 41 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625265:0:23731:0:(rw26.c:898:ll_write_end()) pos 167936, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625269:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000999ccf0f[3 00000000048617aa 2 1 000000000235009b 0 0 41] 00000080:00200000:1.0:1788201559.625271:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000d946a5b6 17ffffc0001021 2:0 ffff8bc146c50620 41 lru 00000080:00200000:1.0:1788201559.625276:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000ff5e4dbb 41: 1< 0 - - > 2< 167936 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625278:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000999ccf0f 00000080:00200000:1.0:1788201559.625280:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 42. 00000080:00200000:1.0:1788201559.625281:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 42 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625295:0:23731:0:(rw26.c:898:ll_write_end()) pos 172032, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625299:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000261ed92a[3 00000000048617aa 2 1 000000000235009b 0 0 42] 00000080:00200000:1.0:1788201559.625302:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000d2ac8896 17ffffc0001001 3:0 ffff8bc146c50ee0 42 lru 00000080:00200000:1.0:1788201559.625307:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000081a8ec81 42: 1< 0 - - > 2< 172032 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625309:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000261ed92a 00000080:00200000:1.0:1788201559.625310:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 43. 00000080:00200000:1.0:1788201559.625312:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 43 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625328:0:23731:0:(rw26.c:898:ll_write_end()) pos 176128, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625332:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000072960bdb[3 00000000048617aa 2 1 000000000235009b 0 0 43] 00000080:00200000:1.0:1788201559.625335:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000a1cef3e1 17ffffc0001001 3:0 ffff8bc146c50e00 43 lru 00000080:00200000:1.0:1788201559.625339:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000008ee12dd8 43: 1< 0 - - > 2< 176128 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625341:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000072960bdb 00000080:00200000:1.0:1788201559.625342:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 44. 00000080:00200000:1.0:1788201559.625343:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 44 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625357:0:23731:0:(rw26.c:898:ll_write_end()) pos 180224, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625360:0:23731:0:(rw26.c:956:ll_write_end()) page@000000009dd1bc7a[3 00000000048617aa 2 1 000000000235009b 0 0 44] 00000080:00200000:1.0:1788201559.625363:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000416900a7 17ffffc0001001 3:0 ffff8bc146c508c0 44 lru 00000080:00200000:1.0:1788201559.625368:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000910c9f6a 44: 1< 0 - - > 2< 180224 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625369:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000009dd1bc7a 00000080:00200000:1.0:1788201559.625370:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 45. 00000080:00200000:1.0:1788201559.625372:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 45 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625385:0:23731:0:(rw26.c:898:ll_write_end()) pos 184320, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625389:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000082ff00cd[3 00000000048617aa 2 1 000000000235009b 0 0 45] 00000080:00200000:1.0:1788201559.625392:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000004314193f 17ffffc0001001 3:0 ffff8bc146c50540 45 lru 00000080:00200000:1.0:1788201559.625397:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000004cac8e16 45: 1< 0 - - > 2< 184320 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625399:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000082ff00cd 00000080:00200000:1.0:1788201559.625400:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 46. 00000080:00200000:1.0:1788201559.625402:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 46 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625416:0:23731:0:(rw26.c:898:ll_write_end()) pos 188416, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625420:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000066644e5b[3 00000000048617aa 2 1 000000000235009b 0 0 46] 00000080:00200000:1.0:1788201559.625423:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000d5755202 17ffffc0001001 3:0 ffff8bc146c50a80 46 lru 00000080:00200000:1.0:1788201559.625428:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000005ad3d29 46: 1< 0 - - > 2< 188416 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625430:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000066644e5b 00000080:00200000:1.0:1788201559.625431:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 47. 00000080:00200000:1.0:1788201559.625433:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 47 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625447:0:23731:0:(rw26.c:898:ll_write_end()) pos 192512, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625451:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000fcdc30bf[3 00000000048617aa 2 1 000000000235009b 0 0 47] 00000080:00200000:1.0:1788201559.625454:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000004d3133b0 17ffffc0001001 3:0 ffff8bc1442979a0 47 lru 00000080:00200000:1.0:1788201559.625459:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000042175d98 47: 1< 0 - - > 2< 192512 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625461:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000fcdc30bf 00000080:00200000:1.0:1788201559.625462:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 48. 00000080:00200000:1.0:1788201559.625464:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 48 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625478:0:23731:0:(rw26.c:898:ll_write_end()) pos 196608, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625482:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000dcbc5db9[3 00000000048617aa 2 1 000000000235009b 0 0 48] 00000080:00200000:1.0:1788201559.625484:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000474e8ec6 17ffffc0001001 3:0 ffff8bc144297c40 48 lru 00000080:00200000:1.0:1788201559.625488:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000eaf708af 48: 1< 0 - - > 2< 196608 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625490:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000dcbc5db9 00000080:00200000:1.0:1788201559.625492:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 49. 00000080:00200000:1.0:1788201559.625494:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 49 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625507:0:23731:0:(rw26.c:898:ll_write_end()) pos 200704, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625512:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000e731ed2c[3 00000000048617aa 2 1 000000000235009b 0 0 49] 00000080:00200000:1.0:1788201559.625515:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000007348afae 17ffffc0001001 3:0 ffff8bc144297a80 49 lru 00000080:00200000:1.0:1788201559.625520:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b51b642f 49: 1< 0 - - > 2< 200704 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625522:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000e731ed2c 00000080:00200000:1.0:1788201559.625523:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 50. 00000080:00200000:1.0:1788201559.625525:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 50 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625542:0:23731:0:(rw26.c:898:ll_write_end()) pos 204800, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625546:0:23731:0:(rw26.c:956:ll_write_end()) page@000000002c49df71[3 00000000048617aa 2 1 000000000235009b 0 0 50] 00000080:00200000:1.0:1788201559.625548:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000006be118ab 17ffffc0001001 3:0 ffff8bc144297540 50 lru 00000080:00200000:1.0:1788201559.625552:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000c4353b86 50: 1< 0 - - > 2< 204800 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625554:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000002c49df71 00000080:00200000:1.0:1788201559.625555:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 51. 00000080:00200000:1.0:1788201559.625557:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 51 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625569:0:23731:0:(rw26.c:898:ll_write_end()) pos 208896, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625572:0:23731:0:(rw26.c:956:ll_write_end()) page@000000009affcaf1[3 00000000048617aa 2 1 000000000235009b 0 0 51] 00000080:00200000:1.0:1788201559.625574:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000065422166 17ffffc0001001 3:0 ffff8bc1442978c0 51 lru 00000080:00200000:1.0:1788201559.625579:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000087b8255e 51: 1< 0 - - > 2< 208896 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625581:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000009affcaf1 00000080:00200000:1.0:1788201559.625582:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 52. 00000080:00200000:1.0:1788201559.625584:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 52 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625599:0:23731:0:(rw26.c:898:ll_write_end()) pos 212992, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625603:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000113930ac[3 00000000048617aa 2 1 000000000235009b 0 0 52] 00000080:00200000:1.0:1788201559.625606:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000006a2084f3 17ffffc0001001 3:0 ffff8bc144297e00 52 lru 00000080:00200000:1.0:1788201559.625611:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000f0fb103e 52: 1< 0 - - > 2< 212992 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625613:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000113930ac 00000080:00200000:1.0:1788201559.625615:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 53. 00000080:00200000:1.0:1788201559.625616:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 53 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625631:0:23731:0:(rw26.c:898:ll_write_end()) pos 217088, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625635:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000086256ba3[3 00000000048617aa 2 1 000000000235009b 0 0 53] 00000080:00200000:1.0:1788201559.625638:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000004cd7f32d 17ffffc0001001 3:0 ffff8bc144297ee0 53 lru 00000080:00200000:1.0:1788201559.625642:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000064ce8931 53: 1< 0 - - > 2< 217088 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625661:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000086256ba3 00000080:00200000:1.0:1788201559.625662:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 54. 00000080:00200000:1.0:1788201559.625665:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 54 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625679:0:23731:0:(rw26.c:898:ll_write_end()) pos 221184, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625683:0:23731:0:(rw26.c:956:ll_write_end()) page@000000000ab1a335[3 00000000048617aa 2 1 000000000235009b 0 0 54] 00000080:00200000:1.0:1788201559.625686:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000bc5fae5c 17ffffc0001001 3:0 ffff8bc144297620 54 lru 00000080:00200000:1.0:1788201559.625691:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000008d8cb10f 54: 1< 0 - - > 2< 221184 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625693:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000000ab1a335 00000080:00200000:1.0:1788201559.625694:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 55. 00000080:00200000:1.0:1788201559.625696:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 55 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625710:0:23731:0:(rw26.c:898:ll_write_end()) pos 225280, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625714:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000ea375fd5[3 00000000048617aa 2 1 000000000235009b 0 0 55] 00000080:00200000:1.0:1788201559.625716:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000008dbab3d4 17ffffc0001001 3:0 ffff8bc1442977e0 55 lru 00000080:00200000:1.0:1788201559.625721:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000572dfe49 55: 1< 0 - - > 2< 225280 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625723:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000ea375fd5 00000080:00200000:1.0:1788201559.625724:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 56. 00000080:00200000:1.0:1788201559.625725:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 56 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625743:0:23731:0:(rw26.c:898:ll_write_end()) pos 229376, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625748:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000eb97292c[3 00000000048617aa 2 1 000000000235009b 0 0 56] 00000080:00200000:1.0:1788201559.625750:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000cfb12da1 17ffffc0001021 2:0 ffff8bc144297700 56 lru 00000080:00200000:1.0:1788201559.625755:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000e2db200b 56: 1< 0 - - > 2< 229376 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625757:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000eb97292c 00000080:00200000:1.0:1788201559.625758:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 57. 00000080:00200000:1.0:1788201559.625760:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 57 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625773:0:23731:0:(rw26.c:898:ll_write_end()) pos 233472, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625778:0:23731:0:(rw26.c:956:ll_write_end()) page@000000006a4632be[3 00000000048617aa 2 1 000000000235009b 0 0 57] 00000080:00200000:1.0:1788201559.625781:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000009ea95bac 17ffffc0001001 3:0 ffff8bc144297b60 57 lru 00000080:00200000:1.0:1788201559.625787:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000007f8cbbe5 57: 1< 0 - - > 2< 233472 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625814:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000006a4632be 00000080:00200000:1.0:1788201559.625816:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 58. 00000080:00200000:1.0:1788201559.625818:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 58 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625834:0:23731:0:(rw26.c:898:ll_write_end()) pos 237568, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625839:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000078901975[3 00000000048617aa 2 1 000000000235009b 0 0 58] 00000080:00200000:1.0:1788201559.625842:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000006cc402f6 17ffffc0001001 3:0 ffff8bc1442972a0 58 lru 00000080:00200000:1.0:1788201559.625848:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000061748c3d 58: 1< 0 - - > 2< 237568 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625850:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000078901975 00000080:00200000:1.0:1788201559.625851:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 59. 00000080:00200000:1.0:1788201559.625853:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 59 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625869:0:23731:0:(rw26.c:898:ll_write_end()) pos 241664, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625874:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000ddf013d8[3 00000000048617aa 2 1 000000000235009b 0 0 59] 00000080:00200000:1.0:1788201559.625878:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000c48d8902 17ffffc0001001 3:0 ffff8bc144297460 59 lru 00000080:00200000:1.0:1788201559.625883:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000007bc49eca 59: 1< 0 - - > 2< 241664 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625885:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000ddf013d8 00000080:00200000:1.0:1788201559.625886:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 60. 00000080:00200000:1.0:1788201559.625888:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 60 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625904:0:23731:0:(rw26.c:898:ll_write_end()) pos 245760, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625909:0:23731:0:(rw26.c:956:ll_write_end()) page@000000004bd60ebd[3 00000000048617aa 2 1 000000000235009b 0 0 60] 00000080:00200000:1.0:1788201559.625912:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000493518e3 17ffffc0001001 3:0 ffff8bc144297d20 60 lru 00000080:00200000:1.0:1788201559.625918:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000043a5a5ac 60: 1< 0 - - > 2< 245760 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625920:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000004bd60ebd 00000080:00200000:1.0:1788201559.625921:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 61. 00000080:00200000:1.0:1788201559.625923:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 61 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.625938:0:23731:0:(rw26.c:898:ll_write_end()) pos 249856, len 4096, copied 4096 00000080:00200000:1.0:1788201559.625942:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000db98bcb6[3 00000000048617aa 2 1 000000000235009b 0 0 61] 00000080:00200000:1.0:1788201559.625944:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000ed8027b8 17ffffc0001001 3:0 ffff8bc144297000 61 lru 00000080:00200000:1.0:1788201559.625949:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000001e57e3f3 61: 1< 0 - - > 2< 249856 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.625951:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000db98bcb6 00000080:00200000:1.0:1788201559.625953:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 62. 00000080:00200000:1.0:1788201559.625954:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 62 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.626982:0:23731:0:(rw26.c:898:ll_write_end()) pos 253952, len 4096, copied 4096 00000080:00200000:1.0:1788201559.626990:0:23731:0:(rw26.c:956:ll_write_end()) page@000000006cb5497c[3 00000000048617aa 2 1 000000000235009b 0 0 62] 00000080:00200000:1.0:1788201559.626994:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000eff8b660 17ffffc0001001 3:0 ffff8bc144297380 62 lru 00000080:00200000:1.0:1788201559.627000:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000006de851 62: 1< 0 - - > 2< 253952 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.627002:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000006cb5497c 00000080:00200000:1.0:1788201559.627003:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 63. 00000080:00200000:1.0:1788201559.627006:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 63 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.627023:0:23731:0:(rw26.c:898:ll_write_end()) pos 258048, len 4096, copied 4096 00000080:00200000:1.0:1788201559.627027:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000481f59c5[3 00000000048617aa 2 1 000000000235009b 0 0 63] 00000080:00200000:1.0:1788201559.627030:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000059bfbef5 17ffffc0001001 3:0 ffff8bc1442971c0 63 lru 00000080:00200000:1.0:1788201559.627036:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000453cb38f 63: 1< 0 - - > 2< 258048 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.627038:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000481f59c5 00000080:00200000:1.0:1788201559.627039:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 64. 00000080:00200000:1.0:1788201559.627041:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 64 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.627067:0:23731:0:(rw26.c:898:ll_write_end()) pos 262144, len 4096, copied 4096 00000080:00200000:1.0:1788201559.627072:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000065bcb282[3 00000000048617aa 2 1 000000000235009b 0 0 64] 00000080:00200000:1.0:1788201559.627075:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000390569d6 17ffffc0001001 3:0 ffff8bc1442970e0 64 lru 00000080:00200000:1.0:1788201559.627080:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000003f1be95c 64: 1< 0 - - > 2< 262144 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.627082:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000065bcb282 00000080:00200000:1.0:1788201559.627083:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 65. 00000080:00200000:1.0:1788201559.627085:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 65 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.627102:0:23731:0:(rw26.c:898:ll_write_end()) pos 266240, len 4096, copied 4096 00000080:00200000:1.0:1788201559.627107:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000c49f931f[3 00000000048617aa 2 1 000000000235009b 0 0 65] 00000080:00200000:1.0:1788201559.627110:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000940806aa 17ffffc0001001 3:0 ffff8bc166523380 65 lru 00000080:00200000:1.0:1788201559.627114:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000314a7ce1 65: 1< 0 - - > 2< 266240 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.627116:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000c49f931f 00000080:00200000:1.0:1788201559.627118:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 66. 00000080:00200000:1.0:1788201559.627119:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 66 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.627194:0:23731:0:(rw26.c:898:ll_write_end()) pos 270336, len 4096, copied 4096 00000080:00200000:1.0:1788201559.627199:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000e3244264[3 00000000048617aa 2 1 000000000235009b 0 0 66] 00000080:00200000:1.0:1788201559.627202:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000928297cc 17ffffc0001001 3:0 ffff8bc1665231c0 66 lru 00000080:00200000:1.0:1788201559.627208:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000005c2f0b37 66: 1< 0 - - > 2< 270336 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.627210:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000e3244264 00000080:00200000:1.0:1788201559.627212:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 67. 00000080:00200000:1.0:1788201559.627214:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 67 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.627230:0:23731:0:(rw26.c:898:ll_write_end()) pos 274432, len 4096, copied 4096 00000080:00200000:1.0:1788201559.627235:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000085a1fd64[3 00000000048617aa 2 1 000000000235009b 0 0 67] 00000080:00200000:1.0:1788201559.627237:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000c6573c1b 17ffffc0001001 3:0 ffff8bc1665230e0 67 lru 00000080:00200000:1.0:1788201559.627242:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000074baeb3a 67: 1< 0 - - > 2< 274432 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.627244:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000085a1fd64 00000080:00200000:1.0:1788201559.627245:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 68. 00000080:00200000:1.0:1788201559.627247:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 68 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.627261:0:23731:0:(rw26.c:898:ll_write_end()) pos 278528, len 4096, copied 4096 00000080:00200000:1.0:1788201559.627266:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000a6aa459f[3 00000000048617aa 2 1 000000000235009b 0 0 68] 00000080:00200000:1.0:1788201559.627269:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000008934ec83 17ffffc0001001 3:0 ffff8bc1665239a0 68 lru 00000080:00200000:1.0:1788201559.627274:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000063c4cd36 68: 1< 0 - - > 2< 278528 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.627344:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000a6aa459f 00000080:00200000:1.0:1788201559.627345:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 69. 00000080:00200000:1.0:1788201559.627348:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 69 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.627365:0:23731:0:(rw26.c:898:ll_write_end()) pos 282624, len 4096, copied 4096 00000080:00200000:1.0:1788201559.627368:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000f153c5f4[3 00000000048617aa 2 1 000000000235009b 0 0 69] 00000080:00200000:1.0:1788201559.627371:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000da076f99 17ffffc0001001 3:0 ffff8bc166523c40 69 lru 00000080:00200000:1.0:1788201559.627375:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000062b0e2a 69: 1< 0 - - > 2< 282624 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.627377:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000f153c5f4 00000080:00200000:1.0:1788201559.627378:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 70. 00000080:00200000:1.0:1788201559.627380:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 70 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.627394:0:23731:0:(rw26.c:898:ll_write_end()) pos 286720, len 4096, copied 4096 00000080:00200000:1.0:1788201559.627398:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000058187681[3 00000000048617aa 2 1 000000000235009b 0 0 70] 00000080:00200000:1.0:1788201559.627401:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000003e07369b 17ffffc0001001 3:0 ffff8bc166523a80 70 lru 00000080:00200000:1.0:1788201559.627407:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000006225a0e5 70: 1< 0 - - > 2< 286720 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.627409:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000058187681 00000080:00200000:1.0:1788201559.627410:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 71. 00000080:00200000:1.0:1788201559.627412:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 71 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.627433:0:23731:0:(rw26.c:898:ll_write_end()) pos 290816, len 4096, copied 4096 00000080:00200000:1.0:1788201559.627438:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000b4506aba[3 00000000048617aa 2 1 000000000235009b 0 0 71] 00000080:00200000:1.0:1788201559.627441:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000b5da0e7d 17ffffc0001021 2:0 ffff8bc166523540 71 lru 00000080:00200000:1.0:1788201559.627447:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000e9a189f0 71: 1< 0 - - > 2< 290816 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.627448:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000b4506aba 00000080:00200000:1.0:1788201559.627450:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 72. 00000080:00200000:1.0:1788201559.627451:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 72 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.627467:0:23731:0:(rw26.c:898:ll_write_end()) pos 294912, len 4096, copied 4096 00000080:00200000:1.0:1788201559.627471:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000b1ccae26[3 00000000048617aa 2 1 000000000235009b 0 0 72] 00000080:00200000:1.0:1788201559.627474:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000724ac633 17ffffc0001001 3:0 ffff8bc1665238c0 72 lru 00000080:00200000:1.0:1788201559.627479:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000b18cb039 72: 1< 0 - - > 2< 294912 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.627481:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000b1ccae26 00000080:00200000:1.0:1788201559.627482:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 73. 00000080:00200000:1.0:1788201559.627484:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 73 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.627497:0:23731:0:(rw26.c:898:ll_write_end()) pos 299008, len 4096, copied 4096 00000080:00200000:1.0:1788201559.627501:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000013598e45[3 00000000048617aa 2 1 000000000235009b 0 0 73] 00000080:00200000:1.0:1788201559.627504:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000d36714b8 17ffffc0001001 3:0 ffff8bc166523e00 73 lru 00000080:00200000:1.0:1788201559.627508:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000044172f25 73: 1< 0 - - > 2< 299008 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.627509:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000013598e45 00000080:00200000:1.0:1788201559.627510:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 74. 00000080:00200000:1.0:1788201559.627512:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 74 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.627525:0:23731:0:(rw26.c:898:ll_write_end()) pos 303104, len 4096, copied 4096 00000080:00200000:1.0:1788201559.627529:0:23731:0:(rw26.c:956:ll_write_end()) page@0000000066180c16[3 00000000048617aa 2 1 000000000235009b 0 0 74] 00000080:00200000:1.0:1788201559.627532:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @000000006c9a3437 17ffffc0001001 3:0 ffff8bc166523ee0 74 lru 00000080:00200000:1.0:1788201559.627536:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000003eb6f6d2 74: 1< 0 - - > 2< 303104 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.627538:0:23731:0:(rw26.c:956:ll_write_end()) end page@0000000066180c16 00000080:00200000:1.0:1788201559.627539:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 75. 00000080:00200000:1.0:1788201559.627541:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 75 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.627556:0:23731:0:(rw26.c:898:ll_write_end()) pos 307200, len 4096, copied 4096 00000080:00200000:1.0:1788201559.627560:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000a01f8f2d[3 00000000048617aa 2 1 000000000235009b 0 0 75] 00000080:00200000:1.0:1788201559.627563:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000b8cce3a2 17ffffc0001001 3:0 ffff8bc166523620 75 lru 00000080:00200000:1.0:1788201559.627567:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@000000006b2971b3 75: 1< 0 - - > 2< 307200 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.627569:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000a01f8f2d 00000080:00200000:1.0:1788201559.627571:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 76. 00000080:00200000:1.0:1788201559.627573:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 76 of 0 to 4096 bytes 00000080:00200000:1.0:1788201559.627588:0:23731:0:(rw26.c:898:ll_write_end()) pos 311296, len 4096, copied 4096 00000080:00200000:1.0:1788201559.627592:0:23731:0:(rw26.c:956:ll_write_end()) page@00000000738fa808[3 00000000048617aa 2 1 000000000235009b 0 0 76] 00000080:00200000:1.0:1788201559.627595:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @00000000f9350c26 17ffffc0001001 3:0 ffff8bc1665237e0 76 lru 00000080:00200000:1.0:1788201559.627600:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@00000000955e6814 76: 1< 0 - - > 2< 311296 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.627602:0:23731:0:(rw26.c:956:ll_write_end()) end page@00000000738fa808 00000080:00200000:1.0:1788201559.627604:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 77. 00000080:00200000:1.0:1788201559.627605:0:23731:0:(rw26.c:704:ll_write_begin()) Writing 77 of 0 to 1758 bytes 00000080:00200000:1.0:1788201559.627631:0:23731:0:(rw26.c:898:ll_write_end()) pos 315392, len 1758, copied 1758 00000080:00200000:1.0:1788201559.627636:0:23731:0:(rw26.c:956:ll_write_end()) page@000000006b149951[3 00000000048617aa 2 1 000000000235009b 0 0 77] 00000080:00200000:1.0:1788201559.627638:0:23731:0:(rw26.c:956:ll_write_end()) vmpage @0000000004cfb0a9 17ffffc0001001 3:0 ffff8bc166523700 77 lru 00000080:00200000:1.0:1788201559.627643:0:23731:0:(rw26.c:956:ll_write_end()) osc-page@0000000006119486 77: 1< 0 - - > 2< 315392 0 0 0x0 0x0 | 000000000ce25486 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201559.627645:0:23731:0:(rw26.c:956:ll_write_end()) end page@000000006b149951 00000080:00200000:1.0:1788201559.627646:0:23731:0:(rw26.c:956:ll_write_end()) queued cl_page: 78. 00000080:00200000:1.0:1788201559.627650:0:23731:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 78, from 0, to 1758 prio 0 00000008:00010000:1.0:1788201559.627683:0:23731:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000398cf242 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201559.627717:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc14465abb8, count 15, dirtied 15 00000080:00200000:1.0:1788201559.627996:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc14465abb8, count 15, dirtied 15 00000080:00200000:1.0:1788201559.628014:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc14465abb8, count 15, dirtied 15 00000080:00200000:1.0:1788201559.628030:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc14465abb8, count 15, dirtied 15 00000080:00200000:1.0:1788201559.628046:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc14465abb8, count 15, dirtied 15 00000080:00200000:1.0:1788201559.628054:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc14465abb8, count 3, dirtied 3 00000080:00200000:1.0:1788201559.628058:0:23731:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 78 pages 317150 bytes, tot: 317150 00000080:00200000:1.0:1788201559.628062:0:23731:0:(vvp_io.c:1358:vvp_io_write_start()) test-framework.sh: write bytes 0, result: 317150 00000020:00010000:1.0:1788201559.628081:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c4128 (ffff8bc148e3b128/0) at cl_lock_release():245 00000020:00010000:1.0:1788201559.628084:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c4128 (ffff8bc148e3b128/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.628088:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc14bb78fb0 (ffff8bc148e3be18/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201559.628097:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.628109:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201559.628127:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c4128 (ffff8bc148e3b128/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201559.628129:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc14bb78fb0 (ffff8bc148e3b128/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201559.631896:0:23731:0:(vvp_io.c:533:vvp_io_advance()) advancing 317150 bytes 00000080:00200000:1.0:1788201559.631915:0:23731:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 77] 00000080:00200000:1.0:1788201559.631952:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x131:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201559.631968:0:23731:0:(file.c:2238:ll_file_io_generic()) test-framework.sh: 2 io complete with rc: 0, result: 317150, restart: 0 00000080:00200000:1.0:1788201559.632006:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x131:0x0] updating i_size 317150 i_blocks 1 00000080:00200000:1.0:1788201559.632014:0:23731:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 317150 00000080:00200008:1.0:1788201559.632065:0:23731:0:(file.c:479:ll_file_release()) START file test-framework.sh:[0x200000bd7:0x131:0x0](ffff8bc14465aa08), flags 100001 00000002:00100000:1.0:1788201559.632201:0:23731:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc172758000 x1875064727868672/t8589937138(8589937138) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201575 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201559.632216:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201559.632222:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc17275a680 x1875064727869312/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201559.632247:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17275a680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727869312:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201559.632573:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc4480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.636266:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275a680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727869312:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201559.636378:0:23731:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc172758000 x1875064727868672/t8589937138(8589937138) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201575 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201559.636453:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.636473:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.636491:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.636506:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.636514:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.636520:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.636524:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.636531:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201559.636535:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.636544:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.636560:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.636567:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201559.636573:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.636576:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=test-framework.sh, flags=8 00000080:00200008:1.0:1788201559.636583:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file test-framework.sh:[0x200000bd7:0x131:0x0](ffff8bc14465aa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201559.636588:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x131:0x0](ffff8bc14465aa08),name=test-framework.sh 00000002:00010000:1.0:1788201559.636599:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x131:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.636607:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109531c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201559.636615:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109531c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201559.636627:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.636631:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x131:0x0](ffff8bc14465aa08) 00000080:00010000:1.0:1788201559.636633:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x131:0x0](ffff8bc14465aa08) for lock 0xd138388016f6ecb2 00000080:00010000:1.0:1788201559.636637:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ecb2 from it ffffadd1c7da3cb8 00010000:00010000:1.0:1788201559.636641:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109531c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201559.636648:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109531c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201559.636699:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x131:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201559.636710:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x131:0x0] 00000008:00010000:1.0:1788201559.637004:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201559.637009:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4fb0, osc lock ffff8bc145d08130, flags 0x400001002 00010000:00010000:1.0:1788201559.637030:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.637042:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201559.637055:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201559.637059:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.637068:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201559.637085:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201559.637095:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x131:0x0] updating i_size 317150 i_blocks 1 00000020:00010000:1.0:1788201559.637099:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e27530 (ffff8bc148e3b128/0) at cl_lock_release():245 00000020:00010000:1.0:1788201559.637102:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e27530 (ffff8bc148e3b128/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.637105:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4fb0 (ffff8bc148e3be18/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.637109:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e27530 (ffff8bc148e3b128/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201559.637111:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4fb0 (ffff8bc148e3b128/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201559.637151:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x131:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201559.637209:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.637219:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.637227:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.637235:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.637242:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.637246:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.637248:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.637253:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201559.637256:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.637264:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.637354:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.637360:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201559.637364:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.637378:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=yaml.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=9 00000080:00200000:1.0:1788201559.637382:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=yaml.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:1.0:1788201559.637393:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: yaml.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201559.637440:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ecc7 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.637448:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ecc7 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.637459:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ecc7 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.637483:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172759500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727869440:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.637642:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc4480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.642519:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172759500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727869440:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201559.642542:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ecc7 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.642556:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ecc7 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.642563:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ecc7 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.642570:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ecc7 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.642580:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ecc7 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.642587:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bce00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201559.642592:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ecc7 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.642598:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ecc7 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.642605:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ecc7 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.642613:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201559.642619:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ecc7 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.642625:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ecc7 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201559.643861:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc172759500 x1875064727869440/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201575 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201559.643878:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201559.643906:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:1.0:1788201559.643985:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.644000:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.644011:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.644030:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.644036:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.644041:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.644044:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.644051:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201559.644055:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.644064:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.644380:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.644388:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201559.644394:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.644409:0:23731:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=yaml.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=8 00000080:00200000:1.0:1788201559.644413:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=yaml.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:1.0:1788201559.644426:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: yaml.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201559.644468:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ecce lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.644475:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ecce lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.644484:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ecce lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.644509:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172759500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727869568:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.644667:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc4480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.649757:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172759500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727869568:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201559.649786:0:23731:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ecce lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.649923:0:23731:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ecce lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.649930:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ecce lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.649937:0:23731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ecce lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.649945:0:23731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ecce lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.649952:0:23731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bc600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201559.649967:0:23731:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ecce lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.649974:0:23731:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ecce lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.649981:0:23731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ecce lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.649988:0:23731:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201559.649996:0:23731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ecce lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.650003:0:23731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ecce lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201559.650022:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc172759500 x1875064727869568/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201575 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201559.650038:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201559.650068:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00000080:00200000:1.0:1788201559.650378:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.650396:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.650406:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.650418:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.650425:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.650431:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.650434:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.650440:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3bf8 00010000:00010000:1.0:1788201559.650444:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.650453:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.650469:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.650477:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201559.650482:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.650495:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.650505:0:23731:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=yaml.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), file ffff8bc153aa9e00, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:1.0:1788201559.650514:0:23731:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=yaml.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000002:00010000:1.0:1788201559.650534:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: yaml.sh,[0x200000bd7:0x132:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201559.650583:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.650591:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201559.650602:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201559.650610:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172759500 x1875064727869824/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201559.650620:0:23731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201559.650641:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172759500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727869824:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.651025:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc4480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.657571:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172759500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727869824:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201559.657601:0:23731:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.657626:0:23731:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x132:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.657634:0:23731:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.657644:0:23731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.657655:0:23731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.657669:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.657676:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.657683:0:23731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201559.657695:0:23731:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc172759500 x1875064727869824/t8589937140(8589937140) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/664 e 0 to 0 dl 1788201575 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201559.657708:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc172759500 x1875064727869824/t8589937140(8589937140) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/664 e 0 to 0 dl 1788201575 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201559.657721:0:23731:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201559.657734:0:23731:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.657758:0:23731:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/306 (0 0) 00000080:00200000:1.0:1788201559.657766:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201559.657781:0:23731:0:(namei.c:1628:ll_create_it()) VFS Op:name=yaml.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=open|creat 00000080:00200000:1.0:1788201559.657852:0:23731:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x132:0x0](ffff8bc1446580c8) 00000080:00200000:1.0:1788201559.657999:0:23731:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x132:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201559.658010:0:23731:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x132:0x0](ffff8bc1446580c8) 00000080:00010000:1.0:1788201559.658013:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x132:0x0](ffff8bc1446580c8) for lock 0xd138388016f6ecd5 00000080:00010000:1.0:1788201559.658023:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x132:0x0](ffff8bc1446580c8) 00000080:00200008:1.0:1788201559.658037:0:23731:0:(file.c:1090:ll_file_open()) START file yaml.sh:[0x200000bd7:0x132:0x0](ffff8bc1446580c8), flags 100301 00000002:00100000:1.0:1788201559.658060:0:23731:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc172759500 x1875064727869824/t8589937140(8589937140) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/664 e 0 to 0 dl 1788201575 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201559.659345:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ecd5 from it ffff8bc144cb5f60 00010000:00010000:1.0:1788201559.659360:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.659372:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201559.659403:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x132:0x0](ffff8bc1446580c8), inode mode 81a4 mask 40 00000080:00200008:1.0:1788201559.659432:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file yaml.sh:[0x200000bd7:0x132:0x0](ffff8bc1446580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201559.659438:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x132:0x0](ffff8bc1446580c8),name=yaml.sh 00000002:00010000:1.0:1788201559.659462:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x132:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.659474:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.659486:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201559.659499:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.659504:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x132:0x0](ffff8bc1446580c8) 00000080:00010000:1.0:1788201559.659507:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x132:0x0](ffff8bc1446580c8) for lock 0xd138388016f6ecd5 00000080:00010000:1.0:1788201559.659513:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ecd5 from it ffffadd1c7da3cd8 00010000:00010000:1.0:1788201559.659516:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.659524:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201559.659561:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x132:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201559.659572:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x132:0x0] 00000008:00010000:1.0:1788201559.659602:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201559.659606:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4830, osc lock ffff8bc145d08130, flags 0x400001002 00010000:00010000:1.0:1788201559.659661:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007110c2fe/0xd138388016f6ecdc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.659671:0:23731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007110c2fe/0xd138388016f6ecdc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201559.659709:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1788201559.659728:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201559.659746:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727869952:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201559.663622:0:10055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007110c2fe/0xd138388016f6ecdc lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.663656:0:10055:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007110c2fe/0xd138388016f6ecdc lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095385 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.663670:0:10055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007110c2fe/0xd138388016f6ecdc lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095385 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.663681:0:10055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007110c2fe/0xd138388016f6ecdc lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095385 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201559.663697:0:10055:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007110c2fe/0xd138388016f6ecdc lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095385 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201559.663709:0:10055:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1788201559.663729:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007110c2fe/0xd138388016f6ecdc lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171095385 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.663740:0:10055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007110c2fe/0xd138388016f6ecdc lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171095385 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.663758:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007110c2fe/0xd138388016f6ecdc lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171095385 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.663768:0:10055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007110c2fe/0xd138388016f6ecdc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171095385 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201559.663814:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727869952:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201559.668162:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743446784 00000100:00100000:1.0:1788201559.668172:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743446784 00000100:00100000:1.0:1788201559.668231:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 618 00000100:00100000:1.0:1788201559.668240:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17270b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23413:x1875064743446784:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201559.668258:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007110c2fe/0xd138388016f6ecdc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171095385 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.668354:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201559.668361:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17270b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23413:x1875064743446784:12345-192.168.201.143@tcp:104: Request processed in 122us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201559.668368:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 618 00000100:00100000:1.0:1788201559.673953:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743446912 00000100:00100000:1.0:1788201559.673972:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743446912 00000100:00100000:1.0:1788201559.674031:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 619 00000100:00100000:1.0:1788201559.674042:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17270b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21003:x1875064743446912:12345-192.168.201.143@tcp:105: 00010000:00010000:1.0:1788201559.674058:0:20877:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.674070:0:20877:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.674079:0:20877:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.674107:0:20877:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.674116:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.674125:0:20877:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.674158:0:20877:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc149f3ce00) 00000100:00100000:1.0:1788201559.674228:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17270b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21003:x1875064743446912:12345-192.168.201.143@tcp:105: Request processed in 188us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201559.674237:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 619 00000008:00010000:0.0:1788201559.674684:0:23731:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000cd0be2df ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201559.674709:0:23731:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc144658278, count 2, dirtied 2 00000080:00200000:0.0:1788201559.674714:0:23731:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 2 pages 4512 bytes, tot: 4512 00000080:00200000:0.0:1788201559.674717:0:23731:0:(vvp_io.c:1358:vvp_io_write_start()) yaml.sh: write bytes 0, result: 4512 00000020:00010000:0.0:1788201559.674733:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc148fb1308 (ffff8bc1499c4488/0) at cl_lock_release():245 00000020:00010000:0.0:1788201559.674736:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc148fb1308 (ffff8bc1499c4488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201559.674740:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146f0a030 (ffff8bc1499c4998/1) at cl_lock_cancel():142 00010000:00010000:0.0:1788201559.674745:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201559.674754:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1788201559.674769:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc148fb1308 (ffff8bc1499c4488/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201559.674772:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146f0a030 (ffff8bc1499c4488/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201559.674779:0:23731:0:(vvp_io.c:533:vvp_io_advance()) advancing 4512 bytes 00000080:00200000:0.0:1788201559.674788:0:23731:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 1] 00000080:00200000:0.0:1788201559.674857:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x132:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201559.674863:0:23731:0:(file.c:2238:ll_file_io_generic()) yaml.sh: 2 io complete with rc: 0, result: 4512, restart: 0 00000080:00200000:0.0:1788201559.674871:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x132:0x0] updating i_size 4512 i_blocks 1 00000080:00200000:0.0:1788201559.674876:0:23731:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 4512 00000080:00200008:0.0:1788201559.674916:0:23731:0:(file.c:479:ll_file_release()) START file yaml.sh:[0x200000bd7:0x132:0x0](ffff8bc1446580c8), flags 100001 00000002:00100000:0.0:1788201559.674982:0:23731:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc172759500 x1875064727869824/t8589937140(8589937140) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/664 e 0 to 0 dl 1788201575 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1788201559.674994:0:23731:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1788201559.675000:0:23731:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172709f80 x1875064727870464/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1788201559.675028:0:23731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172709f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727870464:192.168.201.143@tcp:35:cp.0 00000100:00100000:0.0:1788201559.675208:0:23731:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150c83540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201559.680409:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17270a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727870208:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201559.680603:0:23731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172709f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23731:1875064727870464:192.168.201.143@tcp:35:cp.0 00000002:00100000:0.0:1788201559.680631:0:23731:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc172759500 x1875064727869824/t8589937140(8589937140) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/664 e 0 to 0 dl 1788201575 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201559.680703:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201559.680721:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201559.680888:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.680989:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.681000:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.681008:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.681012:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.681019:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7da3b58 00010000:00010000:1.0:1788201559.681023:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.681032:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.681054:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.681063:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201559.681069:0:23731:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.681073:0:23731:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=yaml.sh, flags=8 00000080:00200008:1.0:1788201559.681081:0:23731:0:(file.c:6283:ll_getattr_dentry()) START file yaml.sh:[0x200000bd7:0x132:0x0](ffff8bc1446580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201559.681086:0:23731:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x132:0x0](ffff8bc1446580c8),name=yaml.sh 00000002:00010000:1.0:1788201559.681240:0:23731:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x132:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.681250:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201559.681259:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201559.681266:0:23731:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.681272:0:23731:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x132:0x0](ffff8bc1446580c8) 00000080:00010000:1.0:1788201559.681274:0:23731:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x132:0x0](ffff8bc1446580c8) for lock 0xd138388016f6ecd5 00000080:00010000:1.0:1788201559.681278:0:23731:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ecd5 from it ffffadd1c7da3cb8 00010000:00010000:1.0:1788201559.681281:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201559.681289:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201559.681338:0:23731:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x132:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201559.681349:0:23731:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x132:0x0] 00000008:00010000:1.0:1788201559.681386:0:23731:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201559.681390:0:23731:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d40b0, osc lock ffff8bc145d08850, flags 0x400001002 00010000:00010000:1.0:1788201559.681409:0:23731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.681420:0:23731:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201559.681433:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201559.681437:0:23731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201559.681445:0:23731:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201559.681456:0:23731:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201559.681465:0:23731:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x132:0x0] updating i_size 4512 i_blocks 1 00000020:00010000:1.0:1788201559.681470:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201559.681474:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.681478:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d40b0 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201559.681481:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201559.681485:0:23731:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d40b0 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201559.681515:0:23731:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x132:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201559.697125:0:23733:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201559.697219:0:23733:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201559.697240:0:23733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.697266:0:23733:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.697276:0:23733:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201559.697285:0:23733:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201559.697289:0:23733:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:0.0:1788201559.697297:0:23733:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7f6bbe0 00010000:00010000:0.0:1788201559.697301:0:23733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.697315:0:23733:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.697332:0:23733:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.697340:0:23733:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201559.697347:0:23733:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.697362:0:23733:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d0, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=1536 00000080:00200000:0.0:1788201559.697365:0:23733:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201559.697370:0:23733:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201559.697374:0:23733:0:(namei.c:2239:do_mkdir()) VFS Op:name=d0, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00800000:00000004:0.0:1788201559.697396:0:23733:0:(obd_class.h:1057:obd_statfs_async()) lustre-MDT0000-mdc-ffff8bc143fc0000: age 840, max_age 0 00000100:00100000:1.0:1788201559.697492:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727870592:192.168.201.143@tcp:41:createmany.0 00000020:00100000:0.0:1788201559.698055:0:23733:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201559.698066:0:23733:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172708e00 x1875064727870848/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201559.698086:0:23733:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172708e00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23733:1875064727870848:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201559.698216:0:23733:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150c83540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201559.702302:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727870592:192.168.201.143@tcp:41:createmany.0 00000100:00100000:0.0:1788201559.710402:0:23733:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172708e00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23733:1875064727870848:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201559.710451:0:23733:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x133:0x0](ffff8bc1459563c8) 00000080:00200000:0.0:1788201559.710459:0:23733:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x133:0x0], updating i_size 512 00000080:00200000:0.0:1788201559.710523:0:23733:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201559.710542:0:23733:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201559.710561:0:23733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.710576:0:23733:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.710585:0:23733:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201559.710591:0:23733:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201559.710595:0:23733:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:0.0:1788201559.710603:0:23733:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7f6bbe0 00010000:00010000:0.0:1788201559.710607:0:23733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.710616:0:23733:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.710631:0:23733:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.710637:0:23733:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201559.710643:0:23733:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.710662:0:23733:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d1, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=1536 00000080:00200000:0.0:1788201559.710666:0:23733:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201559.710671:0:23733:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201559.710675:0:23733:0:(namei.c:2239:do_mkdir()) VFS Op:name=d1, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00000020:00100000:0.0:1788201559.710732:0:23733:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201559.710741:0:23733:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc17270aa00 x1875064727871104/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201559.710764:0:23733:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17270aa00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23733:1875064727871104:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201559.710873:0:23733:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150c83540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201559.717294:0:23733:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17270aa00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23733:1875064727871104:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201559.717345:0:23733:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348) 00000080:00200000:0.0:1788201559.717354:0:23733:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x134:0x0], updating i_size 512 00000080:00200000:0.0:1788201559.717421:0:23733:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201559.717441:0:23733:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201559.717459:0:23733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.717474:0:23733:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.717483:0:23733:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201559.717489:0:23733:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201559.717492:0:23733:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:0.0:1788201559.717500:0:23733:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7f6bbe0 00010000:00010000:0.0:1788201559.717504:0:23733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.717513:0:23733:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.717528:0:23733:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.717535:0:23733:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201559.717540:0:23733:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.717553:0:23733:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d2, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=1536 00000080:00200000:0.0:1788201559.717557:0:23733:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201559.717561:0:23733:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201559.717566:0:23733:0:(namei.c:2239:do_mkdir()) VFS Op:name=d2, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00000020:00100000:0.0:1788201559.717624:0:23733:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201559.717634:0:23733:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172709880 x1875064727871360/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201559.717656:0:23733:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172709880 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23733:1875064727871360:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201559.717737:0:23733:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150c83540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201559.723180:0:23733:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172709880 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23733:1875064727871360:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201559.723233:0:23733:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88) 00000080:00200000:0.0:1788201559.723240:0:23733:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x135:0x0], updating i_size 512 00000080:00200000:0.0:1788201559.723308:0:23733:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201559.723328:0:23733:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201559.723347:0:23733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.723361:0:23733:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.723370:0:23733:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201559.723376:0:23733:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201559.723380:0:23733:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:0.0:1788201559.723387:0:23733:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7f6bbe0 00010000:00010000:0.0:1788201559.723391:0:23733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.723400:0:23733:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.723416:0:23733:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.723423:0:23733:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201559.723429:0:23733:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.723445:0:23733:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d3, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=1536 00000080:00200000:0.0:1788201559.723448:0:23733:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201559.723453:0:23733:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201559.723457:0:23733:0:(namei.c:2239:do_mkdir()) VFS Op:name=d3, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00000020:00100000:0.0:1788201559.723517:0:23733:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201559.723525:0:23733:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc17270bb80 x1875064727871616/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201559.723548:0:23733:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17270bb80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23733:1875064727871616:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201559.723628:0:23733:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150c83540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201559.732277:0:23733:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17270bb80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23733:1875064727871616:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201559.732332:0:23733:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8) 00000080:00200000:0.0:1788201559.732339:0:23733:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x136:0x0], updating i_size 512 00000080:00200000:0.0:1788201559.732411:0:23733:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201559.732430:0:23733:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201559.732448:0:23733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.732463:0:23733:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.732472:0:23733:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201559.732478:0:23733:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201559.732483:0:23733:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:0.0:1788201559.732491:0:23733:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7f6bbe0 00010000:00010000:0.0:1788201559.732496:0:23733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.732510:0:23733:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.732526:0:23733:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.732533:0:23733:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201559.732539:0:23733:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.732553:0:23733:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d4, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=1536 00000080:00200000:0.0:1788201559.732557:0:23733:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201559.732562:0:23733:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201559.732566:0:23733:0:(namei.c:2239:do_mkdir()) VFS Op:name=d4, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00000020:00100000:0.0:1788201559.732627:0:23733:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201559.732637:0:23733:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172709c00 x1875064727871872/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201559.732660:0:23733:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172709c00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23733:1875064727871872:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201559.732737:0:23733:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150c83540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201559.738281:0:23733:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172709c00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23733:1875064727871872:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201559.738332:0:23733:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x137:0x0](ffff8bc1459500c8) 00000080:00200000:0.0:1788201559.738341:0:23733:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x137:0x0], updating i_size 512 00000080:00200000:1.0:1788201559.753364:0:23734:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.753398:0:23734:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.753419:0:23734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.753442:0:23734:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.753451:0:23734:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.753459:0:23734:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.753463:0:23734:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.753471:0:23734:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7f6bbd0 00010000:00010000:1.0:1788201559.753475:0:23734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.753484:0:23734:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.753501:0:23734:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.753509:0:23734:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201559.753515:0:23734:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.753528:0:23734:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f0, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=1536 00000080:00200000:1.0:1788201559.753531:0:23734:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.753536:0:23734:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.753541:0:23734:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f0, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=33060, excl=1 00000080:00200000:1.0:1788201559.753545:0:23734:0:(namei.c:2084:ll_mknod()) VFS Op:name=f0, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) mode 100444 dev 0 00000020:00100000:1.0:1788201559.753606:0:23734:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201559.753622:0:23734:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172759180 x1875064727872128/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201559.753650:0:23734:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172759180 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23734:1875064727872128:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201559.753927:0:23734:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.759275:0:23734:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172759180 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23734:1875064727872128:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201559.759328:0:23734:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x138:0x0](ffff8bc14465a1c8) 00000080:00200000:1.0:1788201559.759410:0:23734:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f0, unhashed 1 00000080:00200000:1.0:1788201559.759485:0:23734:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.759503:0:23734:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.759521:0:23734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.759535:0:23734:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.759543:0:23734:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.759548:0:23734:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.759552:0:23734:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.759559:0:23734:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7f6bbd0 00010000:00010000:1.0:1788201559.759563:0:23734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.759572:0:23734:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.759586:0:23734:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.759594:0:23734:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201559.759599:0:23734:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.759611:0:23734:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f1, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=1536 00000080:00200000:1.0:1788201559.759614:0:23734:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.759620:0:23734:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.759624:0:23734:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f1, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=33060, excl=1 00000080:00200000:1.0:1788201559.759628:0:23734:0:(namei.c:2084:ll_mknod()) VFS Op:name=f1, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) mode 100444 dev 0 00000020:00100000:1.0:1788201559.759681:0:23734:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201559.759691:0:23734:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172758a80 x1875064727872384/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201559.759715:0:23734:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172758a80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23734:1875064727872384:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201559.759846:0:23734:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.766645:0:23734:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172758a80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23734:1875064727872384:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201559.766698:0:23734:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x139:0x0](ffff8bc14465c2c8) 00000080:00200000:1.0:1788201559.766788:0:23734:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f1, unhashed 1 00000080:00200000:1.0:1788201559.766875:0:23734:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.766894:0:23734:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.766912:0:23734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.766926:0:23734:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.766934:0:23734:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.766940:0:23734:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.766943:0:23734:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.766951:0:23734:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7f6bbd0 00010000:00010000:1.0:1788201559.766963:0:23734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.766974:0:23734:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.766990:0:23734:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.766997:0:23734:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201559.767003:0:23734:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.767015:0:23734:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f2, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=1536 00000080:00200000:1.0:1788201559.767018:0:23734:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.767022:0:23734:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.767026:0:23734:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f2, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=33060, excl=1 00000080:00200000:1.0:1788201559.767030:0:23734:0:(namei.c:2084:ll_mknod()) VFS Op:name=f2, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) mode 100444 dev 0 00000020:00100000:1.0:1788201559.767084:0:23734:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201559.767259:0:23734:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172758700 x1875064727872640/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201559.767283:0:23734:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172758700 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23734:1875064727872640:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201559.767413:0:23734:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.774771:0:23734:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172758700 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23734:1875064727872640:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201559.774863:0:23734:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x13a:0x0](ffff8bc14465b248) 00000080:00200000:1.0:1788201559.774953:0:23734:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f2, unhashed 1 00000080:00200000:1.0:1788201559.775028:0:23734:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.775048:0:23734:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.775070:0:23734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.775085:0:23734:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.775104:0:23734:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.775111:0:23734:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.775115:0:23734:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.775125:0:23734:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7f6bbd0 00010000:00010000:1.0:1788201559.775129:0:23734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.775148:0:23734:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.775165:0:23734:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.775172:0:23734:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201559.775177:0:23734:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.775191:0:23734:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f3, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=1536 00000080:00200000:1.0:1788201559.775194:0:23734:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.775199:0:23734:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.775203:0:23734:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f3, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=33060, excl=1 00000080:00200000:1.0:1788201559.775206:0:23734:0:(namei.c:2084:ll_mknod()) VFS Op:name=f3, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) mode 100444 dev 0 00000020:00100000:1.0:1788201559.775261:0:23734:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201559.775271:0:23734:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172759880 x1875064727872896/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201559.775295:0:23734:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172759880 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23734:1875064727872896:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201559.775387:0:23734:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.784064:0:23734:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172759880 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23734:1875064727872896:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201559.784131:0:23734:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x13b:0x0](ffff8bc144659148) 00000080:00200000:1.0:1788201559.784221:0:23734:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f3, unhashed 1 00000080:00200000:1.0:1788201559.784282:0:23734:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.784299:0:23734:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.784318:0:23734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.784333:0:23734:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.784342:0:23734:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.784347:0:23734:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.784351:0:23734:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.784358:0:23734:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7f6bbd0 00010000:00010000:1.0:1788201559.784362:0:23734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.784371:0:23734:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.784387:0:23734:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.784406:0:23734:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201559.784413:0:23734:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.784425:0:23734:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f4, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=1536 00000080:00200000:1.0:1788201559.784429:0:23734:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.784433:0:23734:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.784438:0:23734:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f4, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=33060, excl=1 00000080:00200000:1.0:1788201559.784442:0:23734:0:(namei.c:2084:ll_mknod()) VFS Op:name=f4, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) mode 100444 dev 0 00000020:00100000:1.0:1788201559.784496:0:23734:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201559.784505:0:23734:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc17275aa00 x1875064727873152/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201559.784529:0:23734:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17275aa00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23734:1875064727873152:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201559.784594:0:23734:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.791765:0:23734:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275aa00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23734:1875064727873152:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201559.792263:0:23734:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x13c:0x0](ffff8bc145951988) 00000080:00200000:0.0:1788201559.792357:0:23734:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f4, unhashed 1 00000080:00200000:0.0:1788201559.809471:0:23735:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201559.809509:0:23735:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201559.809530:0:23735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.809555:0:23735:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.809563:0:23735:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201559.809572:0:23735:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201559.809576:0:23735:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:0.0:1788201559.809584:0:23735:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7dabbd0 00010000:00010000:0.0:1788201559.809588:0:23735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.809597:0:23735:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.809613:0:23735:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.809622:0:23735:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201559.809628:0:23735:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.809640:0:23735:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d0, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=24 00000080:00200000:0.0:1788201559.809645:0:23735:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=d0, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=0 00000002:00010000:0.0:1788201559.809657:0:23735:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d0,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: lookup flags 0 00010000:00010000:0.0:1788201559.809708:0:23735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6ecea lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201559.809716:0:23735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6ecea lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23735 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201559.809727:0:23735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6ecea lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23735 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201559.809758:0:23735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172708a80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23735:1875064727873280:192.168.201.143@tcp:101:createmany.0 00000100:00100000:0.0:1788201559.809897:0:23735:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150c83540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.814558:0:23735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172708a80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23735:1875064727873280:192.168.201.143@tcp:101:createmany.0 00010000:00010000:1.0:1788201559.814587:0:23735:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6ecea lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095434 expref: -99 pid: 23735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.814609:0:23735:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6ecea lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095434 expref: -99 pid: 23735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.814617:0:23735:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6ecea lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095434 expref: -99 pid: 23735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.814628:0:23735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6ecea lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095434 expref: -99 pid: 23735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.814639:0:23735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6ecea lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095434 expref: -99 pid: 23735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.814651:0:23735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6ecea lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095434 expref: -99 pid: 23735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.814659:0:23735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6ecea lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095434 expref: -99 pid: 23735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.814665:0:23735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6ecea lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095434 expref: -99 pid: 23735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201559.814682:0:23735:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x10 disposition=0xb, status=0 req@ffff8bc172708a80 x1875064727873280/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201575 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201559.814694:0:23735:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6ecea lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095434 expref: -99 pid: 23735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.814704:0:23735:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/307 (0 0) 00000080:00200000:1.0:1788201559.814711:0:23735:0:(namei.c:952:ll_intent_lock()) intent lock 16 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201559.814935:0:23735:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x133:0x0], updating i_size 512 00000080:00200000:1.0:1788201559.814942:0:23735:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x133:0x0](ffff8bc1459563c8): rc = 0 00000080:00010000:1.0:1788201559.814949:0:23735:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x133:0x0](ffff8bc1459563c8) for lock 0xd138388016f6ecea 00000080:00010000:1.0:1788201559.814973:0:23735:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x133:0x0](ffff8bc1459563c8) 00000080:00010000:1.0:1788201559.814977:0:23735:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ecea from it ffffadd1c7dabaa0 00010000:00010000:1.0:1788201559.814981:0:23735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6ecea lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095434 expref: -99 pid: 23735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.814991:0:23735:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6ecea lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095434 expref: -99 pid: 23735 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201559.815027:0:23735:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.815048:0:23735:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f0, dir=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), flags=1536 00000080:00200000:1.0:1788201559.815052:0:23735:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.815058:0:23735:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.815063:0:23735:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f0, dir=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), flags=33060, excl=1 00000080:00200000:1.0:1788201559.815066:0:23735:0:(namei.c:2084:ll_mknod()) VFS Op:name=f0, dir=[0x200000bd7:0x133:0x0](ffff8bc1459563c8) mode 100444 dev 0 00000020:00100000:1.0:1788201559.815252:0:23735:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201559.815260:0:23735:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172759f80 x1875064727873536/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201559.815284:0:23735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172759f80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23735:1875064727873536:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201559.815421:0:23735:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.820909:0:23735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172759f80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23735:1875064727873536:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201559.820975:0:23735:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x13d:0x0](ffff8bc14465f448) 00000080:00200000:1.0:1788201559.821066:0:23735:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f0, unhashed 1 00000080:00200000:1.0:1788201559.821149:0:23735:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.821168:0:23735:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.821187:0:23735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.821201:0:23735:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.821208:0:23735:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.821214:0:23735:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.821217:0:23735:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.821225:0:23735:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7dabbd0 00010000:00010000:1.0:1788201559.821229:0:23735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.821237:0:23735:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.821256:0:23735:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.821263:0:23735:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201559.821268:0:23735:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.821272:0:23735:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d0, flags=24 00000080:00200000:1.0:1788201559.821275:0:23735:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.821287:0:23735:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), flags=1536 00000080:00200000:1.0:1788201559.821291:0:23735:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.821297:0:23735:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.821301:0:23735:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), flags=33060, excl=1 00000080:00200000:1.0:1788201559.821305:0:23735:0:(namei.c:2084:ll_mknod()) VFS Op:name=f1, dir=[0x200000bd7:0x133:0x0](ffff8bc1459563c8) mode 100444 dev 0 00000020:00100000:1.0:1788201559.821360:0:23735:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201559.821369:0:23735:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc17275b800 x1875064727873792/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201559.821401:0:23735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17275b800 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23735:1875064727873792:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201559.821484:0:23735:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.830582:0:23735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275b800 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23735:1875064727873792:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201559.830633:0:23735:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x13e:0x0](ffff8bc1446b9148) 00000080:00200000:1.0:1788201559.830719:0:23735:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f1, unhashed 1 00000080:00200000:1.0:1788201559.830777:0:23735:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.830872:0:23735:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.830891:0:23735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.830905:0:23735:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.830914:0:23735:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.830919:0:23735:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.830923:0:23735:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.830930:0:23735:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7dabbd0 00010000:00010000:1.0:1788201559.830935:0:23735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.830943:0:23735:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.830969:0:23735:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.830977:0:23735:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201559.830983:0:23735:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.830986:0:23735:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d0, flags=24 00000080:00200000:1.0:1788201559.830989:0:23735:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.831002:0:23735:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f2, dir=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), flags=1536 00000080:00200000:1.0:1788201559.831006:0:23735:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.831012:0:23735:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.831016:0:23735:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f2, dir=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), flags=33060, excl=1 00000080:00200000:1.0:1788201559.831020:0:23735:0:(namei.c:2084:ll_mknod()) VFS Op:name=f2, dir=[0x200000bd7:0x133:0x0](ffff8bc1459563c8) mode 100444 dev 0 00000020:00100000:1.0:1788201559.831070:0:23735:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201559.831080:0:23735:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172759c00 x1875064727874048/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201559.831103:0:23735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172759c00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23735:1875064727874048:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201559.831182:0:23735:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.837025:0:23735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172759c00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23735:1875064727874048:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201559.837079:0:23735:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x13f:0x0](ffff8bc1446bba88) 00000080:00200000:1.0:1788201559.837178:0:23735:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f2, unhashed 1 00000080:00200000:1.0:1788201559.837238:0:23735:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.837256:0:23735:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.837276:0:23735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.837291:0:23735:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.837300:0:23735:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.837305:0:23735:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.837309:0:23735:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.837315:0:23735:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7dabbd0 00010000:00010000:1.0:1788201559.837319:0:23735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.837328:0:23735:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.837343:0:23735:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.837350:0:23735:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201559.837356:0:23735:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.837359:0:23735:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d0, flags=24 00000080:00200000:1.0:1788201559.837362:0:23735:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.837375:0:23735:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f3, dir=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), flags=1536 00000080:00200000:1.0:1788201559.837378:0:23735:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.837384:0:23735:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.837388:0:23735:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f3, dir=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), flags=33060, excl=1 00000080:00200000:1.0:1788201559.837392:0:23735:0:(namei.c:2084:ll_mknod()) VFS Op:name=f3, dir=[0x200000bd7:0x133:0x0](ffff8bc1459563c8) mode 100444 dev 0 00000020:00100000:1.0:1788201559.837449:0:23735:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201559.837459:0:23735:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc17275a300 x1875064727874304/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201559.837489:0:23735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17275a300 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23735:1875064727874304:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201559.837565:0:23735:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.843384:0:23735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275a300 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23735:1875064727874304:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201559.843442:0:23735:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x140:0x0](ffff8bc1446b8908) 00000080:00200000:1.0:1788201559.843524:0:23735:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f3, unhashed 1 00000080:00200000:1.0:1788201559.843581:0:23735:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.843598:0:23735:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.843615:0:23735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.843629:0:23735:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.843636:0:23735:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.843642:0:23735:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.843646:0:23735:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.843654:0:23735:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7dabbd0 00010000:00010000:1.0:1788201559.843657:0:23735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.843665:0:23735:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.843680:0:23735:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.843686:0:23735:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201559.843692:0:23735:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.843695:0:23735:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d0, flags=24 00000080:00200000:1.0:1788201559.843698:0:23735:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.843710:0:23735:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), flags=1536 00000080:00200000:1.0:1788201559.843714:0:23735:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.843719:0:23735:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.843723:0:23735:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), flags=33060, excl=1 00000080:00200000:1.0:1788201559.843726:0:23735:0:(namei.c:2084:ll_mknod()) VFS Op:name=f4, dir=[0x200000bd7:0x133:0x0](ffff8bc1459563c8) mode 100444 dev 0 00000020:00100000:1.0:1788201559.843780:0:23735:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201559.843946:0:23735:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc17275b480 x1875064727874560/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201559.845430:0:23735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17275b480 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23735:1875064727874560:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201559.845544:0:23735:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150c83540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201559.852788:0:23735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275b480 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23735:1875064727874560:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201559.852866:0:23735:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x141:0x0](ffff8bc145953a88) 00000080:00200000:0.0:1788201559.852950:0:23735:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f4, unhashed 1 00000080:00200000:0.0:1788201559.866529:0:23736:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201559.866561:0:23736:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201559.866580:0:23736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.866597:0:23736:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.866606:0:23736:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201559.866613:0:23736:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201559.866617:0:23736:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:0.0:1788201559.866625:0:23736:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7db3bd0 00010000:00010000:0.0:1788201559.866629:0:23736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.866638:0:23736:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.866656:0:23736:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.866665:0:23736:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201559.866671:0:23736:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.866684:0:23736:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d1, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=24 00000080:00200000:0.0:1788201559.866690:0:23736:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=d1, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=0 00000002:00010000:0.0:1788201559.866703:0:23736:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d1,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: lookup flags 0 00010000:00010000:0.0:1788201559.866767:0:23736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6ecf1 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201559.866776:0:23736:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6ecf1 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201559.866788:0:23736:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6ecf1 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201559.867018:0:23736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17270a680 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23736:1875064727874688:192.168.201.143@tcp:101:createmany.0 00000100:00100000:0.0:1788201559.867396:0:23736:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150c83540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201559.872153:0:23736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17270a680 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23736:1875064727874688:192.168.201.143@tcp:101:createmany.0 00010000:00010000:0.0:1788201559.872182:0:23736:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6ecf1 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095496 expref: -99 pid: 23736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201559.872206:0:23736:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6ecf1 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095496 expref: -99 pid: 23736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201559.872214:0:23736:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6ecf1 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095496 expref: -99 pid: 23736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201559.872226:0:23736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6ecf1 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095496 expref: -99 pid: 23736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201559.872242:0:23736:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6ecf1 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095496 expref: -99 pid: 23736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201559.872254:0:23736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6ecf1 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095496 expref: -99 pid: 23736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201559.872263:0:23736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6ecf1 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095496 expref: -99 pid: 23736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201559.872271:0:23736:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6ecf1 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095496 expref: -99 pid: 23736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201559.872284:0:23736:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x10 disposition=0xb, status=0 req@ffff8bc17270a680 x1875064727874688/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201575 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201559.872297:0:23736:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6ecf1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095496 expref: -99 pid: 23736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201559.872307:0:23736:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/308 (0 0) 00000080:00200000:0.0:1788201559.872314:0:23736:0:(namei.c:952:ll_intent_lock()) intent lock 16 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201559.872336:0:23736:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x134:0x0], updating i_size 512 00000080:00200000:0.0:1788201559.872340:0:23736:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x134:0x0](ffff8bc145955348): rc = 0 00000080:00010000:0.0:1788201559.872346:0:23736:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x134:0x0](ffff8bc145955348) for lock 0xd138388016f6ecf1 00000080:00010000:0.0:1788201559.872359:0:23736:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x134:0x0](ffff8bc145955348) 00000080:00010000:0.0:1788201559.872364:0:23736:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ecf1 from it ffffadd1c7db3aa0 00010000:00010000:0.0:1788201559.872368:0:23736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6ecf1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095496 expref: -99 pid: 23736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201559.872383:0:23736:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6ecf1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095496 expref: -99 pid: 23736 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201559.872416:0:23736:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.872439:0:23736:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f0, dir=[0x200000bd7:0x134:0x0](ffff8bc145955348), flags=1536 00000080:00200000:0.0:1788201559.872442:0:23736:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348), inode mode 41ed mask 3 00000080:00200000:0.0:1788201559.872448:0:23736:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348), inode mode 41ed mask 3 00000080:00200000:0.0:1788201559.872453:0:23736:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f0, dir=[0x200000bd7:0x134:0x0](ffff8bc145955348), flags=33060, excl=1 00000080:00200000:0.0:1788201559.872456:0:23736:0:(namei.c:2084:ll_mknod()) VFS Op:name=f0, dir=[0x200000bd7:0x134:0x0](ffff8bc145955348) mode 100444 dev 0 00000020:00100000:0.0:1788201559.872513:0:23736:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201559.872521:0:23736:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc17270a680 x1875064727874944/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201559.872543:0:23736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17270a680 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23736:1875064727874944:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201559.872635:0:23736:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150c83540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201559.878547:0:23736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17270a680 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23736:1875064727874944:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201559.878602:0:23736:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x142:0x0](ffff8bc1459542c8) 00000080:00200000:0.0:1788201559.878690:0:23736:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f0, unhashed 1 00000080:00200000:0.0:1788201559.878756:0:23736:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201559.878773:0:23736:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201559.878838:0:23736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.878855:0:23736:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.878868:0:23736:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201559.878874:0:23736:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201559.878878:0:23736:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:0.0:1788201559.878886:0:23736:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7db3bd0 00010000:00010000:0.0:1788201559.878891:0:23736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.878900:0:23736:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.878915:0:23736:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.878922:0:23736:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201559.878927:0:23736:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.878930:0:23736:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d1, flags=24 00000080:00200000:0.0:1788201559.878933:0:23736:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.878946:0:23736:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x134:0x0](ffff8bc145955348), flags=1536 00000080:00200000:0.0:1788201559.878949:0:23736:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348), inode mode 41ed mask 3 00000080:00200000:0.0:1788201559.878967:0:23736:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348), inode mode 41ed mask 3 00000080:00200000:0.0:1788201559.878971:0:23736:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x134:0x0](ffff8bc145955348), flags=33060, excl=1 00000080:00200000:0.0:1788201559.878975:0:23736:0:(namei.c:2084:ll_mknod()) VFS Op:name=f1, dir=[0x200000bd7:0x134:0x0](ffff8bc145955348) mode 100444 dev 0 00000020:00100000:0.0:1788201559.879032:0:23736:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201559.879042:0:23736:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172708a80 x1875064727875200/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201559.879066:0:23736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172708a80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23736:1875064727875200:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201559.879181:0:23736:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150c83540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201559.884332:0:23736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172708a80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23736:1875064727875200:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201559.884386:0:23736:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x143:0x0](ffff8bc145956c08) 00000080:00200000:0.0:1788201559.884478:0:23736:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f1, unhashed 1 00000080:00200000:0.0:1788201559.884536:0:23736:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201559.884554:0:23736:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201559.884571:0:23736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.884586:0:23736:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.884594:0:23736:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201559.884600:0:23736:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201559.884603:0:23736:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:0.0:1788201559.884611:0:23736:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7db3bd0 00010000:00010000:0.0:1788201559.884615:0:23736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.884624:0:23736:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.884639:0:23736:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.884646:0:23736:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201559.884652:0:23736:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.884655:0:23736:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d1, flags=24 00000080:00200000:0.0:1788201559.884658:0:23736:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.884670:0:23736:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f2, dir=[0x200000bd7:0x134:0x0](ffff8bc145955348), flags=1536 00000080:00200000:0.0:1788201559.884674:0:23736:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348), inode mode 41ed mask 3 00000080:00200000:0.0:1788201559.884679:0:23736:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348), inode mode 41ed mask 3 00000080:00200000:0.0:1788201559.884684:0:23736:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f2, dir=[0x200000bd7:0x134:0x0](ffff8bc145955348), flags=33060, excl=1 00000080:00200000:0.0:1788201559.884687:0:23736:0:(namei.c:2084:ll_mknod()) VFS Op:name=f2, dir=[0x200000bd7:0x134:0x0](ffff8bc145955348) mode 100444 dev 0 00000020:00100000:0.0:1788201559.884783:0:23736:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201559.884830:0:23736:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172561880 x1875064727875456/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201559.884854:0:23736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172561880 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23736:1875064727875456:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201559.884995:0:23736:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150c83540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201559.891614:0:23736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172561880 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23736:1875064727875456:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201559.891673:0:23736:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x144:0x0](ffff8bc145957448) 00000080:00200000:0.0:1788201559.891775:0:23736:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f2, unhashed 1 00000080:00200000:0.0:1788201559.891866:0:23736:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201559.891884:0:23736:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201559.891902:0:23736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.891918:0:23736:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.891927:0:23736:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201559.891932:0:23736:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201559.891936:0:23736:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:0.0:1788201559.891965:0:23736:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7db3bd0 00010000:00010000:0.0:1788201559.891970:0:23736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.891979:0:23736:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.892001:0:23736:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.892009:0:23736:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201559.892015:0:23736:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.892019:0:23736:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d1, flags=24 00000080:00200000:0.0:1788201559.892022:0:23736:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.892035:0:23736:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f3, dir=[0x200000bd7:0x134:0x0](ffff8bc145955348), flags=1536 00000080:00200000:0.0:1788201559.892039:0:23736:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348), inode mode 41ed mask 3 00000080:00200000:0.0:1788201559.892043:0:23736:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348), inode mode 41ed mask 3 00000080:00200000:0.0:1788201559.892048:0:23736:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f3, dir=[0x200000bd7:0x134:0x0](ffff8bc145955348), flags=33060, excl=1 00000080:00200000:0.0:1788201559.892051:0:23736:0:(namei.c:2084:ll_mknod()) VFS Op:name=f3, dir=[0x200000bd7:0x134:0x0](ffff8bc145955348) mode 100444 dev 0 00000020:00100000:0.0:1788201559.892104:0:23736:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201559.892116:0:23736:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172561c00 x1875064727875712/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201559.892150:0:23736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172561c00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23736:1875064727875712:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201559.892227:0:23736:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150c83540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201559.903215:0:23736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172561c00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23736:1875064727875712:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201559.903265:0:23736:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x145:0x0](ffff8bc145950908) 00000080:00200000:0.0:1788201559.903351:0:23736:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f3, unhashed 1 00000080:00200000:0.0:1788201559.903407:0:23736:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201559.903425:0:23736:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201559.903444:0:23736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.903461:0:23736:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.903477:0:23736:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201559.903484:0:23736:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201559.903488:0:23736:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:0.0:1788201559.903496:0:23736:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7db3bd0 00010000:00010000:0.0:1788201559.903500:0:23736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.903511:0:23736:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.903525:0:23736:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.903533:0:23736:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201559.903538:0:23736:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.903542:0:23736:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d1, flags=24 00000080:00200000:0.0:1788201559.903544:0:23736:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.903558:0:23736:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x134:0x0](ffff8bc145955348), flags=1536 00000080:00200000:0.0:1788201559.903561:0:23736:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348), inode mode 41ed mask 3 00000080:00200000:0.0:1788201559.903565:0:23736:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348), inode mode 41ed mask 3 00000080:00200000:0.0:1788201559.903569:0:23736:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x134:0x0](ffff8bc145955348), flags=33060, excl=1 00000080:00200000:0.0:1788201559.903573:0:23736:0:(namei.c:2084:ll_mknod()) VFS Op:name=f4, dir=[0x200000bd7:0x134:0x0](ffff8bc145955348) mode 100444 dev 0 00000020:00100000:0.0:1788201559.903626:0:23736:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201559.903635:0:23736:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172560e00 x1875064727875968/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201559.903658:0:23736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172560e00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23736:1875064727875968:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201559.904099:0:23736:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150c83540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201559.908974:0:23736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172560e00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23736:1875064727875968:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201559.909029:0:23736:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x146:0x0](ffff8bc145951148) 00000080:00200000:0.0:1788201559.909143:0:23736:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f4, unhashed 1 00000100:00100000:1.0:1788201559.925534:0:23737:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23737:1875064727876096:192.168.201.143@tcp:101:createmany.0 00010000:00010000:1.0:1788201559.925560:0:23737:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6ecf8 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710954f8 expref: -99 pid: 23737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.925582:0:23737:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6ecf8 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710954f8 expref: -99 pid: 23737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.925590:0:23737:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6ecf8 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710954f8 expref: -99 pid: 23737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.925599:0:23737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6ecf8 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710954f8 expref: -99 pid: 23737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.925610:0:23737:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6ecf8 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710954f8 expref: -99 pid: 23737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.925622:0:23737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6ecf8 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710954f8 expref: -99 pid: 23737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.925630:0:23737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6ecf8 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710954f8 expref: -99 pid: 23737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.925637:0:23737:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6ecf8 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710954f8 expref: -99 pid: 23737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201559.925649:0:23737:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x10 disposition=0xb, status=0 req@ffff8bc1726cd180 x1875064727876096/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201575 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201559.925662:0:23737:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6ecf8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710954f8 expref: -99 pid: 23737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.925672:0:23737:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/309 (0 0) 00000080:00200000:1.0:1788201559.925679:0:23737:0:(namei.c:952:ll_intent_lock()) intent lock 16 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201559.925702:0:23737:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x135:0x0], updating i_size 512 00000080:00200000:1.0:1788201559.925705:0:23737:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x135:0x0](ffff8bc145955b88): rc = 0 00000080:00010000:1.0:1788201559.925711:0:23737:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x135:0x0](ffff8bc145955b88) for lock 0xd138388016f6ecf8 00000080:00010000:1.0:1788201559.925724:0:23737:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x135:0x0](ffff8bc145955b88) 00000080:00010000:1.0:1788201559.925728:0:23737:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ecf8 from it ffffadd1c7d8baa0 00010000:00010000:1.0:1788201559.925732:0:23737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6ecf8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710954f8 expref: -99 pid: 23737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201559.925755:0:23737:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6ecf8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710954f8 expref: -99 pid: 23737 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201559.925815:0:23737:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.925839:0:23737:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f0, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88), flags=1536 00000080:00200000:1.0:1788201559.925843:0:23737:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.925849:0:23737:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.925854:0:23737:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f0, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88), flags=33060, excl=1 00000080:00200000:1.0:1788201559.925858:0:23737:0:(namei.c:2084:ll_mknod()) VFS Op:name=f0, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88) mode 100444 dev 0 00000020:00100000:1.0:1788201559.925921:0:23737:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201559.925929:0:23737:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc17275bb80 x1875064727876352/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201559.925950:0:23737:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17275bb80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23737:1875064727876352:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201559.926974:0:23737:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.931576:0:23737:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275bb80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23737:1875064727876352:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201559.931629:0:23737:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x147:0x0](ffff8bc1446bcb08) 00000080:00200000:1.0:1788201559.931738:0:23737:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f0, unhashed 1 00000080:00200000:1.0:1788201559.931846:0:23737:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.931865:0:23737:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.931883:0:23737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.931897:0:23737:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.931904:0:23737:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.931910:0:23737:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.931914:0:23737:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.931921:0:23737:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7d8bbd0 00010000:00010000:1.0:1788201559.931925:0:23737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.931937:0:23737:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.931965:0:23737:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.931972:0:23737:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201559.931978:0:23737:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.931981:0:23737:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d2, flags=24 00000080:00200000:1.0:1788201559.931984:0:23737:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.931996:0:23737:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88), flags=1536 00000080:00200000:1.0:1788201559.932000:0:23737:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.932005:0:23737:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.932008:0:23737:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88), flags=33060, excl=1 00000080:00200000:1.0:1788201559.932012:0:23737:0:(namei.c:2084:ll_mknod()) VFS Op:name=f1, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88) mode 100444 dev 0 00000020:00100000:1.0:1788201559.932069:0:23737:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201559.932080:0:23737:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b3b80 x1875064727876608/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201559.932101:0:23737:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b3b80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23737:1875064727876608:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201559.932161:0:23737:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.936700:0:23737:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b3b80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23737:1875064727876608:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201559.936749:0:23737:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x148:0x0](ffff8bc1446bd348) 00000080:00200000:1.0:1788201559.936868:0:23737:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f1, unhashed 1 00000080:00200000:1.0:1788201559.936925:0:23737:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.936942:0:23737:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.936969:0:23737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.936987:0:23737:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.936995:0:23737:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.937001:0:23737:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.937005:0:23737:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.937012:0:23737:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7d8bbd0 00010000:00010000:1.0:1788201559.937016:0:23737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.937025:0:23737:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.937040:0:23737:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.937048:0:23737:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201559.937053:0:23737:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.937056:0:23737:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d2, flags=24 00000080:00200000:1.0:1788201559.937058:0:23737:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.937070:0:23737:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f2, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88), flags=1536 00000080:00200000:1.0:1788201559.937074:0:23737:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.937080:0:23737:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.937084:0:23737:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f2, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88), flags=33060, excl=1 00000080:00200000:1.0:1788201559.937087:0:23737:0:(namei.c:2084:ll_mknod()) VFS Op:name=f2, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88) mode 100444 dev 0 00000020:00100000:1.0:1788201559.937150:0:23737:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201559.937159:0:23737:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b0380 x1875064727876864/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201559.937186:0:23737:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b0380 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23737:1875064727876864:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201559.937255:0:23737:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.943841:0:23737:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b0380 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23737:1875064727876864:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201559.943893:0:23737:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x149:0x0](ffff8bc1446baa08) 00000080:00200000:1.0:1788201559.943994:0:23737:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f2, unhashed 1 00000080:00200000:1.0:1788201559.944060:0:23737:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.944078:0:23737:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.944109:0:23737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.944124:0:23737:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.944136:0:23737:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.944142:0:23737:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.944146:0:23737:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.944154:0:23737:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7d8bbd0 00010000:00010000:1.0:1788201559.944158:0:23737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.944166:0:23737:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.944182:0:23737:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.944189:0:23737:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201559.944195:0:23737:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.944199:0:23737:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d2, flags=24 00000080:00200000:1.0:1788201559.944202:0:23737:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.944218:0:23737:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f3, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88), flags=1536 00000080:00200000:1.0:1788201559.944222:0:23737:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.944227:0:23737:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.944231:0:23737:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f3, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88), flags=33060, excl=1 00000080:00200000:1.0:1788201559.944235:0:23737:0:(namei.c:2084:ll_mknod()) VFS Op:name=f3, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88) mode 100444 dev 0 00000020:00100000:1.0:1788201559.944288:0:23737:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201559.944296:0:23737:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14602b800 x1875064727877120/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201559.944316:0:23737:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602b800 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23737:1875064727877120:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201559.944387:0:23737:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201559.950615:0:23737:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602b800 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23737:1875064727877120:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201559.950661:0:23737:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x14a:0x0](ffff8bc1446bdb88) 00000080:00200000:1.0:1788201559.950744:0:23737:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f3, unhashed 1 00000080:00200000:1.0:1788201559.950825:0:23737:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201559.950856:0:23737:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201559.950875:0:23737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.950891:0:23737:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.950899:0:23737:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201559.950904:0:23737:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201559.950908:0:23737:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201559.950916:0:23737:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7d8bbd0 00010000:00010000:1.0:1788201559.950921:0:23737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201559.950931:0:23737:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201559.950947:0:23737:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.950963:0:23737:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201559.950969:0:23737:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.950972:0:23737:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d2, flags=24 00000080:00200000:1.0:1788201559.950975:0:23737:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 1 00000080:00200000:1.0:1788201559.950987:0:23737:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88), flags=1536 00000080:00200000:1.0:1788201559.950990:0:23737:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.950995:0:23737:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 3 00000080:00200000:1.0:1788201559.951000:0:23737:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88), flags=33060, excl=1 00000080:00200000:1.0:1788201559.951003:0:23737:0:(namei.c:2084:ll_mknod()) VFS Op:name=f4, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88) mode 100444 dev 0 00000020:00100000:1.0:1788201559.951055:0:23737:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201559.951064:0:23737:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14602a300 x1875064727877376/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201559.951085:0:23737:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602a300 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23737:1875064727877376:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201559.951174:0:23737:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201559.966759:0:23737:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602a300 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23737:1875064727877376:192.168.201.143@tcp:36:createmany.0 00000080:00200000:3.0:1788201559.966842:0:23737:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x14b:0x0](ffff8bc1459d00c8) 00000080:00200000:3.0:1788201559.967014:0:23737:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f4, unhashed 1 00000080:00200000:0.0:1788201559.983459:0:23738:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201559.983495:0:23738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201559.983515:0:23738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.983531:0:23738:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.983540:0:23738:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201559.983548:0:23738:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201559.983551:0:23738:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:0.0:1788201559.983559:0:23738:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7db3bd0 00010000:00010000:0.0:1788201559.983563:0:23738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.983572:0:23738:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.983587:0:23738:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.983595:0:23738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201559.983601:0:23738:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.983613:0:23738:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d3, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=24 00000080:00200000:0.0:1788201559.983618:0:23738:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=d3, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=0 00000002:00010000:0.0:1788201559.983631:0:23738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d3,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: lookup flags 0 00010000:00010000:0.0:1788201559.983678:0:23738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6ecff lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201559.983686:0:23738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6ecff lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23738 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201559.983697:0:23738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6ecff lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23738 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201559.983723:0:23738:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172562a00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23738:1875064727877504:192.168.201.143@tcp:101:createmany.0 00000100:00100000:0.0:1788201559.985088:0:23738:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150c83540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201559.993308:0:23738:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172562a00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23738:1875064727877504:192.168.201.143@tcp:101:createmany.0 00010000:00010000:0.0:1788201559.993342:0:23738:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6ecff lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109555a expref: -99 pid: 23738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201559.993366:0:23738:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6ecff lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109555a expref: -99 pid: 23738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201559.993375:0:23738:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6ecff lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109555a expref: -99 pid: 23738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201559.993385:0:23738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6ecff lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109555a expref: -99 pid: 23738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201559.993396:0:23738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6ecff lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109555a expref: -99 pid: 23738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201559.993410:0:23738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6ecff lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109555a expref: -99 pid: 23738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201559.993422:0:23738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6ecff lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109555a expref: -99 pid: 23738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201559.993430:0:23738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6ecff lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109555a expref: -99 pid: 23738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201559.993442:0:23738:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x10 disposition=0xb, status=0 req@ffff8bc172562a00 x1875064727877504/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201575 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201559.993455:0:23738:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6ecff lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109555a expref: -99 pid: 23738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201559.993465:0:23738:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/310 (0 0) 00000080:00200000:0.0:1788201559.993473:0:23738:0:(namei.c:952:ll_intent_lock()) intent lock 16 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201559.993499:0:23738:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x136:0x0], updating i_size 512 00000080:00200000:0.0:1788201559.993503:0:23738:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x136:0x0](ffff8bc1459521c8): rc = 0 00000080:00010000:0.0:1788201559.993510:0:23738:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x136:0x0](ffff8bc1459521c8) for lock 0xd138388016f6ecff 00000080:00010000:0.0:1788201559.993530:0:23738:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x136:0x0](ffff8bc1459521c8) 00000080:00010000:0.0:1788201559.993534:0:23738:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ecff from it ffffadd1c7db3aa0 00010000:00010000:0.0:1788201559.993538:0:23738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6ecff lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109555a expref: -99 pid: 23738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201559.993548:0:23738:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6ecff lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109555a expref: -99 pid: 23738 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201559.993583:0:23738:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.993607:0:23738:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f0, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), flags=1536 00000080:00200000:0.0:1788201559.993612:0:23738:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201559.993618:0:23738:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201559.993623:0:23738:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f0, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), flags=33060, excl=1 00000080:00200000:0.0:1788201559.993627:0:23738:0:(namei.c:2084:ll_mknod()) VFS Op:name=f0, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8) mode 100444 dev 0 00000020:00100000:0.0:1788201559.993683:0:23738:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201559.993691:0:23738:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172562a00 x1875064727877760/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201559.993715:0:23738:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172562a00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23738:1875064727877760:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201559.993832:0:23738:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150c83540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201559.998757:0:23738:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172562a00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23738:1875064727877760:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201559.998881:0:23738:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x14c:0x0](ffff8bc145954b08) 00000080:00200000:0.0:1788201559.998985:0:23738:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f0, unhashed 1 00000080:00200000:0.0:1788201559.999051:0:23738:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201559.999068:0:23738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201559.999086:0:23738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.999332:0:23738:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.999341:0:23738:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201559.999349:0:23738:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201559.999353:0:23738:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:0.0:1788201559.999361:0:23738:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7db3bd0 00010000:00010000:0.0:1788201559.999366:0:23738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201559.999380:0:23738:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201559.999397:0:23738:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.999404:0:23738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201559.999409:0:23738:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.999413:0:23738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d3, flags=24 00000080:00200000:0.0:1788201559.999416:0:23738:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201559.999429:0:23738:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), flags=1536 00000080:00200000:0.0:1788201559.999432:0:23738:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201559.999437:0:23738:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201559.999441:0:23738:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), flags=33060, excl=1 00000080:00200000:0.0:1788201559.999445:0:23738:0:(namei.c:2084:ll_mknod()) VFS Op:name=f1, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8) mode 100444 dev 0 00000020:00100000:0.0:1788201559.999496:0:23738:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201559.999506:0:23738:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172562d80 x1875064727878016/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201559.999529:0:23738:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172562d80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23738:1875064727878016:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201559.999650:0:23738:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150c83540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201560.011322:0:23738:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172562d80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23738:1875064727878016:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201560.011380:0:23738:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x14d:0x0](ffff8bc144683248) 00000080:00200000:0.0:1788201560.011533:0:23738:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f1, unhashed 1 00000080:00200000:0.0:1788201560.011595:0:23738:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201560.011613:0:23738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201560.011633:0:23738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201560.011654:0:23738:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201560.011663:0:23738:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201560.011669:0:23738:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201560.011673:0:23738:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:0.0:1788201560.011681:0:23738:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7db3bd0 00010000:00010000:0.0:1788201560.011686:0:23738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201560.011695:0:23738:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201560.011710:0:23738:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201560.011717:0:23738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201560.011723:0:23738:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201560.011727:0:23738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d3, flags=24 00000080:00200000:0.0:1788201560.011730:0:23738:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201560.011964:0:23738:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f2, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), flags=1536 00000080:00200000:0.0:1788201560.011970:0:23738:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201560.011976:0:23738:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201560.011980:0:23738:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f2, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), flags=33060, excl=1 00000080:00200000:0.0:1788201560.011984:0:23738:0:(namei.c:2084:ll_mknod()) VFS Op:name=f2, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8) mode 100444 dev 0 00000020:00100000:0.0:1788201560.012042:0:23738:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201560.012052:0:23738:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172561f80 x1875064727878272/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201560.012082:0:23738:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172561f80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23738:1875064727878272:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201560.012211:0:23738:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150c83540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201560.019725:0:23738:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172561f80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23738:1875064727878272:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201560.019831:0:23738:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x14e:0x0](ffff8bc144683a88) 00000080:00200000:0.0:1788201560.019923:0:23738:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f2, unhashed 1 00000080:00200000:0.0:1788201560.019995:0:23738:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201560.020013:0:23738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201560.020032:0:23738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201560.020047:0:23738:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201560.020054:0:23738:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201560.020060:0:23738:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201560.020064:0:23738:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:0.0:1788201560.020072:0:23738:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7db3bd0 00010000:00010000:0.0:1788201560.020076:0:23738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201560.020085:0:23738:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201560.020114:0:23738:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201560.020121:0:23738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201560.020126:0:23738:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201560.020140:0:23738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d3, flags=24 00000080:00200000:0.0:1788201560.020144:0:23738:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201560.020156:0:23738:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f3, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), flags=1536 00000080:00200000:0.0:1788201560.020159:0:23738:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201560.020164:0:23738:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201560.020168:0:23738:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f3, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), flags=33060, excl=1 00000080:00200000:0.0:1788201560.020172:0:23738:0:(namei.c:2084:ll_mknod()) VFS Op:name=f3, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8) mode 100444 dev 0 00000020:00100000:0.0:1788201560.020225:0:23738:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201560.020234:0:23738:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172563480 x1875064727878528/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201560.020256:0:23738:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172563480 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23738:1875064727878528:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201560.020341:0:23738:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150c83540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201560.025403:0:23738:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172563480 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23738:1875064727878528:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201560.025461:0:23738:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x14f:0x0](ffff8bc144681148) 00000080:00200000:0.0:1788201560.025552:0:23738:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f3, unhashed 1 00000080:00200000:0.0:1788201560.025611:0:23738:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201560.025630:0:23738:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201560.025649:0:23738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201560.025663:0:23738:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201560.025670:0:23738:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201560.025676:0:23738:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201560.025679:0:23738:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:0.0:1788201560.025687:0:23738:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7db3bd0 00010000:00010000:0.0:1788201560.025691:0:23738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201560.025699:0:23738:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201560.025714:0:23738:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201560.025721:0:23738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201560.025727:0:23738:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201560.025730:0:23738:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d3, flags=24 00000080:00200000:0.0:1788201560.025733:0:23738:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201560.025745:0:23738:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), flags=1536 00000080:00200000:0.0:1788201560.025749:0:23738:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201560.025753:0:23738:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201560.025758:0:23738:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), flags=33060, excl=1 00000080:00200000:0.0:1788201560.025761:0:23738:0:(namei.c:2084:ll_mknod()) VFS Op:name=f4, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8) mode 100444 dev 0 00000020:00100000:0.0:1788201560.025847:0:23738:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201560.025856:0:23738:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172563800 x1875064727878784/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201560.025877:0:23738:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172563800 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23738:1875064727878784:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201560.025943:0:23738:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150c83540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201560.031986:0:23738:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172563800 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23738:1875064727878784:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201560.032045:0:23738:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x150:0x0](ffff8bc144687448) 00000080:00200000:0.0:1788201560.032364:0:23738:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f4, unhashed 1 00000080:00200000:3.0:1788201560.047702:0:23739:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201560.047733:0:23739:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201560.047752:0:23739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201560.047768:0:23739:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201560.047777:0:23739:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201560.047784:0:23739:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201560.047788:0:23739:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201560.048035:0:23739:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7dcbbd0 00010000:00010000:3.0:1788201560.048039:0:23739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201560.048048:0:23739:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201560.048066:0:23739:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201560.048074:0:23739:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201560.048080:0:23739:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201560.048102:0:23739:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d4, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=24 00000080:00200000:3.0:1788201560.048107:0:23739:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=d4, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=0 00000002:00010000:3.0:1788201560.048121:0:23739:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d4,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: lookup flags 0 00010000:00010000:3.0:1788201560.048356:0:23739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031c00/0xd138388016f6ed06 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201560.048370:0:23739:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031c00/0xd138388016f6ed06 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201560.048380:0:23739:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031c00/0xd138388016f6ed06 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23739 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201560.048408:0:23739:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff5880 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23739:1875064727878912:192.168.201.143@tcp:101:createmany.0 00000100:00100000:3.0:1788201560.048561:0:23739:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145fda300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201560.052548:0:23739:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff5880 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23739:1875064727878912:192.168.201.143@tcp:101:createmany.0 00010000:00010000:3.0:1788201560.052578:0:23739:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031c00/0xd138388016f6ed06 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710955bc expref: -99 pid: 23739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201560.052601:0:23739:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031c00/0xd138388016f6ed06 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x137:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710955bc expref: -99 pid: 23739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201560.052610:0:23739:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031c00/0xd138388016f6ed06 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x137:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710955bc expref: -99 pid: 23739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201560.052622:0:23739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031c00/0xd138388016f6ed06 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x137:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710955bc expref: -99 pid: 23739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201560.052634:0:23739:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031c00/0xd138388016f6ed06 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x137:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710955bc expref: -99 pid: 23739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201560.052649:0:23739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031c00/0xd138388016f6ed06 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x137:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710955bc expref: -99 pid: 23739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201560.052663:0:23739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031c00/0xd138388016f6ed06 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x137:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710955bc expref: -99 pid: 23739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201560.052671:0:23739:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031c00/0xd138388016f6ed06 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x137:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710955bc expref: -99 pid: 23739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201560.052684:0:23739:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x10 disposition=0xb, status=0 req@ffff8bc151ff5880 x1875064727878912/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201576 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201560.052698:0:23739:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031c00/0xd138388016f6ed06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x137:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710955bc expref: -99 pid: 23739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201560.052709:0:23739:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/311 (0 0) 00000080:00200000:3.0:1788201560.052716:0:23739:0:(namei.c:952:ll_intent_lock()) intent lock 16 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1788201560.052739:0:23739:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x137:0x0], updating i_size 512 00000080:00200000:3.0:1788201560.052742:0:23739:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x137:0x0](ffff8bc1459500c8): rc = 0 00000080:00010000:3.0:1788201560.052748:0:23739:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x137:0x0](ffff8bc1459500c8) for lock 0xd138388016f6ed06 00000080:00010000:3.0:1788201560.052761:0:23739:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x137:0x0](ffff8bc1459500c8) 00000080:00010000:3.0:1788201560.052766:0:23739:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed06 from it ffffadd1c7dcbaa0 00010000:00010000:3.0:1788201560.052770:0:23739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031c00/0xd138388016f6ed06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x137:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710955bc expref: -99 pid: 23739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201560.052780:0:23739:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031c00/0xd138388016f6ed06 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x137:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710955bc expref: -99 pid: 23739 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201560.053555:0:23739:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201560.053577:0:23739:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f0, dir=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), flags=1536 00000080:00200000:3.0:1788201560.053582:0:23739:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), inode mode 41ed mask 3 00000080:00200000:3.0:1788201560.053589:0:23739:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), inode mode 41ed mask 3 00000080:00200000:3.0:1788201560.053593:0:23739:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f0, dir=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), flags=33060, excl=1 00000080:00200000:3.0:1788201560.053597:0:23739:0:(namei.c:2084:ll_mknod()) VFS Op:name=f0, dir=[0x200000bd7:0x137:0x0](ffff8bc1459500c8) mode 100444 dev 0 00000020:00100000:3.0:1788201560.053655:0:23739:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1788201560.053665:0:23739:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc151ff5880 x1875064727879168/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201560.053688:0:23739:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff5880 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23739:1875064727879168:192.168.201.143@tcp:36:createmany.0 00000100:00100000:3.0:1788201560.053783:0:23739:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145fda300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201560.062410:0:23739:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff5880 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23739:1875064727879168:192.168.201.143@tcp:36:createmany.0 00000080:00200000:3.0:1788201560.062467:0:23739:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x151:0x0](ffff8bc1459d4b08) 00000080:00200000:3.0:1788201560.062553:0:23739:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f0, unhashed 1 00000080:00200000:3.0:1788201560.062611:0:23739:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201560.062630:0:23739:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201560.062649:0:23739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201560.062669:0:23739:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201560.062677:0:23739:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201560.062683:0:23739:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201560.062698:0:23739:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201560.062706:0:23739:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7dcbbd0 00010000:00010000:3.0:1788201560.062710:0:23739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201560.062723:0:23739:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201560.062745:0:23739:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201560.062753:0:23739:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201560.062758:0:23739:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201560.062761:0:23739:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d4, flags=24 00000080:00200000:3.0:1788201560.062763:0:23739:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201560.062777:0:23739:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), flags=1536 00000080:00200000:3.0:1788201560.062780:0:23739:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), inode mode 41ed mask 3 00000080:00200000:3.0:1788201560.062785:0:23739:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), inode mode 41ed mask 3 00000080:00200000:3.0:1788201560.062820:0:23739:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), flags=33060, excl=1 00000080:00200000:3.0:1788201560.062826:0:23739:0:(namei.c:2084:ll_mknod()) VFS Op:name=f1, dir=[0x200000bd7:0x137:0x0](ffff8bc1459500c8) mode 100444 dev 0 00000020:00100000:3.0:1788201560.062882:0:23739:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1788201560.062890:0:23739:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc151ff5c00 x1875064727879424/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201560.062912:0:23739:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff5c00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23739:1875064727879424:192.168.201.143@tcp:36:createmany.0 00000100:00100000:3.0:1788201560.064358:0:23739:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145fda300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201560.070119:0:23739:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff5c00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23739:1875064727879424:192.168.201.143@tcp:36:createmany.0 00000080:00200000:3.0:1788201560.070189:0:23739:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x152:0x0](ffff8bc1459d0908) 00000080:00200000:3.0:1788201560.070277:0:23739:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f1, unhashed 1 00000080:00200000:3.0:1788201560.070338:0:23739:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201560.070355:0:23739:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201560.070374:0:23739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201560.070395:0:23739:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201560.070404:0:23739:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201560.070410:0:23739:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201560.070414:0:23739:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201560.070422:0:23739:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7dcbbd0 00010000:00010000:3.0:1788201560.070426:0:23739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201560.070436:0:23739:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201560.070453:0:23739:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201560.070460:0:23739:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201560.070466:0:23739:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201560.070469:0:23739:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d4, flags=24 00000080:00200000:3.0:1788201560.070473:0:23739:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201560.070485:0:23739:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f2, dir=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), flags=1536 00000080:00200000:3.0:1788201560.070490:0:23739:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), inode mode 41ed mask 3 00000080:00200000:3.0:1788201560.070495:0:23739:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), inode mode 41ed mask 3 00000080:00200000:3.0:1788201560.070499:0:23739:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f2, dir=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), flags=33060, excl=1 00000080:00200000:3.0:1788201560.070503:0:23739:0:(namei.c:2084:ll_mknod()) VFS Op:name=f2, dir=[0x200000bd7:0x137:0x0](ffff8bc1459500c8) mode 100444 dev 0 00000020:00100000:3.0:1788201560.070552:0:23739:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1788201560.070561:0:23739:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc151ff4700 x1875064727879680/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201560.070590:0:23739:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff4700 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23739:1875064727879680:192.168.201.143@tcp:36:createmany.0 00000100:00100000:3.0:1788201560.070667:0:23739:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145fda300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201560.081332:0:23739:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff4700 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23739:1875064727879680:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201560.093011:0:23739:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23739:1875064727879936:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201560.093073:0:23739:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x154:0x0](ffff8bc144682a08) 00000080:00200000:0.0:1788201560.093170:0:23739:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f3, unhashed 1 00000080:00200000:0.0:1788201560.093229:0:23739:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201560.093246:0:23739:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201560.093266:0:23739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201560.093282:0:23739:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201560.093291:0:23739:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201560.093298:0:23739:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201560.093302:0:23739:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:0.0:1788201560.093309:0:23739:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7dcbbd0 00010000:00010000:0.0:1788201560.093313:0:23739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201560.093323:0:23739:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201560.093340:0:23739:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201560.093347:0:23739:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201560.093353:0:23739:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201560.093357:0:23739:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d4, flags=24 00000080:00200000:0.0:1788201560.093360:0:23739:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201560.093444:0:23739:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), flags=1536 00000080:00200000:0.0:1788201560.093447:0:23739:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201560.093452:0:23739:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201560.093456:0:23739:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), flags=33060, excl=1 00000080:00200000:0.0:1788201560.093460:0:23739:0:(namei.c:2084:ll_mknod()) VFS Op:name=f4, dir=[0x200000bd7:0x137:0x0](ffff8bc1459500c8) mode 100444 dev 0 00000020:00100000:0.0:1788201560.093513:0:23739:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201560.093522:0:23739:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172563b80 x1875064727880192/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201560.093546:0:23739:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172563b80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23739:1875064727880192:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201560.093653:0:23739:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150c83540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201560.098199:0:23739:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172563b80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23739:1875064727880192:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201560.098257:0:23739:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x155:0x0](ffff8bc144686c08) 00000080:00200000:0.0:1788201560.098341:0:23739:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f4, unhashed 1 00000080:00200000:1.0:1788201560.116350:0:23740:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201560.116380:0:23740:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201560.116400:0:23740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201560.116417:0:23740:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201560.116425:0:23740:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201560.116433:0:23740:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201560.116436:0:23740:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201560.116443:0:23740:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7d8bbe0 00010000:00010000:1.0:1788201560.116447:0:23740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201560.116456:0:23740:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201560.116472:0:23740:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201560.116479:0:23740:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201560.116485:0:23740:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201560.116496:0:23740:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=e0, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=1536 00000080:00200000:1.0:1788201560.116499:0:23740:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201560.116504:0:23740:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201560.116509:0:23740:0:(namei.c:2239:do_mkdir()) VFS Op:name=e0, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00000020:00100000:1.0:1788201560.116575:0:23740:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201560.116587:0:23740:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d6d80 x1875064727880448/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201560.116611:0:23740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23740:1875064727880448:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201560.117755:0:23740:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc4600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201560.129651:0:23740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23740:1875064727880448:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201560.129703:0:23740:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x156:0x0](ffff8bc1446b80c8) 00000080:00200000:1.0:1788201560.129712:0:23740:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x156:0x0], updating i_size 512 00000080:00200000:1.0:1788201560.129787:0:23740:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201560.129858:0:23740:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201560.129877:0:23740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201560.129892:0:23740:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201560.129901:0:23740:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201560.129907:0:23740:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201560.129911:0:23740:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201560.129918:0:23740:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7d8bbe0 00010000:00010000:1.0:1788201560.129922:0:23740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201560.129930:0:23740:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201560.129968:0:23740:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201560.129976:0:23740:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201560.129982:0:23740:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201560.129999:0:23740:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=e1, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=1536 00000080:00200000:1.0:1788201560.130002:0:23740:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201560.130008:0:23740:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201560.130013:0:23740:0:(namei.c:2239:do_mkdir()) VFS Op:name=e1, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00000020:00100000:1.0:1788201560.130078:0:23740:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201560.130087:0:23740:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d6a00 x1875064727880704/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201560.130111:0:23740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23740:1875064727880704:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201560.130446:0:23740:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc4600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201560.138204:0:23740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23740:1875064727880704:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201560.138255:0:23740:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x157:0x0](ffff8bc1446bc2c8) 00000080:00200000:1.0:1788201560.138263:0:23740:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x157:0x0], updating i_size 512 00000080:00200000:1.0:1788201560.138340:0:23740:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201560.138360:0:23740:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201560.138379:0:23740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201560.138394:0:23740:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201560.138402:0:23740:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201560.138409:0:23740:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201560.138412:0:23740:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201560.138420:0:23740:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7d8bbe0 00010000:00010000:1.0:1788201560.138424:0:23740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201560.138434:0:23740:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201560.138453:0:23740:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201560.138460:0:23740:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201560.138466:0:23740:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201560.138482:0:23740:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=e2, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=1536 00000080:00200000:1.0:1788201560.138485:0:23740:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201560.138491:0:23740:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201560.138496:0:23740:0:(namei.c:2239:do_mkdir()) VFS Op:name=e2, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00000020:00100000:1.0:1788201560.138556:0:23740:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201560.138565:0:23740:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d5500 x1875064727880960/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201560.138589:0:23740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23740:1875064727880960:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201560.138661:0:23740:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145cc4600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201560.147393:0:23740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23740:1875064727880960:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201560.147455:0:23740:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x158:0x0](ffff8bc1446be3c8) 00000080:00200000:1.0:1788201560.147463:0:23740:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x158:0x0], updating i_size 512 00000080:00200000:1.0:1788201560.147531:0:23740:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201560.147550:0:23740:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201560.147568:0:23740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201560.147582:0:23740:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201560.147590:0:23740:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201560.147597:0:23740:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201560.147600:0:23740:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201560.147608:0:23740:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7d8bbe0 00010000:00010000:1.0:1788201560.147612:0:23740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201560.147626:0:23740:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201560.147642:0:23740:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201560.147648:0:23740:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201560.147655:0:23740:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201560.147668:0:23740:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=e3, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=1536 00000080:00200000:1.0:1788201560.147671:0:23740:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201560.147676:0:23740:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201560.147681:0:23740:0:(namei.c:2239:do_mkdir()) VFS Op:name=e3, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00000020:00100000:1.0:1788201560.148491:0:23740:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201560.148504:0:23740:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d6300 x1875064727881216/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201560.148672:0:23740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23740:1875064727881216:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201560.148787:0:23740:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150c83540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201560.156446:0:23740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23740:1875064727881216:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201560.156499:0:23740:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x159:0x0](ffff8bc144681988) 00000080:00200000:0.0:1788201560.156507:0:23740:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x159:0x0], updating i_size 512 00000080:00200000:0.0:1788201560.156578:0:23740:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201560.156597:0:23740:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201560.156616:0:23740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201560.156633:0:23740:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201560.156641:0:23740:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201560.156647:0:23740:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201560.156651:0:23740:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:0.0:1788201560.156659:0:23740:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7d8bbe0 00010000:00010000:0.0:1788201560.156663:0:23740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201560.156673:0:23740:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201560.156689:0:23740:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201560.156695:0:23740:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201560.156701:0:23740:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201560.156715:0:23740:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=e4, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=1536 00000080:00200000:0.0:1788201560.156718:0:23740:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201560.156722:0:23740:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201560.156726:0:23740:0:(namei.c:2239:do_mkdir()) VFS Op:name=e4, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00000020:00100000:0.0:1788201560.156783:0:23740:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201560.156844:0:23740:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172560a80 x1875064727881472/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201560.156867:0:23740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172560a80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23740:1875064727881472:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201560.156967:0:23740:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150c83540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201560.162660:0:23740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172560a80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:23740:1875064727881472:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201560.162715:0:23740:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x15a:0x0](ffff8bc1446821c8) 00000080:00200000:0.0:1788201560.162723:0:23740:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x15a:0x0], updating i_size 512 00000100:00100000:1.0:1788201560.836102:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727881856:192.168.201.143@tcp:400:kworker.0 00000100:00100000:1.0:1788201560.836232:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201560.836240:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727881728:192.168.201.143@tcp:400:kworker.0 00000100:00100000:0.0:1788201560.854843:0:10053:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8bc143fc0000: committing for last_committed 8589935269 gen 1 00000100:00100000:0.0:1788201560.854973:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727881984:192.168.201.143@tcp:400:kworker.0 00000100:00100000:0.0:1788201560.854988:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:21dcfac0-2fe1-402c-8fca-db923b83f76c:10053:1875064727881600:192.168.201.143@tcp:400:kworker.0 00010000:00010000:3.0:1788201561.412031:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201561.628692:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201561.628736:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201561.628765:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201561.628820:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201561.628845:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743448960 00000100:00100000:3.0:1788201561.628853:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743448960 00000100:00100000:3.0:1788201561.628891:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743449088 00000100:00100000:3.0:1788201561.628894:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743449088 00000100:00100000:3.0:1788201561.628902:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743449216 00000100:00100000:3.0:1788201561.628904:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743449216 00000100:00100000:3.0:1788201561.628912:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743449344 00000100:00100000:3.0:1788201561.628914:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743449344 00000100:00100000:3.0:1788201561.628938:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 620 00000100:00100000:3.0:1788201561.628948:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc151ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+7:23415:x1875064743448960:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201561.628968:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000038e63dae/0xd138388016f6df37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x175:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171091c49 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201561.629044:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201561.629051:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc151ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+7:23415:x1875064743448960:12345-192.168.201.143@tcp:104: Request processed in 105us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201561.629058:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 620 00000100:00100000:3.0:1788201561.629075:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 621 00000100:00100000:3.0:1788201561.629081:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc151ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+6:23416:x1875064743449088:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201561.629090:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000cb7c18a2/0xd138388016f6da91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171091033 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201561.629126:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788201561.629131:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc151ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+6:23416:x1875064743449088:12345-192.168.201.143@tcp:104: Request processed in 50us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201561.629137:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 621 00000100:00100000:3.0:1788201561.629149:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 622 00000100:00100000:3.0:1788201561.629155:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc151ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+5:23417:x1875064743449216:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201561.629163:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005c45581d/0xd138388016f6d8ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090bef expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201561.629191:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788201561.629197:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc151ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+5:23417:x1875064743449216:12345-192.168.201.143@tcp:104: Request processed in 42us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201561.629202:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 622 00000100:00100000:3.0:1788201561.629226:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 623 00000100:00100000:3.0:1788201561.629233:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc151ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23131:x1875064743449344:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201561.629241:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a8029326/0xd138388016f6e009 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171092032 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201561.629263:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788201561.629268:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc151ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23131:x1875064743449344:12345-192.168.201.143@tcp:104: Request processed in 36us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201561.629272:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 623 00010000:00010000:3.0:1788201561.629362:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788201561.629368:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000038e63dae/0xd138388016f6df37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x175:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171091c49 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201561.629376:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172724200 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201561.629382:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000038e63dae/0xd138388016f6df37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x175:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171091c49 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201561.629463:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000038e63dae/0xd138388016f6df37 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x175:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171091c49 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201561.629470:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201561.629491:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000038e63dae/0xd138388016f6df37 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x175:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171091c49 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201561.629499:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000038e63dae/0xd138388016f6df37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x175:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171091c49 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201561.629519:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788201561.629522:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000cb7c18a2/0xd138388016f6da91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171091033 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201561.629529:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17267e000 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201561.629532:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000cb7c18a2/0xd138388016f6da91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171091033 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201561.629567:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000cb7c18a2/0xd138388016f6da91 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171091033 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201561.629575:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201561.629591:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000cb7c18a2/0xd138388016f6da91 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171091033 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201561.629599:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000cb7c18a2/0xd138388016f6da91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171091033 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201561.629612:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201561.629615:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005c45581d/0xd138388016f6d8ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090bef expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201561.629621:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172610000 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201561.629625:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005c45581d/0xd138388016f6d8ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171090bef expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201561.629657:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005c45581d/0xd138388016f6d8ed lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090bef expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201561.629664:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201561.629670:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005c45581d/0xd138388016f6d8ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090bef expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201561.629676:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005c45581d/0xd138388016f6d8ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090bef expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201561.629691:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201561.629696:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a8029326/0xd138388016f6e009 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171092032 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201561.629702:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172723800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201561.629705:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a8029326/0xd138388016f6e009 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171092032 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201561.629735:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a8029326/0xd138388016f6e009 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171092032 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201561.629743:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201561.629748:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a8029326/0xd138388016f6e009 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171092032 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201561.629755:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a8029326/0xd138388016f6e009 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171092032 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201561.629769:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201561.629771:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201561.629773:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201561.629779:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201561.629813:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727882112:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201561.629872:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201561.629879:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727882496:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201561.629914:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727882240:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201561.629952:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201561.629959:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727882368:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201561.629989:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201561.633662:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201561.635008:0:21781:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201561.635033:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743450496 00000100:00100000:3.0:1788201561.635043:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743450496 00000100:00100000:3.0:1788201561.635162:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 624 00000100:00100000:3.0:1788201561.635172:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc146440850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23392:x1875064743450496:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201561.635191:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e0506911/0xd138388016f6da05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x162:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090ec7 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201561.635288:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201561.635296:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc146440850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23392:x1875064743450496:12345-192.168.201.143@tcp:104: Request processed in 125us (1642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201561.635304:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 624 00010000:00010000:3.0:1788201561.635411:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201561.635417:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e0506911/0xd138388016f6da05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x162:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090ec7 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201561.635427:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17267fa00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201561.635432:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e0506911/0xd138388016f6da05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x162:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171090ec7 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201561.635527:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e0506911/0xd138388016f6da05 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x162:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090ec7 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201561.635536:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201561.635557:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e0506911/0xd138388016f6da05 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x162:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090ec7 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201561.635567:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e0506911/0xd138388016f6da05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x162:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090ec7 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201561.635588:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201561.635591:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201561.635593:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201561.635613:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727882624:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201561.664425:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201561.664459:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201561.664489:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201561.664511:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201561.664523:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201561.664534:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201561.664550:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201561.664583:0:20877:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788201561.664608:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743450624 00000100:00100000:1.0:1788201561.664615:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743450624 00000100:00100000:1.0:1788201561.664653:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743450752 00000100:00100000:1.0:1788201561.664656:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743450752 00000100:00100000:1.0:1788201561.664667:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743450880 00000100:00100000:1.0:1788201561.664669:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743450880 00000100:00100000:1.0:1788201561.664675:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743451008 00000100:00100000:1.0:1788201561.664677:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743451008 00000100:00100000:1.0:1788201561.664683:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743451136 00000100:00100000:1.0:1788201561.664685:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743451136 00000100:00100000:1.0:1788201561.664692:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743451264 00000100:00100000:1.0:1788201561.664694:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743451264 00000100:00100000:1.0:1788201561.664703:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743451392 00000100:00100000:1.0:1788201561.664705:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743451392 00000100:00100000:1.0:1788201561.664716:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 625 00000100:00100000:1.0:1788201561.664726:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1727d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23417:x1875064743450624:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201561.664743:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d2560409/0xd138388016f6da4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x163:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090f7d expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201561.664839:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201561.664846:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1727d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23417:x1875064743450624:12345-192.168.201.143@tcp:104: Request processed in 121us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201561.664852:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 625 00000100:00100000:1.0:1788201561.664872:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 626 00000100:00100000:1.0:1788201561.664879:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1727d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+9:23407:x1875064743450752:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201561.664890:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d3b4ff4/0xd138388016f6e02c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109208d expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:0.0:1788201561.665020:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 627 00000100:00100000:0.0:1788201561.665031:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1727d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+9:23415:x1875064743450880:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201561.665041:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6d884 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090ade expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201561.665089:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788201561.665097:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1727d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+9:23407:x1875064743450752:12345-192.168.201.143@tcp:104: Request processed in 218us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201561.665103:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 626 00000100:00100000:1.0:1788201561.665117:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 628 00000100:00100000:1.0:1788201561.665123:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1727d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+8:23413:x1875064743451008:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201561.665131:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000033878fa5/0xd138388016f6d76c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x158:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090806 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.672835:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788201561.672858:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1727d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+8:23415:x1875064743450880:12345-192.168.201.143@tcp:104: Request processed in 7821us (8359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201561.672871:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 627 00000100:00100000:0.0:1788201561.672918:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 629 00000100:00100000:0.0:1788201561.672946:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1727d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+7:23394:x1875064743451136:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201561.672966:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000036bc7ba7/0xd138388016f6dc58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710914d2 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.673049:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788201561.673055:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1727d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+7:23394:x1875064743451136:12345-192.168.201.143@tcp:104: Request processed in 119us (8531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201561.673061:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 629 00000100:00100000:0.0:1788201561.673076:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 630 00000100:00100000:0.0:1788201561.673082:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1727d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+6:21821:x1875064743451264:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201561.673092:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2948ea1/0xd138388016f6ddb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171091860 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.673116:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788201561.673121:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1727d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+6:21821:x1875064743451264:12345-192.168.201.143@tcp:104: Request processed in 39us (8587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201561.673126:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 630 00000100:00100000:0.0:1788201561.673138:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 631 00000100:00100000:0.0:1788201561.673144:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172656850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+5:23408:x1875064743451392:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201561.673153:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000037110e0c/0xd138388016f6d99c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x160:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090db6 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.673176:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788201561.673181:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172656850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+5:23408:x1875064743451392:12345-192.168.201.143@tcp:104: Request processed in 37us (8631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201561.673187:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 631 00000100:00100000:0.0:1788201561.673341:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201561.673438:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201561.673471:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201561.673495:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201561.673515:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201561.673535:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201561.673557:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201561.673662:0:21781:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/3 left), rc = 0 00000100:00100000:0.0:1788201561.673692:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743451648 00000100:00100000:0.0:1788201561.673700:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743451648 00000100:00100000:0.0:1788201561.673726:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743451776 00000100:00100000:0.0:1788201561.673729:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743451776 00000100:00100000:0.0:1788201561.673739:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743452032 00000100:00100000:0.0:1788201561.673741:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743452032 00000100:00100000:0.0:1788201561.673750:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743452160 00000100:00100000:0.0:1788201561.673752:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743452160 00000100:00100000:0.0:1788201561.673760:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743452288 00000100:00100000:0.0:1788201561.673761:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743452288 00000100:00100000:0.0:1788201561.673769:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743452544 00000100:00100000:0.0:1788201561.673771:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743452544 00000100:00100000:0.0:1788201561.673779:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743452672 00000100:00100000:0.0:1788201561.673782:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743452672 00000100:00100000:0.0:1788201561.673819:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 632 00000100:00100000:0.0:1788201561.673826:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172562300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+6:24638:x1875064743451648:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201561.673836:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005d8fb7a0/0xd138388016f6d7f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090972 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.673869:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:0.0:1788201561.673874:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172562300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+6:24638:x1875064743451648:12345-192.168.201.143@tcp:104: Request processed in 50us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201561.673880:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 632 00000100:00100000:0.0:1788201561.673893:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 633 00000100:00100000:0.0:1788201561.673899:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172560380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+5:21820:x1875064743451776:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201561.673906:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6d69a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x155:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710905e4 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.673942:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:0.0:1788201561.673948:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172560380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+5:21820:x1875064743451776:12345-192.168.201.143@tcp:104: Request processed in 49us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201561.673954:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 633 00000100:00100000:0.0:1788201561.673965:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 634 00000100:00100000:0.0:1788201561.673971:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172561500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+8:28099:x1875064743452032:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201561.673980:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000072781f2e/0xd138388016f6d81b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710909cd expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.674000:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to priority blp list, 10 blwis in pool 00000100:00100000:0.0:1788201561.674005:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172561500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+8:28099:x1875064743452032:12345-192.168.201.143@tcp:104: Request processed in 35us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201561.674011:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 634 00000100:00100000:0.0:1788201561.674022:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 635 00000100:00100000:0.0:1788201561.674027:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172563100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+7:21822:x1875064743452160:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201561.674036:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6db1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x166:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109119f expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.674056:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to priority blp list, 11 blwis in pool 00000100:00100000:0.0:1788201561.674061:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172563100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+7:21822:x1875064743452160:12345-192.168.201.143@tcp:104: Request processed in 34us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201561.674066:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 635 00000100:00100000:0.0:1788201561.674077:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 636 00000100:00100000:0.0:1788201561.674083:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172561180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+6:24636:x1875064743452288:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201561.674091:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d238d6f6/0xd138388016f6de1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x171:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171091971 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.674112:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to priority blp list, 12 blwis in pool 00000100:00100000:0.0:1788201561.674117:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172561180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+6:24636:x1875064743452288:12345-192.168.201.143@tcp:104: Request processed in 34us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201561.674122:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 636 00000100:00100000:0.0:1788201561.674131:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 637 00000100:00100000:0.0:1788201561.674136:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172560700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+5:23411:x1875064743452544:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201561.674144:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d272bbb9/0xd138388016f6dba9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x168:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109130b expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.674165:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to priority blp list, 13 blwis in pool 00000100:00100000:0.0:1788201561.674170:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172560700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+5:23411:x1875064743452544:12345-192.168.201.143@tcp:104: Request processed in 34us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201561.674175:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 637 00000100:00100000:0.0:1788201561.674186:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 638 00000100:00100000:0.0:1788201561.674192:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14742c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23389:x1875064743452672:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201561.674201:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6d7d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090917 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.674222:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to priority blp list, 14 blwis in pool 00000100:00100000:0.0:1788201561.674227:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14742c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23389:x1875064743452672:12345-192.168.201.143@tcp:104: Request processed in 36us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201561.674233:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 638 00000100:00100000:0.0:1788201561.674270:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201561.674315:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201561.674357:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743452928 00000100:00100000:0.0:1788201561.674362:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743452928 00000100:00100000:0.0:1788201561.674376:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743453184 00000100:00100000:0.0:1788201561.674379:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743453184 00000100:00100000:0.0:1788201561.674389:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 639 00000100:00100000:0.0:1788201561.674395:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172562300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+5:23391:x1875064743452928:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201561.674403:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000944abbc3/0xd138388016f6d861 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090a83 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.674430:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to priority blp list, 15 blwis in pool 00000100:00100000:0.0:1788201561.674435:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172562300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+5:23391:x1875064743452928:12345-192.168.201.143@tcp:104: Request processed in 41us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201561.674441:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 639 00000100:00100000:0.0:1788201561.674452:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 640 00000100:00100000:0.0:1788201561.674457:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172560380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23416:x1875064743453184:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201561.674466:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6dc35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171091477 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.674487:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to priority blp list, 16 blwis in pool 00000100:00100000:0.0:1788201561.674493:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172560380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23416:x1875064743453184:12345-192.168.201.143@tcp:104: Request processed in 35us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201561.674498:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 640 00010000:00010000:0.0:1788201561.674569:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:0.0:1788201561.674576:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d2560409/0xd138388016f6da4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x163:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090f7d expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.674585:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc143a48200 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201561.674591:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d2560409/0xd138388016f6da4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x163:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171090f7d expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.674670:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d2560409/0xd138388016f6da4b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x163:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090f7d expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.674678:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201561.674700:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d2560409/0xd138388016f6da4b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x163:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090f7d expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.674707:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d2560409/0xd138388016f6da4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x163:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090f7d expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.674734:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:0.0:1788201561.674739:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d3b4ff4/0xd138388016f6e02c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109208d expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.674746:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172723e00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201561.674749:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d3b4ff4/0xd138388016f6e02c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e217109208d expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.674784:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d3b4ff4/0xd138388016f6e02c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109208d expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.674815:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201561.674822:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d3b4ff4/0xd138388016f6e02c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109208d expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.674829:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d3b4ff4/0xd138388016f6e02c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109208d expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.674844:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:0.0:1788201561.674847:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6d884 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090ade expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.674853:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3c800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201561.674857:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6d884 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171090ade expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.674894:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6d884 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090ade expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.674902:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201561.674914:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6d884 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090ade expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.674933:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6d884 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090ade expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.674948:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:0.0:1788201561.674952:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000033878fa5/0xd138388016f6d76c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x158:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090806 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.674959:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1725a1200 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201561.674963:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000033878fa5/0xd138388016f6d76c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x158:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171090806 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.674996:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000033878fa5/0xd138388016f6d76c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x158:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090806 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675003:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201561.675009:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000033878fa5/0xd138388016f6d76c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x158:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090806 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675017:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000033878fa5/0xd138388016f6d76c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x158:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090806 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675030:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:0.0:1788201561.675035:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000036bc7ba7/0xd138388016f6dc58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710914d2 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675041:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14400de00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201561.675045:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000036bc7ba7/0xd138388016f6dc58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e21710914d2 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675073:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000036bc7ba7/0xd138388016f6dc58 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710914d2 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675079:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201561.675083:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000036bc7ba7/0xd138388016f6dc58 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710914d2 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675091:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000036bc7ba7/0xd138388016f6dc58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710914d2 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675101:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1788201561.675105:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2948ea1/0xd138388016f6ddb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171091860 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675110:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc16645cc00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201561.675113:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2948ea1/0xd138388016f6ddb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171091860 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675146:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2948ea1/0xd138388016f6ddb6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171091860 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675152:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201561.675156:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2948ea1/0xd138388016f6ddb6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171091860 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675163:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2948ea1/0xd138388016f6ddb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171091860 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675175:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1788201561.675179:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000037110e0c/0xd138388016f6d99c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x160:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090db6 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675185:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3cc00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201561.675188:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000037110e0c/0xd138388016f6d99c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x160:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171090db6 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675216:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000037110e0c/0xd138388016f6d99c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x160:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090db6 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675223:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201561.675228:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000037110e0c/0xd138388016f6d99c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x160:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090db6 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675235:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000037110e0c/0xd138388016f6d99c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x160:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090db6 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675249:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788201561.675253:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005d8fb7a0/0xd138388016f6d7f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090972 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675261:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1725a0200 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201561.675264:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005d8fb7a0/0xd138388016f6d7f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171090972 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675295:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005d8fb7a0/0xd138388016f6d7f8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090972 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675303:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201561.675307:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005d8fb7a0/0xd138388016f6d7f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090972 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675315:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005d8fb7a0/0xd138388016f6d7f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090972 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675329:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788201561.675333:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6d69a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x155:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710905e4 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675339:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bd800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201561.675343:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6d69a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x155:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e21710905e4 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675377:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6d69a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x155:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710905e4 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675384:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201561.675388:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6d69a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x155:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710905e4 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675395:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6d69a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x155:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710905e4 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675408:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788201561.675411:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000072781f2e/0xd138388016f6d81b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710909cd expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675417:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17258b800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201561.675421:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000072781f2e/0xd138388016f6d81b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e21710909cd expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675450:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000072781f2e/0xd138388016f6d81b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710909cd expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675456:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201561.675461:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000072781f2e/0xd138388016f6d81b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710909cd expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675467:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000072781f2e/0xd138388016f6d81b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710909cd expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675482:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788201561.675486:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6db1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x166:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109119f expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675494:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc143a48400 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201561.675497:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6db1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x166:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e217109119f expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675525:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6db1d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x166:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109119f expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675531:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201561.675535:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6db1d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x166:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109119f expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675542:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6db1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x166:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109119f expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675569:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788201561.675572:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d238d6f6/0xd138388016f6de1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x171:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171091971 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675580:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc16645d600 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201561.675584:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d238d6f6/0xd138388016f6de1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x171:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171091971 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675621:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d238d6f6/0xd138388016f6de1f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x171:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171091971 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675629:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201561.675633:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d238d6f6/0xd138388016f6de1f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x171:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171091971 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675641:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d238d6f6/0xd138388016f6de1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x171:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171091971 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675654:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788201561.675658:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d272bbb9/0xd138388016f6dba9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x168:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109130b expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675664:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1727c8600 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201561.675667:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d272bbb9/0xd138388016f6dba9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x168:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e217109130b expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675698:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d272bbb9/0xd138388016f6dba9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x168:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109130b expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675705:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201561.675709:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d272bbb9/0xd138388016f6dba9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x168:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109130b expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675716:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d272bbb9/0xd138388016f6dba9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x168:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109130b expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675729:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201561.675733:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6d7d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090917 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675739:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1725a0800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201561.675743:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6d7d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171090917 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675772:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6d7d5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090917 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675779:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201561.675783:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6d7d5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090917 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675814:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6d7d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090917 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675828:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201561.675831:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000944abbc3/0xd138388016f6d861 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090a83 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675837:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17258a000 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201561.675841:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000944abbc3/0xd138388016f6d861 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171090a83 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675875:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000944abbc3/0xd138388016f6d861 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090a83 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675881:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201561.675886:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000944abbc3/0xd138388016f6d861 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090a83 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675892:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000944abbc3/0xd138388016f6d861 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090a83 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.675904:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201561.675907:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6dc35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171091477 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.675914:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14a779c00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201561.675917:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6dc35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171091477 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201561.679728:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788201561.679751:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1727d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23413:x1875064743451008:12345-192.168.201.143@tcp:104: Request processed in 14619us (15231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201561.679764:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 628 00010000:00010000:1.0:1788201561.679886:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201561.679920:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727882880:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201561.680041:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727883392:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201561.680067:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727883904:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201561.680091:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727884416:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201561.680117:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788201561.680124:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727882752:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201561.680146:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727883264:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201561.680165:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727883776:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201561.680184:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727884288:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201561.680223:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727883008:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201561.680247:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727883520:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201561.680264:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727884032:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201561.680280:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727884544:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201561.680299:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788201561.680305:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727883136:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201561.680326:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727883648:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201561.680342:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727884160:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201561.680376:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201561.680955:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727882112:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201561.683324:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727882624:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201561.683342:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727882496:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201561.684293:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6dc35 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171091477 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.684305:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201561.684336:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6dc35 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171091477 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.684346:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6dc35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171091477 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201561.684445:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201561.684462:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727884672:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201561.684712:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201561.684715:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201561.684717:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201561.704966:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201561.705128:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727882752:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201561.705146:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727883264:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201561.705155:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727883776:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201561.705162:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727884288:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201561.705170:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727882880:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201561.705177:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727883392:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201561.705185:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727883904:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201561.705191:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727884416:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201561.705342:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727883136:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201561.705351:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727883648:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201561.705367:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727883008:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201561.705375:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727883520:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201561.705383:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727884032:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201561.705390:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727884544:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201561.706082:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201561.706138:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727884672:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201561.706147:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727884160:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201561.713717:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201561.713948:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743453952 00000100:00100000:1.0:1788201561.713953:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743453952 00000100:00100000:1.0:1788201561.713977:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 641 00000100:00100000:1.0:1788201561.713989:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1727d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23391:x1875064743453440:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201561.714008:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b442319c/0xd138388016f6df7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171091ec6 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201561.714015:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 642 00000100:00100000:3.0:1788201561.714044:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1727d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23416:x1875064743453952:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201561.714064:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000018ce99ac/0xd138388016f6dc12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x169:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109141c expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201561.714155:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201561.714164:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1727d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23416:x1875064743453952:12345-192.168.201.143@tcp:104: Request processed in 132us (8083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201561.714173:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 642 00010000:00010000:1.0:1788201561.714234:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201561.714243:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000018ce99ac/0xd138388016f6dc12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x169:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109141c expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201561.714255:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172610800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201561.714261:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000018ce99ac/0xd138388016f6dc12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x169:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e217109141c expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201561.714351:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000018ce99ac/0xd138388016f6dc12 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x169:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109141c expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201561.714436:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201561.714464:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000018ce99ac/0xd138388016f6dc12 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x169:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109141c expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201561.714473:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000018ce99ac/0xd138388016f6dc12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x169:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109141c expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201561.714496:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201561.714497:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201561.714499:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201561.714516:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201561.714524:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1727d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23391:x1875064743453440:12345-192.168.201.143@tcp:104: Request processed in 537us (9567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201561.714531:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 641 00010000:00010000:1.0:1788201561.714551:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201561.714556:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b442319c/0xd138388016f6df7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171091ec6 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201561.714568:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc140031400 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201561.714573:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b442319c/0xd138388016f6df7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171091ec6 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201561.714613:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b442319c/0xd138388016f6df7d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171091ec6 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201561.714620:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201561.714628:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b442319c/0xd138388016f6df7d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171091ec6 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201561.714635:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b442319c/0xd138388016f6df7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171091ec6 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201561.714655:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201561.714659:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201561.714661:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201561.714690:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727884800:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201561.718342:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:1.0:1788201561.718574:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201561.718582:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000db2a7bff/0xd138388016f6dab4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109108e expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201561.718594:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17267e600 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201561.718601:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000db2a7bff/0xd138388016f6dab4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e217109108e expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201561.718690:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000db2a7bff/0xd138388016f6dab4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109108e expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201561.718700:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201561.718728:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000db2a7bff/0xd138388016f6dab4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109108e expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201561.718736:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000db2a7bff/0xd138388016f6dab4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109108e expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000100:00100000:1.0:1788201561.718763:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201561.718779:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727885056:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201561.718912:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201561.718915:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201561.718916:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201561.718997:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:0.0:1788201561.720559:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201561.720566:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008ff2197d/0xd138388016f6dafa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x165:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171091144 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.720576:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc143a49000 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201561.720580:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008ff2197d/0xd138388016f6dafa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x165:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171091144 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.720636:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008ff2197d/0xd138388016f6dafa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x165:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171091144 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.720644:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201561.720657:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008ff2197d/0xd138388016f6dafa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x165:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171091144 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.720667:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008ff2197d/0xd138388016f6dafa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x165:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171091144 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201561.720684:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201561.720686:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201561.720690:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201561.720703:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727885440:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201561.720781:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201561.720827:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 648 00000100:00100000:3.0:1788201561.720847:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1726cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:24636:x1875064743455232:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201561.720865:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b477b91d/0xd138388016f6d979 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x160:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090d5b expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201561.720948:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201561.720955:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1726cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:24636:x1875064743455232:12345-192.168.201.143@tcp:104: Request processed in 116us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201561.720963:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 648 00000100:00100000:3.0:1788201561.720987:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 649 00000100:00100000:3.0:1788201561.720994:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1726ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23407:x1875064743455488:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201561.721005:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007f236d4a/0xd138388016f6d726 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090750 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201561.721035:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788201561.721042:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1726ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23407:x1875064743455488:12345-192.168.201.143@tcp:104: Request processed in 48us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201561.721048:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 649 00010000:00010000:0.0:1788201561.721315:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201561.721321:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b477b91d/0xd138388016f6d979 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x160:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090d5b expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.721331:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc143a49400 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201561.721336:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b477b91d/0xd138388016f6d979 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x160:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171090d5b expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.721516:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b477b91d/0xd138388016f6d979 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x160:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090d5b expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.721531:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201561.721552:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b477b91d/0xd138388016f6d979 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x160:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090d5b expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.721560:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b477b91d/0xd138388016f6d979 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x160:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090d5b expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.721577:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201561.721580:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007f236d4a/0xd138388016f6d726 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171090750 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.721586:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17258bc00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201561.721590:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007f236d4a/0xd138388016f6d726 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171090750 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.721623:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007f236d4a/0xd138388016f6d726 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090750 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.721630:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201561.721636:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007f236d4a/0xd138388016f6d726 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090750 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.721643:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007f236d4a/0xd138388016f6d726 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171090750 expref: -99 pid: 23025 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201561.721658:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201561.721661:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201561.721663:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201561.721677:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727885568:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201561.721725:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201561.721733:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727885696:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201561.723341:0:20876:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:3.0:1788201561.723385:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727885824:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201561.731356:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727884800:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201561.734539:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727885568:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201561.734748:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727885440:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201561.734784:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727885312:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201561.735401:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727885824:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201562.436593:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201565.508355:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201565.958429:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727886336:192.168.201.143@tcp:400:kworker.0 00000100:00100000:3.0:1788201565.958594:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201565.958601:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:21dcfac0-2fe1-402c-8fca-db923b83f76c:10054:1875064727885952:192.168.201.143@tcp:400:kworker.0 00000100:00100000:3.0:1788201565.970634:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:21dcfac0-2fe1-402c-8fca-db923b83f76c:10054:1875064727885952:192.168.201.143@tcp:400:kworker.0 00000100:00100000:3.0:1788201565.970651:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727886336:192.168.201.143@tcp:400:kworker.0 00010000:00010000:0.0:1788201568.580838:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201571.077081:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727886848:192.168.201.143@tcp:400:kworker.0 00000100:00100000:0.0:1788201571.077121:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:21dcfac0-2fe1-402c-8fca-db923b83f76c:10055:1875064727886464:192.168.201.143@tcp:400:kworker.0 00000100:00100000:3.0:1788201571.077364:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727886720:192.168.201.143@tcp:400:kworker.0 00000100:00100000:3.0:1788201571.103227:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727886848:192.168.201.143@tcp:400:kworker.0 00000100:00100000:1.0:1788201571.103262:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:21dcfac0-2fe1-402c-8fca-db923b83f76c:10055:1875064727886464:192.168.201.143@tcp:400:kworker.0 00010000:00010000:0.0:1788201571.653052:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201574.724781:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201576.196233:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:21dcfac0-2fe1-402c-8fca-db923b83f76c:10055:1875064727886976:192.168.201.143@tcp:400:kworker.0 00000100:00100000:1.0:1788201576.196336:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201576.196340:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727887360:192.168.201.143@tcp:400:kworker.0 00000100:00100000:1.0:1788201576.196391:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727887104:192.168.201.143@tcp:400:kworker.0 00000100:00100000:0.0:1788201576.200461:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:21dcfac0-2fe1-402c-8fca-db923b83f76c:10055:1875064727886976:192.168.201.143@tcp:400:kworker.0 00000100:00100000:1.0:1788201576.204067:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727887360:192.168.201.143@tcp:400:kworker.0 00000100:00100000:3.0:1788201576.204164:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727887104:192.168.201.143@tcp:400:kworker.0 00010000:00010000:0.0:1788201577.796295:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201580.868032:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201581.318159:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727887872:192.168.201.143@tcp:400:kworker.0 00000100:00100000:3.0:1788201581.318197:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201581.318204:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:21dcfac0-2fe1-402c-8fca-db923b83f76c:10054:1875064727887488:192.168.201.143@tcp:400:kworker.0 00000100:00100000:3.0:1788201581.341158:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:21dcfac0-2fe1-402c-8fca-db923b83f76c:10054:1875064727887488:192.168.201.143@tcp:400:kworker.0 00000100:00100000:3.0:1788201581.341237:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727887872:192.168.201.143@tcp:400:kworker.0 00000100:00100000:3.0:1788201581.342296:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727887616:192.168.201.143@tcp:400:kworker.0 00010000:00010000:0.0:1788201581.894260:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201582.917005:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201583.944363:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.990888:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201586.440861:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727888128:192.168.201.143@tcp:400:kworker.0 00000100:00100000:3.0:1788201586.440990:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201586.440997:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727888256:192.168.201.143@tcp:400:kworker.0 00000100:00100000:1.0:1788201586.441239:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:21dcfac0-2fe1-402c-8fca-db923b83f76c:10055:1875064727888000:192.168.201.143@tcp:400:kworker.0 00000100:00100000:1.0:1788201586.441282:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201586.441288:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727888384:192.168.201.143@tcp:400:kworker.0 00000100:00100000:1.0:1788201586.447680:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727888384:192.168.201.143@tcp:400:kworker.0 00000100:00100000:3.0:1788201586.447954:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727888256:192.168.201.143@tcp:400:kworker.0 00000100:00100000:3.0:1788201586.448114:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727888128:192.168.201.143@tcp:400:kworker.0 00000100:00100000:1.0:1788201586.448363:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:21dcfac0-2fe1-402c-8fca-db923b83f76c:10055:1875064727888000:192.168.201.143@tcp:400:kworker.0 00010000:00010000:1.0:1788201587.013394:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201587.724533:0:24444:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-lfsck test 7a: non-stopped LFSCK should auto restarts after MDS remount (1) ========================================================== 14:39:46 (1788201586) 00000080:00200000:0.0:1788201587.978175:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xe6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.978192:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.978249:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xe6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.978270:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xe7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.978275:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.978293:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xe7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.978309:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xe8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.978313:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.978332:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xe8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.978348:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xe9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.978353:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.978369:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xe9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.978386:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xea:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.978390:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.978407:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xea:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.978424:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xeb:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.978429:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.978446:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xeb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.978462:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xec:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.978475:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.978496:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xec:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.978514:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xed:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.978519:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.978536:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xed:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.978553:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xee:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.978556:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.978574:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xee:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.978591:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xef:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.978596:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.978613:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xef:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.978630:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.978634:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.978652:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.978669:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.978673:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.978692:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.978709:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf2:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.978714:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.978732:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.978750:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.978754:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.978772:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.978924:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.978930:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.978954:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.978972:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.978977:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.978995:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.979011:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.979015:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.979032:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.979049:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.979053:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.979072:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.979088:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.979092:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.979111:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.979129:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.979133:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.979150:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.979168:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xfa:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.979171:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.979186:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xfa:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.979202:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xfb:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.979205:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.979220:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xfb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.979235:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xfc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.979239:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.979254:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xfc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.979270:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xfd:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.979274:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.979288:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xfd:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.979303:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xfe:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.979306:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.979323:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xfe:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.979339:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xff:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.979343:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.979360:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xff:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.979376:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x100:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.979380:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.979397:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x100:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.979414:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x101:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.979418:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.979435:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x101:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.979452:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x102:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.979456:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.979483:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x102:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.979500:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x103:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.979505:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.979521:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x103:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.979536:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x104:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.979539:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.979556:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x104:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.979574:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x105:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.979578:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.979595:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x105:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.979611:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x106:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.979615:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.979632:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x106:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.979648:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x107:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.979653:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201587.979669:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x107:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.979684:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x108:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.979688:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:0.0:1788201587.979714:0:14232:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000e6b9159f ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fe41aa0d/0xd138388016f6e725 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109449e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201587.979738:0:14232:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000e6b9159f ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fe41aa0d/0xd138388016f6e725 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109449e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201587.979834:0:14232:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fe41aa0d/0xd138388016f6e725 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109449e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 1 00000008:00100000:0.0:1788201587.979970:0:14232:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc14416f800 - object 0x280000400:395 offset 0<>8441 00000100:00100000:3.0:1788201587.980077:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000080:00200000:0.0:1788201587.982063:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x108:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.982123:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x109:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.982135:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:0.0:1788201587.982169:0:14232:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000005b738b9d ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6e748 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710944f9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201587.982192:0:14232:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000005b738b9d ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6e748 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710944f9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201587.982251:0:14232:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6e748 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710944f9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 1 00000008:00100000:0.0:1788201587.982358:0:14232:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc14416d880 - object 0x240000400:395 offset 0<>1790 00000080:00200000:0.0:1788201587.982404:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x109:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.982425:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x10a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.982431:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:0.0:1788201587.982448:0:14232:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000008ce585c7 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008332e9f8/0xd138388016f6e76b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094554 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201587.982459:0:14232:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000008ce585c7 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008332e9f8/0xd138388016f6e76b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094554 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201587.982492:0:14232:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008332e9f8/0xd138388016f6e76b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094554 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201587.982526:0:14232:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc14416ca80 - object 0x280000400:396 offset 0<>1694 00000080:00200000:0.0:1788201587.982547:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x10a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.982567:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x10b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.982573:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:0.0:1788201587.982589:0:14232:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000000feb0963 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d8911af5/0xd138388016f6e78e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710945af expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201587.982598:0:14232:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000000feb0963 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d8911af5/0xd138388016f6e78e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710945af expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201587.982621:0:14232:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d8911af5/0xd138388016f6e78e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710945af expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201587.982657:0:14232:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc14416df80 - object 0x240000400:396 offset 0<>6430 00000080:00200000:0.0:1788201587.989184:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x10b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.989240:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x10c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.989252:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:0.0:1788201587.989290:0:14232:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000cc8ad32a ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000acf6f96b/0xd138388016f6e7b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109460a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201587.989312:0:14232:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000cc8ad32a ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000acf6f96b/0xd138388016f6e7b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109460a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201587.989375:0:14232:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000acf6f96b/0xd138388016f6e7b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109460a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201587.989598:0:14232:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc14416dc00 - object 0x280000400:397 offset 0<>6234 00000080:00200000:0.0:1788201587.989640:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x10c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.989662:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x10d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.989668:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:0.0:1788201587.989687:0:14232:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000006ce4158d ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6e7d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094665 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201587.989698:0:14232:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000006ce4158d ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6e7d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094665 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201587.989752:0:14232:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6e7d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094665 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201587.989867:0:14232:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc14416ed80 - object 0x240000400:397 offset 0<>111139 00000080:00200000:0.0:1788201587.989901:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x10d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.989923:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x10e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.989929:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:0.0:1788201587.989947:0:14232:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000637616f9 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a20b739c/0xd138388016f6e7f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710946c0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201587.989958:0:14232:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000637616f9 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a20b739c/0xd138388016f6e7f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710946c0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201587.989988:0:14232:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a20b739c/0xd138388016f6e7f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710946c0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201587.990038:0:14232:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc14416c000 - object 0x280000400:398 offset 0<>35427 00000080:00200000:0.0:1788201587.990060:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x10e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.990080:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x10f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.990086:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:0.0:1788201587.990101:0:14232:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000953f8997 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000618f56a5/0xd138388016f6e81a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109471b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201587.990116:0:14232:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000953f8997 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000618f56a5/0xd138388016f6e81a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109471b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201587.990140:0:14232:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000618f56a5/0xd138388016f6e81a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109471b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201587.990204:0:14232:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc14416d180 - object 0x240000400:398 offset 0<>13879 00000080:00200000:0.0:1788201587.990224:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x10f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.990243:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x110:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.990249:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:0.0:1788201587.990264:0:14232:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000effc8163 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1560c4/0xd138388016f6e83d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094776 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201587.990273:0:14232:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000effc8163 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1560c4/0xd138388016f6e83d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094776 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201587.990294:0:14232:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1560c4/0xd138388016f6e83d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094776 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201587.990323:0:14232:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc14416e300 - object 0x280000400:399 offset 0<>2129 00000080:00200000:0.0:1788201587.990341:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x110:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.990360:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x111:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.990364:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:0.0:1788201587.990378:0:14232:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000e5953ede ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084c24abf/0xd138388016f6e860 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710947d1 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201587.990394:0:14232:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000e5953ede ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084c24abf/0xd138388016f6e860 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710947d1 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201587.994717:0:14232:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084c24abf/0xd138388016f6e860 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710947d1 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201587.994933:0:14232:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc14416f480 - object 0x240000400:399 offset 0<>158554 00000080:00200000:0.0:1788201587.995019:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x111:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:0.0:1788201587.995060:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727889664:192.168.201.143@tcp:4:cp.0 00000080:00200000:0.0:1788201587.995367:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x112:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.995378:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:0.0:1788201587.995628:0:14232:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000003214e177 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201587.995647:0:14232:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000003214e177 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201587.995690:0:14232:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201587.995763:0:14232:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc14416fb80 - object 0x280000400:400 offset 0<>37842 00000100:00100000:1.0:1788201587.995867:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727889792:192.168.201.143@tcp:4:cp.0 00000080:00200000:0.0:1788201587.996533:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x112:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201587.996569:0:14232:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x113:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201587.996576:0:14232:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:0.0:1788201587.996599:0:14232:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000940e05d0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a08eaec7/0xd138388016f6e8a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094887 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201587.996613:0:14232:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000940e05d0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a08eaec7/0xd138388016f6e8a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094887 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201587.996647:0:14232:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a08eaec7/0xd138388016f6e8a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094887 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201587.996698:0:14232:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc14416ce00 - object 0x240000400:400 offset 0<>423 00000080:00200000:0.0:1788201587.996735:0:14232:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x113:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:0.0:1788201587.996753:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201587.996767:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727889920:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201588.019604:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000cc8ad32a ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000acf6f96b/0xd138388016f6e7b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109460a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201588.019664:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000cc8ad32a ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000acf6f96b/0xd138388016f6e7b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109460a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201588.019704:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727889024:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201588.019825:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000effc8163 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1560c4/0xd138388016f6e83d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094776 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201588.019841:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000effc8163 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1560c4/0xd138388016f6e83d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094776 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201588.019860:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727889536:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201588.019912:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000953f8997 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000618f56a5/0xd138388016f6e81a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109471b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201588.019930:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000953f8997 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000618f56a5/0xd138388016f6e81a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109471b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201588.019947:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727889408:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201588.019986:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000000feb0963 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d8911af5/0xd138388016f6e78e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710945af expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201588.020001:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000000feb0963 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d8911af5/0xd138388016f6e78e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710945af expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201588.020015:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727888896:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201588.020057:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000e6b9159f ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fe41aa0d/0xd138388016f6e725 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109449e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 1 00000008:00010000:3.0:1788201588.020074:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000e6b9159f ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fe41aa0d/0xd138388016f6e725 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109449e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 1 00000100:00100000:3.0:1788201588.020096:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727888512:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201588.021843:0:10052:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000008ce585c7 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008332e9f8/0xd138388016f6e76b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094554 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201588.021879:0:10052:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000008ce585c7 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008332e9f8/0xd138388016f6e76b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094554 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201588.021906:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727888768:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201588.021930:0:10052:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000005b738b9d ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6e748 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710944f9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 1 00000008:00010000:1.0:1788201588.021942:0:10052:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000005b738b9d ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6e748 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710944f9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 1 00000100:00100000:1.0:1788201588.021954:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727888640:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201588.048069:0:10053:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000006ce4158d ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6e7d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094665 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201588.048135:0:10053:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000006ce4158d ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6e7d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094665 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201588.048174:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727889152:192.168.201.143@tcp:4:cp.0 00010000:00010000:3.0:1788201588.050067:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000008:00010000:1.0:1788201588.050629:0:10053:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000003214e177 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201588.051915:0:10053:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000003214e177 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201588.051957:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727889792:192.168.201.143@tcp:4:cp.0 00000008:00010000:0.0:1788201588.061285:0:10053:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000637616f9 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a20b739c/0xd138388016f6e7f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710946c0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201588.061339:0:10053:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000637616f9 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a20b739c/0xd138388016f6e7f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710946c0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:0.0:1788201588.061381:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727889280:192.168.201.143@tcp:4:cp.0 00000080:00200000:3.0:1788201588.158405:0:24313:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201588.158448:0:24313:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201588.158484:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201588.158505:0:24313:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201588.158514:0:24313:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201588.158528:0:24313:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201588.158532:0:24313:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:3.0:1788201588.158542:0:24313:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7df3bb0 00010000:00010000:3.0:1788201588.158547:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201588.158558:0:24313:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201588.158581:0:24313:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 44 00000080:00200008:3.0:1788201588.158596:0:24313:0:(file.c:1090:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8bc1459f00c8), flags 304000 00000080:00200008:3.0:1788201588.158622:0:24313:0:(file.c:6283:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8bc1459f00c8), request_mask 2047, flags 0, foreign 0 00000002:00010000:3.0:1788201588.158655:0:24313:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: readdir flags 0 00010000:00010000:3.0:1788201588.158662:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201588.158672:0:24313:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000100:00100000:3.0:1788201588.161432:0:24313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff6300 pname:cluuid:pid:xid:nid:opc:job bash:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24313:1875064727890048:192.168.201.143@tcp:37:bash.0 00000100:00100000:3.0:1788201588.161752:0:24313:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201588.179897:0:24313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff6300 pname:cluuid:pid:xid:nid:opc:job bash:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24313:1875064727890048:192.168.201.143@tcp:37:bash.0 00010000:00010000:0.0:1788201588.180811:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201588.180830:0:24313:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201588.180875:0:24313:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201588.180899:0:24313:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201588.180918:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201588.180931:0:24313:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201588.180940:0:24313:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201588.180947:0:24313:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201588.180951:0:24313:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:0.0:1788201588.180957:0:24313:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c7df3cd8 00010000:00010000:0.0:1788201588.180960:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201588.180968:0:24313:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201588.181249:0:24313:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8) pos/size0/6656 32bit_api 0 00000080:00200000:0.0:1788201588.181311:0:24313:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8) pos/size18446744073709551614/6656 32bit_api 0 00000080:00200008:0.0:1788201588.181389:0:24313:0:(file.c:479:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8bc1459f00c8), flags 304000 00000080:00200000:0.0:1788201588.189261:0:24460:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201588.189302:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201588.189325:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201588.189352:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201588.189360:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201588.189372:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201588.189376:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:0.0:1788201588.189384:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c1923b58 00010000:00010000:0.0:1788201588.189388:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201588.189396:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201588.189428:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201588.189437:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=8 00000080:00200008:0.0:1788201588.189448:0:24460:0:(file.c:6283:ll_getattr_dentry()) START file d6b.sanity-lfsck:[0x200000bd7:0xe5:0x0](ffff8bc145933248), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201588.189454:0:24460:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248),name=d6b.sanity-lfsck 00000002:00010000:0.0:1788201588.189476:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0xe5:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201588.189484:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00010000:00010000:0.0:1788201588.189546:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed0d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.189555:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed0d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.189567:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed0d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201588.189609:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416c700 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727890176:192.168.201.143@tcp:101:rm.0 00000100:00100000:0.0:1788201588.189751:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201588.196971:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416c700 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727890176:192.168.201.143@tcp:101:rm.0 00010000:00010000:0.0:1788201588.197005:0:24460:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed0d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095728 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.197025:0:24460:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed0d lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095728 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.197045:0:24460:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed0d lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095728 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.197058:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed0d lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095728 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.197071:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed0d lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095728 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.197087:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed0d lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095728 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.197097:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed0d lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095728 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.197105:0:24460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed0d lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095728 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201588.197124:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc14416c700 x1875064727890176/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201604 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201588.197140:0:24460:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095728 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.197151:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/229 (0 0) 00000080:00200000:0.0:1788201588.197159:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1788201588.197183:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0xe5:0x0], updating i_size 16896 00000080:00010000:0.0:1788201588.197190:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0xe5:0x0](ffff8bc145933248) for lock 0xd138388016f6ed0d 00000080:00010000:0.0:1788201588.197198:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0xe5:0x0](ffff8bc145933248) 00000080:00010000:0.0:1788201588.197202:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed0d from it ffffadd1c1923cb8 00010000:00010000:0.0:1788201588.197206:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095728 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.197216:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed0d lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095728 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201588.197442:0:24460:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201588.197479:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201588.197490:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201588.197502:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201588.197508:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201588.197513:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201588.197517:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:0.0:1788201588.197521:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c1923bf8 00010000:00010000:0.0:1788201588.197524:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201588.197531:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201588.197540:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201588.197548:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=266 00000080:00200000:0.0:1788201588.197554:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 44 00000080:00200008:0.0:1788201588.197564:0:24460:0:(file.c:1090:ll_file_open()) START file d6b.sanity-lfsck:[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags 704400 00000002:00010000:0.0:1788201588.197582:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0xe5:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1788201588.197635:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6ed14 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.197643:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6ed14 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1788201588.197657:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1788201588.197664:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14416c700 x1875064727890432/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1788201588.197673:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6ed14 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201588.197697:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416c700 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727890432:192.168.201.143@tcp:101:rm.0 00000100:00100000:1.0:1788201588.201638:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201588.213591:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416c700 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727890432:192.168.201.143@tcp:101:rm.0 00010000:00010000:1.0:1788201588.213623:0:24460:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6ed14 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.213640:0:24460:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6ed14 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.213661:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6ed14 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.213668:0:24460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6ed14 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.213678:0:24460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6ed14 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.213685:0:24460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3c800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201588.213691:0:24460:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6ed14 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.213698:0:24460:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6ed14 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.213706:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6ed14 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.213714:0:24460:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201588.213721:0:24460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6ed14 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.213728:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6ed14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201588.213754:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff8bc14416c700 x1875064727890432/t8589937182(8589937182) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201604 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201588.213769:0:24460:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14416c700 x1875064727890432/t8589937182(8589937182) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201604 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201588.213784:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1788201588.213865:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0xe5:0x0], updating i_size 16896 00000002:00100000:1.0:1788201588.213887:0:24460:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14416c700 x1875064727890432/t8589937182(8589937182) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201604 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1788201588.217814:0:24460:0:(file.c:6283:ll_getattr_dentry()) START file d6b.sanity-lfsck:[0x200000bd7:0xe5:0x0](ffff8bc145933248), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201588.217838:0:24460:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248),name=d6b.sanity-lfsck 00000002:00010000:1.0:1788201588.217878:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0xe5:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201588.217903:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed0d lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095728 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201588.217929:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed0d lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095728 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201588.217939:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201588.217952:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0xe5:0x0](ffff8bc145933248) 00000080:00010000:1.0:1788201588.217956:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0xe5:0x0](ffff8bc145933248) for lock 0xd138388016f6ed0d 00000080:00010000:1.0:1788201588.217965:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed0d from it ffffadd1c1923cd8 00010000:00010000:1.0:1788201588.217970:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095728 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201588.217981:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed0d lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095728 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201588.218118:0:24460:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248) pos/size0/16896 32bit_api 0 00000002:00010000:1.0:1788201588.218135:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0xe5:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: readdir flags 0 00010000:00010000:1.0:1788201588.218143:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed0d lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095728 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.218153:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed0d lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095728 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000100:00100000:1.0:1788201588.218941:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727890560:192.168.201.143@tcp:37:rm.0 00000100:00100000:1.0:1788201588.219351:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201588.251390:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727890560:192.168.201.143@tcp:37:rm.0 00010000:00010000:1.0:1788201588.257544:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095728 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.257576:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed0d lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095728 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201588.306071:0:24460:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248) pos/size0/16896 32bit_api 0 00000080:00200000:3.0:1788201588.306240:0:24460:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248) pos/size18446744073709551614/16896 32bit_api 0 00000080:00200000:3.0:1788201588.306274:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201588.306287:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=maloo_upload.sh, flags=0 00000080:00200000:3.0:1788201588.306293:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:3.0:1788201588.306299:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=maloo_upload.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:3.0:1788201588.306390:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed0d lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e2171095728 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 1 00010000:00010000:3.0:1788201588.306531:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48c00/0xd138388016f6e27f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109373f expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201588.310365:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171093d90 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201588.310469:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0xf8:0x0]: losing layout lock 00010000:00010000:3.0:1788201588.310571:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171093d90 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201588.310582:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed0d lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171095728 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 1 00010000:00010000:3.0:1788201588.310596:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:3.0:1788201588.310600:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c800/0xd138388016f6e4e7 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171093d90 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201588.310626:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed0d lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171095728 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 1 00000020:00100000:3.0:1788201588.310647:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1788201588.310665:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc151ff7480 x1875064727891328/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201588.310698:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff7480 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727891328:192.168.201.143@tcp:36:rm.0 00000100:00100000:3.0:1788201588.310881:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201588.318705:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff7480 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727891328:192.168.201.143@tcp:36:rm.0 00000080:00200000:3.0:1788201588.318893:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1788201588.318906:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1788201588.318982:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201588.319065:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0xf8:0x0](ffff8bc1459d5b88) 00000008:00010000:3.0:1788201588.319117:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 838 blocks 1 [cma]time 1788201556 1788201556 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d554d574/0xd138388016f6e4f5 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x183:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093da5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201588.319216:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201588.319230:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=racer.sh, flags=0 00000080:00200000:3.0:1788201588.319237:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:3.0:1788201588.319243:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=racer.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:3.0:1788201588.319298:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400da00/0xd138388016f6e6f4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e217109442e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201588.319329:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x107:0x0]: losing layout lock 00010000:00010000:3.0:1788201588.319392:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400da00/0xd138388016f6e6f4 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109442e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201588.319401:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201588.319405:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400da00/0xd138388016f6e6f4 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x107:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109442e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000020:00100000:3.0:1788201588.319444:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1788201588.319456:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc151ff6d80 x1875064727891584/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201588.319493:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff6d80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727891584:192.168.201.143@tcp:36:rm.0 00000100:00100000:3.0:1788201588.319596:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201588.325972:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff6d80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727891584:192.168.201.143@tcp:36:rm.0 00000080:00200000:3.0:1788201588.326078:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x107:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1788201588.326090:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1788201588.326158:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x107:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201588.326245:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x107:0x0](ffff8bc1459d42c8) 00000008:00010000:3.0:1788201588.326300:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 7187 blocks 1 [cma]time 1788201557 1788201557 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aa9ac74c/0xd138388016f6e702 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x18a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094443 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201588.326400:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201588.326421:0:24460:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f1, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=0 00000080:00200000:3.0:1788201588.326426:0:24460:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f1, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00000002:00010000:3.0:1788201588.326455:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f1,[0x0:0x0:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201588.326545:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6ed22 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.326556:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6ed22 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.326569:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6ed22 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201588.326595:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff4380 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727891712:192.168.201.143@tcp:101:rm.0 00000100:00100000:3.0:1788201588.326676:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201588.330055:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff4380 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727891712:192.168.201.143@tcp:101:rm.0 00010000:00010000:3.0:1788201588.330092:0:24460:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6ed22 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109579f expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.330122:0:24460:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6ed22 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x139:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109579f expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.330133:0:24460:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6ed22 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x139:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109579f expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.330147:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6ed22 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x139:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109579f expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.330160:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6ed22 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x139:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109579f expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.330177:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6ed22 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x139:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109579f expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.330188:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6ed22 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x139:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109579f expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.330197:0:24460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6ed22 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x139:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109579f expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201588.330210:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc151ff4380 x1875064727891712/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201604 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201588.330224:0:24460:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6ed22 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x139:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109579f expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.330237:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/313 (0 0) 00000080:00200000:3.0:1788201588.330254:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1788201588.330283:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x139:0x0], updating i_size 0 00000080:00200000:3.0:1788201588.330286:0:24460:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x139:0x0](ffff8bc14465c2c8): rc = 0 00000080:00200000:3.0:1788201588.330340:0:24460:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x139:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1788201588.330366:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x139:0x0](ffff8bc14465c2c8) for lock 0xd138388016f6ed22 00000080:00010000:3.0:1788201588.330378:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x139:0x0](ffff8bc14465c2c8) 00000080:00010000:3.0:1788201588.330383:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed22 from it ffffadd1c1923df8 00010000:00010000:3.0:1788201588.330387:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6ed22 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x139:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109579f expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.330398:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6ed22 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x139:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109579f expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201588.330467:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:3.0:1788201588.330478:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=f1, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:3.0:1788201588.330526:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6ed22 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x139:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e217109579f expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201588.330550:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x139:0x0]: losing layout lock 00010000:00010000:3.0:1788201588.330602:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6ed22 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x139:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109579f expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201588.330610:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201588.330614:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6ed22 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x139:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109579f expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:3.0:1788201588.330656:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1788201588.330666:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc151ff4380 x1875064727891968/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201588.330695:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff4380 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727891968:192.168.201.143@tcp:36:rm.0 00000100:00100000:3.0:1788201588.331019:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201588.340159:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff4380 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727891968:192.168.201.143@tcp:36:rm.0 00000080:00200000:3.0:1788201588.340269:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x139:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201588.340278:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x139:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201588.340304:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x139:0x0](ffff8bc14465c2c8) 00000080:00200000:3.0:1788201588.340380:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201588.340391:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=setup-nfs.sh, flags=0 00000080:00200000:3.0:1788201588.340397:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:3.0:1788201588.340402:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=setup-nfs.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:3.0:1788201588.340457:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a400/0xd138388016f6ec6c lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171095266 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201588.340509:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x12f:0x0]: losing layout lock 00010000:00010000:3.0:1788201588.340580:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a400/0xd138388016f6ec6c lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x12f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171095266 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201588.340587:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201588.340591:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a400/0xd138388016f6ec6c lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x12f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171095266 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000020:00100000:3.0:1788201588.340619:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1788201588.340629:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc151ff5f80 x1875064727892224/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201588.340663:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff5f80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727892224:192.168.201.143@tcp:36:rm.0 00000100:00100000:3.0:1788201588.340732:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201588.349057:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff5f80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727892224:192.168.201.143@tcp:36:rm.0 00000080:00200000:3.0:1788201588.349200:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x12f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1788201588.349214:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:3.0:1788201588.349261:0:24460:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000003886946a ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:3.0:1788201588.349300:0:24460:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000003886946a ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:3.0:1788201588.349334:0:24460:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000003886946a ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201588.349382:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x12f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201588.349446:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x12f:0x0](ffff8bc1459f4b08) 00000008:00010000:3.0:1788201588.349504:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 1611 blocks 1 [cma]time 1788201559 1788201559 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201588.349589:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201588.349602:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-lnet.sh, flags=0 00000080:00200000:3.0:1788201588.349608:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:3.0:1788201588.349613:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=sanity-lnet.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00000100:00100000:3.0:1788201588.397493:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727893376:192.168.201.143@tcp:101:rm.0 00010000:00010000:3.0:1788201588.397530:0:24460:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6ed29 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095863 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.397557:0:24460:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6ed29 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x159:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095863 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.397567:0:24460:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6ed29 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x159:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095863 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.397581:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6ed29 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x159:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095863 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.397594:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6ed29 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x159:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095863 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.397617:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6ed29 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x159:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095863 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.397627:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6ed29 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x159:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095863 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.397648:0:24460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6ed29 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x159:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095863 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201588.397664:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc1726cdc00 x1875064727893376/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201604 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201588.397680:0:24460:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6ed29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x159:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095863 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.397693:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/345 (0 0) 00000080:00200000:3.0:1788201588.397702:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1788201588.397732:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x159:0x0], updating i_size 7680 00000080:00200000:3.0:1788201588.397736:0:24460:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x159:0x0](ffff8bc144681988): rc = 0 00000080:00010000:3.0:1788201588.397743:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x159:0x0](ffff8bc144681988) for lock 0xd138388016f6ed29 00000080:00010000:3.0:1788201588.397757:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x159:0x0](ffff8bc144681988) 00000080:00010000:3.0:1788201588.397761:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed29 from it ffffadd1c1923b20 00010000:00010000:3.0:1788201588.397765:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6ed29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x159:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095863 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.397777:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6ed29 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x159:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095863 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:3.0:1788201588.397851:0:24460:0:(file.c:6283:ll_getattr_dentry()) START file e3:[0x200000bd7:0x159:0x0](ffff8bc144681988), request_mask 2047, flags 0, foreign 0 00000002:00010000:3.0:1788201588.397877:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0xe5:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: readdir flags 0 00010000:00010000:3.0:1788201588.397886:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00010000:00010000:3.0:1788201588.397930:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6ed30 lrc: 3/1,0 mode: --/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.397938:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6ed30 lrc: 3/1,0 mode: --/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.397949:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6ed30 lrc: 3/1,0 mode: --/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201588.397974:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff4000 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727893504:192.168.201.143@tcp:101:rm.0 00000100:00100000:3.0:1788201588.398202:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201588.401729:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff4000 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727893504:192.168.201.143@tcp:101:rm.0 00010000:00010000:3.0:1788201588.401769:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6ed30 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109586a expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.401934:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6ed30 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109586a expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201588.401956:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x4 disposition=0x0, status=0 req@ffff8bc151ff4000 x1875064727893504/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 328/344 e 0 to 0 dl 1788201604 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201588.403757:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff4000 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727893632:192.168.201.143@tcp:37:rm.0 00000100:00100000:3.0:1788201588.404276:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201588.425696:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff4000 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727893632:192.168.201.143@tcp:37:rm.0 00010000:00010000:3.0:1788201588.426831:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6ed30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109586a expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.426856:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6ed30 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109586a expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201588.440070:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710952c1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.440102:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710952c1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.440111:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ec8f from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.440119:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710952c1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.440128:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ec8f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x130:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710952c1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.440190:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.440199:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.440205:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e96a from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.440209:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.440217:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.440240:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734400/0xd138388016f6e415 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093b6e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.440248:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734400/0xd138388016f6e415 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093b6e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.440256:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e415 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.440259:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734400/0xd138388016f6e415 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093b6e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.440266:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734400/0xd138388016f6e415 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093b6e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.440287:0:24461:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/307 (0 0) 00010000:00010000:0.0:1788201588.440339:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6ed3e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 24461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.440346:0:24461:0:(ldlm_request.c:1275:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6ed3e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x0 pid: 24461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.440368:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611c00/0xd138388016f6e68b lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x104:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109431d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.440377:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611c00/0xd138388016f6e68b lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x104:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109431d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.440384:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e68b from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.440387:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611c00/0xd138388016f6e68b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x104:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109431d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.440395:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611c00/0xd138388016f6e68b lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x104:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109431d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.440420:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645c800/0xd138388016f6eb9a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x129:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095044 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.440429:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645c800/0xd138388016f6eb9a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x129:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095044 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.440435:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eb9a from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.440438:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645c800/0xd138388016f6eb9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x129:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095044 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.440445:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645c800/0xd138388016f6eb9a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x129:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095044 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.440520:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6e2b7 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710937e0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.440530:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6e2b7 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710937e0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.440537:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e2b7 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.440541:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6e2b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710937e0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.440549:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6e2b7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710937e0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.440571:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267f000/0xd138388016f6e47e lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093c7f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.440580:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267f000/0xd138388016f6e47e lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093c7f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.440586:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e47e from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.440590:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267f000/0xd138388016f6e47e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093c7f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.440598:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267f000/0xd138388016f6e47e lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093c7f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1788201588.440912:0:24461:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x130:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201588.440924:0:24461:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x130:0x0] 00000008:00010000:0.0:1788201588.440955:0:24461:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:0.0:1788201588.440960:0:24461:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1506417b0, osc lock ffff8bc145d350a0, flags 0x400041012 00010000:00010000:0.0:1788201588.440981:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.440994:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.441005:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.441014:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:0.0:1788201588.441036:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_release():245 00000020:00010000:0.0:1788201588.441040:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.441042:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1506417b0 (ffff8bc1499c4998/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.441048:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201588.441050:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1506417b0 (ffff8bc1499c4488/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201588.441082:0:24461:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x130:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201588.441104:0:24461:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x119:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201588.441109:0:24461:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x119:0x0] 00000008:00010000:0.0:1788201588.441122:0:24461:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:0.0:1788201588.441124:0:24461:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1506417b0, osc lock ffff8bc145d350a0, flags 0x400041012 00010000:00010000:0.0:1788201588.441135:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x193:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.441145:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.441154:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.441163:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:0.0:1788201588.441176:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_release():245 00000020:00010000:0.0:1788201588.441179:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.441182:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1506417b0 (ffff8bc1499c4998/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.441186:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201588.441188:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1506417b0 (ffff8bc1499c4488/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201588.441200:0:24461:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x119:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201588.441217:0:24461:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf2:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201588.441222:0:24461:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0xf2:0x0] 00000008:00010000:0.0:1788201588.441234:0:24461:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:0.0:1788201588.441236:0:24461:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1506417b0, osc lock ffff8bc145d350a0, flags 0x400041012 00010000:00010000:0.0:1788201588.441244:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e48effa4/0xd138388016f6e423 lrc: 2/0,1 mode: PW/PW res: [0x280000400:0x180:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093b83 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.441254:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e48effa4/0xd138388016f6e423 lrc: 2/0,1 mode: PW/PW res: [0x280000400:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093b83 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.441262:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e48effa4/0xd138388016f6e423 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171093b83 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.441270:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e48effa4/0xd138388016f6e423 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093b83 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 1 00000020:00010000:0.0:1788201588.441279:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_release():245 00000020:00010000:0.0:1788201588.441282:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.441284:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1506417b0 (ffff8bc1499c4998/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.441287:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201588.441289:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1506417b0 (ffff8bc1499c4488/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201588.441300:0:24461:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf2:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201588.441319:0:24461:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x104:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201588.441324:0:24461:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x104:0x0] 00000008:00010000:0.0:1788201588.441335:0:24461:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:0.0:1788201588.441338:0:24461:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1506417b0, osc lock ffff8bc145d350a0, flags 0x400041012 00010000:00010000:0.0:1788201588.441347:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a3ce3255/0xd138388016f6e699 lrc: 2/0,1 mode: PW/PW res: [0x280000400:0x189:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094332 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.441356:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a3ce3255/0xd138388016f6e699 lrc: 2/0,1 mode: PW/PW res: [0x280000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094332 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.441366:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a3ce3255/0xd138388016f6e699 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094332 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.441375:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a3ce3255/0xd138388016f6e699 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094332 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:0.0:1788201588.441385:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_release():245 00000020:00010000:0.0:1788201588.441388:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.441390:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1506417b0 (ffff8bc1499c4998/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.441393:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201588.441396:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1506417b0 (ffff8bc1499c4488/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201588.441406:0:24461:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x104:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201588.442389:0:24462:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x129:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201588.442399:0:24462:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x129:0x0] 00000008:00010000:3.0:1788201588.442426:0:24462:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:3.0:1788201588.442431:0:24462:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149fec930, osc lock ffff8bc14691a130, flags 0x400041012 00010000:00010000:3.0:1788201588.442451:0:24462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004b4e8b7f/0xd138388016f6eba8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171095059 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201588.442476:0:24462:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004b4e8b7f/0xd138388016f6eba8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171095059 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201588.442486:0:24462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004b4e8b7f/0xd138388016f6eba8 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171095059 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201588.442495:0:24462:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004b4e8b7f/0xd138388016f6eba8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171095059 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:3.0:1788201588.442511:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_release():245 00000020:00010000:3.0:1788201588.442514:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201588.442517:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149fec930 (ffff8bc1460e9098/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201588.442520:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201588.442523:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149fec930 (ffff8bc1460e9bd8/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201588.442552:0:24462:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x129:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201588.442575:0:24462:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xe8:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201588.442580:0:24462:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0xe8:0x0] 00000008:00010000:3.0:1788201588.442593:0:24462:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:3.0:1788201588.442595:0:24462:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149fec930, osc lock ffff8bc14691a130, flags 0x400041012 00010000:00010000:3.0:1788201588.442606:0:24462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e1840c2c/0xd138388016f6e2c5 lrc: 2/0,1 mode: PW/PW res: [0x280000400:0x17b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710937f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201588.442616:0:24462:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e1840c2c/0xd138388016f6e2c5 lrc: 2/0,1 mode: PW/PW res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710937f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201588.442625:0:24462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e1840c2c/0xd138388016f6e2c5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710937f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201588.442632:0:24462:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e1840c2c/0xd138388016f6e2c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710937f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1788201588.443220:0:24461:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf5:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201588.443228:0:24461:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0xf5:0x0] 00000008:00010000:0.0:1788201588.443248:0:24461:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:0.0:1788201588.443251:0:24461:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1506417b0, osc lock ffff8bc145d350a0, flags 0x400041012 00010000:00010000:0.0:1788201588.443264:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084ac9b5f/0xd138388016f6e48c lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x181:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093c94 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.443278:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084ac9b5f/0xd138388016f6e48c lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093c94 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.443288:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084ac9b5f/0xd138388016f6e48c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171093c94 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.443295:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084ac9b5f/0xd138388016f6e48c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093c94 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 1 00000020:00010000:0.0:1788201588.443308:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_release():245 00000020:00010000:0.0:1788201588.443312:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.443314:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1506417b0 (ffff8bc1499c4998/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.443317:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201588.443320:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1506417b0 (ffff8bc1499c4488/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201588.443335:0:24461:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf5:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000020:00010000:3.0:1788201588.443420:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_release():245 00000020:00010000:3.0:1788201588.443423:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201588.443427:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149fec930 (ffff8bc1460e9098/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201588.443429:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201588.443431:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149fec930 (ffff8bc1460e9bd8/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201588.443448:0:24462:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xe8:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1788201588.518546:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6e7c6 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094650 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.518576:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6e7c6 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094650 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.518586:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e7c6 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.518593:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6e7c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094650 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.518604:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6e7c6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094650 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.522473:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172724000/0xd138388016f6e50a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093deb expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.522504:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172724000/0xd138388016f6e50a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093deb expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.522514:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e50a from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.522521:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172724000/0xd138388016f6e50a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093deb expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.522532:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172724000/0xd138388016f6e50a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093deb expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.522575:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610600/0xd138388016f6e780 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x10b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109459a expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.522585:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610600/0xd138388016f6e780 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x10b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109459a expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.522592:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e780 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.522596:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610600/0xd138388016f6e780 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x10b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109459a expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.522604:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610600/0xd138388016f6e780 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x10b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109459a expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.522624:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267e400/0xd138388016f6e717 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094489 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.522705:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267e400/0xd138388016f6e717 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094489 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.522714:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e717 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.522718:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267e400/0xd138388016f6e717 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094489 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.522727:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267e400/0xd138388016f6e717 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094489 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.522751:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172723200/0xd138388016f6e366 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710939a7 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.522760:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172723200/0xd138388016f6e366 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710939a7 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.522767:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e366 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.522770:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172723200/0xd138388016f6e366 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710939a7 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.522778:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172723200/0xd138388016f6e366 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710939a7 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.522876:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611e00/0xd138388016f6e7e9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x10e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710946ab expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.522886:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611e00/0xd138388016f6e7e9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x10e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710946ab expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.522895:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e7e9 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.522899:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611e00/0xd138388016f6e7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x10e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710946ab expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.522908:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611e00/0xd138388016f6e7e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x10e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710946ab expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.522926:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611a00/0xd138388016f6e8bb lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x114:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710948cd expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.522935:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611a00/0xd138388016f6e8bb lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x114:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710948cd expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.522941:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e8bb from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.522945:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611a00/0xd138388016f6e8bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x114:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710948cd expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.522952:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611a00/0xd138388016f6e8bb lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x114:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710948cd expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.523006:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6ed45 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.523015:0:24461:0:(ldlm_request.c:1275:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6ed45 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.523037:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725800/0xd138388016f6e645 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x102:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094267 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.523046:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725800/0xd138388016f6e645 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x102:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094267 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.523051:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e645 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.523054:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725800/0xd138388016f6e645 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x102:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094267 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.523061:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725800/0xd138388016f6e645 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x102:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094267 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1788201588.523991:0:24461:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf9:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201588.524003:0:24461:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0xf9:0x0] 00000008:00010000:0.0:1788201588.524034:0:24461:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:0.0:1788201588.524039:0:24461:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1506412b0, osc lock ffff8bc145d350a0, flags 0x400041012 00010000:00010000:0.0:1788201588.524062:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000af56bec5/0xd138388016f6e518 lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x183:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093e70 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.524078:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000af56bec5/0xd138388016f6e518 lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093e70 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201588.524374:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727894912:192.168.201.143@tcp:36:rm.0 00000080:00200000:3.0:1788201588.524451:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x130:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1788201588.524470:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:3.0:1788201588.524514:0:24460:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 0000000022ba4270 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201588.524546:0:24460:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 0000000022ba4270 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201588.524574:0:24460:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 0000000022ba4270 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201588.524621:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x130:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201588.524908:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x130:0x0](ffff8bc14465d348) 00000008:00010000:3.0:1788201588.524951:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 1765 blocks 1 [cma]time 1788201559 1788201559 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201588.525040:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201588.525052:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=run_tar.sh, flags=0 00010000:00010000:3.0:1788201588.525069:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:3.0:1788201588.525079:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e96a from it ffffadd1c1923d78 00010000:00010000:3.0:1788201588.525083:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000100:00100000:1.0:1788201588.525386:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727895040:192.168.201.143@tcp:63:ll_sa.0 00010000:00010000:0.0:1788201588.526213:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000af56bec5/0xd138388016f6e518 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171093e70 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.526238:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000af56bec5/0xd138388016f6e518 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093e70 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201588.526385:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1788201588.526421:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:3.0:1788201588.526432:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=run_tar.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:3.0:1788201588.526523:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1788201588.526553:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x119:0x0]: losing layout lock 00010000:00010000:3.0:1788201588.526613:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1788201588.526623:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201588.526627:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7000/0xd138388016f6e96a lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x119:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094a94 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00010000:0.0:1788201588.526730:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_release():245 00000020:00010000:0.0:1788201588.526734:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.526740:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1506412b0 (ffff8bc1499c4998/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.526745:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201588.526748:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1506412b0 (ffff8bc1499c4488/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201588.526778:0:24461:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf9:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1788201588.527330:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778e00/0xd138388016f6eb54 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x127:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094f8e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.527344:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778e00/0xd138388016f6eb54 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x127:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094f8e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.527354:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eb54 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.527360:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778e00/0xd138388016f6eb54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x127:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094f8e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.527370:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778e00/0xd138388016f6eb54 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x127:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094f8e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.527397:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172735600/0xd138388016f6e4a1 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093cda expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.527406:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172735600/0xd138388016f6e4a1 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093cda expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.527413:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e4a1 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.527418:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172735600/0xd138388016f6e4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093cda expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.527426:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172735600/0xd138388016f6e4a1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093cda expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.527446:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031800/0xd138388016f6eb77 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x128:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094fe9 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.527465:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031800/0xd138388016f6eb77 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x128:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094fe9 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.527472:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eb77 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.527475:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031800/0xd138388016f6eb77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x128:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094fe9 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.527483:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031800/0xd138388016f6eb77 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x128:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094fe9 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.527505:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6800/0xd138388016f6ea5f lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x120:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094d11 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.527514:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6800/0xd138388016f6ea5f lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x120:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094d11 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.527521:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ea5f from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.527525:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6800/0xd138388016f6ea5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x120:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094d11 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.527539:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6800/0xd138388016f6ea5f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x120:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094d11 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.527559:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722c00/0xd138388016f6e320 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xeb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710938f1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.527568:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722c00/0xd138388016f6e320 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xeb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710938f1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.527574:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e320 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.527578:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722c00/0xd138388016f6e320 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xeb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710938f1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.527585:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722c00/0xd138388016f6e320 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xeb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710938f1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.527604:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611000/0xd138388016f6e5dc lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094156 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.527612:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611000/0xd138388016f6e5dc lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094156 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.527620:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e5dc from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.527623:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611000/0xd138388016f6e5dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094156 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.527631:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611000/0xd138388016f6e5dc lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094156 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000020:00100000:3.0:1788201588.527823:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1788201588.527841:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc151ff4000 x1875064727895296/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201588.527871:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff4000 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727895296:192.168.201.143@tcp:36:rm.0 00000100:00100000:3.0:1788201588.527984:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788201588.528368:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d000/0xd138388016f6ed4c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 24461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.528377:0:24461:0:(ldlm_request.c:1275:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d000/0xd138388016f6ed4c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x0 pid: 24461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.528400:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6ec03 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x12c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095155 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.528411:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6ec03 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x12c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095155 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.528418:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ec03 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.528423:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6ec03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095155 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.528431:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6ec03 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095155 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.528464:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6ed53 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 24461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.528472:0:24461:0:(ldlm_request.c:1275:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6ed53 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x0 pid: 24461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.528493:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.528508:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.528516:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eac8 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.528519:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.528527:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.528549:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.528558:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.528565:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e82f from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.528569:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.528578:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.528595:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49a00/0xd138388016f6e389 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093a02 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.528604:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49a00/0xd138388016f6e389 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093a02 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.528612:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e389 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.528616:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49a00/0xd138388016f6e389 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093a02 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.528625:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49a00/0xd138388016f6e389 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093a02 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.530759:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.530777:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.531337:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e98d from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.531342:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.531351:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.531383:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172723a00/0xd138388016f6e73a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x109:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710944e4 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.531393:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172723a00/0xd138388016f6e73a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x109:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710944e4 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.531401:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e73a from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.531405:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172723a00/0xd138388016f6e73a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x109:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710944e4 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.531413:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172723a00/0xd138388016f6e73a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x109:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710944e4 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.531433:0:24461:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/310 (0 0) 00010000:00010000:0.0:1788201588.531480:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6ed5a lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x10000000000000 pid: 24461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.531489:0:24461:0:(ldlm_request.c:1275:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6ed5a lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x0 pid: 24461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.531516:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267f400/0xd138388016f6e550 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xfb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093fea expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.531526:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267f400/0xd138388016f6e550 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xfb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093fea expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.531533:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e550 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.531537:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267f400/0xd138388016f6e550 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xfb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093fea expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.531546:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267f400/0xd138388016f6e550 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xfb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093fea expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.531564:0:24461:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/311 (0 0) 00010000:00010000:0.0:1788201588.531577:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3de00/0xd138388016f6ed61 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x10000000000000 pid: 24461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.531590:0:24461:0:(ldlm_request.c:1275:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3de00/0xd138388016f6ed61 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x0 pid: 24461 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201588.531680:0:24461:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x127:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201588.531686:0:24461:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x127:0x0] 00000008:00010000:0.0:1788201588.531707:0:24461:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:0.0:1788201588.531710:0:24461:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc146f0a2b0, osc lock ffff8bc145d350a0, flags 0x400041012 00010000:00010000:0.0:1788201588.531721:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6eb62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094fa3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.531733:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6eb62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094fa3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.531743:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6eb62 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094fa3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.531753:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6eb62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094fa3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:0.0:1788201588.531764:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_release():245 00000020:00010000:0.0:1788201588.531767:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.531770:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146f0a2b0 (ffff8bc1499c4998/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.531774:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201588.531776:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146f0a2b0 (ffff8bc1499c4488/1) at cl_lock_fini():72 00000100:00100000:1.0:1788201588.531938:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201588.531965:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727895424:192.168.201.143@tcp:63:ll_sa.0 00000080:00200000:0.0:1788201588.533381:0:24461:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x127:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201588.533414:0:24461:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x128:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201588.533420:0:24461:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x128:0x0] 00000008:00010000:0.0:1788201588.533438:0:24461:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:0.0:1788201588.533441:0:24461:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc146f0a2b0, osc lock ffff8bc145d350a0, flags 0x400041012 00010000:00010000:0.0:1788201588.533454:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000df0d0d42/0xd138388016f6eb85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094ffe expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.533473:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000df0d0d42/0xd138388016f6eb85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094ffe expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.533483:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000df0d0d42/0xd138388016f6eb85 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094ffe expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.533492:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000df0d0d42/0xd138388016f6eb85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094ffe expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:0.0:1788201588.533503:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_release():245 00000020:00010000:0.0:1788201588.533506:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.533509:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146f0a2b0 (ffff8bc1499c4998/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.533512:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201588.533515:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146f0a2b0 (ffff8bc1499c4488/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201588.533528:0:24461:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x128:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201588.533547:0:24461:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x120:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201588.533552:0:24461:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x120:0x0] 00000008:00010000:0.0:1788201588.533565:0:24461:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:0.0:1788201588.533567:0:24461:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc146f0a2b0, osc lock ffff8bc145d350a0, flags 0x400041012 00010000:00010000:0.0:1788201588.533576:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f1e1fa05/0xd138388016f6ea6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x197:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094d26 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.533593:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f1e1fa05/0xd138388016f6ea6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094d26 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.533603:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f1e1fa05/0xd138388016f6ea6d lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094d26 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.533612:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f1e1fa05/0xd138388016f6ea6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094d26 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:0.0:1788201588.533622:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_release():245 00000020:00010000:0.0:1788201588.533625:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.533628:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146f0a2b0 (ffff8bc1499c4998/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.533631:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201588.533646:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146f0a2b0 (ffff8bc1499c4488/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201588.533657:0:24461:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x120:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201588.533675:0:24461:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xeb:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201588.533680:0:24461:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0xeb:0x0] 00000008:00010000:0.0:1788201588.533693:0:24461:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:0.0:1788201588.533695:0:24461:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc146f0a2b0, osc lock ffff8bc145d350a0, flags 0x400041012 00010000:00010000:0.0:1788201588.533705:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000038efa3ed/0xd138388016f6e32e lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x17c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093906 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.533716:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000038efa3ed/0xd138388016f6e32e lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093906 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.533732:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000038efa3ed/0xd138388016f6e32e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171093906 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.533741:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000038efa3ed/0xd138388016f6e32e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093906 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:0.0:1788201588.533752:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_release():245 00000020:00010000:0.0:1788201588.533755:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.533758:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146f0a2b0 (ffff8bc1499c4998/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.533761:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201588.533764:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146f0a2b0 (ffff8bc1499c4488/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201588.533774:0:24461:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xeb:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:3.0:1788201588.556778:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff4000 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727895296:192.168.201.143@tcp:36:rm.0 00000080:00200000:3.0:1788201588.556896:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x119:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1788201588.556908:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:3.0:1788201588.556954:0:24460:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000009a8144be ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201588.556989:0:24460:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000009a8144be ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201588.557017:0:24460:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000009a8144be ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201588.557061:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x119:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201588.557122:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x119:0x0](ffff8bc144659988) 00000008:00010000:3.0:1788201588.557164:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 1654 blocks 1 [cma]time 1788201558 1788201558 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x193:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201588.557248:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201588.557264:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=lfsck-performance.sh, flags=0 00010000:00010000:3.0:1788201588.557288:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734400/0xd138388016f6e415 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093b6e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:3.0:1788201588.557297:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e415 from it ffffadd1c1923d78 00010000:00010000:3.0:1788201588.557302:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734400/0xd138388016f6e415 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093b6e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201588.557311:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734400/0xd138388016f6e415 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093b6e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1788201588.557352:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:3.0:1788201588.557359:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=lfsck-performance.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:3.0:1788201588.557410:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734400/0xd138388016f6e415 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171093b6e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1788201588.557437:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0xf2:0x0]: losing layout lock 00010000:00010000:3.0:1788201588.557506:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734400/0xd138388016f6e415 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0xf2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171093b6e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1788201588.557519:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201588.557522:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734400/0xd138388016f6e415 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0xf2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171093b6e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:3.0:1788201588.557547:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1788201588.557558:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc151ff4700 x1875064727895680/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201588.557585:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff4700 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727895680:192.168.201.143@tcp:36:rm.0 00000100:00100000:3.0:1788201588.557695:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788201588.558102:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7c00/0xd138388016f6ea19 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x11e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094c5b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558118:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7c00/0xd138388016f6ea19 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x11e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094c5b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.558126:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ea19 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.558131:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7c00/0xd138388016f6ea19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x11e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094c5b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558140:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7c00/0xd138388016f6ea19 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x11e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094c5b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.558185:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610c00/0xd138388016f6e668 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x103:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710942c2 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558194:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610c00/0xd138388016f6e668 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x103:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710942c2 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.558201:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e668 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.558204:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610c00/0xd138388016f6e668 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x103:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710942c2 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558212:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610c00/0xd138388016f6e668 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x103:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710942c2 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.558234:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267fc00/0xd138388016f6e898 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x113:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094872 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558243:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267fc00/0xd138388016f6e898 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x113:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094872 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.558251:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e898 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.558254:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267fc00/0xd138388016f6e898 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x113:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094872 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558262:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267fc00/0xd138388016f6e898 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x113:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094872 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.558281:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6200/0xd138388016f6ea82 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x121:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094d6c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558291:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6200/0xd138388016f6ea82 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x121:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094d6c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.558298:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ea82 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.558301:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6200/0xd138388016f6ea82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x121:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094d6c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558310:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6200/0xd138388016f6ea82 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x121:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094d6c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.558328:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109531c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558337:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109531c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.558344:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ecb2 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.558347:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109531c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558356:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ecb2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x131:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109531c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.558372:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6e875 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094817 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558381:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6e875 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094817 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.558389:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e875 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.558392:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6e875 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094817 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558400:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6e875 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094817 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.558417:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172724600/0xd138388016f6e8de lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x115:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094928 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558426:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172724600/0xd138388016f6e8de lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x115:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094928 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.558432:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e8de from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.558436:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172724600/0xd138388016f6e8de lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x115:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094928 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558443:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172724600/0xd138388016f6e8de lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x115:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094928 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.558496:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109420c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558505:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109420c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.558512:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e622 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.558516:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109420c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558525:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400ce00/0xd138388016f6e622 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109420c expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.558546:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725a00/0xd138388016f6e5ff lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x100:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710941b1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558556:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725a00/0xd138388016f6e5ff lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x100:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710941b1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.558563:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e5ff from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.558567:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725a00/0xd138388016f6e5ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x100:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710941b1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558576:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725a00/0xd138388016f6e5ff lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x100:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710941b1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.558594:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645d000/0xd138388016f6eaeb lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x124:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094e7d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558603:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645d000/0xd138388016f6eaeb lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x124:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094e7d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.558610:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eaeb from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.558614:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645d000/0xd138388016f6eaeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x124:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094e7d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558628:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645d000/0xd138388016f6eaeb lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x124:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094e7d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.558646:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267ea00/0xd138388016f6e3ac lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093a5d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558654:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267ea00/0xd138388016f6e3ac lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093a5d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.558662:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e3ac from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.558666:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267ea00/0xd138388016f6e3ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093a5d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558674:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267ea00/0xd138388016f6e3ac lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093a5d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.558692:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734a00/0xd138388016f6e52d lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xfa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093f7a expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558700:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734a00/0xd138388016f6e52d lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xfa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093f7a expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.558707:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e52d from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.558710:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734a00/0xd138388016f6e52d lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xfa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093f7a expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558718:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734a00/0xd138388016f6e52d lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xfa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093f7a expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.558738:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558748:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.558755:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ec26 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.558758:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558765:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.558837:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6e80c lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x10f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094706 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558847:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6e80c lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x10f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094706 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.558854:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e80c from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.558858:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6e80c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x10f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094706 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558866:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6e80c lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x10f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094706 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.558884:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611400/0xd138388016f6e6ae lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x105:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094378 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558893:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611400/0xd138388016f6e6ae lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x105:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094378 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.558901:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e6ae from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.558904:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611400/0xd138388016f6e6ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x105:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094378 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558912:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611400/0xd138388016f6e6ae lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x105:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094378 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.558930:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6e294 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xe7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093785 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558940:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6e294 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xe7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093785 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.558946:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e294 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.558950:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6e294 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xe7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093785 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558957:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6e294 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xe7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093785 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.558975:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6600/0xd138388016f6ea3c lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x11f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094cb6 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.558984:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6600/0xd138388016f6ea3c lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x11f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094cb6 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.558992:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ea3c from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.558995:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6600/0xd138388016f6ea3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x11f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094cb6 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559003:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6600/0xd138388016f6ea3c lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x11f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094cb6 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.559021:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c200/0xd138388016f6e9b0 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x11b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094b4a expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559030:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c200/0xd138388016f6e9b0 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x11b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094b4a expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.559037:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e9b0 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.559042:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c200/0xd138388016f6e9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x11b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094b4a expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559050:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c200/0xd138388016f6e9b0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x11b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094b4a expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.559102:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559111:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.559118:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e924 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.559122:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559129:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.559151:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559159:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.559165:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ebbd from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.559168:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559176:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.559196:0:24461:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/308 (0 0) 00010000:00010000:0.0:1788201588.559238:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.559246:0:24461:0:(ldlm_request.c:1275:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.559268:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7600/0xd138388016f6e9f6 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x11d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094c00 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559281:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7600/0xd138388016f6e9f6 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x11d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094c00 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.559288:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e9f6 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.559292:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7600/0xd138388016f6e9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x11d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094c00 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559301:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7600/0xd138388016f6e9f6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x11d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094c00 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.559320:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6e7a3 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710945f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559327:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6e7a3 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710945f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.559335:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e7a3 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.559339:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6e7a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710945f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559347:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6e7a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710945f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.559364:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6e3f2 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093b13 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559372:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6e3f2 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093b13 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.559379:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e3f2 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.559382:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6e3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093b13 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559390:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6e3f2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093b13 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.559406:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725600/0xd138388016f6e75d lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x10a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109453f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559414:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725600/0xd138388016f6e75d lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x10a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109453f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.559421:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e75d from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.559425:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725600/0xd138388016f6e75d lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x10a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109453f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559433:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725600/0xd138388016f6e75d lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x10a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109453f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.559454:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12be00/0xd138388016f6ec49 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x12e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109520b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559474:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12be00/0xd138388016f6ec49 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x12e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109520b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.559481:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ec49 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.559485:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12be00/0xd138388016f6ec49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109520b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559493:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12be00/0xd138388016f6ec49 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109520b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.559518:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6ed6f lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 24461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.559526:0:24461:0:(ldlm_request.c:1275:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6ed6f lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x0 pid: 24461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.559542:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559552:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.559559:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e4c4 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.559563:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559571:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.559591:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172735000/0xd138388016f6e573 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xfc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094045 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559599:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172735000/0xd138388016f6e573 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xfc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094045 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.559607:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e573 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.559611:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172735000/0xd138388016f6e573 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xfc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094045 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559620:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172735000/0xd138388016f6e573 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xfc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094045 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.559636:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6e00/0xd138388016f6e9d3 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x11c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094ba5 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559645:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6e00/0xd138388016f6e9d3 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x11c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094ba5 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.559653:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e9d3 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.559656:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6e00/0xd138388016f6e9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x11c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094ba5 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559664:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6e00/0xd138388016f6e9d3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x11c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094ba5 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.559684:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 24461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.559691:0:24461:0:(ldlm_request.c:1275:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x0 pid: 24461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.559707:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559717:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.559724:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ebe0 from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.559728:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559737:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.559755:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49200/0xd138388016f6e26a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109370e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559764:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49200/0xd138388016f6e26a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109370e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1788201588.559771:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e26a from it ffffadd1c7dd3d48 00010000:00010000:0.0:1788201588.559774:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49200/0xd138388016f6e26a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109370e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.559783:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49200/0xd138388016f6e26a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109370e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000100:00100000:0.0:1788201588.559906:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201588.559930:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727895808:192.168.201.143@tcp:63:ll_sa.0 00000080:00200000:0.0:1788201588.560069:0:24461:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x11e:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201588.560080:0:24461:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x11e:0x0] 00000008:00010000:0.0:1788201588.560109:0:24461:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:0.0:1788201588.560113:0:24461:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1724565b0, osc lock ffff8bc145d350a0, flags 0x400041012 00010000:00010000:0.0:1788201588.560133:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892703bf/0xd138388016f6ea27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x196:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094c70 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.560145:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892703bf/0xd138388016f6ea27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094c70 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.560156:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892703bf/0xd138388016f6ea27 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094c70 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.560166:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892703bf/0xd138388016f6ea27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094c70 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:0.0:1788201588.560180:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_release():245 00000020:00010000:0.0:1788201588.560184:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.560188:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1724565b0 (ffff8bc1499c4998/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.560193:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201588.560196:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1724565b0 (ffff8bc1499c4488/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201588.560224:0:24461:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x11e:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201588.560246:0:24461:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x103:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201588.560252:0:24461:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x103:0x0] 00000008:00010000:0.0:1788201588.560265:0:24461:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:0.0:1788201588.560267:0:24461:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1724565b0, osc lock ffff8bc145d350a0, flags 0x400041012 00010000:00010000:0.0:1788201588.560277:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000029fa8324/0xd138388016f6e676 lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x188:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710942d7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.560293:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000029fa8324/0xd138388016f6e676 lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710942d7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.560303:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000029fa8324/0xd138388016f6e676 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710942d7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.560313:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000029fa8324/0xd138388016f6e676 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710942d7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:0.0:1788201588.560324:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_release():245 00000020:00010000:0.0:1788201588.560327:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.560330:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1724565b0 (ffff8bc1499c4998/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.560334:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201588.560336:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1724565b0 (ffff8bc1499c4488/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201588.560347:0:24461:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x103:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201588.560364:0:24461:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x113:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201588.560369:0:24461:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x113:0x0] 00000008:00010000:0.0:1788201588.560380:0:24461:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:0.0:1788201588.560382:0:24461:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1724565b0, osc lock ffff8bc145d350a0, flags 0x400041012 00010000:00010000:0.0:1788201588.560392:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a08eaec7/0xd138388016f6e8a6 lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094887 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.560402:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a08eaec7/0xd138388016f6e8a6 lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094887 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.560417:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a08eaec7/0xd138388016f6e8a6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094887 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.560425:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a08eaec7/0xd138388016f6e8a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094887 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:0.0:1788201588.560435:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_release():245 00000020:00010000:0.0:1788201588.560438:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.560440:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1724565b0 (ffff8bc1499c4998/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.560443:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201588.560446:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1724565b0 (ffff8bc1499c4488/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201588.560468:0:24461:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x113:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201588.560486:0:24461:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x121:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201588.560491:0:24461:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x121:0x0] 00000008:00010000:0.0:1788201588.560503:0:24461:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:0.0:1788201588.560505:0:24461:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1724565b0, osc lock ffff8bc145d350a0, flags 0x400041012 00010000:00010000:0.0:1788201588.560516:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x197:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.560526:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.560536:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.560551:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:0.0:1788201588.560562:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_release():245 00000020:00010000:0.0:1788201588.560565:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.560568:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1724565b0 (ffff8bc1499c4998/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.560571:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201588.560573:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1724565b0 (ffff8bc1499c4488/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201588.560585:0:24461:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x121:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201588.560602:0:24461:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x131:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201588.560607:0:24461:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x131:0x0] 00000008:00010000:0.0:1788201588.560619:0:24461:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:0.0:1788201588.560621:0:24461:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1724565b0, osc lock ffff8bc145d350a0, flags 0x400041012 00010000:00010000:0.0:1788201588.560630:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.560640:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.560650:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.560659:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:0.0:1788201588.560675:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_release():245 00000020:00010000:0.0:1788201588.560678:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.560680:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1724565b0 (ffff8bc1499c4998/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.560683:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201588.560686:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1724565b0 (ffff8bc1499c4488/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201588.560696:0:24461:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x131:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201588.560714:0:24461:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x112:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201588.560719:0:24461:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x112:0x0] 00000008:00010000:0.0:1788201588.560730:0:24461:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:0.0:1788201588.560733:0:24461:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1724565b0, osc lock ffff8bc145d350a0, flags 0x400041012 00010000:00010000:0.0:1788201588.560741:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 2/0,1 mode: PW/PW res: [0x280000400:0x190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.560750:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 2/0,1 mode: PW/PW res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.560759:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.560769:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:0.0:1788201588.560778:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_release():245 00000020:00010000:0.0:1788201588.560781:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.560784:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1724565b0 (ffff8bc1499c4998/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.560787:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201588.560812:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1724565b0 (ffff8bc1499c4488/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201588.560824:0:24461:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x112:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201588.560842:0:24461:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x115:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201588.560846:0:24461:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x115:0x0] 00000008:00010000:0.0:1788201588.560858:0:24461:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:0.0:1788201588.560860:0:24461:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1724565b0, osc lock ffff8bc145d350a0, flags 0x400041012 00010000:00010000:0.0:1788201588.560868:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000004e9ac6d/0xd138388016f6e8ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x191:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109493d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.560879:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000004e9ac6d/0xd138388016f6e8ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109493d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.560889:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000004e9ac6d/0xd138388016f6e8ec lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109493d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.560898:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000004e9ac6d/0xd138388016f6e8ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109493d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:0.0:1788201588.560908:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_release():245 00000020:00010000:0.0:1788201588.560910:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.560913:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1724565b0 (ffff8bc1499c4998/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.560917:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201588.560919:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1724565b0 (ffff8bc1499c4488/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201588.560930:0:24461:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x115:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201588.560947:0:24461:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x101:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201588.560951:0:24461:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x101:0x0] 00000008:00010000:0.0:1788201588.560963:0:24461:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:0.0:1788201588.560965:0:24461:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1724565b0, osc lock ffff8bc145d350a0, flags 0x400041012 00010000:00010000:0.0:1788201588.560974:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000499c3d5c/0xd138388016f6e630 lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x187:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094221 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.560984:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000499c3d5c/0xd138388016f6e630 lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094221 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.560993:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000499c3d5c/0xd138388016f6e630 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094221 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.561002:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000499c3d5c/0xd138388016f6e630 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094221 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:0.0:1788201588.561012:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_release():245 00000020:00010000:0.0:1788201588.561015:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.561018:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1724565b0 (ffff8bc1499c4998/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.561021:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201588.561024:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1724565b0 (ffff8bc1499c4488/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201588.561034:0:24461:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x101:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201588.561051:0:24461:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x100:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201588.561055:0:24461:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x100:0x0] 00000008:00010000:0.0:1788201588.561066:0:24461:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:0.0:1788201588.561068:0:24461:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1724565b0, osc lock ffff8bc145d350a0, flags 0x400041012 00010000:00010000:0.0:1788201588.561077:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 2/0,1 mode: PW/PW res: [0x280000400:0x187:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.561087:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 2/0,1 mode: PW/PW res: [0x280000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.561096:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.561105:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:0.0:1788201588.561116:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_release():245 00000020:00010000:0.0:1788201588.561118:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.561121:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1724565b0 (ffff8bc1499c4998/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.561124:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201588.561126:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1724565b0 (ffff8bc1499c4488/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201588.561137:0:24461:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x100:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201588.561153:0:24461:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x124:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201588.561157:0:24461:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x124:0x0] 00000008:00010000:0.0:1788201588.561168:0:24461:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:0.0:1788201588.561171:0:24461:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1724565b0, osc lock ffff8bc145d350a0, flags 0x400041012 00010000:00010000:0.0:1788201588.561179:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x199:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.561188:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.561197:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201588.561211:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:0.0:1788201588.561221:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_release():245 00000020:00010000:0.0:1788201588.561224:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.561227:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1724565b0 (ffff8bc1499c4998/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.561230:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201588.561233:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1724565b0 (ffff8bc1499c4488/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201588.561244:0:24461:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x124:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201588.561262:0:24461:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xef:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201588.561267:0:24461:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0xef:0x0] 00000008:00010000:0.0:1788201588.561278:0:24461:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:0.0:1788201588.561281:0:24461:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1724565b0, osc lock ffff8bc145d350a0, flags 0x400041012 00010000:00010000:0.0:1788201588.561290:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005c0c7627/0xd138388016f6e3ba lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x17e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093a72 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.561300:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005c0c7627/0xd138388016f6e3ba lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093a72 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.561311:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005c0c7627/0xd138388016f6e3ba lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171093a72 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.561320:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005c0c7627/0xd138388016f6e3ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093a72 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:0.0:1788201588.561335:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_release():245 00000020:00010000:0.0:1788201588.561338:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.561341:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1724565b0 (ffff8bc1499c4998/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.561343:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201588.561346:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1724565b0 (ffff8bc1499c4488/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201588.561356:0:24461:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xef:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201588.561373:0:24461:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xfa:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201588.561378:0:24461:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0xfa:0x0] 00000008:00010000:0.0:1788201588.561389:0:24461:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:0.0:1788201588.561391:0:24461:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1724565b0, osc lock ffff8bc145d350a0, flags 0x400041012 00010000:00010000:0.0:1788201588.561399:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000cd330330/0xd138388016f6e53b lrc: 2/0,1 mode: PW/PW res: [0x280000400:0x184:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093fa4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.561408:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000cd330330/0xd138388016f6e53b lrc: 2/0,1 mode: PW/PW res: [0x280000400:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093fa4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.561416:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000cd330330/0xd138388016f6e53b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171093fa4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201588.561424:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000cd330330/0xd138388016f6e53b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093fa4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:0.0:1788201588.561433:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_release():245 00000020:00010000:0.0:1788201588.561435:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.561438:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1724565b0 (ffff8bc1499c4998/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201588.561441:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9720 (ffff8bc1499c4488/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201588.561443:0:24461:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1724565b0 (ffff8bc1499c4488/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201588.562049:0:24462:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x12d:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201588.562057:0:24462:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x12d:0x0] 00000008:00010000:3.0:1788201588.562078:0:24462:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:3.0:1788201588.562081:0:24462:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149fec930, osc lock ffff8bc14691a130, flags 0x400041012 00010000:00010000:3.0:1788201588.562094:0:24462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201588.562107:0:24462:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201588.562117:0:24462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201588.562125:0:24462:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:3.0:1788201588.562137:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_release():245 00000020:00010000:3.0:1788201588.562141:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201588.562144:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149fec930 (ffff8bc1460e9098/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201588.562147:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201588.562149:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149fec930 (ffff8bc1460e9bd8/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201588.562172:0:24462:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x12d:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201588.562194:0:24462:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x10f:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201588.562199:0:24462:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x10f:0x0] 00000008:00010000:3.0:1788201588.562211:0:24462:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:3.0:1788201588.562213:0:24462:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149fec930, osc lock ffff8bc14691a130, flags 0x400041012 00010000:00010000:3.0:1788201588.562222:0:24462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000618f56a5/0xd138388016f6e81a lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x18e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109471b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201588.562232:0:24462:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000618f56a5/0xd138388016f6e81a lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109471b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201588.562242:0:24462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000618f56a5/0xd138388016f6e81a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109471b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201588.562251:0:24462:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000618f56a5/0xd138388016f6e81a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109471b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:3.0:1788201588.562261:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_release():245 00000020:00010000:3.0:1788201588.562264:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201588.562267:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149fec930 (ffff8bc1460e9098/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201588.562270:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201588.562273:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149fec930 (ffff8bc1460e9bd8/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201588.562285:0:24462:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x10f:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201588.562303:0:24462:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x105:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201588.562307:0:24462:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x105:0x0] 00000008:00010000:3.0:1788201588.562319:0:24462:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:3.0:1788201588.562321:0:24462:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149fec930, osc lock ffff8bc14691a130, flags 0x400041012 00010000:00010000:3.0:1788201588.562329:0:24462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x189:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201588.562339:0:24462:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201588.562348:0:24462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201588.562357:0:24462:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:3.0:1788201588.562367:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_release():245 00000020:00010000:3.0:1788201588.562369:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201588.562372:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149fec930 (ffff8bc1460e9098/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201588.562375:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201588.562378:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149fec930 (ffff8bc1460e9bd8/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201588.562389:0:24462:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x105:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201588.562406:0:24462:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xe7:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201588.562411:0:24462:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0xe7:0x0] 00000008:00010000:3.0:1788201588.562422:0:24462:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:3.0:1788201588.562424:0:24462:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149fec930, osc lock ffff8bc14691a130, flags 0x400041012 00010000:00010000:3.0:1788201588.562433:0:24462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000024db6f57/0xd138388016f6e2a2 lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x17a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109379a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201588.562443:0:24462:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000024db6f57/0xd138388016f6e2a2 lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109379a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201588.562452:0:24462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000024db6f57/0xd138388016f6e2a2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109379a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201588.562471:0:24462:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000024db6f57/0xd138388016f6e2a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109379a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:3.0:1788201588.562481:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_release():245 00000020:00010000:3.0:1788201588.562483:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201588.562486:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149fec930 (ffff8bc1460e9098/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201588.562489:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201588.562492:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149fec930 (ffff8bc1460e9bd8/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201588.562505:0:24462:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xe7:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201588.562524:0:24462:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x11f:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201588.562529:0:24462:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x11f:0x0] 00000008:00010000:3.0:1788201588.562540:0:24462:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:3.0:1788201588.562542:0:24462:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149fec930, osc lock ffff8bc14691a130, flags 0x400041012 00010000:00010000:3.0:1788201588.562553:0:24462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6ea4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x196:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094ccb expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201588.562563:0:24462:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6ea4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094ccb expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201588.562579:0:24462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6ea4a lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094ccb expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201588.562588:0:24462:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6ea4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094ccb expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:3.0:1788201588.562598:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_release():245 00000020:00010000:3.0:1788201588.562600:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201588.562602:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149fec930 (ffff8bc1460e9098/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201588.562605:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201588.562608:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149fec930 (ffff8bc1460e9bd8/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201588.562619:0:24462:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x11f:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201588.562637:0:24462:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x11b:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201588.562642:0:24462:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x11b:0x0] 00000008:00010000:3.0:1788201588.562653:0:24462:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:3.0:1788201588.562655:0:24462:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149fec930, osc lock ffff8bc14691a130, flags 0x400041012 00010000:00010000:3.0:1788201588.562665:0:24462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000096aa1f32/0xd138388016f6e9be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x194:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094b5f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201588.562675:0:24462:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000096aa1f32/0xd138388016f6e9be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094b5f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201588.562685:0:24462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000096aa1f32/0xd138388016f6e9be lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094b5f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201588.562701:0:24462:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000096aa1f32/0xd138388016f6e9be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094b5f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:3.0:1788201588.562711:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_release():245 00000020:00010000:3.0:1788201588.562714:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201588.562717:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149fec930 (ffff8bc1460e9098/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201588.562720:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201588.562723:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149fec930 (ffff8bc1460e9bd8/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201588.562734:0:24462:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x11b:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201588.562751:0:24462:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x117:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201588.562756:0:24462:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x117:0x0] 00000008:00010000:3.0:1788201588.562766:0:24462:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:3.0:1788201588.562769:0:24462:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149fec930, osc lock ffff8bc14691a130, flags 0x400041012 00010000:00010000:3.0:1788201588.563519:0:24462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x192:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.563722:0:24462:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.563736:0:24462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.563747:0:24462:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:1.0:1788201588.563763:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201588.563766:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.563779:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149fec930 (ffff8bc1460e9098/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.563789:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc4000 (ffff8bc1460e9bd8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201588.563812:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149fec930 (ffff8bc1460e9bd8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201588.563840:0:24462:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x117:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201588.563879:0:24462:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x12a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201588.563884:0:24462:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x12a:0x0] 00000008:00010000:1.0:1788201588.563908:0:24462:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:1.0:1788201588.563911:0:24462:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4a30, osc lock ffff8bc145d08850, flags 0x400041012 00010000:00010000:1.0:1788201588.563923:0:24462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.563934:0:24462:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.563944:0:24462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.563954:0:24462:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:1.0:1788201588.563965:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201588.563968:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.563971:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4a30 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.563974:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201588.563977:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4a30 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201588.563999:0:24462:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x12a:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201588.564033:0:24462:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x11d:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201588.564039:0:24462:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x11d:0x0] 00000008:00010000:1.0:1788201588.564053:0:24462:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:1.0:1788201588.564055:0:24462:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4a30, osc lock ffff8bc145d08850, flags 0x400041012 00010000:00010000:1.0:1788201588.564064:0:24462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000094b2d07c/0xd138388016f6ea04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x195:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094c15 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.564075:0:24462:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000094b2d07c/0xd138388016f6ea04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094c15 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.564085:0:24462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000094b2d07c/0xd138388016f6ea04 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094c15 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.564094:0:24462:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000094b2d07c/0xd138388016f6ea04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094c15 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:1.0:1788201588.564104:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201588.564107:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.564110:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4a30 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.564113:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201588.564115:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4a30 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201588.564127:0:24462:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x11d:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201588.564145:0:24462:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x10c:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201588.564150:0:24462:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x10c:0x0] 00000008:00010000:1.0:1788201588.564163:0:24462:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:1.0:1788201588.564165:0:24462:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4a30, osc lock ffff8bc145d08850, flags 0x400041012 00010000:00010000:1.0:1788201588.564174:0:24462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000acf6f96b/0xd138388016f6e7b1 lrc: 2/0,1 mode: PW/PW res: [0x280000400:0x18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109460a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.564185:0:24462:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000acf6f96b/0xd138388016f6e7b1 lrc: 2/0,1 mode: PW/PW res: [0x280000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109460a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.564195:0:24462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000acf6f96b/0xd138388016f6e7b1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109460a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.564210:0:24462:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000acf6f96b/0xd138388016f6e7b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109460a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:1.0:1788201588.564220:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201588.564223:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.564226:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4a30 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.564229:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201588.564232:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4a30 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201588.564256:0:24462:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x10c:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201588.564275:0:24462:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf1:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201588.564280:0:24462:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0xf1:0x0] 00000008:00010000:1.0:1788201588.564292:0:24462:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:1.0:1788201588.564294:0:24462:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4a30, osc lock ffff8bc145d08850, flags 0x400041012 00010000:00010000:1.0:1788201588.564304:0:24462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000c303a2ad/0xd138388016f6e400 lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x17f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093b28 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.564314:0:24462:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000c303a2ad/0xd138388016f6e400 lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x17f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093b28 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.564324:0:24462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000c303a2ad/0xd138388016f6e400 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171093b28 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.564333:0:24462:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000c303a2ad/0xd138388016f6e400 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093b28 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:1.0:1788201588.564349:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201588.564352:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.564355:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4a30 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.564358:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201588.564361:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4a30 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201588.564372:0:24462:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf1:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201588.564389:0:24462:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x10a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201588.564394:0:24462:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x10a:0x0] 00000008:00010000:1.0:1788201588.564405:0:24462:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:1.0:1788201588.564407:0:24462:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4a30, osc lock ffff8bc145d08850, flags 0x400041012 00010000:00010000:1.0:1788201588.564415:0:24462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008332e9f8/0xd138388016f6e76b lrc: 2/0,1 mode: PW/PW res: [0x280000400:0x18c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094554 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.564425:0:24462:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008332e9f8/0xd138388016f6e76b lrc: 2/0,1 mode: PW/PW res: [0x280000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094554 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.564433:0:24462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008332e9f8/0xd138388016f6e76b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094554 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.564441:0:24462:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008332e9f8/0xd138388016f6e76b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094554 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:1.0:1788201588.564451:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201588.564464:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.564467:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4a30 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.564471:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201588.564473:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4a30 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201588.564486:0:24462:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x10a:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201588.564503:0:24462:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x12e:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201588.564508:0:24462:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x12e:0x0] 00000008:00010000:1.0:1788201588.564521:0:24462:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:1.0:1788201588.564523:0:24462:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4a30, osc lock ffff8bc145d08850, flags 0x400041012 00010000:00010000:1.0:1788201588.564533:0:24462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6ec57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171095220 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.564544:0:24462:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6ec57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171095220 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.564553:0:24462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6ec57 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171095220 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.564563:0:24462:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6ec57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171095220 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:1.0:1788201588.564574:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201588.564577:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.564579:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4a30 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.564582:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201588.564585:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4a30 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201588.564597:0:24462:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x12e:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201588.564614:0:24462:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf7:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201588.564619:0:24462:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0xf7:0x0] 00000008:00010000:1.0:1788201588.564631:0:24462:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:1.0:1788201588.564633:0:24462:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4a30, osc lock ffff8bc145d08850, flags 0x400041012 00010000:00010000:1.0:1788201588.564641:0:24462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e38d3ff7/0xd138388016f6e4d2 lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x182:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093d4a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.564651:0:24462:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e38d3ff7/0xd138388016f6e4d2 lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093d4a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.564661:0:24462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e38d3ff7/0xd138388016f6e4d2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171093d4a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.564670:0:24462:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e38d3ff7/0xd138388016f6e4d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093d4a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:1.0:1788201588.564680:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201588.564683:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.564685:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4a30 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.564688:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201588.564691:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4a30 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201588.564703:0:24462:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf7:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201588.564720:0:24462:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xfc:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201588.564725:0:24462:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0xfc:0x0] 00000008:00010000:1.0:1788201588.564736:0:24462:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:1.0:1788201588.564738:0:24462:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4a30, osc lock ffff8bc145d08850, flags 0x400041012 00010000:00010000:1.0:1788201588.564747:0:24462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ab995f56/0xd138388016f6e581 lrc: 2/0,1 mode: PW/PW res: [0x280000400:0x185:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109405a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.564757:0:24462:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ab995f56/0xd138388016f6e581 lrc: 2/0,1 mode: PW/PW res: [0x280000400:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109405a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.564767:0:24462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ab995f56/0xd138388016f6e581 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109405a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.564776:0:24462:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ab995f56/0xd138388016f6e581 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109405a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:1.0:1788201588.564785:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201588.564788:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.564815:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4a30 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.564818:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201588.564820:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4a30 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201588.564833:0:24462:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xfc:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201588.564852:0:24462:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x11c:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201588.564856:0:24462:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x11c:0x0] 00000008:00010000:1.0:1788201588.564867:0:24462:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:1.0:1788201588.564869:0:24462:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4a30, osc lock ffff8bc145d08850, flags 0x400041012 00010000:00010000:1.0:1788201588.564878:0:24462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.564888:0:24462:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.564897:0:24462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.564911:0:24462:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:1.0:1788201588.564923:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201588.564925:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.564928:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4a30 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.564930:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201588.564932:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4a30 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201588.564944:0:24462:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x11c:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201588.564961:0:24462:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x12b:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201588.564965:0:24462:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x12b:0x0] 00000008:00010000:1.0:1788201588.564975:0:24462:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:1.0:1788201588.564977:0:24462:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4a30, osc lock ffff8bc145d08850, flags 0x400041012 00010000:00010000:1.0:1788201588.564986:0:24462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.564994:0:24462:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.565003:0:24462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.565010:0:24462:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:1.0:1788201588.565023:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201588.565025:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.565028:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4a30 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.565030:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201588.565032:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4a30 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201588.565044:0:24462:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x12b:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201588.565061:0:24462:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xe6:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201588.565065:0:24462:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0xe6:0x0] 00000008:00010000:1.0:1788201588.565076:0:24462:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:1.0:1788201588.565078:0:24462:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4a30, osc lock ffff8bc145d08850, flags 0x400041012 00010000:00010000:1.0:1788201588.565086:0:24462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008a78353e/0xd138388016f6e278 lrc: 2/0,1 mode: PW/PW res: [0x280000400:0x17a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093723 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.565096:0:24462:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008a78353e/0xd138388016f6e278 lrc: 2/0,1 mode: PW/PW res: [0x280000400:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093723 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.565105:0:24462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008a78353e/0xd138388016f6e278 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171093723 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.565114:0:24462:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008a78353e/0xd138388016f6e278 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093723 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:1.0:1788201588.565124:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201588.565126:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.565129:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4a30 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.565132:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201588.565134:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4a30 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201588.565145:0:24462:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xe6:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201588.571934:0:24461:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xfa:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:3.0:1788201588.574943:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff4700 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727895680:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201588.575207:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf2:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1788201588.575222:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201588.575359:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201588.575498:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0xf2:0x0](ffff8bc14592ba88) 00000008:00010000:1.0:1788201588.575548:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 28245 blocks 1 [cma]time 1788201556 1788201556 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e48effa4/0xd138388016f6e423 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x180:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093b83 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 1 00000080:00200000:1.0:1788201588.576747:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201588.576763:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d0, flags=0 00010000:00010000:1.0:1788201588.576869:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6ed3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095894 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1788201588.576886:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed3e from it ffffadd1c1923af8 00010000:00010000:1.0:1788201588.576891:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6ed3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095894 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.576902:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6ed3e lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095894 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200008:1.0:1788201588.576993:0:24460:0:(file.c:6283:ll_getattr_dentry()) START file d0:[0x200000bd7:0x133:0x0](ffff8bc1459563c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201588.577000:0:24460:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x133:0x0](ffff8bc1459563c8),name=d0 00000002:00010000:1.0:1788201588.577021:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x133:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201588.577041:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6ed3e lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095894 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.577060:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6ed3e lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095894 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201588.577069:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201588.577076:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x133:0x0](ffff8bc1459563c8) 00000080:00010000:1.0:1788201588.577079:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x133:0x0](ffff8bc1459563c8) for lock 0xd138388016f6ed3e 00000080:00010000:1.0:1788201588.577085:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed3e from it ffffadd1c1923cb8 00010000:00010000:1.0:1788201588.577088:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6ed3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095894 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.577106:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6ed3e lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095894 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1788201588.577156:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201588.577161:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d0, flags=258 00000080:00200000:1.0:1788201588.577165:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), inode mode 41ed mask 44 00000080:00200008:1.0:1788201588.577175:0:24460:0:(file.c:1090:ll_file_open()) START file d0:[0x200000bd7:0x133:0x0](ffff8bc1459563c8), flags 704400 00000002:00010000:1.0:1788201588.577188:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x133:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1788201588.577253:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ed7d lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.577261:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ed7d lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201588.577275:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201588.577288:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d5180 x1875064727896064/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201588.577306:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ed7d lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201588.577331:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727896064:192.168.201.143@tcp:101:rm.0 00000100:00100000:1.0:1788201588.577562:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8000 going to sleep for 11 seconds 00010000:00010000:3.0:1788201588.587051:0:10055:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.587079:0:10055:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.587097:0:10055:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.587117:0:10055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.587131:0:10055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.587146:0:10055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.587155:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.587164:0:10055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201588.587182:0:10055:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc14416f100 x1875064727895808/t0(0) o63->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:24/4 lens 1448/1408 e 0 to 0 dl 1788201604 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ll_sa.0' uid:0 gid:0 projid:4294967295 00000080:00010000:3.0:1788201588.587196:0:10055:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed68 from it ffff8bc17270d590 00010000:00010000:3.0:1788201588.587200:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.587209:0:10055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201588.587245:0:10055:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6ed6f lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959c1 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.587267:0:10055:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6ed6f lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x138:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959c1 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.587275:0:10055:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6ed6f lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x138:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959c1 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.587285:0:10055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6ed6f lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x138:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959c1 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.587294:0:10055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6ed6f lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x138:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959c1 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.587303:0:10055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6ed6f lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x138:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959c1 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.587311:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6ed6f lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x138:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959c1 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.587319:0:10055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6ed6f lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x138:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959c1 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201588.587328:0:10055:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc14416f100 x1875064727895808/t0(0) o63->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:24/4 lens 1448/1408 e 0 to 0 dl 1788201604 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_sa.0' uid:0 gid:0 projid:4294967295 00000080:00010000:3.0:1788201588.587338:0:10055:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed6f from it ffff8bc17270ed90 00010000:00010000:3.0:1788201588.587342:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6ed6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x138:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959c1 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.587356:0:10055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6ed6f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x138:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959c1 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201588.587371:0:10055:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.587383:0:10055:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.587391:0:10055:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.587398:0:10055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.587406:0:10055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.587415:0:10055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.587422:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.587429:0:10055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201588.587443:0:10055:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc14416f100 x1875064727895808/t0(0) o63->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:24/4 lens 1448/1408 e 0 to 0 dl 1788201604 ref 3 fl Interpret:RQU/200/0 rc 0/0 job:'ll_sa.0' uid:0 gid:0 projid:4294967295 00000080:00010000:3.0:1788201588.587453:0:10055:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed76 from it ffff8bc17270fd90 00010000:00010000:3.0:1788201588.587466:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.587476:0:10055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201588.587494:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727895808:192.168.201.143@tcp:63:ll_sa.0 00010000:00010000:3.0:1788201588.587534:0:9520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201588.587556:0:9520:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x134:0x0], updating i_size 7680 00000080:00010000:3.0:1788201588.587563:0:9520:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x134:0x0](ffff8bc145955348) for lock 0xd138388016f6ed68 00000080:00010000:3.0:1788201588.587569:0:9520:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed68 from it ffff8bc17270d590 00010000:00010000:3.0:1788201588.587573:0:9520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201588.587581:0:9520:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201588.592222:0:9520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6ed6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x138:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959c1 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201588.592270:0:9520:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x138:0x0], updating i_size 0 00000080:00200000:3.0:1788201588.592274:0:9520:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x138:0x0](ffff8bc14465a1c8): rc = 0 00000080:00200000:3.0:1788201588.592336:0:9520:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x138:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1788201588.592365:0:9520:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x138:0x0](ffff8bc14465a1c8) for lock 0xd138388016f6ed6f 00000080:00010000:3.0:1788201588.592422:0:9520:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed6f from it ffff8bc17270ed90 00010000:00010000:3.0:1788201588.592429:0:9520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6ed6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x138:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710959c1 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201588.592440:0:9520:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6ed6f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x138:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710959c1 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201588.592484:0:9520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201588.592499:0:9520:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x158:0x0], updating i_size 7680 00000080:00200000:3.0:1788201588.592502:0:9520:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x158:0x0](ffff8bc1446be3c8): rc = 0 00000080:00010000:3.0:1788201588.592507:0:9520:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x158:0x0](ffff8bc1446be3c8) for lock 0xd138388016f6ed76 00000080:00010000:3.0:1788201588.592511:0:9520:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed76 from it ffff8bc17270fd90 00010000:00010000:3.0:1788201588.592514:0:9520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201588.592523:0:9520:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.593484:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ed84 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.593500:0:24461:0:(ldlm_request.c:1275:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ed84 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.599379:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172723000/0xd138388016f6e2da lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xe9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109383b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.599400:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172723000/0xd138388016f6e2da lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xe9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109383b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:1.0:1788201588.599410:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e2da from it ffffadd1c7dd3d48 00010000:00010000:1.0:1788201588.599417:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172723000/0xd138388016f6e2da lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xe9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109383b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.599428:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172723000/0xd138388016f6e2da lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xe9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109383b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201588.599484:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267fe00/0xd138388016f6e596 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xfd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710940a0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.599493:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267fe00/0xd138388016f6e596 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xfd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710940a0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:1.0:1788201588.599500:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e596 from it ffffadd1c7dd3d48 00010000:00010000:1.0:1788201588.599504:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267fe00/0xd138388016f6e596 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xfd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710940a0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.599511:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267fe00/0xd138388016f6e596 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xfd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710940a0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201588.599533:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172735200/0xd138388016f6e45b lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093c24 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.599541:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172735200/0xd138388016f6e45b lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093c24 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:1.0:1788201588.599547:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e45b from it ffffadd1c7dd3d48 00010000:00010000:1.0:1788201588.599551:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172735200/0xd138388016f6e45b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093c24 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.599559:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172735200/0xd138388016f6e45b lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093c24 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201588.599580:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734e00/0xd138388016f6e438 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093bc9 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.599588:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734e00/0xd138388016f6e438 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093bc9 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:1.0:1788201588.599594:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e438 from it ffffadd1c7dd3d48 00010000:00010000:1.0:1788201588.599599:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734e00/0xd138388016f6e438 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093bc9 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.599606:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734e00/0xd138388016f6e438 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093bc9 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201588.599627:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.600592:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:1.0:1788201588.600600:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eb0e from it ffffadd1c7dd3d48 00010000:00010000:1.0:1788201588.600605:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.600612:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201588.600713:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645c600/0xd138388016f6eb31 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x126:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094f33 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.600722:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645c600/0xd138388016f6eb31 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x126:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094f33 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:1.0:1788201588.600728:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eb31 from it ffffadd1c7dd3d48 00010000:00010000:1.0:1788201588.600732:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645c600/0xd138388016f6eb31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x126:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094f33 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.600743:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645c600/0xd138388016f6eb31 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x126:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094f33 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201588.600761:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267e200/0xd138388016f6e3cf lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093ab8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.600768:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267e200/0xd138388016f6e3cf lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xf0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093ab8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:1.0:1788201588.601250:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e3cf from it ffffadd1c7dd3d48 00010000:00010000:1.0:1788201588.601254:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267e200/0xd138388016f6e3cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093ab8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.601262:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267e200/0xd138388016f6e3cf lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093ab8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201588.601291:0:24461:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/309 (0 0) 00010000:00010000:1.0:1788201588.601329:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 24461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.601336:0:24461:0:(ldlm_request.c:1275:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x0 pid: 24461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.601360:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722600/0xd138388016f6e5b9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710940fb expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.601370:0:24461:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722600/0xd138388016f6e5b9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710940fb expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:1.0:1788201588.601377:0:24461:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e5b9 from it ffffadd1c7dd3d48 00010000:00010000:1.0:1788201588.601381:0:24461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722600/0xd138388016f6e5b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710940fb expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.601389:0:24461:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722600/0xd138388016f6e5b9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710940fb expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000002:00010000:1.0:1788201588.601436:0:24461:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0xe5:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: readdir flags 0 00010000:00010000:1.0:1788201588.601444:0:24461:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/229 (0 0) 00010000:00010000:1.0:1788201588.601489:0:24461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6ed92 lrc: 3/1,0 mode: --/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 24461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.601497:0:24461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6ed92 lrc: 3/1,0 mode: --/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x0 pid: 24461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.601507:0:24461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6ed92 lrc: 3/1,0 mode: --/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x0 pid: 24461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201588.601538:0:24461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job ll_sa_24460:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24461:1875064727896320:192.168.201.143@tcp:101:ll_sa.0 00000100:00100000:1.0:1788201588.603816:0:24461:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201588.636589:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727896960:192.168.201.143@tcp:101:rm.0 00010000:00010000:0.0:1788201588.636636:0:24460:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b800/0xd138388016f6ed99 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x133:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a00 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.636650:0:24460:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b800/0xd138388016f6ed99 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x133:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a00 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.636663:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b800/0xd138388016f6ed99 lrc: 4/1,0 mode: CR/CR res: [0x200000bd7:0x133:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a00 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.636676:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b800/0xd138388016f6ed99 lrc: 4/1,0 mode: CR/CR res: [0x200000bd7:0x133:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a00 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201588.636694:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff8bc1726cdc00 x1875064727896960/t8589937201(8589937201) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201604 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201588.636708:0:24460:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1726cdc00 x1875064727896960/t8589937201(8589937201) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201604 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201588.636718:0:24460:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b800/0xd138388016f6ed99 lrc: 3/1,0 mode: CR/CR res: [0x200000bd7:0x133:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a00 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.636730:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 16 res 8589937623/307 (0 0) 00000080:00200000:0.0:1788201588.636737:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1788201588.636763:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x133:0x0], updating i_size 7680 00000080:00010000:0.0:1788201588.636770:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x133:0x0](ffff8bc1459563c8) for lock 0xd138388016f6ed99 00000080:00010000:0.0:1788201588.636777:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed99 from it ffffadd1c1923bd0 00010000:00010000:0.0:1788201588.636968:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b800/0xd138388016f6ed99 lrc: 3/1,0 mode: CR/CR res: [0x200000bd7:0x133:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a00 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.636982:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b800/0xd138388016f6ed99 lrc: 2/0,0 mode: CR/CR res: [0x200000bd7:0x133:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a00 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00100000:0.0:1788201588.637015:0:24460:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1726cdc00 x1875064727896960/t8589937201(8589937201) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201604 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1788201588.637118:0:24460:0:(file.c:6283:ll_getattr_dentry()) START file d0:[0x200000bd7:0x133:0x0](ffff8bc1459563c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201588.637127:0:24460:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x133:0x0](ffff8bc1459563c8),name=d0 00000002:00010000:0.0:1788201588.637153:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x133:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201588.637168:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6ed3e lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095894 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 1 00010000:00010000:0.0:1788201588.637181:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6ed3e lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095894 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 1 00000080:00200000:0.0:1788201588.637188:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201588.637194:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x133:0x0](ffff8bc1459563c8) 00000080:00010000:0.0:1788201588.637198:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x133:0x0](ffff8bc1459563c8) for lock 0xd138388016f6ed3e 00000080:00010000:0.0:1788201588.637201:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed3e from it ffffadd1c1923cd8 00010000:00010000:0.0:1788201588.637204:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6ed3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095894 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 1 00010000:00010000:0.0:1788201588.637211:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6ed3e lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095894 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 1 00000080:00200000:0.0:1788201588.637247:0:24460:0:(llite_lib.c:2912:ll_statfs()) VFS Op:sb=lustre (ffff8bc143fc0000) d0 proj=0 00000080:00000004:0.0:1788201588.637252:0:24460:0:(obd_class.h:1091:obd_statfs()) lustre-clilmv-ffff8bc143fc0000: age 840, max_age 874 00800000:00000004:0.0:1788201588.637260:0:24460:0:(obd_class.h:1091:obd_statfs()) lustre-MDT0000-mdc-ffff8bc143fc0000: age 840, max_age 874 00000100:00100000:0.0:1788201588.637302:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416ea00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727897088:192.168.201.143@tcp:41:rm.0 00000100:00100000:0.0:1788201588.637567:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201588.641831:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416ea00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727897088:192.168.201.143@tcp:41:rm.0 00800000:00000004:1.0:1788201588.641870:0:24460:0:(obd_class.h:1117:obd_statfs()) lustre-MDT0000-mdc-ffff8bc143fc0000: update ffff8bc151fa1e10 cache blocks 125440/141312 objects 17504/17955 00000080:00000004:1.0:1788201588.641878:0:24460:0:(obd_class.h:1117:obd_statfs()) lustre-clilmv-ffff8bc143fc0000: update ffff8bc151fa5190 cache blocks 125440/141312 objects 17504/17955 00000080:00000004:1.0:1788201588.641884:0:24460:0:(llite_lib.c:2764:ll_statfs_internal()) MDC blocks 125440/141312 objects 17504/17955 00000080:00200000:1.0:1788201588.641925:0:24460:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200000bd7:0x133:0x0](ffff8bc1459563c8) pos/size0/7680 32bit_api 0 00000080:00200000:1.0:1788201588.641968:0:24460:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200000bd7:0x133:0x0](ffff8bc1459563c8) pos/size18446744073709551614/7680 32bit_api 0 00000080:00200000:1.0:1788201588.641999:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201588.642020:0:24460:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), flags=0 00000080:00200000:1.0:1788201588.642039:0:24460:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f1, dir=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), intent=getattr 00000002:00010000:1.0:1788201588.642065:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f1,[0x0:0x0:0x0]) in obj [0x200000bd7:0x133:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201588.642139:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eda0 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x133:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.642152:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eda0 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x133:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.642163:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eda0 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x133:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201588.642188:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727897216:192.168.201.143@tcp:101:rm.0 00000100:00100000:1.0:1788201588.642278:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201588.649163:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727897344:192.168.201.143@tcp:63:ll_sa.0 00000080:00200000:1.0:1788201588.650226:0:24462:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x111:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201588.650240:0:24462:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x111:0x0] 00000008:00010000:1.0:1788201588.650274:0:24462:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:1.0:1788201588.650279:0:24462:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4030, osc lock ffff8bc145d08850, flags 0x400041012 00010000:00010000:1.0:1788201588.650306:0:24462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084c24abf/0xd138388016f6e860 lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x18f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710947d1 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.650328:0:24462:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084c24abf/0xd138388016f6e860 lrc: 2/0,1 mode: PW/PW res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710947d1 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.650341:0:24462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084c24abf/0xd138388016f6e860 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710947d1 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.650351:0:24462:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084c24abf/0xd138388016f6e860 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710947d1 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:1.0:1788201588.650373:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201588.650377:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.650380:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4030 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.650384:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201588.650387:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4030 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201588.650432:0:24462:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x111:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201588.650467:0:24462:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x132:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201588.650473:0:24462:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x132:0x0] 00000008:00010000:1.0:1788201588.650486:0:24462:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:1.0:1788201588.650488:0:24462:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4030, osc lock ffff8bc145d08850, flags 0x400041012 00010000:00010000:1.0:1788201588.650500:0:24462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.650510:0:24462:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.650519:0:24462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.650527:0:24462:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:1.0:1788201588.650538:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201588.650541:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.650544:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4030 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.650548:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201588.650551:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4030 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201588.650563:0:24462:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x132:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201588.650582:0:24462:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x106:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201588.650587:0:24462:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x106:0x0] 00000008:00010000:1.0:1788201588.650600:0:24462:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:1.0:1788201588.650603:0:24462:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4030, osc lock ffff8bc145d08850, flags 0x400041012 00010000:00010000:1.0:1788201588.650612:0:24462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f6fd8f72/0xd138388016f6e6df lrc: 2/0,1 mode: PW/PW res: [0x280000400:0x18a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710943e8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.650622:0:24462:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f6fd8f72/0xd138388016f6e6df lrc: 2/0,1 mode: PW/PW res: [0x280000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710943e8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.650630:0:24462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f6fd8f72/0xd138388016f6e6df lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710943e8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201588.650639:0:24462:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f6fd8f72/0xd138388016f6e6df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710943e8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:1.0:1788201588.650648:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201588.650651:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.650653:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4030 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.650656:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201588.650658:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4030 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201588.650670:0:24462:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x106:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201588.650686:0:24462:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x116:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201588.650690:0:24462:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x116:0x0] 00000008:00010000:1.0:1788201588.650702:0:24462:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 2b 00000008:00010000:1.0:1788201588.650704:0:24462:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4030, osc lock ffff8bc145d08850, flags 0x400041012 00010000:00010000:1.0:1788201588.650714:0:24462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e90f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x192:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094998 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.650723:0:24462:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e90f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094998 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.650732:0:24462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e90f lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171094998 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.650740:0:24462:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e90f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094998 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:1.0:1788201588.650748:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201588.650751:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.650753:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4030 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201588.650756:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201588.650758:0:24462:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4030 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201588.650771:0:24462:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x116:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:0.0:1788201588.653524:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727897216:192.168.201.143@tcp:101:rm.0 00010000:00010000:0.0:1788201588.653564:0:24460:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eda0 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x133:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a23 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.653596:0:24460:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eda0 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x13e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a23 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.653606:0:24460:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eda0 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x13e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a23 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.653619:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eda0 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x13e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a23 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.653630:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eda0 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x13e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a23 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.653646:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eda0 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x13e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a23 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.653655:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eda0 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x13e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a23 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.653668:0:24460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eda0 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x13e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a23 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201588.653682:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc1727d5180 x1875064727897216/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201604 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201588.653699:0:24460:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eda0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x13e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a23 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201588.653711:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/318 (0 0) 00000080:00200000:0.0:1788201588.653720:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x133:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201588.653749:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x13e:0x0], updating i_size 0 00000080:00200000:0.0:1788201588.653753:0:24460:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x13e:0x0](ffff8bc1446b9148): rc = 0 00000080:00200000:1.0:1788201588.654681:0:24460:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x13e:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1788201588.654720:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x13e:0x0](ffff8bc1446b9148) for lock 0xd138388016f6eda0 00000080:00010000:1.0:1788201588.654736:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x13e:0x0](ffff8bc1446b9148) 00000080:00010000:1.0:1788201588.654740:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eda0 from it ffffadd1c1923df8 00010000:00010000:1.0:1788201588.654746:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eda0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x13e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095a23 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.654765:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eda0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x13e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095a23 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201588.655178:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201588.655189:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=f1, dir=[0x200000bd7:0x133:0x0](ffff8bc1459563c8) 00010000:00010000:1.0:1788201588.655249:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6ed3e lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e2171095894 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 1 00010000:00010000:1.0:1788201588.655274:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6ecea lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095434 expref: -99 pid: 23735 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.655344:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eda0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x13e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171095a23 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201588.655365:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x13e:0x0]: losing layout lock 00010000:00010000:1.0:1788201588.655930:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eda0 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x13e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171095a23 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201588.655942:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6ed3e lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171095894 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 1 00010000:00010000:1.0:1788201588.655949:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1788201588.655952:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eda0 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x13e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171095a23 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201588.655972:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6ed3e lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171095894 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 1 00000020:00100000:1.0:1788201588.655998:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201588.656012:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d5180 x1875064727897600/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201588.656213:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727897600:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201588.656399:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8600 going to sleep for 11 seconds 00010000:00010000:3.0:1788201588.670333:0:10055:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ed84 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a3f expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.670368:0:10055:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ed84 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x13c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a3f expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.670378:0:10055:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ed84 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x13c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a3f expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.670391:0:10055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ed84 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x13c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a3f expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.670402:0:10055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ed84 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x13c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a3f expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.670414:0:10055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ed84 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x13c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a3f expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.670422:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ed84 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x13c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a3f expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.670431:0:10055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ed84 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x13c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a3f expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201588.670450:0:10055:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc1726cdf80 x1875064727897344/t0(0) o63->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:24/4 lens 1840/1800 e 0 to 0 dl 1788201604 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ll_sa.0' uid:0 gid:0 projid:4294967295 00000080:00010000:3.0:1788201588.670477:0:10055:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed84 from it ffff8bc14742fd90 00010000:00010000:3.0:1788201588.670482:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ed84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x13c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a3f expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.670499:0:10055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ed84 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x13c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a3f expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201588.670533:0:10055:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.670543:0:10055:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201588.670547:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727897728:192.168.201.143@tcp:101:rm.0 00010000:00010000:3.0:1788201588.670549:0:10055:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.670557:0:10055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.670565:0:10055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.670566:0:24460:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6edb5 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x133:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095acb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.670573:0:10055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.670579:0:24460:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6edb5 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x13f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095acb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.670580:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.670587:0:24460:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6edb5 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x13f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095acb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.670588:0:10055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.670594:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6edb5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x13f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095acb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.670602:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6edb5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x13f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095acb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201588.670603:0:10055:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc1726cdf80 x1875064727897344/t0(0) o63->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:24/4 lens 1840/1800 e 0 to 0 dl 1788201604 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_sa.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788201588.670611:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6edb5 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x13f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095acb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00010000:3.0:1788201588.670612:0:10055:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed8b from it ffff8bc14742c190 00010000:00010000:3.0:1788201588.670615:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.670618:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6edb5 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x13f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095acb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.670624:0:10055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201588.670626:0:24460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6edb5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x13f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095acb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201588.670634:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc1726cfb80 x1875064727897728/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201604 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201588.670646:0:24460:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6edb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x13f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095acb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.670650:0:10055:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6eda7 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a77 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.670657:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/319 (0 0) 00010000:00010000:3.0:1788201588.670659:0:10055:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6eda7 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x13b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a77 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201588.670664:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x133:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201588.670666:0:10055:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6eda7 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x13b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a77 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.670671:0:10055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6eda7 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x13b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a77 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.670678:0:10055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6eda7 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x13b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a77 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.670685:0:10055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6eda7 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x13b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a77 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201588.670689:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x13f:0x0], updating i_size 0 00000080:00200000:1.0:1788201588.670692:0:24460:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x13f:0x0](ffff8bc1446bba88): rc = 0 00010000:00010000:3.0:1788201588.670697:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6eda7 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x13b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a77 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.670703:0:10055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6eda7 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x13b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a77 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201588.670712:0:10055:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc1726cdf80 x1875064727897344/t0(0) o63->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:24/4 lens 1840/1800 e 0 to 0 dl 1788201604 ref 3 fl Interpret:RQU/200/0 rc 0/0 job:'ll_sa.0' uid:0 gid:0 projid:4294967295 00000080:00010000:3.0:1788201588.670719:0:10055:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eda7 from it ffff8bc166519990 00010000:00010000:3.0:1788201588.670722:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6eda7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x13b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a77 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.670729:0:10055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6eda7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x13b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a77 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201588.670741:0:10055:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201588.670745:0:24460:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x13f:0x0]: layout version change: 4294967294 -> 4294967295 00010000:00010000:3.0:1788201588.670753:0:10055:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.670759:0:10055:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.670766:0:10055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00010000:1.0:1788201588.670768:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x13f:0x0](ffff8bc1446bba88) for lock 0xd138388016f6edb5 00010000:00010000:3.0:1788201588.670777:0:10055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00010000:1.0:1788201588.670781:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x13f:0x0](ffff8bc1446bba88) 00000080:00010000:1.0:1788201588.670784:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6edb5 from it ffffadd1c1923df8 00010000:00010000:3.0:1788201588.670784:0:10055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.670787:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6edb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x13f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095acb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.670821:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201588.670824:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6edb5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x13f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095acb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201588.670829:0:10055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201588.670837:0:10055:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc1726cdf80 x1875064727897344/t0(0) o63->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:24/4 lens 1840/1800 e 0 to 0 dl 1788201604 ref 4 fl Interpret:RQU/200/0 rc 0/0 job:'ll_sa.0' uid:0 gid:0 projid:4294967295 00000080:00010000:3.0:1788201588.670844:0:10055:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6edae from it ffff8bc166519d90 00010000:00010000:3.0:1788201588.670846:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201588.670853:0:10055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201588.670855:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x133:0x0](ffff8bc1459563c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201588.670864:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=f2, dir=[0x200000bd7:0x133:0x0](ffff8bc1459563c8) 00000100:00100000:3.0:1788201588.670866:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727897344:192.168.201.143@tcp:63:ll_sa.0 00010000:00010000:3.0:1788201588.670899:0:9520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ed84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x13c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a3f expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201588.670909:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6edb5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x13f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171095acb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201588.670916:0:9520:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x13c:0x0], updating i_size 0 00000080:00200000:3.0:1788201588.670918:0:9520:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x13c:0x0](ffff8bc145951988): rc = 0 00000080:00200000:1.0:1788201588.670936:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x13f:0x0]: losing layout lock 00000080:00200000:3.0:1788201588.670940:0:9520:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x13c:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1788201588.670955:0:9520:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x13c:0x0](ffff8bc145951988) for lock 0xd138388016f6ed84 00000080:00010000:3.0:1788201588.670970:0:9520:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed84 from it ffff8bc14742fd90 00010000:00010000:3.0:1788201588.670973:0:9520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ed84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x13c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095a3f expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201588.670981:0:9520:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ed84 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x13c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095a3f expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.670982:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6edb5 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x13f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171095acb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201588.670989:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201588.670992:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6edb5 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x13f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171095acb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201588.671002:0:9520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201588.671011:0:9520:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x135:0x0], updating i_size 7680 00000080:00010000:3.0:1788201588.671015:0:9520:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x135:0x0](ffff8bc145955b88) for lock 0xd138388016f6ed8b 00000080:00010000:3.0:1788201588.671017:0:9520:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed8b from it ffff8bc14742c190 00000020:00100000:1.0:1788201588.671018:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00010000:00010000:3.0:1788201588.671020:0:9520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201588.671024:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d5f80 x1875064727897984/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1788201588.671029:0:9520:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201588.671041:0:9520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6eda7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x13b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a77 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201588.671049:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727897984:192.168.201.143@tcp:36:rm.0 00000080:00200000:3.0:1788201588.671056:0:9520:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x13b:0x0], updating i_size 0 00000080:00200000:3.0:1788201588.671058:0:9520:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x13b:0x0](ffff8bc144659148): rc = 0 00000080:00200000:3.0:1788201588.671070:0:9520:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x13b:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1788201588.671079:0:9520:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x13b:0x0](ffff8bc144659148) for lock 0xd138388016f6eda7 00000080:00010000:3.0:1788201588.671083:0:9520:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eda7 from it ffff8bc166519990 00010000:00010000:3.0:1788201588.671086:0:9520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6eda7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x13b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095a77 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201588.671093:0:9520:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6eda7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x13b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095a77 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201588.671105:0:9520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201588.671116:0:9520:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x157:0x0], updating i_size 7680 00000080:00200000:3.0:1788201588.671119:0:9520:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x157:0x0](ffff8bc1446bc2c8): rc = 0 00000080:00010000:3.0:1788201588.671122:0:9520:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x157:0x0](ffff8bc1446bc2c8) for lock 0xd138388016f6edae 00000080:00010000:3.0:1788201588.671124:0:9520:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6edae from it ffff8bc166519d90 00010000:00010000:3.0:1788201588.671127:0:9520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201588.671133:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8d80 going to sleep for 11 seconds 00010000:00010000:3.0:1788201588.671134:0:9520:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000100:00100000:1.0:1788201588.740186:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727899136:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201588.740302:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x140:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201588.740315:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x140:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201588.740347:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x140:0x0](ffff8bc1446b8908) 00000080:00200008:1.0:1788201588.740507:0:24460:0:(file.c:479:ll_file_release()) START file d0:[0x200000bd7:0x133:0x0](ffff8bc1459563c8), flags 704000 00010000:00010000:1.0:1788201588.740545:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b800/0xd138388016f6ed99 lrc: 2/0,0 mode: CR/CR res: [0x200000bd7:0x133:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a00 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201588.740585:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201588.740598:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d0, flags=0 00000080:00200000:1.0:1788201588.740605:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201588.740610:0:24460:0:(namei.c:2328:ll_rmdir()) VFS Op:name=d0, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:1.0:1788201588.740642:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6ed92 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e21710959f2 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201588.740694:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b800/0xd138388016f6ed99 lrc: 2/0,0 mode: CR/CR res: [0x200000bd7:0x133:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e2171095a00 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00100000:1.0:1788201588.740753:0:24460:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1726cdc00 x1875064727896960/t8589937201(8589937201) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201604 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201588.740765:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201588.740986:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d5c00 x1875064727899392/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201588.741016:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727899392:192.168.201.143@tcp:35:rm.0 00000100:00100000:1.0:1788201588.742335:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201588.754312:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727899392:192.168.201.143@tcp:35:rm.0 00000002:00100000:1.0:1788201588.754357:0:24460:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1726cdc00 x1875064727896960/t8589937201(8589937201) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201604 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1788201588.754434:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6ecea lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e2171095434 expref: -99 pid: 23735 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.754502:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b800/0xd138388016f6ed99 lrc: 1/0,0 mode: --/CR res: [0x200000bd7:0x133:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171095a00 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.754512:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6ecea lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171095434 expref: -99 pid: 23735 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.754522:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6ed92 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e21710959f2 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201588.754535:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1788201588.754539:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b800/0xd138388016f6ed99 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x133:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171095a00 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.754554:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c600/0xd138388016f6ecea lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x133:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171095434 expref: -99 pid: 23735 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.754570:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6ed92 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e21710959f2 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1788201588.754589:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201588.754596:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d5c00 x1875064727899648/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201588.754621:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727899648:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201588.754870:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201588.787593:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727900160:192.168.201.143@tcp:36:rm.0 00000080:00200000:3.0:1788201588.787704:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x129:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1788201588.787718:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:3.0:1788201588.787761:0:24460:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000844cdb52 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004b4e8b7f/0xd138388016f6eba8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171095059 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201588.953180:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146028e00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727904384:192.168.201.143@tcp:36:rm.0 00000100:00100000:3.0:1788201588.953319:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc9c0 going to sleep for 11 seconds 00000080:00200000:3.0:1788201588.958189:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x128:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1788201588.958208:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:3.0:1788201588.958269:0:24460:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000009ffd8b5f ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000df0d0d42/0xd138388016f6eb85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094ffe expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201588.958320:0:24460:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000009ffd8b5f ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000df0d0d42/0xd138388016f6eb85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094ffe expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201588.958348:0:24460:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000009ffd8b5f ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000df0d0d42/0xd138388016f6eb85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094ffe expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201588.958386:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x128:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201588.958511:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x128:0x0](ffff8bc1459d6c08) 00000008:00010000:3.0:1788201588.958553:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 42517 blocks 1 [cma]time 1788201559 1788201559 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000df0d0d42/0xd138388016f6eb85 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x19b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094ffe expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201588.959317:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201588.959337:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-krb5.sh, flags=0 00010000:00010000:3.0:1788201588.959359:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6800/0xd138388016f6ea5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x120:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094d11 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:3.0:1788201588.959374:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ea5f from it ffffadd1c1923d78 00010000:00010000:3.0:1788201588.959377:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6800/0xd138388016f6ea5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x120:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094d11 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201588.959386:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6800/0xd138388016f6ea5f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x120:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094d11 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1788201588.959407:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:3.0:1788201588.959411:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=sanity-krb5.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:3.0:1788201588.959485:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6800/0xd138388016f6ea5f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x120:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171094d11 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1788201588.959513:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x120:0x0]: losing layout lock 00010000:00010000:3.0:1788201588.959576:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6800/0xd138388016f6ea5f lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x120:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094d11 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1788201588.959582:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201588.959584:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6800/0xd138388016f6ea5f lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x120:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094d11 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:3.0:1788201588.959613:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1788201588.960176:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc151ff5c00 x1875064727904640/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201588.960215:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff5c00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727904640:192.168.201.143@tcp:36:rm.0 00000100:00100000:3.0:1788201588.960530:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201588.970786:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff5c00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727904640:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201588.970935:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x120:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201588.970949:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:0.0:1788201588.970998:0:24460:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000c84a0dfd ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f1e1fa05/0xd138388016f6ea6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094d26 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201588.971046:0:24460:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000c84a0dfd ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f1e1fa05/0xd138388016f6ea6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094d26 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201588.971080:0:24460:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000c84a0dfd ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f1e1fa05/0xd138388016f6ea6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094d26 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201588.971139:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x120:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201588.971243:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x120:0x0](ffff8bc1459f5b88) 00000008:00010000:0.0:1788201588.971370:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 31711 blocks 1 [cma]time 1788201558 1788201558 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f1e1fa05/0xd138388016f6ea6d lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x197:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094d26 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201588.971473:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201588.971487:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=functions.sh, flags=0 00010000:00010000:0.0:1788201588.971509:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722c00/0xd138388016f6e320 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xeb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710938f1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:0.0:1788201588.971520:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e320 from it ffffadd1c1923d78 00010000:00010000:0.0:1788201588.971526:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722c00/0xd138388016f6e320 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xeb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710938f1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.971538:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722c00/0xd138388016f6e320 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xeb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710938f1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201588.971563:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201588.971569:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=functions.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:0.0:1788201588.971620:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722c00/0xd138388016f6e320 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xeb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710938f1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201588.971647:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0xeb:0x0]: losing layout lock 00010000:00010000:0.0:1788201588.971705:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722c00/0xd138388016f6e320 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0xeb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710938f1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1788201588.971712:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201588.971716:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722c00/0xd138388016f6e320 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0xeb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710938f1 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:0.0:1788201588.971748:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201588.971760:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14416ea00 x1875064727904896/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201588.971820:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416ea00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727904896:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201588.971948:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201588.980548:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416ea00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727904896:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201588.980677:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xeb:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201588.980690:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201588.980757:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xeb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201588.980958:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0xeb:0x0](ffff8bc145935348) 00000008:00010000:0.0:1788201588.981011:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 38517 blocks 1 [cma]time 1788201555 1788201555 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000038efa3ed/0xd138388016f6e32e lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x17c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093906 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1788201588.981104:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201588.981120:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=ost-pools.sh, flags=0 00010000:00010000:0.0:1788201588.981141:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611000/0xd138388016f6e5dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094156 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:0.0:1788201588.981152:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e5dc from it ffffadd1c1923d78 00010000:00010000:0.0:1788201588.981157:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611000/0xd138388016f6e5dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094156 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201588.981167:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611000/0xd138388016f6e5dc lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094156 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201588.981199:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201588.981206:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=ost-pools.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:0.0:1788201588.981262:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611000/0xd138388016f6e5dc lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171094156 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201588.981290:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0xff:0x0]: losing layout lock 00010000:00010000:0.0:1788201588.981346:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611000/0xd138388016f6e5dc lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094156 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1788201588.981354:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201588.981358:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172611000/0xd138388016f6e5dc lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0xff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094156 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:0.0:1788201588.981384:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201588.981396:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14416f100 x1875064727905152/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201588.981424:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416f100 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727905152:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201588.989179:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201588.996920:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416f100 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727905152:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201588.997057:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xff:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1788201588.997072:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201588.997149:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xff:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201588.997302:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0xff:0x0](ffff8bc145929988) 00000008:00010000:1.0:1788201588.997356:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 55540 blocks 1 [cma]time 1788201556 1788201556 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017a4a5c3/0xd138388016f6e5ea lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x186:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109416b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1788201588.998967:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201588.999004:0:24460:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f2, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=0 00000080:00200000:1.0:1788201588.999010:0:24460:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f2, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00010000:00010000:1.0:1788201588.999040:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d000/0xd138388016f6ed4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x13a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710958e1 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1788201588.999061:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed4c from it ffffadd1c1923bd8 00010000:00010000:1.0:1788201588.999066:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d000/0xd138388016f6ed4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x13a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710958e1 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201588.999079:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d000/0xd138388016f6ed4c lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x13a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710958e1 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201588.999942:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201588.999977:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=f2, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:1.0:1788201589.000087:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d000/0xd138388016f6ed4c lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x13a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710958e1 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201589.000134:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x13a:0x0]: losing layout lock 00010000:00010000:1.0:1788201589.000203:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d000/0xd138388016f6ed4c lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x13a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710958e1 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201589.000211:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201589.000213:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d000/0xd138388016f6ed4c lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x13a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710958e1 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:1.0:1788201589.000241:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201589.000258:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d6680 x1875064727905408/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201589.000289:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727905408:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201589.000616:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.008001:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727905408:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201589.008130:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x13a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201589.008143:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x13a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201589.008172:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x13a:0x0](ffff8bc14465b248) 00000080:00200000:1.0:1788201589.008264:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.008280:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=scrub-performance.sh, flags=0 00010000:00010000:1.0:1788201589.008307:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6ec03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095155 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:1.0:1788201589.008322:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ec03 from it ffffadd1c1923d78 00010000:00010000:1.0:1788201589.008327:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6ec03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095155 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201589.008337:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6ec03 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095155 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.008361:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201589.008368:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=scrub-performance.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:1.0:1788201589.008428:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6ec03 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171095155 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.008471:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x12c:0x0]: losing layout lock 00010000:00010000:1.0:1788201589.008529:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6ec03 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x12c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171095155 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201589.008536:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201589.008539:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6ec03 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x12c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171095155 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:1.0:1788201589.008568:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201589.008579:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d4700 x1875064727905664/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201589.008605:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727905664:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201589.008695:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.015553:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727905664:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201589.015675:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x12c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1788201589.015687:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:1.0:1788201589.015736:0:24460:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000b36c62bd ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000090432167/0xd138388016f6ec11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109516a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201589.015787:0:24460:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000b36c62bd ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000090432167/0xd138388016f6ec11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109516a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201589.015867:0:24460:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000b36c62bd ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000090432167/0xd138388016f6ec11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109516a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201589.015917:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x12c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201589.015996:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x12c:0x0](ffff8bc1459f0908) 00000008:00010000:1.0:1788201589.016046:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 5105 blocks 1 [cma]time 1788201559 1788201559 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000090432167/0xd138388016f6ec11 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x19d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109516a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201589.016759:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.016785:0:24460:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=e0, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=0 00000080:00200000:1.0:1788201589.016833:0:24460:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=e0, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00010000:00010000:1.0:1788201589.016859:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6ed53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x156:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710958fd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1788201589.016878:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed53 from it ffffadd1c1923900 00010000:00010000:1.0:1788201589.016883:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6ed53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x156:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710958fd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201589.016893:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6ed53 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x156:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710958fd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200008:1.0:1788201589.016925:0:24460:0:(file.c:6283:ll_getattr_dentry()) START file e0:[0x200000bd7:0x156:0x0](ffff8bc1446b80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201589.016932:0:24460:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x156:0x0](ffff8bc1446b80c8),name=e0 00000002:00010000:1.0:1788201589.016956:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x156:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201589.016967:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6ed53 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x156:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710958fd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201589.016982:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6ed53 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x156:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710958fd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201589.016990:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201589.016997:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x156:0x0](ffff8bc1446b80c8) 00000080:00010000:1.0:1788201589.017001:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x156:0x0](ffff8bc1446b80c8) for lock 0xd138388016f6ed53 00000080:00010000:1.0:1788201589.017007:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed53 from it ffffadd1c1923cb8 00010000:00010000:1.0:1788201589.017011:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6ed53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x156:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710958fd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201589.017024:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6ed53 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x156:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710958fd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1788201589.017061:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.017068:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=e0, flags=258 00000080:00200000:1.0:1788201589.017075:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x156:0x0](ffff8bc1446b80c8), inode mode 41ed mask 44 00000080:00200008:1.0:1788201589.017083:0:24460:0:(file.c:1090:ll_file_open()) START file e0:[0x200000bd7:0x156:0x0](ffff8bc1446b80c8), flags 704400 00000002:00010000:1.0:1788201589.017320:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x156:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1788201589.017389:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6edd8 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.017397:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6edd8 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201589.017473:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201589.017489:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d6300 x1875064727905920/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201589.017500:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6edd8 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201589.017529:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727905920:192.168.201.143@tcp:101:rm.0 00000100:00100000:1.0:1788201589.017824:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.030199:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727905920:192.168.201.143@tcp:101:rm.0 00010000:00010000:1.0:1788201589.030233:0:24460:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6edd8 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.030249:0:24460:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6edd8 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.030258:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6edd8 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.030265:0:24460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6edd8 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.030276:0:24460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6edd8 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.030284:0:24460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bd000 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201589.030290:0:24460:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6edd8 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.030297:0:24460:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6edd8 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.030305:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6edd8 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x20e400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.030314:0:24460:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201589.030323:0:24460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6edd8 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.030331:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6edd8 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201589.030359:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff8bc1727d6300 x1875064727905920/t8589937232(8589937232) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201605 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201589.030376:0:24460:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1727d6300 x1875064727905920/t8589937232(8589937232) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201605 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201589.030393:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1788201589.030433:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x156:0x0], updating i_size 7680 00000002:00100000:1.0:1788201589.030466:0:24460:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1727d6300 x1875064727905920/t8589937232(8589937232) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201605 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1788201589.030555:0:24460:0:(file.c:6283:ll_getattr_dentry()) START file e0:[0x200000bd7:0x156:0x0](ffff8bc1446b80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201589.030563:0:24460:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x156:0x0](ffff8bc1446b80c8),name=e0 00000002:00010000:1.0:1788201589.030590:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x156:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201589.030611:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6ed53 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x156:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710958fd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201589.030625:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6ed53 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x156:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710958fd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1788201589.030634:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201589.030639:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x156:0x0](ffff8bc1446b80c8) 00000080:00010000:1.0:1788201589.030643:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x156:0x0](ffff8bc1446b80c8) for lock 0xd138388016f6ed53 00000080:00010000:1.0:1788201589.030648:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed53 from it ffffadd1c1923cd8 00010000:00010000:1.0:1788201589.030652:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6ed53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x156:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710958fd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201589.030661:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6ed53 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x156:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710958fd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.030705:0:24460:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200000bd7:0x156:0x0](ffff8bc1446b80c8) pos/size0/7680 32bit_api 0 00000002:00010000:1.0:1788201589.030719:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x156:0x0]) in obj [0x200000bd7:0x156:0x0], intent: readdir flags 0 00010000:00010000:1.0:1788201589.030726:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6ed53 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x156:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710958fd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201589.030733:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6ed53 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x156:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710958fd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000100:00100000:1.0:1788201589.031505:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727906048:192.168.201.143@tcp:37:rm.0 00000100:00100000:1.0:1788201589.031640:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.056990:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727906048:192.168.201.143@tcp:37:rm.0 00010000:00010000:1.0:1788201589.057712:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6ed53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x156:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710958fd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201589.057732:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6ed53 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x156:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710958fd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:1.0:1788201589.058022:0:24460:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200000bd7:0x156:0x0](ffff8bc1446b80c8) pos/size18446744073709551614/7680 32bit_api 0 00000080:00200008:1.0:1788201589.058049:0:24460:0:(file.c:479:ll_file_release()) START file e0:[0x200000bd7:0x156:0x0](ffff8bc1446b80c8), flags 704000 00000002:00100000:1.0:1788201589.058143:0:24460:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1727d6300 x1875064727905920/t8589937232(8589937232) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201605 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201589.058158:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201589.058166:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d5500 x1875064727906304/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201589.058196:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727906304:192.168.201.143@tcp:35:rm.0 00000100:00100000:1.0:1788201589.058336:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00010000:00010000:3.0:1788201589.059958:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201589.068860:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727906304:192.168.201.143@tcp:35:rm.0 00000002:00100000:1.0:1788201589.068925:0:24460:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1727d6300 x1875064727905920/t8589937232(8589937232) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201605 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201589.069014:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.069033:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=e0, flags=0 00000080:00200000:1.0:1788201589.069043:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201589.069049:0:24460:0:(namei.c:2328:ll_rmdir()) VFS Op:name=e0, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:1.0:1788201589.069094:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6ed53 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x156:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e21710958fd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:1.0:1788201589.069254:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6ed53 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x156:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e21710958fd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:1.0:1788201589.069264:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201589.069268:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6ed53 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x156:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e21710958fd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000020:00100000:1.0:1788201589.069296:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201589.069304:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d5500 x1875064727906560/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201589.069331:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727906560:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201589.069462:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.074337:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727906560:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201589.074405:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x156:0x0](ffff8bc1446b80c8) 00000080:00200000:1.0:1788201589.074535:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.074550:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-lsnapshot.sh, flags=0 00010000:00010000:1.0:1788201589.074576:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:1.0:1788201589.074595:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eac8 from it ffffadd1c1923d78 00010000:00010000:1.0:1788201589.074599:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201589.074609:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.074639:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201589.074645:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=sanity-lsnapshot.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:1.0:1788201589.074749:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.074780:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x123:0x0]: losing layout lock 00010000:00010000:1.0:1788201589.074879:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201589.074888:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201589.074891:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400cc00/0xd138388016f6eac8 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x123:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094e22 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:1.0:1788201589.074921:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201589.074932:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d6300 x1875064727906816/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201589.074960:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727906816:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201589.075047:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.080399:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727906816:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201589.080541:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x123:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1788201589.080555:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:1.0:1788201589.080600:0:24460:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000f007d240 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201589.080652:0:24460:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000f007d240 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201589.080683:0:24460:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000f007d240 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201589.080734:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x123:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201589.080834:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x123:0x0](ffff8bc1459d2a08) 00000008:00010000:1.0:1788201589.080884:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 10934 blocks 1 [cma]time 1788201558 1788201558 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x198:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201589.080972:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.080987:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=replay-single-lmv.sh, flags=0 00010000:00010000:1.0:1788201589.081010:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:1.0:1788201589.081021:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e82f from it ffffadd1c1923d78 00010000:00010000:1.0:1788201589.081026:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201589.081037:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.081064:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201589.081071:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=replay-single-lmv.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:1.0:1788201589.081371:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.081401:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x110:0x0]: losing layout lock 00010000:00010000:1.0:1788201589.081616:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201589.081683:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201589.081687:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400c400/0xd138388016f6e82f lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094761 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:1.0:1788201589.081718:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201589.081732:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d6a00 x1875064727907072/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201589.081761:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727907072:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201589.082019:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.089173:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727907072:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201589.089302:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x110:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1788201589.089316:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201589.089387:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x110:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201589.089492:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x110:0x0](ffff8bc1459d5348) 00000008:00010000:1.0:1788201589.089547:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 2129 blocks 1 [cma]time 1788201557 1788201557 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1560c4/0xd138388016f6e83d lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x18f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094776 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1788201589.089663:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.089677:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=krb5_login.sh, flags=0 00010000:00010000:1.0:1788201589.089698:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49a00/0xd138388016f6e389 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093a02 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:1.0:1788201589.089710:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e389 from it ffffadd1c1923d78 00010000:00010000:1.0:1788201589.089715:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49a00/0xd138388016f6e389 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093a02 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201589.089727:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49a00/0xd138388016f6e389 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093a02 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.089753:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201589.089759:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=krb5_login.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:1.0:1788201589.089855:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49a00/0xd138388016f6e389 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171093a02 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.089885:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0xee:0x0]: losing layout lock 00010000:00010000:1.0:1788201589.089942:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49a00/0xd138388016f6e389 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171093a02 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201589.089950:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201589.089954:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49a00/0xd138388016f6e389 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171093a02 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:1.0:1788201589.089982:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201589.089993:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d6d80 x1875064727907328/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201589.090021:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727907328:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201589.090110:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.096764:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727907328:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201589.096918:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xee:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1788201589.096933:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201589.097006:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xee:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201589.097079:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0xee:0x0](ffff8bc1459800c8) 00000008:00010000:1.0:1788201589.097144:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 674 blocks 1 [cma]time 1788201555 1788201555 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003e728182/0xd138388016f6e397 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x17e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093a17 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1788201589.097234:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.097249:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-benchmark.sh, flags=0 00010000:00010000:1.0:1788201589.097271:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:1.0:1788201589.097282:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e98d from it ffffadd1c1923d78 00010000:00010000:1.0:1788201589.097288:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201589.097299:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.097325:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201589.097331:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=sanity-benchmark.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:1.0:1788201589.097382:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.097408:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x11a:0x0]: losing layout lock 00010000:00010000:1.0:1788201589.097470:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201589.097478:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201589.097483:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6e98d lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x11a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094aef expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:1.0:1788201589.097512:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201589.097522:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d4e00 x1875064727907584/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201589.097551:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727907584:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201589.097638:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.103964:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727907584:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201589.104087:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x11a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1788201589.104102:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:1.0:1788201589.104149:0:24460:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000009fce27d9 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fff55c5/0xd138388016f6e99b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094b04 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201589.104191:0:24460:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000009fce27d9 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fff55c5/0xd138388016f6e99b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094b04 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201589.104239:0:24460:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000009fce27d9 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fff55c5/0xd138388016f6e99b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094b04 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201589.104297:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x11a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201589.104373:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x11a:0x0](ffff8bc14465cb08) 00000008:00010000:1.0:1788201589.104429:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 6548 blocks 1 [cma]time 1788201558 1788201558 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fff55c5/0xd138388016f6e99b lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x194:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094b04 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201589.104529:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.104545:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=recovery-mds-scale.sh, flags=0 00010000:00010000:1.0:1788201589.104569:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172723a00/0xd138388016f6e73a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x109:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710944e4 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:1.0:1788201589.104581:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e73a from it ffffadd1c1923d78 00010000:00010000:1.0:1788201589.104586:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172723a00/0xd138388016f6e73a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x109:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710944e4 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201589.104597:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172723a00/0xd138388016f6e73a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x109:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710944e4 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.104623:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201589.104641:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=recovery-mds-scale.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:1.0:1788201589.104696:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172723a00/0xd138388016f6e73a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x109:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710944e4 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.104726:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x109:0x0]: losing layout lock 00010000:00010000:1.0:1788201589.104780:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172723a00/0xd138388016f6e73a lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x109:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710944e4 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201589.104842:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201589.104845:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172723a00/0xd138388016f6e73a lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x109:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710944e4 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:1.0:1788201589.104873:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201589.104885:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d4000 x1875064727907840/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201589.104915:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727907840:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201589.105004:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.116705:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727907840:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201589.116859:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x109:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1788201589.116874:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201589.116942:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x109:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201589.117020:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x109:0x0](ffff8bc145933a88) 00000008:00010000:1.0:1788201589.117072:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 1790 blocks 1 [cma]time 1788201557 1788201557 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6e748 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x18b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710944f9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 1 00000080:00200000:1.0:1788201589.117166:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.117177:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d3, flags=0 00010000:00010000:1.0:1788201589.117200:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6ed5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095935 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1788201589.117214:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed5a from it ffffadd1c1923af8 00010000:00010000:1.0:1788201589.117220:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6ed5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095935 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201589.117232:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6ed5a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095935 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200008:1.0:1788201589.117261:0:24460:0:(file.c:6283:ll_getattr_dentry()) START file d3:[0x200000bd7:0x136:0x0](ffff8bc1459521c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201589.117269:0:24460:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8),name=d3 00000002:00010000:1.0:1788201589.117289:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x136:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201589.117300:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6ed5a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095935 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201589.117314:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6ed5a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095935 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201589.117323:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201589.117328:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x136:0x0](ffff8bc1459521c8) 00000080:00010000:1.0:1788201589.117333:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x136:0x0](ffff8bc1459521c8) for lock 0xd138388016f6ed5a 00000080:00010000:1.0:1788201589.117338:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed5a from it ffffadd1c1923cb8 00010000:00010000:1.0:1788201589.117342:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6ed5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095935 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201589.117350:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6ed5a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095935 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1788201589.117389:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.117394:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d3, flags=258 00000080:00200000:1.0:1788201589.117399:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 44 00000080:00200008:1.0:1788201589.117409:0:24460:0:(file.c:1090:ll_file_open()) START file d3:[0x200000bd7:0x136:0x0](ffff8bc1459521c8), flags 704400 00000002:00010000:1.0:1788201589.117424:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x136:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1788201589.117497:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eddf lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.117506:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eddf lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201589.117520:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201589.117531:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d5880 x1875064727908096/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201589.117542:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eddf lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201589.117567:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727908096:192.168.201.143@tcp:101:rm.0 00000100:00100000:1.0:1788201589.117754:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.121517:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727908096:192.168.201.143@tcp:101:rm.0 00010000:00010000:1.0:1788201589.121548:0:24460:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eddf lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.121563:0:24460:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eddf lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.121572:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eddf lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.121581:0:24460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eddf lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.121592:0:24460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eddf lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.121601:0:24460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bd000 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201589.121607:0:24460:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eddf lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.121615:0:24460:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eddf lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.121632:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eddf lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x20e400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.121640:0:24460:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201589.121648:0:24460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eddf lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.121654:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6eddf lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201589.121679:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff8bc1727d5880 x1875064727908096/t8589937240(8589937240) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201605 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201589.121695:0:24460:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1727d5880 x1875064727908096/t8589937240(8589937240) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201605 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201589.121711:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1788201589.121736:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x136:0x0], updating i_size 7680 00000002:00100000:1.0:1788201589.121756:0:24460:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1727d5880 x1875064727908096/t8589937240(8589937240) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201605 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1788201589.121888:0:24460:0:(file.c:6283:ll_getattr_dentry()) START file d3:[0x200000bd7:0x136:0x0](ffff8bc1459521c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201589.121897:0:24460:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8),name=d3 00000002:00010000:1.0:1788201589.121921:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x136:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201589.121941:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6ed5a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095935 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201589.121957:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6ed5a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095935 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1788201589.121966:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201589.121972:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x136:0x0](ffff8bc1459521c8) 00000080:00010000:1.0:1788201589.121976:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x136:0x0](ffff8bc1459521c8) for lock 0xd138388016f6ed5a 00000080:00010000:1.0:1788201589.121982:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed5a from it ffffadd1c1923cd8 00010000:00010000:1.0:1788201589.121985:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6ed5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095935 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201589.121994:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6ed5a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095935 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.122030:0:24460:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8) pos/size0/7680 32bit_api 0 00000002:00010000:1.0:1788201589.122044:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x136:0x0]) in obj [0x200000bd7:0x136:0x0], intent: readdir flags 0 00010000:00010000:1.0:1788201589.122050:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6ed5a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095935 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201589.122059:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6ed5a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095935 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000100:00100000:1.0:1788201589.122724:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727908224:192.168.201.143@tcp:37:rm.0 00000100:00100000:1.0:1788201589.122882:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.132158:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727908224:192.168.201.143@tcp:37:rm.0 00010000:00010000:1.0:1788201589.132967:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6ed5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095935 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201589.132990:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6ed5a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095935 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200008:1.0:1788201589.133076:0:24460:0:(file.c:479:ll_file_release()) START file d3:[0x200000bd7:0x136:0x0](ffff8bc1459521c8), flags 704000 00000002:00100000:1.0:1788201589.133160:0:24460:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1727d5880 x1875064727908096/t8589937240(8589937240) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201605 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201589.133175:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201589.133182:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d4a80 x1875064727908480/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201589.133208:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727908480:192.168.201.143@tcp:35:rm.0 00000100:00100000:1.0:1788201589.133303:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.136908:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727908480:192.168.201.143@tcp:35:rm.0 00000002:00100000:1.0:1788201589.136951:0:24460:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1727d5880 x1875064727908096/t8589937240(8589937240) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201605 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201589.137038:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.137048:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d3, flags=258 00000080:00200000:1.0:1788201589.137058:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 44 00000080:00200008:1.0:1788201589.137068:0:24460:0:(file.c:1090:ll_file_open()) START file d3:[0x200000bd7:0x136:0x0](ffff8bc1459521c8), flags 704400 00000002:00010000:1.0:1788201589.137108:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x136:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1788201589.137187:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ede6 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.137198:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ede6 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201589.137212:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201589.137219:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d4a80 x1875064727908736/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201589.137337:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ede6 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201589.137362:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727908736:192.168.201.143@tcp:101:rm.0 00000100:00100000:1.0:1788201589.137614:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.146926:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727908736:192.168.201.143@tcp:101:rm.0 00010000:00010000:1.0:1788201589.146981:0:24460:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ede6 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095ec2 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.146995:0:24460:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ede6 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095ec2 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.147010:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ede6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095ec2 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.147025:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ede6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095ec2 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201589.147044:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff8bc1727d4a80 x1875064727908736/t8589937242(8589937242) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201605 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201589.147060:0:24460:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1727d4a80 x1875064727908736/t8589937242(8589937242) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201605 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201589.147078:0:24460:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ede6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095ec2 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.147091:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 16 res 8589937623/310 (0 0) 00000080:00200000:1.0:1788201589.147099:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1788201589.147127:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x136:0x0], updating i_size 7680 00000080:00010000:1.0:1788201589.147134:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x136:0x0](ffff8bc1459521c8) for lock 0xd138388016f6ede6 00000080:00010000:1.0:1788201589.147144:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ede6 from it ffffadd1c1923bd0 00010000:00010000:1.0:1788201589.147148:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ede6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095ec2 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.147161:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ede6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095ec2 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00100000:1.0:1788201589.147198:0:24460:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1727d4a80 x1875064727908736/t8589937242(8589937242) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201605 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1788201589.148496:0:24460:0:(file.c:6283:ll_getattr_dentry()) START file d3:[0x200000bd7:0x136:0x0](ffff8bc1459521c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201589.148512:0:24460:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8),name=d3 00000002:00010000:1.0:1788201589.148546:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x136:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201589.148566:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6ed5a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095935 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:1.0:1788201589.148584:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6ed5a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095935 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:1.0:1788201589.148593:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201589.148603:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x136:0x0](ffff8bc1459521c8) 00000080:00010000:1.0:1788201589.148607:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x136:0x0](ffff8bc1459521c8) for lock 0xd138388016f6ed5a 00000080:00010000:1.0:1788201589.148615:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed5a from it ffffadd1c1923cd8 00010000:00010000:1.0:1788201589.148619:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6ed5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095935 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:1.0:1788201589.149342:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6ed5a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095935 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 1 00000080:00200000:1.0:1788201589.149398:0:24460:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8) pos/size0/7680 32bit_api 0 00000080:00200000:1.0:1788201589.149437:0:24460:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8) pos/size18446744073709551614/7680 32bit_api 0 00000080:00200000:1.0:1788201589.149478:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.149500:0:24460:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f3, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), flags=0 00000080:00200000:1.0:1788201589.149505:0:24460:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f3, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), intent=getattr 00000002:00010000:1.0:1788201589.149520:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f3,[0x0:0x0:0x0]) in obj [0x200000bd7:0x136:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201589.149578:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6eded lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.149587:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6eded lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.149600:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6eded lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201589.149703:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727908864:192.168.201.143@tcp:101:rm.0 00000100:00100000:1.0:1788201589.149935:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.163611:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727908864:192.168.201.143@tcp:101:rm.0 00010000:00010000:1.0:1788201589.163648:0:24460:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6eded lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095ee5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.163677:0:24460:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6eded lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x14f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095ee5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.163687:0:24460:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6eded lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095ee5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.163702:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6eded lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095ee5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.163716:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6eded lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095ee5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.163732:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6eded lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095ee5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.163742:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6eded lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095ee5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.163751:0:24460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6eded lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095ee5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201589.163764:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc1727d5880 x1875064727908864/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201605 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201589.163780:0:24460:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6eded lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095ee5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.163818:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/335 (0 0) 00000080:00200000:1.0:1788201589.163827:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x136:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201589.163856:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x14f:0x0], updating i_size 0 00000080:00200000:1.0:1788201589.163859:0:24460:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x14f:0x0](ffff8bc144681148): rc = 0 00000080:00200000:1.0:1788201589.163920:0:24460:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x14f:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1788201589.163948:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x14f:0x0](ffff8bc144681148) for lock 0xd138388016f6eded 00000080:00010000:1.0:1788201589.163960:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x14f:0x0](ffff8bc144681148) 00000080:00010000:1.0:1788201589.163965:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eded from it ffffadd1c1923df8 00010000:00010000:1.0:1788201589.163969:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6eded lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095ee5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.163980:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6eded lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095ee5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201589.164017:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201589.164026:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=f3, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8) 00010000:00010000:1.0:1788201589.164074:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6ed5a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e2171095935 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 1 00010000:00010000:1.0:1788201589.164096:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6ecff lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109555a expref: -99 pid: 23738 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201589.164182:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6eded lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171095ee5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201589.164204:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x14f:0x0]: losing layout lock 00010000:00010000:1.0:1788201589.164252:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6eded lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171095ee5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201589.164261:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6ed5a lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171095935 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 1 00010000:00010000:1.0:1788201589.164268:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1788201589.164272:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6eded lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171095ee5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201589.164288:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6ed5a lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171095935 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 1 00000020:00100000:1.0:1788201589.164305:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201589.164313:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d5880 x1875064727909120/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201589.164341:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727909120:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201589.164472:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.175699:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727909120:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201589.175856:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x14f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201589.175867:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x14f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201589.175895:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x14f:0x0](ffff8bc144681148) 00000080:00200000:1.0:1788201589.175986:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.176008:0:24460:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), flags=0 00000080:00200000:1.0:1788201589.176013:0:24460:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f4, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), intent=getattr 00000002:00010000:1.0:1788201589.176041:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f4,[0x0:0x0:0x0]) in obj [0x200000bd7:0x136:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201589.176274:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edf4 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.176292:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edf4 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.176305:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edf4 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201589.176332:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727909248:192.168.201.143@tcp:101:rm.0 00000100:00100000:1.0:1788201589.176566:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.187134:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727909248:192.168.201.143@tcp:101:rm.0 00010000:00010000:1.0:1788201589.187171:0:24460:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edf4 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095f1d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.187202:0:24460:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edf4 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x150:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095f1d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.187213:0:24460:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edf4 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x150:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095f1d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.187227:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edf4 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x150:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095f1d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.187240:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edf4 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x150:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095f1d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.187257:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edf4 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x150:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095f1d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.187273:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edf4 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x150:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095f1d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.187283:0:24460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edf4 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x150:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095f1d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201589.187296:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc1727d7480 x1875064727909248/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201605 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201589.187312:0:24460:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edf4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x150:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095f1d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.187325:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/336 (0 0) 00000080:00200000:1.0:1788201589.187333:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x136:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201589.187361:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x150:0x0], updating i_size 0 00000080:00200000:1.0:1788201589.187365:0:24460:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x150:0x0](ffff8bc144687448): rc = 0 00000080:00200000:1.0:1788201589.187567:0:24460:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x150:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1788201589.187599:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x150:0x0](ffff8bc144687448) for lock 0xd138388016f6edf4 00000080:00010000:1.0:1788201589.187613:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x150:0x0](ffff8bc144687448) 00000080:00010000:1.0:1788201589.187618:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6edf4 from it ffffadd1c1923df8 00010000:00010000:1.0:1788201589.187631:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edf4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x150:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095f1d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.187642:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edf4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x150:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095f1d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201589.187681:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201589.187691:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=f4, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8) 00010000:00010000:1.0:1788201589.187747:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edf4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x150:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171095f1d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201589.187773:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x150:0x0]: losing layout lock 00010000:00010000:1.0:1788201589.187878:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edf4 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x150:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171095f1d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201589.187886:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201589.187889:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edf4 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x150:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171095f1d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1788201589.187919:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201589.187929:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d7480 x1875064727909504/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201589.187957:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727909504:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201589.188179:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.201378:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727909504:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201589.201592:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x150:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201589.201603:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x150:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201589.201697:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x150:0x0](ffff8bc144687448) 00000080:00200000:1.0:1788201589.202476:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.202508:0:24460:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f0, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), flags=0 00000080:00200000:1.0:1788201589.202513:0:24460:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f0, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), intent=getattr 00000002:00010000:1.0:1788201589.202541:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f0,[0x0:0x0:0x0]) in obj [0x200000bd7:0x136:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201589.202610:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edfb lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.202627:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edfb lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.202637:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edfb lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201589.202663:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727909632:192.168.201.143@tcp:101:rm.0 00000100:00100000:1.0:1788201589.210927:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.217338:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727909632:192.168.201.143@tcp:101:rm.0 00010000:00010000:1.0:1788201589.217382:0:24460:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edfb lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095f55 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.217413:0:24460:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edfb lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x14c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095f55 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.217420:0:24460:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edfb lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095f55 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.217432:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edfb lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095f55 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.217452:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edfb lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095f55 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.217467:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edfb lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095f55 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.217479:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edfb lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095f55 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.217487:0:24460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edfb lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095f55 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201589.217499:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc1727d7100 x1875064727909632/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201605 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201589.217512:0:24460:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095f55 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.217523:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/332 (0 0) 00000080:00200000:1.0:1788201589.217531:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x136:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201589.217559:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x14c:0x0], updating i_size 0 00000080:00200000:1.0:1788201589.217563:0:24460:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x14c:0x0](ffff8bc145954b08): rc = 0 00000080:00200000:1.0:1788201589.217618:0:24460:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x14c:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1788201589.217643:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x14c:0x0](ffff8bc145954b08) for lock 0xd138388016f6edfb 00000080:00010000:1.0:1788201589.217655:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x14c:0x0](ffff8bc145954b08) 00000080:00010000:1.0:1788201589.217659:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6edfb from it ffffadd1c1923df8 00010000:00010000:1.0:1788201589.217662:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095f55 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.217672:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edfb lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095f55 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201589.217708:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201589.217719:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=f0, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8) 00010000:00010000:1.0:1788201589.217767:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edfb lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171095f55 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201589.217839:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x14c:0x0]: losing layout lock 00010000:00010000:1.0:1788201589.217882:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edfb lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171095f55 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201589.217888:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201589.217892:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6edfb lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171095f55 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1788201589.217916:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201589.217923:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d7100 x1875064727909888/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201589.217946:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727909888:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201589.218034:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.226722:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727909888:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201589.226886:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x14c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201589.226897:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x14c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201589.226926:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x14c:0x0](ffff8bc145954b08) 00000080:00200000:1.0:1788201589.227010:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.227028:0:24460:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f2, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), flags=0 00000080:00200000:1.0:1788201589.227033:0:24460:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f2, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), intent=getattr 00000002:00010000:1.0:1788201589.227055:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f2,[0x0:0x0:0x0]) in obj [0x200000bd7:0x136:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201589.227111:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee02 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.227127:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee02 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.227137:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee02 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201589.227159:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727910016:192.168.201.143@tcp:101:rm.0 00000100:00100000:1.0:1788201589.227258:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.236639:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727910016:192.168.201.143@tcp:101:rm.0 00010000:00010000:1.0:1788201589.236676:0:24460:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee02 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095f8d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.236705:0:24460:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee02 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x14e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095f8d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.236713:0:24460:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee02 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095f8d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.236724:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee02 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095f8d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.236736:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee02 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095f8d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.236750:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee02 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095f8d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.236763:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee02 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095f8d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.236771:0:24460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee02 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095f8d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201589.236783:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc1727d7800 x1875064727910016/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201605 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201589.236834:0:24460:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095f8d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.236846:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/334 (0 0) 00000080:00200000:1.0:1788201589.236853:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x136:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201589.236884:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x14e:0x0], updating i_size 0 00000080:00200000:1.0:1788201589.236887:0:24460:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x14e:0x0](ffff8bc144683a88): rc = 0 00000080:00200000:0.0:1788201589.237014:0:24460:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x14e:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1788201589.237207:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x14e:0x0](ffff8bc144683a88) for lock 0xd138388016f6ee02 00000080:00010000:0.0:1788201589.237224:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x14e:0x0](ffff8bc144683a88) 00000080:00010000:0.0:1788201589.237229:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ee02 from it ffffadd1c1923df8 00010000:00010000:0.0:1788201589.237235:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095f8d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201589.237250:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee02 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095f8d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201589.237300:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201589.237312:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=f2, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8) 00010000:00010000:0.0:1788201589.237380:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee02 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171095f8d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201589.237522:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x14e:0x0]: losing layout lock 00010000:00010000:0.0:1788201589.237596:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee02 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171095f8d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201589.237605:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201589.237608:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee02 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171095f8d expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1788201589.237655:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201589.237669:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14416d500 x1875064727910272/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201589.237701:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416d500 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727910272:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201589.237893:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201589.242441:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416d500 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727910272:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201589.242582:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x14e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201589.242595:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x14e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201589.242633:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x14e:0x0](ffff8bc144683a88) 00000080:00200000:0.0:1788201589.242728:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201589.242751:0:24460:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), flags=0 00000080:00200000:0.0:1788201589.242757:0:24460:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f1, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), intent=getattr 00000002:00010000:0.0:1788201589.242820:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f1,[0x0:0x0:0x0]) in obj [0x200000bd7:0x136:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201589.242897:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8000/0xd138388016f6ee09 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201589.242909:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8000/0xd138388016f6ee09 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201589.242920:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8000/0xd138388016f6ee09 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201589.242945:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416e680 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727910400:192.168.201.143@tcp:101:rm.0 00000100:00100000:0.0:1788201589.243063:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201589.254761:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416e680 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727910400:192.168.201.143@tcp:101:rm.0 00010000:00010000:0.0:1788201589.254822:0:24460:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8000/0xd138388016f6ee09 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095fc5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201589.254853:0:24460:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8000/0xd138388016f6ee09 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x14d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095fc5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201589.254863:0:24460:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8000/0xd138388016f6ee09 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095fc5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201589.254877:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8000/0xd138388016f6ee09 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095fc5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201589.254891:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8000/0xd138388016f6ee09 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095fc5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201589.254907:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8000/0xd138388016f6ee09 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095fc5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201589.254917:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8000/0xd138388016f6ee09 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095fc5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201589.254926:0:24460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8000/0xd138388016f6ee09 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095fc5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201589.254940:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc14416e680 x1875064727910400/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201605 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201589.254957:0:24460:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8000/0xd138388016f6ee09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095fc5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201589.254970:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/333 (0 0) 00000080:00200000:0.0:1788201589.254979:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x136:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201589.255008:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x14d:0x0], updating i_size 0 00000080:00200000:0.0:1788201589.255012:0:24460:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x14d:0x0](ffff8bc144683248): rc = 0 00000080:00200000:0.0:1788201589.255081:0:24460:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x14d:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1788201589.255107:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x14d:0x0](ffff8bc144683248) for lock 0xd138388016f6ee09 00000080:00010000:0.0:1788201589.255120:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x14d:0x0](ffff8bc144683248) 00000080:00010000:0.0:1788201589.255124:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ee09 from it ffffadd1c1923df8 00010000:00010000:0.0:1788201589.255128:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8000/0xd138388016f6ee09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095fc5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201589.255139:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8000/0xd138388016f6ee09 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095fc5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201589.255176:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x136:0x0](ffff8bc1459521c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201589.255186:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=f1, dir=[0x200000bd7:0x136:0x0](ffff8bc1459521c8) 00010000:00010000:0.0:1788201589.255247:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8000/0xd138388016f6ee09 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171095fc5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201589.255272:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x14d:0x0]: losing layout lock 00010000:00010000:0.0:1788201589.255326:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8000/0xd138388016f6ee09 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171095fc5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201589.255334:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201589.255338:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8000/0xd138388016f6ee09 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171095fc5 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1788201589.255365:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201589.255373:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14416e680 x1875064727910656/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201589.255401:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416e680 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727910656:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201589.255950:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201589.267657:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416e680 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727910656:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201589.267773:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x14d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201589.267786:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x14d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201589.267847:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x14d:0x0](ffff8bc144683248) 00000080:00200008:0.0:1788201589.267938:0:24460:0:(file.c:479:ll_file_release()) START file d3:[0x200000bd7:0x136:0x0](ffff8bc1459521c8), flags 704000 00010000:00010000:0.0:1788201589.267970:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ede6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095ec2 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201589.268001:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201589.268072:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d3, flags=0 00000080:00200000:0.0:1788201589.268081:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201589.268085:0:24460:0:(namei.c:2328:ll_rmdir()) VFS Op:name=d3, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:0.0:1788201589.268118:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ede6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e2171095ec2 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00100000:0.0:1788201589.268175:0:24460:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1727d4a80 x1875064727908736/t8589937242(8589937242) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201605 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1788201589.268186:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1788201589.268190:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14416c380 x1875064727910912/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1788201589.268212:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416c380 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727910912:192.168.201.143@tcp:35:rm.0 00000100:00100000:0.0:1788201589.269254:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201589.285163:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416c380 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727910912:192.168.201.143@tcp:35:rm.0 00000002:00100000:0.0:1788201589.285215:0:24460:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1727d4a80 x1875064727908736/t8589937242(8589937242) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201605 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1788201589.285286:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6ecff lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e217109555a expref: -99 pid: 23738 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201589.285351:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ede6 lrc: 1/0,0 mode: --/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171095ec2 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201589.285361:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6ecff lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e217109555a expref: -99 pid: 23738 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201589.285368:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1788201589.285372:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ede6 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x136:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171095ec2 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201589.285394:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6ecff lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x136:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e217109555a expref: -99 pid: 23738 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000020:00100000:0.0:1788201589.285989:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201589.286000:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14416c380 x1875064727911168/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201589.396947:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602a680 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727912704:192.168.201.143@tcp:36:rm.0 00000100:00100000:3.0:1788201589.397087:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201589.416126:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602a680 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727912704:192.168.201.143@tcp:36:rm.0 00000080:00200000:3.0:1788201589.416243:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x152:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201589.416255:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x152:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201589.416284:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x152:0x0](ffff8bc1459d0908) 00000080:00200000:3.0:1788201589.416713:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201589.416747:0:24460:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f2, dir=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), flags=0 00000080:00200000:3.0:1788201589.416752:0:24460:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f2, dir=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), intent=getattr 00000002:00010000:3.0:1788201589.416933:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f2,[0x0:0x0:0x0]) in obj [0x200000bd7:0x137:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201589.417116:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee25 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x137:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.417129:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee25 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x137:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.417143:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee25 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x137:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201589.417170:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff5880 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727912832:192.168.201.143@tcp:101:rm.0 00000100:00100000:3.0:1788201589.417278:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201589.420998:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff5880 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727912832:192.168.201.143@tcp:101:rm.0 00010000:00010000:3.0:1788201589.421042:0:24460:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee25 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x137:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096089 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.421070:0:24460:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee25 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x153:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096089 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.421086:0:24460:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee25 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x153:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096089 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.421100:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee25 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x153:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096089 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.421112:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee25 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x153:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096089 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.421127:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee25 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x153:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096089 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.421136:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee25 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x153:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096089 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.421144:0:24460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee25 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x153:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096089 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201589.421157:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc151ff5880 x1875064727912832/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201605 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201589.421172:0:24460:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x153:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096089 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.421183:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/339 (0 0) 00000080:00200000:3.0:1788201589.421191:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x137:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1788201589.421217:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x153:0x0], updating i_size 0 00000080:00200000:3.0:1788201589.421221:0:24460:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x153:0x0](ffff8bc1459f2a08): rc = 0 00000080:00200000:3.0:1788201589.421275:0:24460:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x153:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1788201589.421301:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x153:0x0](ffff8bc1459f2a08) for lock 0xd138388016f6ee25 00000080:00010000:3.0:1788201589.421313:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x153:0x0](ffff8bc1459f2a08) 00000080:00010000:3.0:1788201589.421317:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ee25 from it ffffadd1c1923df8 00010000:00010000:3.0:1788201589.421321:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x153:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096089 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.421332:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee25 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x153:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096089 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201589.421382:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), inode mode 41ed mask 3 00000080:00200000:3.0:1788201589.421391:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=f2, dir=[0x200000bd7:0x137:0x0](ffff8bc1459500c8) 00010000:00010000:3.0:1788201589.422754:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee25 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x153:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171096089 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201589.422827:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x153:0x0]: losing layout lock 00010000:00010000:3.0:1788201589.422895:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee25 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x153:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096089 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201589.422904:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201589.422907:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee25 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x153:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096089 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:3.0:1788201589.422943:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1788201589.422957:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc151ff5880 x1875064727913088/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201589.422988:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff5880 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727913088:192.168.201.143@tcp:36:rm.0 00000100:00100000:3.0:1788201589.423186:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201589.435238:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff5880 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727913088:192.168.201.143@tcp:36:rm.0 00000080:00200000:3.0:1788201589.435351:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x153:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201589.435361:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x153:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201589.435390:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x153:0x0](ffff8bc1459f2a08) 00000080:00200000:3.0:1788201589.435509:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201589.435531:0:24460:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f0, dir=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), flags=0 00000080:00200000:3.0:1788201589.435537:0:24460:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f0, dir=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), intent=getattr 00000002:00010000:3.0:1788201589.435565:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f0,[0x0:0x0:0x0]) in obj [0x200000bd7:0x137:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201589.435656:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6ee2c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x137:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.435668:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6ee2c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x137:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.435682:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6ee2c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x137:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201589.435706:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff7b80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727913216:192.168.201.143@tcp:101:rm.0 00000100:00100000:3.0:1788201589.435847:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201589.453608:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff7b80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727913216:192.168.201.143@tcp:101:rm.0 00010000:00010000:3.0:1788201589.453730:0:24460:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6ee2c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x137:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710960c1 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.453787:0:24460:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6ee2c lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x151:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710960c1 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.453820:0:24460:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6ee2c lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x151:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710960c1 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.453832:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6ee2c lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x151:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710960c1 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.453845:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6ee2c lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x151:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710960c1 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.453862:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6ee2c lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x151:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710960c1 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.453871:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6ee2c lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x151:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710960c1 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.453880:0:24460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6ee2c lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x151:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710960c1 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201589.453892:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc151ff7b80 x1875064727913216/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201605 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201589.453903:0:24460:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6ee2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x151:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710960c1 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.453913:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/337 (0 0) 00000080:00200000:3.0:1788201589.453919:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x137:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1788201589.453941:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x151:0x0], updating i_size 0 00000080:00200000:3.0:1788201589.453944:0:24460:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x151:0x0](ffff8bc1459d4b08): rc = 0 00000080:00200000:3.0:1788201589.453987:0:24460:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x151:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1788201589.454006:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x151:0x0](ffff8bc1459d4b08) for lock 0xd138388016f6ee2c 00000080:00010000:3.0:1788201589.454017:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x151:0x0](ffff8bc1459d4b08) 00000080:00010000:3.0:1788201589.454021:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ee2c from it ffffadd1c1923df8 00010000:00010000:3.0:1788201589.454024:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6ee2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x151:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710960c1 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.454033:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6ee2c lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x151:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710960c1 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201589.454072:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), inode mode 41ed mask 3 00000080:00200000:3.0:1788201589.454081:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=f0, dir=[0x200000bd7:0x137:0x0](ffff8bc1459500c8) 00010000:00010000:3.0:1788201589.454130:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6ee2c lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x151:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710960c1 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201589.454154:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x151:0x0]: losing layout lock 00010000:00010000:3.0:1788201589.454202:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6ee2c lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x151:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710960c1 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201589.454208:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201589.454211:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6ee2c lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x151:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710960c1 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:3.0:1788201589.454700:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1788201589.454708:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc151ff7b80 x1875064727913472/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201589.454732:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff7b80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727913472:192.168.201.143@tcp:36:rm.0 00000100:00100000:3.0:1788201589.456911:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201589.461359:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff7b80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727913472:192.168.201.143@tcp:36:rm.0 00000080:00200000:3.0:1788201589.461512:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x151:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201589.461525:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x151:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201589.461554:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x151:0x0](ffff8bc1459d4b08) 00000080:00200000:3.0:1788201589.461642:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201589.461661:0:24460:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f3, dir=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), flags=0 00000080:00200000:3.0:1788201589.461665:0:24460:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f3, dir=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), intent=getattr 00000002:00010000:3.0:1788201589.461688:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f3,[0x0:0x0:0x0]) in obj [0x200000bd7:0x137:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201589.461750:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee33 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x137:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.461766:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee33 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x137:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.461779:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee33 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x137:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201589.461846:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff4e00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727913600:192.168.201.143@tcp:101:rm.0 00000100:00100000:3.0:1788201589.461924:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.468029:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff4e00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727913600:192.168.201.143@tcp:101:rm.0 00010000:00010000:1.0:1788201589.468067:0:24460:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee33 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x137:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710960f9 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.468115:0:24460:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee33 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x154:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710960f9 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.468127:0:24460:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee33 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x154:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710960f9 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.468142:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee33 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x154:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710960f9 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.468157:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee33 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x154:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710960f9 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.468174:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee33 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x154:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710960f9 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.468185:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee33 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x154:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710960f9 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.468194:0:24460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee33 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x154:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710960f9 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201589.468207:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc151ff4e00 x1875064727913600/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201605 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201589.468222:0:24460:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x154:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710960f9 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.468233:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/340 (0 0) 00000080:00200000:1.0:1788201589.468241:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x137:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201589.468266:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x154:0x0], updating i_size 0 00000080:00200000:1.0:1788201589.468270:0:24460:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x154:0x0](ffff8bc144682a08): rc = 0 00000080:00200000:1.0:1788201589.468326:0:24460:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x154:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1788201589.468353:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x154:0x0](ffff8bc144682a08) for lock 0xd138388016f6ee33 00000080:00010000:1.0:1788201589.468364:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x154:0x0](ffff8bc144682a08) 00000080:00010000:1.0:1788201589.468369:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ee33 from it ffffadd1c1923df8 00010000:00010000:1.0:1788201589.468373:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x154:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710960f9 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.468384:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee33 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x154:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710960f9 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201589.468452:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201589.468463:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=f3, dir=[0x200000bd7:0x137:0x0](ffff8bc1459500c8) 00010000:00010000:1.0:1788201589.468517:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee33 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x154:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710960f9 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201589.468544:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x154:0x0]: losing layout lock 00010000:00010000:1.0:1788201589.468601:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee33 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x154:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710960f9 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201589.468609:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201589.468613:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6ee33 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x154:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710960f9 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1788201589.468731:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201589.468739:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d7b80 x1875064727913856/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201589.468766:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7b80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727913856:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201589.469608:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.483572:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7b80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727913856:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201589.483773:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x154:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201589.483785:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x154:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201589.483920:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x154:0x0](ffff8bc144682a08) 00000080:00200000:1.0:1788201589.484088:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.484238:0:24460:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), flags=0 00000080:00200000:1.0:1788201589.484244:0:24460:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f4, dir=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), intent=getattr 00000002:00010000:1.0:1788201589.484274:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f4,[0x0:0x0:0x0]) in obj [0x200000bd7:0x137:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201589.484351:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee3a lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x137:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.484362:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee3a lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x137:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.484373:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee3a lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x137:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201589.484397:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727913984:192.168.201.143@tcp:101:rm.0 00000100:00100000:1.0:1788201589.484621:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.488130:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727913984:192.168.201.143@tcp:101:rm.0 00010000:00010000:1.0:1788201589.488168:0:24460:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee3a lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x137:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096131 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.488196:0:24460:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee3a lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x155:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096131 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.488205:0:24460:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee3a lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x155:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096131 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.488219:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee3a lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x155:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096131 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.488241:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee3a lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x155:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096131 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.488258:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee3a lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x155:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096131 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.488267:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee3a lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x155:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096131 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.488276:0:24460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee3a lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x155:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096131 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201589.488288:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc1727d4380 x1875064727913984/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201605 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201589.488302:0:24460:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x155:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096131 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.488312:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/341 (0 0) 00000080:00200000:1.0:1788201589.488320:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x137:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201589.488345:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x155:0x0], updating i_size 0 00000080:00200000:1.0:1788201589.488348:0:24460:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x155:0x0](ffff8bc144686c08): rc = 0 00000080:00200000:1.0:1788201589.488399:0:24460:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x155:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1788201589.488426:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x155:0x0](ffff8bc144686c08) for lock 0xd138388016f6ee3a 00000080:00010000:1.0:1788201589.488447:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x155:0x0](ffff8bc144686c08) 00000080:00010000:1.0:1788201589.488451:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ee3a from it ffffadd1c1923df8 00010000:00010000:1.0:1788201589.488455:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x155:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096131 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201589.488466:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee3a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x155:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096131 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201589.488504:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x137:0x0](ffff8bc1459500c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201589.488513:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=f4, dir=[0x200000bd7:0x137:0x0](ffff8bc1459500c8) 00010000:00010000:1.0:1788201589.488558:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee3a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x155:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171096131 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201589.488580:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x155:0x0]: losing layout lock 00010000:00010000:1.0:1788201589.488643:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee3a lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x155:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096131 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201589.488650:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201589.488654:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee3a lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x155:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096131 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1788201589.488684:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201589.488692:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d4380 x1875064727914240/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201589.488719:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727914240:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201589.489077:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.499502:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727914240:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201589.499629:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x155:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201589.499641:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x155:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201589.499671:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x155:0x0](ffff8bc144686c08) 00000080:00200008:1.0:1788201589.499754:0:24460:0:(file.c:479:ll_file_release()) START file d4:[0x200000bd7:0x137:0x0](ffff8bc1459500c8), flags 704000 00010000:00010000:1.0:1788201589.499785:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6ee17 lrc: 2/0,0 mode: CR/CR res: [0x200000bd7:0x137:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109602e expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201589.499895:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.499907:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d4, flags=0 00000080:00200000:1.0:1788201589.499915:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201589.499920:0:24460:0:(namei.c:2328:ll_rmdir()) VFS Op:name=d4, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:1.0:1788201589.499955:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6ee17 lrc: 2/0,0 mode: CR/CR res: [0x200000bd7:0x137:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e217109602e expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00100000:1.0:1788201589.500010:0:24460:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc14602aa00 x1875064727912320/t8589937253(8589937253) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201605 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201589.500037:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201589.500044:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d4a80 x1875064727914496/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201589.500067:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727914496:192.168.201.143@tcp:35:rm.0 00000100:00100000:1.0:1788201589.500142:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.504843:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727914496:192.168.201.143@tcp:35:rm.0 00000002:00100000:1.0:1788201589.504890:0:24460:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc14602aa00 x1875064727912320/t8589937253(8589937253) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201605 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1788201589.504957:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031c00/0xd138388016f6ed06 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x137:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e21710955bc expref: -99 pid: 23739 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201589.505035:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6ee17 lrc: 1/0,0 mode: --/CR res: [0x200000bd7:0x137:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e217109602e expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201589.505046:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031c00/0xd138388016f6ed06 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x137:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e21710955bc expref: -99 pid: 23739 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201589.505058:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1788201589.505061:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6ee17 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x137:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e217109602e expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201589.505078:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc140031c00/0xd138388016f6ed06 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x137:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e21710955bc expref: -99 pid: 23739 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000020:00100000:1.0:1788201589.505105:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201589.505112:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d4a80 x1875064727914752/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201589.505138:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727914752:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201589.505243:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.514658:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727914752:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201589.514722:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x137:0x0](ffff8bc1459500c8) 00000080:00200000:1.0:1788201589.514846:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.514861:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-flr.sh, flags=0 00010000:00010000:1.0:1788201589.514885:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7c00/0xd138388016f6ea19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x11e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094c5b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:1.0:1788201589.514899:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ea19 from it ffffadd1c1923d78 00010000:00010000:1.0:1788201589.514904:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7c00/0xd138388016f6ea19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x11e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094c5b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201589.514913:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7c00/0xd138388016f6ea19 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x11e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094c5b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.514945:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201589.514951:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=sanity-flr.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:1.0:1788201589.515056:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7c00/0xd138388016f6ea19 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x11e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171094c5b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.515085:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x11e:0x0]: losing layout lock 00010000:00010000:1.0:1788201589.515140:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7c00/0xd138388016f6ea19 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x11e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094c5b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201589.515148:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201589.515151:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7c00/0xd138388016f6ea19 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x11e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094c5b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:1.0:1788201589.515180:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201589.515191:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d7800 x1875064727915008/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201589.515217:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727915008:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201589.515304:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.522689:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727915008:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201589.522845:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x11e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1788201589.522860:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:1.0:1788201589.522906:0:24460:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 0000000078f2e4b8 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892703bf/0xd138388016f6ea27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094c70 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201589.522983:0:24460:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 0000000078f2e4b8 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892703bf/0xd138388016f6ea27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094c70 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201589.523039:0:24460:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 0000000078f2e4b8 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892703bf/0xd138388016f6ea27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094c70 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201589.523091:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x11e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201589.523313:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x11e:0x0](ffff8bc1459f3248) 00000008:00010000:1.0:1788201589.523362:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 143467 blocks 1 [cma]time 1788201558 1788201558 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892703bf/0xd138388016f6ea27 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x196:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094c70 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201589.523455:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.523471:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=parallel-scale-nfsv4.sh, flags=0 00010000:00010000:1.0:1788201589.523495:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610c00/0xd138388016f6e668 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x103:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710942c2 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:1.0:1788201589.523507:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e668 from it ffffadd1c1923d78 00010000:00010000:1.0:1788201589.523513:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610c00/0xd138388016f6e668 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x103:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710942c2 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201589.523524:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610c00/0xd138388016f6e668 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x103:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710942c2 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.523550:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201589.523557:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=parallel-scale-nfsv4.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:1.0:1788201589.523611:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610c00/0xd138388016f6e668 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x103:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710942c2 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.523647:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x103:0x0]: losing layout lock 00010000:00010000:1.0:1788201589.523706:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610c00/0xd138388016f6e668 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x103:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710942c2 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201589.523714:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201589.523717:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610c00/0xd138388016f6e668 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x103:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710942c2 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:1.0:1788201589.523743:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201589.523756:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a5180 x1875064727915264/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201589.523784:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a5180 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727915264:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201589.523929:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.530829:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a5180 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727915264:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201589.530953:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x103:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1788201589.530967:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201589.531035:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x103:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201589.531115:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x103:0x0](ffff8bc145987448) 00000008:00010000:1.0:1788201589.531164:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 234 blocks 1 [cma]time 1788201557 1788201557 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000029fa8324/0xd138388016f6e676 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x188:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710942d7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1788201589.531258:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.531271:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=rpc.sh, flags=0 00010000:00010000:1.0:1788201589.531293:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267fc00/0xd138388016f6e898 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x113:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094872 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:1.0:1788201589.531309:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e898 from it ffffadd1c1923d78 00010000:00010000:1.0:1788201589.531314:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267fc00/0xd138388016f6e898 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x113:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094872 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201589.531324:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267fc00/0xd138388016f6e898 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x113:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094872 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.531347:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201589.531353:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=rpc.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:1.0:1788201589.531404:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267fc00/0xd138388016f6e898 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x113:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171094872 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000100:00100000:1.0:1788201589.624332:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275a300 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727917056:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201589.624484:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x100:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1788201589.624500:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201589.624571:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x100:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201589.624678:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x100:0x0](ffff8bc145980908) 00000008:00010000:1.0:1788201589.624734:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 6813 blocks 1 [cma]time 1788201556 1788201556 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x187:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1788201589.625111:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.625127:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanityn.sh, flags=0 00010000:00010000:1.0:1788201589.625153:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645d000/0xd138388016f6eaeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x124:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094e7d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:1.0:1788201589.625173:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eaeb from it ffffadd1c1923d78 00010000:00010000:1.0:1788201589.625178:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645d000/0xd138388016f6eaeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x124:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094e7d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201589.625190:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645d000/0xd138388016f6eaeb lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x124:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094e7d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.625216:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201589.625223:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=sanityn.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:1.0:1788201589.625285:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645d000/0xd138388016f6eaeb lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x124:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171094e7d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.625314:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x124:0x0]: losing layout lock 00010000:00010000:1.0:1788201589.625374:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645d000/0xd138388016f6eaeb lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x124:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094e7d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201589.625382:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201589.625385:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645d000/0xd138388016f6eaeb lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x124:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094e7d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:1.0:1788201589.625411:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201589.625427:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a6d80 x1875064727917312/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201589.625466:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a6d80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727917312:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201589.625588:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.636477:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a6d80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727917312:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201589.638052:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x124:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1788201589.638071:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:1.0:1788201589.638126:0:24460:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000a1d91876 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201589.638217:0:24460:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000a1d91876 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201589.638287:0:24460:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000a1d91876 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201589.638340:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x124:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201589.638700:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x124:0x0](ffff8bc1459f6c08) 00000008:00010000:1.0:1788201589.638774:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 227516 blocks 1 [cma]time 1788201558 1788201558 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x199:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201589.638909:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.638924:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=large-lun.sh, flags=0 00010000:00010000:1.0:1788201589.638947:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267ea00/0xd138388016f6e3ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093a5d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:1.0:1788201589.638959:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e3ac from it ffffadd1c1923d78 00010000:00010000:1.0:1788201589.638964:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267ea00/0xd138388016f6e3ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093a5d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201589.638975:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267ea00/0xd138388016f6e3ac lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093a5d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.639004:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201589.639011:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=large-lun.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:1.0:1788201589.639065:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267ea00/0xd138388016f6e3ac lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171093a5d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.639093:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0xef:0x0]: losing layout lock 00010000:00010000:1.0:1788201589.639165:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267ea00/0xd138388016f6e3ac lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171093a5d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201589.639173:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201589.639177:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267ea00/0xd138388016f6e3ac lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171093a5d expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:1.0:1788201589.639210:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201589.639231:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a5500 x1875064727917568/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201589.639267:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a5500 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727917568:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201589.639450:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.649520:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a5500 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727917568:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201589.649656:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xef:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1788201589.649671:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201589.649744:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xef:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201589.650174:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0xef:0x0](ffff8bc145935b88) 00000008:00010000:1.0:1788201589.650227:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 9198 blocks 1 [cma]time 1788201556 1788201556 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005c0c7627/0xd138388016f6e3ba lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x17e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093a72 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1788201589.650331:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.650346:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=mmp.sh, flags=0 00010000:00010000:1.0:1788201589.650369:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734a00/0xd138388016f6e52d lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xfa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093f7a expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:1.0:1788201589.650380:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e52d from it ffffadd1c1923d78 00010000:00010000:1.0:1788201589.650386:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734a00/0xd138388016f6e52d lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xfa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093f7a expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201589.650398:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734a00/0xd138388016f6e52d lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xfa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093f7a expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.650447:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201589.650455:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=mmp.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:1.0:1788201589.650508:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734a00/0xd138388016f6e52d lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xfa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171093f7a expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.650537:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0xfa:0x0]: losing layout lock 00010000:00010000:1.0:1788201589.650596:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734a00/0xd138388016f6e52d lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0xfa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171093f7a expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201589.650604:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201589.650607:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734a00/0xd138388016f6e52d lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0xfa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171093f7a expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:1.0:1788201589.650648:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201589.650661:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a5880 x1875064727917824/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201589.650687:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a5880 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727917824:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201589.650831:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.658830:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a5880 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727917824:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201589.658941:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xfa:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1788201589.658955:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201589.659034:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xfa:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201589.659134:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0xfa:0x0](ffff8bc14592db88) 00000008:00010000:1.0:1788201589.659187:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 18269 blocks 1 [cma]time 1788201556 1788201556 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000cd330330/0xd138388016f6e53b lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x184:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093fa4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1788201589.659282:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.659298:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=setup-cifs.sh, flags=0 00010000:00010000:1.0:1788201589.659323:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:1.0:1788201589.659336:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ec26 from it ffffadd1c1923d78 00010000:00010000:1.0:1788201589.659342:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201589.659356:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.659381:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201589.659387:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=setup-cifs.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:1.0:1788201589.659460:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.659489:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x12d:0x0]: losing layout lock 00010000:00010000:1.0:1788201589.659546:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201589.659555:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201589.659559:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ec26 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x12d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710951b0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:1.0:1788201589.659588:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201589.659599:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a7100 x1875064727918080/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201589.659626:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a7100 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727918080:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201589.659720:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201589.666170:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a7100 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727918080:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201589.666285:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x12d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1788201589.666299:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:1.0:1788201589.666349:0:24460:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000436963de ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201589.666384:0:24460:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000436963de ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201589.666411:0:24460:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000436963de ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201589.666475:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x12d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201589.666537:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x12d:0x0](ffff8bc14465db88) 00000008:00010000:1.0:1788201589.666582:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 2475 blocks 1 [cma]time 1788201559 1788201559 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201589.666672:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201589.666687:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=replay-ost-single.sh, flags=0 00010000:00010000:1.0:1788201589.666710:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6e80c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x10f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094706 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:1.0:1788201589.666720:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e80c from it ffffadd1c1923d78 00010000:00010000:1.0:1788201589.666725:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6e80c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x10f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094706 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201589.666734:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6e80c lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x10f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094706 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.667068:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201589.667076:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=replay-ost-single.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:1.0:1788201589.667136:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6e80c lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x10f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171094706 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.667164:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x10f:0x0]: losing layout lock 00010000:00010000:1.0:1788201589.667221:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6e80c lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x10f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094706 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201589.667234:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201589.667237:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6e80c lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x10f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094706 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:1.0:1788201589.667264:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201589.667278:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a6300 x1875064727918336/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201589.667306:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a6300 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727918336:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201589.667404:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8c00 going to sleep for 11 seconds 00000080:00200000:3.0:1788201589.701974:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x105:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1788201589.701993:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1788201589.702531:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x105:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201589.702625:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x105:0x0](ffff8bc14592a1c8) 00000008:00010000:3.0:1788201589.702738:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 3079 blocks 1 [cma]time 1788201557 1788201557 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x189:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1788201589.704285:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201589.704307:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=conf-sanity-framework.sh, flags=0 00010000:00010000:3.0:1788201589.704334:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6e294 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xe7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093785 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:3.0:1788201589.704349:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e294 from it ffffadd1c1923d78 00010000:00010000:3.0:1788201589.704355:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6e294 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xe7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093785 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201589.704366:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6e294 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xe7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093785 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1788201589.704392:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:3.0:1788201589.704399:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=conf-sanity-framework.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:3.0:1788201589.704472:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6e294 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xe7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171093785 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1788201589.704502:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0xe7:0x0]: losing layout lock 00010000:00010000:3.0:1788201589.704564:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6e294 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0xe7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171093785 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1788201589.704572:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201589.704576:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6e294 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0xe7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171093785 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:3.0:1788201589.704608:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1788201589.704624:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc151ff7100 x1875064727918848/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 512/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201589.704666:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff7100 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727918848:192.168.201.143@tcp:36:rm.0 00000100:00100000:3.0:1788201589.704844:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201589.724731:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff7100 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727918848:192.168.201.143@tcp:36:rm.0 00000080:00200000:3.0:1788201589.724963:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xe7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1788201589.724978:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1788201589.725107:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xe7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201589.725185:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0xe7:0x0](ffff8bc145985b88) 00000008:00010000:3.0:1788201589.725232:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 5634 blocks 1 [cma]time 1788201555 1788201555 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000024db6f57/0xd138388016f6e2a2 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x17a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109379a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1788201589.725322:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201589.725335:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-hsm.sh, flags=0 00010000:00010000:3.0:1788201589.725357:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6600/0xd138388016f6ea3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x11f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094cb6 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:3.0:1788201589.725368:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ea3c from it ffffadd1c1923d78 00010000:00010000:3.0:1788201589.725374:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6600/0xd138388016f6ea3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x11f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094cb6 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201589.725386:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6600/0xd138388016f6ea3c lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x11f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094cb6 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1788201589.726330:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:3.0:1788201589.726920:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=sanity-hsm.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:3.0:1788201589.727023:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6600/0xd138388016f6ea3c lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x11f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171094cb6 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1788201589.727057:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x11f:0x0]: losing layout lock 00010000:00010000:3.0:1788201589.727121:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6600/0xd138388016f6ea3c lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x11f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094cb6 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1788201589.727129:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201589.727133:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6600/0xd138388016f6ea3c lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x11f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094cb6 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:3.0:1788201589.727167:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1788201589.727183:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc151ff5180 x1875064727919104/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201589.727213:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff5180 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727919104:192.168.201.143@tcp:36:rm.0 00000100:00100000:3.0:1788201589.727352:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201589.733466:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff5180 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727919104:192.168.201.143@tcp:36:rm.0 00000080:00200000:3.0:1788201589.733579:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x11f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1788201589.733593:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:3.0:1788201589.733653:0:24460:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 0000000044dd8b7d ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6ea4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094ccb expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201589.733738:0:24460:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 0000000044dd8b7d ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6ea4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094ccb expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201589.733986:0:24460:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 0000000044dd8b7d ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6ea4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094ccb expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201589.734105:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x11f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201589.734346:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x11f:0x0](ffff8bc1459f5348) 00000008:00010000:3.0:1788201589.734397:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 170595 blocks 1 [cma]time 1788201558 1788201558 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6ea4a lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x196:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094ccb expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201589.734621:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201589.734944:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-compr.sh, flags=0 00010000:00010000:3.0:1788201589.734967:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c200/0xd138388016f6e9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x11b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094b4a expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:3.0:1788201589.734980:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e9b0 from it ffffadd1c1923d78 00010000:00010000:3.0:1788201589.734985:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c200/0xd138388016f6e9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x11b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094b4a expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201589.734997:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c200/0xd138388016f6e9b0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x11b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094b4a expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1788201589.735098:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:3.0:1788201589.735105:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=sanity-compr.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:3.0:1788201589.735161:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c200/0xd138388016f6e9b0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x11b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171094b4a expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1788201589.735188:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x11b:0x0]: losing layout lock 00010000:00010000:3.0:1788201589.735244:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c200/0xd138388016f6e9b0 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x11b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094b4a expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1788201589.735258:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201589.735261:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c200/0xd138388016f6e9b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x11b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094b4a expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:3.0:1788201589.735291:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1788201589.735307:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc151ff6680 x1875064727919360/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201589.735335:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff6680 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727919360:192.168.201.143@tcp:36:rm.0 00000100:00100000:3.0:1788201589.736345:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201589.748418:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff6680 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727919360:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201589.748559:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x11b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201589.748572:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:0.0:1788201589.748616:0:24460:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000311b2370 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000096aa1f32/0xd138388016f6e9be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094b5f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201589.748666:0:24460:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000311b2370 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000096aa1f32/0xd138388016f6e9be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094b5f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201589.748696:0:24460:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000311b2370 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000096aa1f32/0xd138388016f6e9be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094b5f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201589.748736:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x11b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201589.750682:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x11b:0x0](ffff8bc145981988) 00000008:00010000:0.0:1788201589.750865:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 4750 blocks 1 [cma]time 1788201558 1788201558 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000096aa1f32/0xd138388016f6e9be lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x194:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094b5f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201589.750977:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201589.750996:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=run_iozone.sh, flags=0 00010000:00010000:0.0:1788201589.751021:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:0.0:1788201589.751032:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e924 from it ffffadd1c1923d78 00010000:00010000:0.0:1788201589.751037:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201589.751048:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201589.751073:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201589.751080:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=run_iozone.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:0.0:1788201589.751146:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201589.752745:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x117:0x0]: losing layout lock 00010000:00010000:1.0:1788201589.752864:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201589.752876:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201589.752880:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d600/0xd138388016f6e924 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710949de expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:1.0:1788201589.752915:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201589.752932:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a7b80 x1875064727919616/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201589.752963:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a7b80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727919616:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201589.753163:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201589.768243:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a7b80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727919616:192.168.201.143@tcp:36:rm.0 00000080:00200000:3.0:1788201589.768948:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x117:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1788201589.768963:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:3.0:1788201589.769013:0:24460:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000000ce1d5f3 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201589.769051:0:24460:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000000ce1d5f3 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201589.769081:0:24460:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000000ce1d5f3 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201589.769138:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x117:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201589.769210:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x117:0x0](ffff8bc1459d63c8) 00000008:00010000:3.0:1788201589.769258:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 1408 blocks 1 [cma]time 1788201558 1788201558 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x192:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201589.769356:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201589.769371:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-selinux.sh, flags=0 00010000:00010000:3.0:1788201589.769393:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:3.0:1788201589.769403:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ebbd from it ffffadd1c1923d78 00010000:00010000:3.0:1788201589.769516:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201589.769531:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1788201589.769557:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:3.0:1788201589.769564:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=sanity-selinux.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:3.0:1788201589.769624:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1788201589.769654:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x12a:0x0]: losing layout lock 00010000:00010000:3.0:1788201589.769715:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1788201589.769724:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201589.769728:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6ebbd lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109509f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:3.0:1788201589.769756:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1788201589.769771:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc151ff4a80 x1875064727919872/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201589.770666:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff4a80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727919872:192.168.201.143@tcp:36:rm.0 00000100:00100000:3.0:1788201589.770885:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201589.784721:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff4a80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727919872:192.168.201.143@tcp:36:rm.0 00000080:00200000:3.0:1788201589.784904:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x12a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1788201589.784917:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:3.0:1788201589.785016:0:24460:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000354268d1 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201589.785061:0:24460:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000354268d1 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201589.785095:0:24460:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000354268d1 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201589.785139:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x12a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201589.785236:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x12a:0x0](ffff8bc14465ba88) 00000008:00010000:3.0:1788201589.785282:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 26716 blocks 1 [cma]time 1788201559 1788201559 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201589.785365:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201589.785376:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d1, flags=0 00010000:00010000:3.0:1788201589.785399:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1788201589.785429:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed68 from it ffffadd1c1923af8 00010000:00010000:3.0:1788201589.785442:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201589.785454:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200008:3.0:1788201589.785486:0:24460:0:(file.c:6283:ll_getattr_dentry()) START file d1:[0x200000bd7:0x134:0x0](ffff8bc145955348), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201589.785493:0:24460:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348),name=d1 00000002:00010000:3.0:1788201589.785516:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x134:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201589.785528:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201589.785543:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201589.785552:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201589.785559:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x134:0x0](ffff8bc145955348) 00000080:00010000:3.0:1788201589.785562:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x134:0x0](ffff8bc145955348) for lock 0xd138388016f6ed68 00000080:00010000:3.0:1788201589.785569:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed68 from it ffffadd1c1923cb8 00010000:00010000:3.0:1788201589.785572:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201589.785580:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1788201589.785620:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:3.0:1788201589.785626:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d1, flags=258 00000080:00200000:3.0:1788201589.785631:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348), inode mode 41ed mask 44 00000080:00200008:3.0:1788201589.785640:0:24460:0:(file.c:1090:ll_file_open()) START file d1:[0x200000bd7:0x134:0x0](ffff8bc145955348), flags 704400 00000002:00010000:3.0:1788201589.785656:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x134:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open flags 0100240704401 00010000:00010000:3.0:1788201589.785721:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee41 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.785729:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee41 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1788201589.785744:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1788201589.785756:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc151ff5500 x1875064727920128/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1788201589.785767:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee41 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201589.785824:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff5500 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727920128:192.168.201.143@tcp:101:rm.0 00000100:00100000:3.0:1788201589.786027:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201589.794592:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff5500 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727920128:192.168.201.143@tcp:101:rm.0 00010000:00010000:3.0:1788201589.794618:0:24460:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee41 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.794632:0:24460:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee41 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.794641:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee41 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.794649:0:24460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee41 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.794659:0:24460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee41 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.794665:0:24460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1725a0a00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201589.794669:0:24460:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee41 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.794677:0:24460:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee41 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.795476:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee41 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x20e400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.795486:0:24460:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201589.795493:0:24460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee41 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.795499:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee41 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201589.795522:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff8bc151ff5500 x1875064727920128/t8589937281(8589937281) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201605 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1788201589.795536:0:24460:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc151ff5500 x1875064727920128/t8589937281(8589937281) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201605 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201589.795863:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1788201589.795891:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x134:0x0], updating i_size 7680 00000002:00100000:3.0:1788201589.795966:0:24460:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc151ff5500 x1875064727920128/t8589937281(8589937281) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201605 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1788201589.796052:0:24460:0:(file.c:6283:ll_getattr_dentry()) START file d1:[0x200000bd7:0x134:0x0](ffff8bc145955348), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201589.796059:0:24460:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348),name=d1 00000002:00010000:3.0:1788201589.796082:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x134:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201589.796101:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201589.796115:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1788201589.796123:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201589.796128:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x134:0x0](ffff8bc145955348) 00000080:00010000:3.0:1788201589.796131:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x134:0x0](ffff8bc145955348) for lock 0xd138388016f6ed68 00000080:00010000:3.0:1788201589.796137:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed68 from it ffffadd1c1923cd8 00010000:00010000:3.0:1788201589.796141:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201589.796150:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1788201589.796423:0:24460:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348) pos/size0/7680 32bit_api 0 00000002:00010000:3.0:1788201589.796447:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x134:0x0]) in obj [0x200000bd7:0x134:0x0], intent: readdir flags 0 00010000:00010000:3.0:1788201589.796455:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1788201589.796464:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6ed68 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959a5 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000100:00100000:3.0:1788201589.913512:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275aa00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727921280:192.168.201.143@tcp:101:rm.0 00010000:00010000:3.0:1788201589.913548:0:24460:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6ee56 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x134:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096409 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.913577:0:24460:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6ee56 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x145:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096409 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.913584:0:24460:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6ee56 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x145:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096409 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.913594:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6ee56 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x145:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096409 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.913603:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6ee56 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x145:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096409 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.913616:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6ee56 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x145:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096409 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.913624:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6ee56 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x145:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096409 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.913631:0:24460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6ee56 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x145:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096409 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201589.913645:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc17275aa00 x1875064727921280/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201605 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201589.913661:0:24460:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6ee56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x145:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096409 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.913673:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/325 (0 0) 00000080:00200000:3.0:1788201589.913680:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x134:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1788201589.913705:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x145:0x0], updating i_size 0 00000080:00200000:3.0:1788201589.913707:0:24460:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x145:0x0](ffff8bc145950908): rc = 0 00000080:00200000:3.0:1788201589.913753:0:24460:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x145:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1788201589.913777:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x145:0x0](ffff8bc145950908) for lock 0xd138388016f6ee56 00000080:00010000:3.0:1788201589.913823:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x145:0x0](ffff8bc145950908) 00000080:00010000:3.0:1788201589.913828:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ee56 from it ffffadd1c1923df8 00010000:00010000:3.0:1788201589.913831:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6ee56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x145:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096409 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.913842:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6ee56 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x145:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096409 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201589.913886:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348), inode mode 41ed mask 3 00000080:00200000:3.0:1788201589.913897:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=f3, dir=[0x200000bd7:0x134:0x0](ffff8bc145955348) 00010000:00010000:3.0:1788201589.913944:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6ee56 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x145:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171096409 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201589.913961:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x145:0x0]: losing layout lock 00010000:00010000:3.0:1788201589.914009:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6ee56 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x145:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096409 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201589.914016:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201589.914019:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6ee56 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x145:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096409 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:3.0:1788201589.914048:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1788201589.914057:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc151ff5500 x1875064727921536/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201589.914082:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff5500 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727921536:192.168.201.143@tcp:36:rm.0 00000100:00100000:3.0:1788201589.914205:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201589.927276:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff5500 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727921536:192.168.201.143@tcp:36:rm.0 00000080:00200000:3.0:1788201589.927570:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x145:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201589.927582:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x145:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201589.927612:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x145:0x0](ffff8bc145950908) 00000080:00200000:3.0:1788201589.927700:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348), inode mode 41ed mask 1 00000080:00200000:3.0:1788201589.927720:0:24460:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x134:0x0](ffff8bc145955348), flags=0 00000080:00200000:3.0:1788201589.927726:0:24460:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f4, dir=[0x200000bd7:0x134:0x0](ffff8bc145955348), intent=getattr 00000002:00010000:3.0:1788201589.927748:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f4,[0x0:0x0:0x0]) in obj [0x200000bd7:0x134:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201589.927876:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee5d lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x134:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.927888:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee5d lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x134:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.927900:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee5d lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x134:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201589.928034:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff4e00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727921664:192.168.201.143@tcp:101:rm.0 00000100:00100000:3.0:1788201589.928295:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201589.939902:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff4e00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727921664:192.168.201.143@tcp:101:rm.0 00010000:00010000:3.0:1788201589.939930:0:24460:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee5d lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x134:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096441 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.939951:0:24460:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee5d lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x146:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096441 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.939960:0:24460:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee5d lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x146:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096441 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.939970:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee5d lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x146:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096441 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.939981:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee5d lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x146:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096441 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.939994:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee5d lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x146:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096441 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.940002:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee5d lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x146:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096441 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.940009:0:24460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee5d lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x146:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096441 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201589.940030:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc151ff4e00 x1875064727921664/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201605 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201589.940043:0:24460:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x146:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096441 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.940054:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/326 (0 0) 00000080:00200000:3.0:1788201589.940061:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x134:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1788201589.940082:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x146:0x0], updating i_size 0 00000080:00200000:3.0:1788201589.940086:0:24460:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x146:0x0](ffff8bc145951148): rc = 0 00000080:00200000:3.0:1788201589.940141:0:24460:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x146:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1788201589.940164:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x146:0x0](ffff8bc145951148) for lock 0xd138388016f6ee5d 00000080:00010000:3.0:1788201589.940174:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x146:0x0](ffff8bc145951148) 00000080:00010000:3.0:1788201589.940178:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ee5d from it ffffadd1c1923df8 00010000:00010000:3.0:1788201589.940181:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x146:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096441 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.940529:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee5d lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x146:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096441 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201589.940624:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348), inode mode 41ed mask 3 00000080:00200000:3.0:1788201589.940633:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=f4, dir=[0x200000bd7:0x134:0x0](ffff8bc145955348) 00010000:00010000:3.0:1788201589.940676:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee5d lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x146:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171096441 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201589.940697:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x146:0x0]: losing layout lock 00010000:00010000:3.0:1788201589.940740:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee5d lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x146:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096441 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201589.940748:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201589.940751:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee5d lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x146:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096441 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:3.0:1788201589.940832:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1788201589.940840:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc151ff4e00 x1875064727921920/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201589.940864:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff4e00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727921920:192.168.201.143@tcp:36:rm.0 00000100:00100000:3.0:1788201589.941009:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201589.953669:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff4e00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727921920:192.168.201.143@tcp:36:rm.0 00000080:00200000:3.0:1788201589.958768:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x146:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201589.958787:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x146:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201589.958838:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x146:0x0](ffff8bc145951148) 00000080:00200000:3.0:1788201589.958950:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348), inode mode 41ed mask 1 00000080:00200000:3.0:1788201589.958974:0:24460:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x134:0x0](ffff8bc145955348), flags=0 00000080:00200000:3.0:1788201589.958981:0:24460:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f1, dir=[0x200000bd7:0x134:0x0](ffff8bc145955348), intent=getattr 00000002:00010000:3.0:1788201589.959007:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f1,[0x0:0x0:0x0]) in obj [0x200000bd7:0x134:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201589.959088:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee64 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x134:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.959102:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee64 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x134:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.959115:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee64 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x134:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201589.959147:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff6300 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727922048:192.168.201.143@tcp:101:rm.0 00000100:00100000:3.0:1788201589.959280:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201589.964445:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff6300 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727922048:192.168.201.143@tcp:101:rm.0 00010000:00010000:3.0:1788201589.964487:0:24460:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee64 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x134:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096479 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.964517:0:24460:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee64 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x143:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096479 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.964526:0:24460:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee64 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x143:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096479 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.964539:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee64 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x143:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096479 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.964551:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee64 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x143:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096479 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.964567:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee64 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x143:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096479 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.964575:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee64 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x143:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096479 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.964583:0:24460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee64 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x143:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096479 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201589.964596:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc151ff6300 x1875064727922048/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201605 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201589.964624:0:24460:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x143:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096479 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.964637:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/323 (0 0) 00000080:00200000:3.0:1788201589.964648:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x134:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1788201589.964679:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x143:0x0], updating i_size 0 00000080:00200000:3.0:1788201589.964682:0:24460:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x143:0x0](ffff8bc145956c08): rc = 0 00000080:00200000:3.0:1788201589.964737:0:24460:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x143:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1788201589.965262:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x143:0x0](ffff8bc145956c08) for lock 0xd138388016f6ee64 00000080:00010000:3.0:1788201589.965278:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x143:0x0](ffff8bc145956c08) 00000080:00010000:3.0:1788201589.965281:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ee64 from it ffffadd1c1923df8 00010000:00010000:3.0:1788201589.965286:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x143:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096479 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201589.965296:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0a00/0xd138388016f6ee64 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x143:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096479 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201589.965335:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348), inode mode 41ed mask 3 00000100:00100000:0.0:1788201590.040005:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1486fa240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201590.052161:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172758a80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727922944:192.168.201.143@tcp:35:rm.0 00000002:00100000:1.0:1788201590.052210:0:24460:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc17275b800 x1875064727920768/t8589937283(8589937283) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201605 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1788201590.052295:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6ecf1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e2171095496 expref: -99 pid: 23736 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201590.052354:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dde00/0xd138388016f6ee48 lrc: 1/0,0 mode: --/CR res: [0x200000bd7:0x134:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e21710963ae expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201590.052363:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6ecf1 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171095496 expref: -99 pid: 23736 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201590.052368:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1788201590.052371:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dde00/0xd138388016f6ee48 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x134:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e21710963ae expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201590.052385:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6ecf1 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x134:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171095496 expref: -99 pid: 23736 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000020:00100000:1.0:1788201590.052407:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201590.052415:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a7480 x1875064727923200/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201590.052451:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a7480 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727923200:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201590.052571:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.057505:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a7480 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727923200:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.057570:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x134:0x0](ffff8bc145955348) 00000080:00200000:0.0:1788201590.057671:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.057685:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-ec.sh, flags=0 00010000:00010000:0.0:1788201590.057709:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7600/0xd138388016f6e9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x11d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094c00 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:0.0:1788201590.057723:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e9f6 from it ffffadd1c1923d78 00010000:00010000:0.0:1788201590.057729:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7600/0xd138388016f6e9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x11d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094c00 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201590.057747:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7600/0xd138388016f6e9f6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x11d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094c00 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.057770:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.057777:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=sanity-ec.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:0.0:1788201590.057906:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7600/0xd138388016f6e9f6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x11d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171094c00 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.057936:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x11d:0x0]: losing layout lock 00010000:00010000:0.0:1788201590.057991:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7600/0xd138388016f6e9f6 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x11d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094c00 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1788201590.057999:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201590.058002:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb7600/0xd138388016f6e9f6 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x11d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094c00 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:0.0:1788201590.058031:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201590.058042:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14416c700 x1875064727923456/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201590.058072:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416c700 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727923456:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201590.058190:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.073234:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416c700 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727923456:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.073356:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x11d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201590.073370:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:0.0:1788201590.073443:0:24460:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 0000000087882e35 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000094b2d07c/0xd138388016f6ea04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094c15 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201590.073514:0:24460:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 0000000087882e35 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000094b2d07c/0xd138388016f6ea04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094c15 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201590.073561:0:24460:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 0000000087882e35 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000094b2d07c/0xd138388016f6ea04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094c15 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201590.073611:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x11d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201590.073861:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x11d:0x0](ffff8bc145953248) 00000008:00010000:0.0:1788201590.073919:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 116978 blocks 1 [cma]time 1788201558 1788201558 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000094b2d07c/0xd138388016f6ea04 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x195:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094c15 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201590.074021:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.074039:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=recovery-scale-lib.sh, flags=0 00010000:00010000:0.0:1788201590.074063:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6e7a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710945f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:0.0:1788201590.074075:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e7a3 from it ffffadd1c1923d78 00010000:00010000:0.0:1788201590.074081:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6e7a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710945f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201590.074106:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6e7a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710945f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.074131:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.074138:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=recovery-scale-lib.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:0.0:1788201590.074192:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6e7a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710945f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.074221:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x10c:0x0]: losing layout lock 00010000:00010000:0.0:1788201590.074278:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6e7a3 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710945f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1788201590.074286:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201590.074289:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6e7a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x10c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710945f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:0.0:1788201590.074315:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201590.074327:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b0380 x1875064727923712/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201590.074354:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b0380 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727923712:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201590.074466:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.088386:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b0380 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727923712:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.088511:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x10c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201590.088524:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201590.088582:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x10c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201590.088667:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x10c:0x0](ffff8bc145934b08) 00000008:00010000:0.0:1788201590.088713:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 6234 blocks 1 [cma]time 1788201557 1788201557 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000acf6f96b/0xd138388016f6e7b1 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109460a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1788201590.088833:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.088848:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=lcov-merge.sh, flags=0 00010000:00010000:0.0:1788201590.088872:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6e3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093b13 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:0.0:1788201590.088884:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e3f2 from it ffffadd1c1923d78 00010000:00010000:0.0:1788201590.088888:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6e3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093b13 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201590.088898:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6e3f2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093b13 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.088921:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.088927:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=lcov-merge.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:0.0:1788201590.088980:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6e3f2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171093b13 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.089008:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0xf1:0x0]: losing layout lock 00010000:00010000:0.0:1788201590.089063:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6e3f2 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171093b13 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1788201590.089071:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201590.089074:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6e3f2 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171093b13 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:0.0:1788201590.089210:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201590.089294:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b3b80 x1875064727923968/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201590.089321:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b3b80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727923968:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201590.089774:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5240 going to sleep for 11 seconds 00010000:00010000:1.0:1788201590.089915:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201590.104283:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b3b80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727923968:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.104393:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201590.104406:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201590.104489:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201590.104575:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0xf1:0x0](ffff8bc145983a88) 00000008:00010000:0.0:1788201590.104625:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 4207 blocks 1 [cma]time 1788201556 1788201556 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000c303a2ad/0xd138388016f6e400 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x17f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093b28 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1788201590.104712:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.104725:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=recovery-oss-scale.sh, flags=0 00010000:00010000:0.0:1788201590.104748:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725600/0xd138388016f6e75d lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x10a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109453f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:0.0:1788201590.104759:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e75d from it ffffadd1c1923d78 00010000:00010000:0.0:1788201590.104763:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725600/0xd138388016f6e75d lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x10a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109453f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201590.104774:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725600/0xd138388016f6e75d lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x10a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109453f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.104852:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.104859:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=recovery-oss-scale.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:0.0:1788201590.104913:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725600/0xd138388016f6e75d lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x10a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e217109453f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.104943:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x10a:0x0]: losing layout lock 00010000:00010000:0.0:1788201590.104999:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725600/0xd138388016f6e75d lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x10a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109453f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1788201590.105007:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201590.105010:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172725600/0xd138388016f6e75d lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x10a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109453f expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:0.0:1788201590.105039:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201590.105051:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b2a00 x1875064727924224/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201590.105078:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b2a00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727924224:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201590.105196:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.110524:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b2a00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727924224:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.110641:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x10a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201590.110654:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201590.110717:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x10a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201590.110786:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x10a:0x0](ffff8bc145986c08) 00000008:00010000:0.0:1788201590.110869:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 1694 blocks 1 [cma]time 1788201557 1788201557 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008332e9f8/0xd138388016f6e76b lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x18c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094554 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1788201590.111020:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.111035:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=setup_kerberos.sh, flags=0 00010000:00010000:0.0:1788201590.111059:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12be00/0xd138388016f6ec49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109520b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:0.0:1788201590.111069:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ec49 from it ffffadd1c1923d78 00010000:00010000:0.0:1788201590.111074:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12be00/0xd138388016f6ec49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109520b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201590.111085:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12be00/0xd138388016f6ec49 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109520b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.111124:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.111131:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=setup_kerberos.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:0.0:1788201590.111184:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12be00/0xd138388016f6ec49 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e217109520b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.111895:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x12e:0x0]: losing layout lock 00010000:00010000:0.0:1788201590.111965:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12be00/0xd138388016f6ec49 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x12e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109520b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1788201590.111974:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201590.111977:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12be00/0xd138388016f6ec49 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x12e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109520b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:0.0:1788201590.112010:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201590.112024:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b1180 x1875064727924480/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201590.112056:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1180 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727924480:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201590.112898:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.123880:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1180 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727924480:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.124031:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x12e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201590.124045:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:0.0:1788201590.124089:0:24460:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000004788e32b ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6ec57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171095220 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201590.124148:0:24460:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000004788e32b ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6ec57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171095220 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201590.124179:0:24460:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000004788e32b ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6ec57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171095220 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201590.124235:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x12e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201590.124332:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x12e:0x0](ffff8bc1459f1148) 00000008:00010000:0.0:1788201590.124375:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 24288 blocks 1 [cma]time 1788201559 1788201559 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6ec57 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x19e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171095220 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201590.124882:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.124910:0:24460:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f0, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=0 00000080:00200000:0.0:1788201590.124916:0:24460:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f0, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00010000:00010000:0.0:1788201590.124939:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6ed6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x138:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710959c1 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1788201590.124956:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed6f from it ffffadd1c1923bd8 00010000:00010000:0.0:1788201590.124961:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6ed6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x138:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710959c1 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201590.124973:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6ed6f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x138:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710959c1 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201590.125000:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.125006:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=f0, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:0.0:1788201590.125063:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6ed6f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x138:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710959c1 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201590.125701:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x138:0x0]: losing layout lock 00010000:00010000:0.0:1788201590.125779:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6ed6f lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x138:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710959c1 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201590.125788:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201590.125837:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6ed6f lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x138:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710959c1 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:0.0:1788201590.125869:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201590.125885:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b1880 x1875064727924736/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201590.125917:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1880 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727924736:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201590.126034:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.130155:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1880 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727924736:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.130266:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x138:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201590.130276:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x138:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201590.130302:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x138:0x0](ffff8bc14465a1c8) 00000080:00200000:0.0:1788201590.130387:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.130402:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=lustre-rsync-test.sh, flags=0 00010000:00010000:0.0:1788201590.130705:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:0.0:1788201590.130721:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e4c4 from it ffffadd1c1923d78 00010000:00010000:0.0:1788201590.130727:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201590.130738:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.130764:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.130770:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=lustre-rsync-test.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:0.0:1788201590.130860:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.130890:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0xf7:0x0]: losing layout lock 00010000:00010000:0.0:1788201590.130945:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1788201590.130953:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201590.130956:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d800/0xd138388016f6e4c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0xf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171093d35 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:0.0:1788201590.130985:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201590.130995:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b0a80 x1875064727924992/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201590.131022:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b0a80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727924992:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201590.131114:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201590.141184:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b0a80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727924992:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201590.141304:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1788201590.141317:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201590.141379:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201590.141495:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0xf7:0x0](ffff8bc1459d1988) 00000008:00010000:1.0:1788201590.141549:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 16105 blocks 1 [cma]time 1788201556 1788201556 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e38d3ff7/0xd138388016f6e4d2 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x182:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093d4a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1788201590.141660:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.141676:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=oos2.sh, flags=0 00010000:00010000:1.0:1788201590.141699:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172735000/0xd138388016f6e573 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xfc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094045 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:1.0:1788201590.141710:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e573 from it ffffadd1c1923d78 00010000:00010000:1.0:1788201590.141715:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172735000/0xd138388016f6e573 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xfc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094045 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.141726:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172735000/0xd138388016f6e573 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xfc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094045 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201590.141750:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201590.141757:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=oos2.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:1.0:1788201590.141842:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172735000/0xd138388016f6e573 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xfc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171094045 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201590.141873:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0xfc:0x0]: losing layout lock 00010000:00010000:1.0:1788201590.141927:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172735000/0xd138388016f6e573 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0xfc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094045 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201590.141936:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201590.141939:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172735000/0xd138388016f6e573 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0xfc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094045 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:1.0:1788201590.141973:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201590.141983:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a5f80 x1875064727925248/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201590.142012:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a5f80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727925248:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201590.142097:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.150392:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a5f80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727925248:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.150526:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xfc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201590.150540:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201590.150599:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xfc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201590.150683:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0xfc:0x0](ffff8bc14592aa08) 00000008:00010000:0.0:1788201590.150737:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 3006 blocks 1 [cma]time 1788201556 1788201556 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ab995f56/0xd138388016f6e581 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x185:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109405a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1788201590.150916:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.150933:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-dom.sh, flags=0 00010000:00010000:0.0:1788201590.150959:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6e00/0xd138388016f6e9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x11c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094ba5 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:0.0:1788201590.150971:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e9d3 from it ffffadd1c1923d78 00010000:00010000:0.0:1788201590.150976:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6e00/0xd138388016f6e9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x11c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094ba5 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201590.150986:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6e00/0xd138388016f6e9d3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x11c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094ba5 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.151015:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.151022:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=sanity-dom.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:0.0:1788201590.151088:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6e00/0xd138388016f6e9d3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x11c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171094ba5 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.151121:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x11c:0x0]: losing layout lock 00010000:00010000:0.0:1788201590.151184:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6e00/0xd138388016f6e9d3 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x11c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094ba5 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1788201590.151191:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201590.151194:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149eb6e00/0xd138388016f6e9d3 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x11c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094ba5 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:0.0:1788201590.151222:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201590.151235:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b2680 x1875064727925504/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201590.151261:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b2680 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727925504:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201590.151360:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.157652:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b2680 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727925504:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.157778:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x11c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201590.157874:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:0.0:1788201590.157925:0:24460:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 0000000014c5a66b ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201590.157965:0:24460:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 0000000014c5a66b ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201590.157995:0:24460:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 0000000014c5a66b ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201590.158042:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x11c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201590.158122:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x11c:0x0](ffff8bc1459863c8) 00000008:00010000:0.0:1788201590.158171:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 6821 blocks 1 [cma]time 1788201558 1788201558 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201590.158258:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.158280:0:24460:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=e2, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=0 00000080:00200000:0.0:1788201590.158286:0:24460:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=e2, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00010000:00010000:0.0:1788201590.158307:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1788201590.158327:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed76 from it ffffadd1c1923900 00010000:00010000:0.0:1788201590.158332:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201590.158344:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200008:0.0:1788201590.158373:0:24460:0:(file.c:6283:ll_getattr_dentry()) START file e2:[0x200000bd7:0x158:0x0](ffff8bc1446be3c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201590.158379:0:24460:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x158:0x0](ffff8bc1446be3c8),name=e2 00000002:00010000:0.0:1788201590.158664:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x158:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201590.158682:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201590.158700:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201590.158712:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201590.158722:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x158:0x0](ffff8bc1446be3c8) 00000080:00010000:0.0:1788201590.158728:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x158:0x0](ffff8bc1446be3c8) for lock 0xd138388016f6ed76 00000080:00010000:0.0:1788201590.158736:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed76 from it ffffadd1c1923cb8 00010000:00010000:0.0:1788201590.158740:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201590.158755:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1788201590.158842:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.158850:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=e2, flags=258 00000080:00200000:0.0:1788201590.158857:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x158:0x0](ffff8bc1446be3c8), inode mode 41ed mask 44 00000080:00200008:0.0:1788201590.158869:0:24460:0:(file.c:1090:ll_file_open()) START file e2:[0x200000bd7:0x158:0x0](ffff8bc1446be3c8), flags 704400 00000002:00010000:0.0:1788201590.158887:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x158:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1788201590.158971:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6ee72 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.158981:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6ee72 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1788201590.159000:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1788201590.159016:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b1f80 x1875064727925760/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1788201590.159027:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6ee72 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201590.159059:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1f80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727925760:192.168.201.143@tcp:101:rm.0 00000100:00100000:0.0:1788201590.159279:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.163039:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1f80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727925760:192.168.201.143@tcp:101:rm.0 00010000:00010000:0.0:1788201590.163082:0:24460:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6ee72 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.163105:0:24460:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6ee72 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.163114:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6ee72 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.163122:0:24460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6ee72 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.163131:0:24460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6ee72 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.163138:0:24460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1727c8200 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201590.163143:0:24460:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6ee72 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.163151:0:24460:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6ee72 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.163158:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6ee72 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x20e400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.163166:0:24460:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201590.163175:0:24460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6ee72 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.163182:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6ee72 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201590.163206:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff8bc1725b1f80 x1875064727925760/t8589937300(8589937300) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201606 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201590.163232:0:24460:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725b1f80 x1875064727925760/t8589937300(8589937300) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201606 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201590.163247:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1788201590.163276:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x158:0x0], updating i_size 7680 00000002:00100000:0.0:1788201590.163297:0:24460:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725b1f80 x1875064727925760/t8589937300(8589937300) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201606 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1788201590.163383:0:24460:0:(file.c:6283:ll_getattr_dentry()) START file e2:[0x200000bd7:0x158:0x0](ffff8bc1446be3c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201590.163393:0:24460:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x158:0x0](ffff8bc1446be3c8),name=e2 00000002:00010000:0.0:1788201590.163418:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x158:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201590.163447:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201590.163462:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1788201590.163471:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201590.163477:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x158:0x0](ffff8bc1446be3c8) 00000080:00010000:0.0:1788201590.163481:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x158:0x0](ffff8bc1446be3c8) for lock 0xd138388016f6ed76 00000080:00010000:0.0:1788201590.163487:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed76 from it ffffadd1c1923cd8 00010000:00010000:0.0:1788201590.163491:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201590.163501:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.163541:0:24460:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200000bd7:0x158:0x0](ffff8bc1446be3c8) pos/size0/7680 32bit_api 0 00000002:00010000:0.0:1788201590.163556:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x158:0x0]) in obj [0x200000bd7:0x158:0x0], intent: readdir flags 0 00010000:00010000:0.0:1788201590.163563:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1788201590.163573:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000100:00100000:0.0:1788201590.164940:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b3480 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727925888:192.168.201.143@tcp:37:rm.0 00000100:00100000:0.0:1788201590.165073:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.185284:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b3480 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727925888:192.168.201.143@tcp:37:rm.0 00010000:00010000:0.0:1788201590.186012:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1788201590.186033:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:0.0:1788201590.186102:0:24460:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200000bd7:0x158:0x0](ffff8bc1446be3c8) pos/size18446744073709551614/7680 32bit_api 0 00000080:00200008:0.0:1788201590.186125:0:24460:0:(file.c:479:ll_file_release()) START file e2:[0x200000bd7:0x158:0x0](ffff8bc1446be3c8), flags 704000 00000002:00100000:0.0:1788201590.186197:0:24460:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1725b1f80 x1875064727925760/t8589937300(8589937300) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201606 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1788201590.186208:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1788201590.186213:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b3480 x1875064727926144/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1788201590.186234:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b3480 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727926144:192.168.201.143@tcp:35:rm.0 00000100:00100000:0.0:1788201590.186351:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.189040:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b3480 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727926144:192.168.201.143@tcp:35:rm.0 00000002:00100000:0.0:1788201590.189085:0:24460:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1725b1f80 x1875064727925760/t8589937300(8589937300) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201606 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201590.189153:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.189165:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=e2, flags=0 00000080:00200000:0.0:1788201590.189171:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.189176:0:24460:0:(namei.c:2328:ll_rmdir()) VFS Op:name=e2, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:0.0:1788201590.189289:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:0.0:1788201590.189446:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:0.0:1788201590.189455:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201590.189458:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6ed76 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x158:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e21710959dd expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000020:00100000:0.0:1788201590.189487:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201590.189494:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b3480 x1875064727926400/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201590.189520:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b3480 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727926400:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201590.189673:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.215038:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b3480 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727926400:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.215105:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x158:0x0](ffff8bc1446be3c8) 00000080:00200000:0.0:1788201590.215187:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.215202:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity.sh, flags=0 00010000:00010000:0.0:1788201590.215224:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:0.0:1788201590.215244:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ebe0 from it ffffadd1c1923d78 00010000:00010000:0.0:1788201590.215249:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201590.215260:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.215285:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.215292:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=sanity.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:0.0:1788201590.215391:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.215443:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x12b:0x0]: losing layout lock 00010000:00010000:0.0:1788201590.215503:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1788201590.215511:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201590.215514:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ebe0 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x12b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710950fa expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:0.0:1788201590.215544:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201590.215555:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b1f80 x1875064727926656/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201590.215581:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1f80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727926656:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201590.215731:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.239221:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1f80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727926656:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.239344:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x12b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201590.239358:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:0.0:1788201590.239403:0:24460:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 0000000081c0d89d ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201590.239486:0:24460:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 0000000081c0d89d ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201590.239535:0:24460:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 0000000081c0d89d ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201590.239579:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x12b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201590.241082:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x12b:0x0](ffff8bc14465ec08) 00000008:00010000:0.0:1788201590.241166:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 1181558 blocks 1 [cma]time 1788201559 1788201559 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201590.241264:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.241279:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=acceptance-small.sh, flags=0 00010000:00010000:0.0:1788201590.241301:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49200/0xd138388016f6e26a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109370e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:0.0:1788201590.241312:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e26a from it ffffadd1c1923d78 00010000:00010000:0.0:1788201590.241317:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49200/0xd138388016f6e26a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109370e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201590.241328:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49200/0xd138388016f6e26a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109370e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.241352:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.241358:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=acceptance-small.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:0.0:1788201590.241408:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49200/0xd138388016f6e26a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e217109370e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.241450:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0xe6:0x0]: losing layout lock 00010000:00010000:0.0:1788201590.241509:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49200/0xd138388016f6e26a lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109370e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1788201590.241517:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201590.241520:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49200/0xd138388016f6e26a lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109370e expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:0.0:1788201590.241551:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201590.241567:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b0700 x1875064727926912/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201590.241598:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b0700 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727926912:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201590.241734:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.250456:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b0700 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727926912:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.250571:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xe6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201590.250585:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201590.250643:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xe6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201590.250710:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0xe6:0x0](ffff8bc1459842c8) 00000008:00010000:0.0:1788201590.250757:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 903 blocks 1 [cma]time 1788201555 1788201555 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008a78353e/0xd138388016f6e278 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x17a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093723 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1788201590.250877:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.250899:0:24460:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f4, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=0 00000080:00200000:0.0:1788201590.250904:0:24460:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f4, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00010000:00010000:0.0:1788201590.250926:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ed84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x13c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095a3f expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1788201590.250942:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed84 from it ffffadd1c1923bd8 00010000:00010000:0.0:1788201590.250947:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ed84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x13c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095a3f expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201590.250960:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ed84 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x13c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095a3f expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201590.250985:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.250991:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=f4, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:0.0:1788201590.251039:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ed84 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x13c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171095a3f expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201590.251065:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x13c:0x0]: losing layout lock 00010000:00010000:0.0:1788201590.251291:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ed84 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x13c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171095a3f expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201590.251300:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201590.251303:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ed84 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x13c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171095a3f expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:0.0:1788201590.251337:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201590.251349:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b2300 x1875064727927168/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201590.251377:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b2300 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727927168:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201590.251538:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.262558:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b2300 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727927168:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.262702:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x13c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201590.262714:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x13c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201590.262744:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x13c:0x0](ffff8bc145951988) 00000080:00200000:0.0:1788201590.262917:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.262936:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=dne_sanity.sh, flags=0 00010000:00010000:0.0:1788201590.262967:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172723000/0xd138388016f6e2da lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xe9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109383b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:0.0:1788201590.262984:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e2da from it ffffadd1c1923d78 00010000:00010000:0.0:1788201590.262990:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172723000/0xd138388016f6e2da lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xe9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109383b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201590.263002:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172723000/0xd138388016f6e2da lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xe9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109383b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.263037:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.263044:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=dne_sanity.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:0.0:1788201590.263123:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172723000/0xd138388016f6e2da lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xe9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e217109383b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.263165:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0xe9:0x0]: losing layout lock 00010000:00010000:0.0:1788201590.263239:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172723000/0xd138388016f6e2da lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0xe9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109383b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1788201590.263250:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201590.263253:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172723000/0xd138388016f6e2da lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0xe9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109383b expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:0.0:1788201590.263291:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201590.263307:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b0e00 x1875064727927424/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201590.263340:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b0e00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727927424:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201590.263476:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.273221:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b0e00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727927424:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.273340:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xe9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201590.273354:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201590.273436:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xe9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201590.273524:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0xe9:0x0](ffff8bc1459821c8) 00000008:00010000:0.0:1788201590.273573:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 1735 blocks 1 [cma]time 1788201555 1788201555 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000042ad0cc8/0xd138388016f6e2e8 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x17b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093850 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1788201590.273664:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.273678:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=oos.sh, flags=0 00010000:00010000:0.0:1788201590.273700:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267fe00/0xd138388016f6e596 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xfd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710940a0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:0.0:1788201590.273718:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e596 from it ffffadd1c1923d78 00010000:00010000:0.0:1788201590.273724:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267fe00/0xd138388016f6e596 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xfd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710940a0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201590.273734:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267fe00/0xd138388016f6e596 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xfd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710940a0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.273761:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.273768:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=oos.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:0.0:1788201590.273908:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267fe00/0xd138388016f6e596 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xfd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710940a0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.273935:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0xfd:0x0]: losing layout lock 00010000:00010000:0.0:1788201590.273990:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267fe00/0xd138388016f6e596 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0xfd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710940a0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1788201590.273998:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201590.274002:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267fe00/0xd138388016f6e596 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0xfd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710940a0 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:0.0:1788201590.274028:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201590.274040:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b2d80 x1875064727927680/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201590.274070:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b2d80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727927680:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201590.274164:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.282768:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b2d80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727927680:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.282909:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xfd:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201590.282922:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201590.282983:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xfd:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201590.283059:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0xfd:0x0](ffff8bc1459363c8) 00000008:00010000:0.0:1788201590.283123:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 2192 blocks 1 [cma]time 1788201556 1788201556 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002cadee1/0xd138388016f6e5a4 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x185:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710940b5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1788201590.283512:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.283686:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=llmount.sh, flags=0 00010000:00010000:1.0:1788201590.283713:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172735200/0xd138388016f6e45b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093c24 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:1.0:1788201590.283725:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e45b from it ffffadd1c1923d78 00010000:00010000:1.0:1788201590.283730:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172735200/0xd138388016f6e45b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093c24 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.283740:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172735200/0xd138388016f6e45b lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093c24 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201590.283766:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201590.283773:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=llmount.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:1.0:1788201590.283881:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172735200/0xd138388016f6e45b lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171093c24 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201590.283909:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0xf4:0x0]: losing layout lock 00010000:00010000:1.0:1788201590.283965:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172735200/0xd138388016f6e45b lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0xf4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171093c24 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201590.283973:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201590.283977:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172735200/0xd138388016f6e45b lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0xf4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171093c24 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:1.0:1788201590.284007:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201590.284021:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a4380 x1875064727927936/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201590.284051:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a4380 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727927936:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201590.284175:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201590.298035:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a4380 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727927936:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201590.298155:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1788201590.298169:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201590.298232:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201590.298302:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0xf4:0x0](ffff8bc14592ec08) 00000008:00010000:1.0:1788201590.298348:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 1754 blocks 1 [cma]time 1788201556 1788201556 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f5d8f02/0xd138388016f6e469 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x181:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093c39 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1788201590.298455:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.298470:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=llmountcleanup.sh, flags=0 00010000:00010000:1.0:1788201590.298491:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734e00/0xd138388016f6e438 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093bc9 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:1.0:1788201590.298504:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e438 from it ffffadd1c1923d78 00010000:00010000:1.0:1788201590.298509:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734e00/0xd138388016f6e438 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093bc9 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.298521:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734e00/0xd138388016f6e438 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093bc9 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201590.298549:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201590.298555:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=llmountcleanup.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:1.0:1788201590.298610:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734e00/0xd138388016f6e438 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171093bc9 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201590.298637:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0xf3:0x0]: losing layout lock 00010000:00010000:1.0:1788201590.298693:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734e00/0xd138388016f6e438 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0xf3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171093bc9 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201590.298702:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201590.298705:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172734e00/0xd138388016f6e438 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0xf3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171093bc9 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:1.0:1788201590.298732:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201590.298743:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a4e00 x1875064727928192/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201590.298769:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a4e00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727928192:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201590.298939:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201590.309747:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a4e00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727928192:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201590.309958:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1788201590.309974:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201590.310036:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201590.310110:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0xf3:0x0](ffff8bc145928908) 00000008:00010000:1.0:1788201590.310160:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 704 blocks 1 [cma]time 1788201556 1788201556 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001c13ee9a/0xd138388016f6e446 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x180:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093bde expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1788201590.310497:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.310516:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-pcc.sh, flags=0 00010000:00010000:1.0:1788201590.310539:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:1.0:1788201590.310551:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eb0e from it ffffadd1c1923d78 00010000:00010000:1.0:1788201590.310555:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.310566:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201590.310591:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201590.310598:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=sanity-pcc.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:1.0:1788201590.310655:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201590.310683:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x125:0x0]: losing layout lock 00010000:00010000:1.0:1788201590.310742:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201590.310751:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201590.310754:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172610a00/0xd138388016f6eb0e lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x125:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094ed8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:1.0:1788201590.310782:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201590.310904:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a7800 x1875064727928448/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201590.310936:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a7800 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727928448:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201590.321827:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201590.331207:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201590.331255:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201590.331276:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201590.331314:0:21781:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201590.331334:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743461632 00000100:00100000:3.0:1788201590.331346:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743461632 00000100:00100000:3.0:1788201590.331396:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743461760 00000100:00100000:3.0:1788201590.331399:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743461760 00000100:00100000:3.0:1788201590.331409:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743461888 00000100:00100000:3.0:1788201590.331411:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743461888 00000100:00100000:3.0:1788201590.331437:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 650 00000100:00100000:3.0:1788201590.331449:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc151ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+6:24638:x1875064743461632:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201590.331475:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000012c9f1c0/0xd138388016f6eab3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094ddc expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201590.331560:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201590.331568:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc151ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+6:24638:x1875064743461632:12345-192.168.201.143@tcp:104: Request processed in 121us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201590.331576:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 650 00000100:00100000:3.0:1788201590.331595:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 651 00000100:00100000:3.0:1788201590.331602:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc151ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+5:23415:x1875064743461760:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201590.331619:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.331649:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788201590.331655:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc151ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+5:23415:x1875064743461760:12345-192.168.201.143@tcp:104: Request processed in 54us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201590.331662:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 651 00000100:00100000:3.0:1788201590.331674:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 652 00000100:00100000:3.0:1788201590.331680:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17257cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23411:x1875064743461888:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201590.331689:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d554d574/0xd138388016f6e4f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093da5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.331714:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788201590.331720:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17257cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23411:x1875064743461888:12345-192.168.201.143@tcp:104: Request processed in 41us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201590.331726:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 652 00010000:00010000:3.0:1788201590.331777:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788201590.331785:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000012c9f1c0/0xd138388016f6eab3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094ddc expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201590.331828:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc16645ca00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201590.331835:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000012c9f1c0/0xd138388016f6eab3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171094ddc expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201590.331938:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000012c9f1c0/0xd138388016f6eab3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094ddc expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201590.331948:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201590.331971:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000012c9f1c0/0xd138388016f6eab3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094ddc expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201590.331980:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000012c9f1c0/0xd138388016f6eab3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094ddc expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201590.332006:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201590.332010:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.332016:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bc800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201590.332020:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.332070:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.332084:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201590.332091:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.332099:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6ec9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710952d6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.332114:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201590.332117:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d554d574/0xd138388016f6e4f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093da5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.332124:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14400c200 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201590.332128:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d554d574/0xd138388016f6e4f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171093da5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.332162:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d554d574/0xd138388016f6e4f5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093da5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.332170:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201590.332185:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d554d574/0xd138388016f6e4f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093da5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.332193:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000d554d574/0xd138388016f6e4f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093da5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.332206:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201590.332209:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201590.332210:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201590.332217:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201590.332225:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201590.332241:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727928832:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201590.332334:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201590.332351:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743462016 00000100:00100000:3.0:1788201590.332355:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743462016 00000100:00100000:3.0:1788201590.332376:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 653 00000100:00100000:3.0:1788201590.332383:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1726cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23392:x1875064743462016:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201590.332392:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6e955 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094a4e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201590.332420:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201590.332440:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1726cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23392:x1875064743462016:12345-192.168.201.143@tcp:104: Request processed in 44us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201590.332446:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 653 00010000:00010000:3.0:1788201590.332460:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201590.332463:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6e955 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094a4e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201590.332471:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14a778600 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201590.332475:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6e955 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171094a4e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201590.332516:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6e955 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094a4e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201590.332530:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201590.332541:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6e955 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094a4e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201590.332549:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6e955 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094a4e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201590.332563:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201590.332565:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201590.332567:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201590.332577:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727928960:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201590.332658:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201590.332672:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743462144 00000100:00100000:3.0:1788201590.332676:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743462144 00000100:00100000:3.0:1788201590.332692:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 654 00000100:00100000:3.0:1788201590.332698:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1726cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21822:x1875064743462144:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201590.332707:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e15b6dd3/0xd138388016f6e351 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093961 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.332733:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201590.332739:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1726cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21822:x1875064743462144:12345-192.168.201.143@tcp:104: Request processed in 41us (82us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201590.332745:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 654 00010000:00010000:3.0:1788201590.332757:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201590.332762:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e15b6dd3/0xd138388016f6e351 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093961 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.332770:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172723600 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201590.332774:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e15b6dd3/0xd138388016f6e351 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171093961 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.332845:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e15b6dd3/0xd138388016f6e351 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093961 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.332854:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201590.332860:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e15b6dd3/0xd138388016f6e351 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093961 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.332868:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e15b6dd3/0xd138388016f6e351 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093961 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.332883:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201590.332885:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201590.332887:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201590.332920:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201590.332933:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743462272 00000100:00100000:3.0:1788201590.332937:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743462272 00000100:00100000:3.0:1788201590.332953:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 655 00000100:00100000:3.0:1788201590.332958:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23390:x1875064743462272:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201590.332967:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e48effa4/0xd138388016f6e423 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093b83 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 1 00010000:00010000:3.0:1788201590.332992:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201590.332999:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23390:x1875064743462272:12345-192.168.201.143@tcp:104: Request processed in 40us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201590.333004:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 655 00010000:00010000:3.0:1788201590.333017:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201590.333020:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e48effa4/0xd138388016f6e423 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093b83 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 1 00010000:00010000:3.0:1788201590.333028:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172735e00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201590.333032:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e48effa4/0xd138388016f6e423 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171093b83 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 1 00010000:00010000:3.0:1788201590.333067:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e48effa4/0xd138388016f6e423 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093b83 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 1 00010000:00010000:3.0:1788201590.333075:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201590.333081:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e48effa4/0xd138388016f6e423 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093b83 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 1 00010000:00010000:3.0:1788201590.333088:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e48effa4/0xd138388016f6e423 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093b83 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 1 00010000:00010000:3.0:1788201590.333103:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201590.333105:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201590.333107:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201590.333141:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201590.333155:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743462400 00000100:00100000:3.0:1788201590.333158:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743462400 00000100:00100000:3.0:1788201590.333176:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 656 00000100:00100000:3.0:1788201590.333182:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23389:x1875064743462400:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201590.333189:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005030058d/0xd138388016f6e30b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710938ab expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.333214:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201590.333219:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23389:x1875064743462400:12345-192.168.201.143@tcp:104: Request processed in 37us (79us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201590.333224:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 656 00010000:00010000:3.0:1788201590.333237:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201590.333240:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005030058d/0xd138388016f6e30b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710938ab expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.333247:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172722400 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201590.333251:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005030058d/0xd138388016f6e30b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e21710938ab expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.333285:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005030058d/0xd138388016f6e30b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710938ab expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.333292:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201590.333302:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005030058d/0xd138388016f6e30b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710938ab expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.333309:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005030058d/0xd138388016f6e30b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710938ab expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.333322:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201590.333325:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201590.333326:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201590.333334:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201590.333344:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727929344:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201590.333406:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201590.333421:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743462528 00000100:00100000:3.0:1788201590.333437:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743462528 00000100:00100000:3.0:1788201590.333454:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 657 00000100:00100000:3.0:1788201590.333460:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23413:x1875064743462528:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201590.333468:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a3ce3255/0xd138388016f6e699 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094332 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201590.333494:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201590.333499:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23413:x1875064743462528:12345-192.168.201.143@tcp:104: Request processed in 40us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201590.333505:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 657 00010000:00010000:3.0:1788201590.333517:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201590.333521:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a3ce3255/0xd138388016f6e699 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094332 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201590.333528:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172724400 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201590.333532:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a3ce3255/0xd138388016f6e699 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171094332 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201590.333565:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a3ce3255/0xd138388016f6e699 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094332 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201590.333572:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201590.333582:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a3ce3255/0xd138388016f6e699 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094332 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201590.333589:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a3ce3255/0xd138388016f6e699 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094332 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201590.333603:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201590.333605:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201590.333607:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201590.333617:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727929472:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201590.333678:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201590.333692:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743463680 00000100:00100000:3.0:1788201590.333695:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743463680 00000100:00100000:3.0:1788201590.333711:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 658 00000100:00100000:3.0:1788201590.333717:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23408:x1875064743463680:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201590.333727:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201590.333752:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201590.333757:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23408:x1875064743463680:12345-192.168.201.143@tcp:104: Request processed in 40us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201590.333763:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 658 00010000:00010000:3.0:1788201590.333775:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201590.333779:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201590.333786:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc15c12b400 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201590.333816:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201590.333860:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201590.333868:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201590.333873:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201590.333881:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e2fdf0d9/0xd138388016f6ec7a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109527b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201590.333897:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201590.333899:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201590.333900:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201590.333936:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201590.333963:0:21781:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201590.333973:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743463808 00000100:00100000:3.0:1788201590.333977:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743463808 00000100:00100000:3.0:1788201590.333992:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 659 00000100:00100000:3.0:1788201590.333998:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc150470850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:24636:x1875064743463808:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201590.334007:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6e7d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094665 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201590.334034:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201590.334039:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc150470850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:24636:x1875064743463808:12345-192.168.201.143@tcp:104: Request processed in 41us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201590.334049:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 659 00010000:00010000:3.0:1788201590.334075:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201590.334079:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6e7d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094665 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201590.334087:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1727c9a00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201590.334091:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6e7d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171094665 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201590.334128:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6e7d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094665 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201590.334136:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201590.334141:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6e7d4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094665 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201590.334149:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6e7d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094665 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201590.334163:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201590.334165:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201590.334167:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201590.334199:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201590.334213:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743463936 00000100:00100000:3.0:1788201590.334217:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743463936 00000100:00100000:3.0:1788201590.334234:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 660 00000100:00100000:3.0:1788201590.334240:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21821:x1875064743463936:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201590.334250:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aa9ac74c/0xd138388016f6e702 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094443 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.334276:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201590.334281:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21821:x1875064743463936:12345-192.168.201.143@tcp:104: Request processed in 41us (82us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201590.334287:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 660 00010000:00010000:3.0:1788201590.334299:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201590.334303:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aa9ac74c/0xd138388016f6e702 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094443 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.334312:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14400dc00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201590.334316:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aa9ac74c/0xd138388016f6e702 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171094443 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.334355:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aa9ac74c/0xd138388016f6e702 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094443 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.334363:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201590.334373:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aa9ac74c/0xd138388016f6e702 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094443 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.334381:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aa9ac74c/0xd138388016f6e702 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094443 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.334395:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201590.334397:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201590.334399:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201590.334408:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201590.334417:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727929856:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201590.334526:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201590.334542:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727928704:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.334583:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727929216:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.334601:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727929728:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.334623:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788201590.334629:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc151ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727928576:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.334647:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727929088:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.334662:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727929600:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201590.337083:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201590.341070:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:1.0:1788201590.341508:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201590.341518:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004b4e8b7f/0xd138388016f6eba8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171095059 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.341528:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc16645c200 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201590.341535:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004b4e8b7f/0xd138388016f6eba8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171095059 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.341650:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004b4e8b7f/0xd138388016f6eba8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171095059 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.341665:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201590.341699:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004b4e8b7f/0xd138388016f6eba8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171095059 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.341709:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004b4e8b7f/0xd138388016f6eba8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171095059 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.341736:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201590.341747:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201590.341749:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201590.341766:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201590.341783:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727930112:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.345041:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743464320 00000100:00100000:1.0:1788201590.345054:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743464320 00000100:00100000:1.0:1788201590.345106:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743464576 00000100:00100000:1.0:1788201590.345110:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743464576 00000100:00100000:1.0:1788201590.345120:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743464448 00000100:00100000:1.0:1788201590.345123:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743464448 00000100:00100000:1.0:1788201590.345138:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 663 00000100:00100000:1.0:1788201590.345150:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172759500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+6:23394:x1875064743464320:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201590.345175:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d8911af5/0xd138388016f6e78e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710945af expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.345284:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201590.345291:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172759500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+6:23394:x1875064743464320:12345-192.168.201.143@tcp:104: Request processed in 144us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201590.345299:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 663 00000100:00100000:1.0:1788201590.345323:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 664 00000100:00100000:1.0:1788201590.345329:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17275a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+5:23417:x1875064743464576:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201590.345339:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000af56bec5/0xd138388016f6e518 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093e70 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.345368:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788201590.345374:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17275a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+5:23417:x1875064743464576:12345-192.168.201.143@tcp:104: Request processed in 45us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201590.345380:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 664 00000100:00100000:1.0:1788201590.345392:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 665 00000100:00100000:1.0:1788201590.345398:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172758000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23416:x1875064743464448:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201590.345406:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.345444:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788201590.345450:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172758000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23416:x1875064743464448:12345-192.168.201.143@tcp:104: Request processed in 52us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201590.345457:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 665 00010000:00010000:1.0:1788201590.345476:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201590.345484:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d8911af5/0xd138388016f6e78e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710945af expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.345493:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172610400 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201590.345499:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d8911af5/0xd138388016f6e78e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e21710945af expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.345605:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d8911af5/0xd138388016f6e78e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710945af expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.345614:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201590.345638:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d8911af5/0xd138388016f6e78e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710945af expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.345648:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d8911af5/0xd138388016f6e78e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710945af expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.345674:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201590.345678:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000af56bec5/0xd138388016f6e518 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093e70 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.345684:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172735800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201590.345687:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000af56bec5/0xd138388016f6e518 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171093e70 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.345722:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000af56bec5/0xd138388016f6e518 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093e70 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.345730:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201590.345747:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000af56bec5/0xd138388016f6e518 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093e70 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.345756:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000af56bec5/0xd138388016f6e518 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093e70 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.345771:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201590.345774:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.345781:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149eb6000 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201590.345784:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.345843:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.345851:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201590.345857:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.345866:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001d3ca5f1/0xd138388016f6e978 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094aa9 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.345881:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201590.345882:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201590.345884:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201590.345906:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727930496:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.345979:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201590.345986:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727930368:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.346020:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727930240:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201590.346055:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201590.350558:0:24460:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8bc143fc0000: committing for last_committed 8589937302 gen 1 00000100:00100000:1.0:1788201590.350586:0:24460:0:(client.c:3161:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8bc1726cf800 x1875064727891072/t8589937184(8589937184) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201604 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201590.350928:0:24460:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8bc1725b1f80 x1875064727926656/t8589937303(8589937303) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/456 e 0 to 0 dl 1788201606 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201590.350942:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a7800 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727928448:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201590.351051:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x125:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1788201590.351066:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:1.0:1788201590.351114:0:24460:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000f57833e2 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094eed expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201590.351205:0:24460:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000f57833e2 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094eed expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201590.351272:0:24460:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000f57833e2 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094eed expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201590.351319:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x125:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201590.351597:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x125:0x0](ffff8bc1459d7448) 00000008:00010000:1.0:1788201590.351645:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 159678 blocks 1 [cma]time 1788201559 1788201559 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x199:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094eed expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201590.351734:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.351748:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-pfl.sh, flags=0 00010000:00010000:1.0:1788201590.351771:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645c600/0xd138388016f6eb31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x126:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094f33 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:1.0:1788201590.351781:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eb31 from it ffffadd1c1923d78 00010000:00010000:1.0:1788201590.351785:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645c600/0xd138388016f6eb31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x126:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094f33 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.351835:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645c600/0xd138388016f6eb31 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x126:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094f33 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201590.351860:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201590.351866:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=sanity-pfl.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:1.0:1788201590.351919:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645c600/0xd138388016f6eb31 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x126:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171094f33 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201590.351947:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x126:0x0]: losing layout lock 00010000:00010000:1.0:1788201590.352002:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645c600/0xd138388016f6eb31 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x126:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094f33 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201590.352012:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201590.352016:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc16645c600/0xd138388016f6eb31 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x126:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094f33 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:1.0:1788201590.352045:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201590.352056:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a5f80 x1875064727930752/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201590.352083:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a5f80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727930752:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201590.352168:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.361509:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201590.361670:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727929472:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.361685:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727929344:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.361694:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727928960:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.361703:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727928832:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201590.361871:0:20877:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201590.361908:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743464832 00000100:00100000:3.0:1788201590.361918:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743464832 00000100:00100000:3.0:1788201590.361991:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 666 00000100:00100000:3.0:1788201590.362002:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172657c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23407:x1875064743464832:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201590.362027:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e1840c2c/0xd138388016f6e2c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710937f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201590.362117:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201590.362124:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172657c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23407:x1875064743464832:12345-192.168.201.143@tcp:104: Request processed in 124us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201590.362132:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 666 00010000:00010000:1.0:1788201590.362520:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201590.362530:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e1840c2c/0xd138388016f6e2c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710937f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.362542:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc143a49800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201590.362550:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e1840c2c/0xd138388016f6e2c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e21710937f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.362657:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e1840c2c/0xd138388016f6e2c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710937f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.362666:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201590.362703:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e1840c2c/0xd138388016f6e2c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710937f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.362713:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e1840c2c/0xd138388016f6e2c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710937f5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.362737:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201590.362749:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201590.362751:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201590.362766:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201590.362784:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727930880:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201590.363439:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743465088 00000100:00100000:0.0:1788201590.363451:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743465088 00000100:00100000:0.0:1788201590.363512:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 667 00000100:00100000:0.0:1788201590.363523:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17275b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23131:x1875064743465088:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201590.363541:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fe41aa0d/0xd138388016f6e725 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109449e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 1 00010000:00010000:0.0:1788201590.363618:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201590.363625:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17275b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23131:x1875064743465088:12345-192.168.201.143@tcp:104: Request processed in 105us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201590.363631:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 667 00010000:00010000:0.0:1788201590.363654:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201590.363660:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fe41aa0d/0xd138388016f6e725 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109449e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 1 00010000:00010000:0.0:1788201590.363674:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172725200 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201590.363681:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fe41aa0d/0xd138388016f6e725 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e217109449e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 1 00010000:00010000:0.0:1788201590.363768:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fe41aa0d/0xd138388016f6e725 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109449e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 1 00010000:00010000:0.0:1788201590.363777:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201590.363819:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fe41aa0d/0xd138388016f6e725 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109449e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 1 00010000:00010000:0.0:1788201590.363829:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fe41aa0d/0xd138388016f6e725 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109449e expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 1 00010000:00010000:0.0:1788201590.363851:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201590.363853:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201590.363855:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201590.374518:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201590.374554:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743465472 00000100:00100000:0.0:1788201590.374564:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743465472 00000100:00100000:0.0:1788201590.374634:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 668 00000100:00100000:0.0:1788201590.374644:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23391:x1875064743465472:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201590.374667:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a20b739c/0xd138388016f6e7f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710946c0 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201590.374742:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201590.374748:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23391:x1875064743465472:12345-192.168.201.143@tcp:104: Request processed in 106us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201590.374756:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 668 00000100:00100000:1.0:1788201590.375594:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727930240:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.375617:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727930112:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.375627:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727928576:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.375636:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727929088:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.375645:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727929600:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.375654:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc151ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727928704:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.375661:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727929216:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.375669:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727929728:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201590.376067:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727930368:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201590.376078:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727930496:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201590.376089:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727929856:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201590.381358:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201590.381399:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201590.381444:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201590.382914:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727930880:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.388703:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a5f80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727930752:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201590.388875:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x126:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1788201590.388888:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:1.0:1788201590.388932:0:24460:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000ac77a73d ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000aeeedc3c/0xd138388016f6eb3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094f48 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201590.388987:0:24460:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000ac77a73d ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000aeeedc3c/0xd138388016f6eb3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094f48 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201590.389033:0:24460:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000ac77a73d ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000aeeedc3c/0xd138388016f6eb3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094f48 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201590.389084:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x126:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201590.389251:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x126:0x0](ffff8bc1459f1988) 00000008:00010000:1.0:1788201590.389298:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 88087 blocks 1 [cma]time 1788201559 1788201559 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000aeeedc3c/0xd138388016f6eb3f lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x19a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094f48 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201590.389382:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.389395:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=large-scale.sh, flags=0 00010000:00010000:1.0:1788201590.389418:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267e200/0xd138388016f6e3cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093ab8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:1.0:1788201590.389444:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e3cf from it ffffadd1c1923d78 00010000:00010000:1.0:1788201590.389449:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267e200/0xd138388016f6e3cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xf0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171093ab8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.389460:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267e200/0xd138388016f6e3cf lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171093ab8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201590.389485:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201590.389491:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=large-scale.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:1.0:1788201590.389545:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267e200/0xd138388016f6e3cf lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xf0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171093ab8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201590.389577:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0xf0:0x0]: losing layout lock 00010000:00010000:1.0:1788201590.389632:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267e200/0xd138388016f6e3cf lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0xf0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171093ab8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201590.389640:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201590.389643:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17267e200/0xd138388016f6e3cf lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0xf0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171093ab8 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:1.0:1788201590.389671:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201590.389684:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a7480 x1875064727931776/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201590.389711:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a7480 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727931776:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201590.389908:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201590.390408:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727931136:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.397251:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727931264:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201590.397470:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201590.397478:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000011373b93/0xd138388016f6e653 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109427c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201590.397492:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172724e00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201590.397499:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000011373b93/0xd138388016f6e653 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e217109427c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201590.397597:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000011373b93/0xd138388016f6e653 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109427c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201590.397616:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201590.397644:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000011373b93/0xd138388016f6e653 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109427c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201590.397653:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000011373b93/0xd138388016f6e653 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109427c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201590.397677:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201590.397679:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201590.397681:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201590.397713:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727931520:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201590.397724:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727931392:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.398873:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727931904:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.398984:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201590.398991:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17275b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727932032:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201590.407242:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201590.407285:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201590.407315:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201590.407344:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201590.407628:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743467392 00000100:00100000:1.0:1788201590.407640:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743467392 00000100:00100000:1.0:1788201590.407691:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743467520 00000100:00100000:1.0:1788201590.407694:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743467520 00000100:00100000:1.0:1788201590.407705:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743467776 00000100:00100000:1.0:1788201590.407707:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743467776 00000100:00100000:1.0:1788201590.407717:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743467904 00000100:00100000:1.0:1788201590.407720:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743467904 00000100:00100000:1.0:1788201590.407737:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 674 00000100:00100000:1.0:1788201590.407760:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+6:23390:x1875064743467392:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201590.407786:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.407941:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201590.407949:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+6:23390:x1875064743467392:12345-192.168.201.143@tcp:104: Request processed in 191us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201590.407956:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 674 00000100:00100000:1.0:1788201590.407977:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 675 00000100:00100000:1.0:1788201590.407984:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+5:24636:x1875064743467520:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201590.407993:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017a4a5c3/0xd138388016f6e5ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109416b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.408023:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788201590.408029:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+5:24636:x1875064743467520:12345-192.168.201.143@tcp:104: Request processed in 46us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201590.408035:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 675 00000100:00100000:1.0:1788201590.408050:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 676 00000100:00100000:1.0:1788201590.408056:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23392:x1875064743467776:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201590.408065:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006b86fbe8/0xd138388016f6e4af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093cef expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.408094:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788201590.408100:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23392:x1875064743467776:12345-192.168.201.143@tcp:104: Request processed in 44us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201590.408109:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 676 00000100:00100000:1.0:1788201590.408121:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 677 00000100:00100000:1.0:1788201590.408127:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23413:x1875064743467904:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201590.408134:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000029fa8324/0xd138388016f6e676 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710942d7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.408157:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788201590.408162:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23413:x1875064743467904:12345-192.168.201.143@tcp:104: Request processed in 36us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201590.408168:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 677 00010000:00010000:1.0:1788201590.408188:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788201590.408195:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.408205:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc143a48a00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201590.408213:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.408311:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.408320:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201590.408346:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.408355:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6ead6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094e37 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.408381:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201590.408385:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017a4a5c3/0xd138388016f6e5ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109416b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.408393:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172722e00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201590.408397:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017a4a5c3/0xd138388016f6e5ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e217109416b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.408444:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017a4a5c3/0xd138388016f6e5ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109416b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.408451:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201590.408457:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017a4a5c3/0xd138388016f6e5ea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109416b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.408465:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000017a4a5c3/0xd138388016f6e5ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109416b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.408478:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201590.408482:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006b86fbe8/0xd138388016f6e4af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093cef expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.408488:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17267f800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201590.408491:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006b86fbe8/0xd138388016f6e4af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171093cef expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.408534:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006b86fbe8/0xd138388016f6e4af lrc: 2/0,0 mode: --/PW res: [0x280000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093cef expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.408542:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201590.408553:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006b86fbe8/0xd138388016f6e4af lrc: 1/0,0 mode: --/PW res: [0x280000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093cef expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.408561:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006b86fbe8/0xd138388016f6e4af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093cef expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.408575:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201590.408579:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000029fa8324/0xd138388016f6e676 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710942d7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.408585:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172610200 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201590.408588:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000029fa8324/0xd138388016f6e676 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e21710942d7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.408620:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000029fa8324/0xd138388016f6e676 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710942d7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.408627:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201590.408633:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000029fa8324/0xd138388016f6e676 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710942d7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.408641:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000029fa8324/0xd138388016f6e676 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710942d7 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.408656:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201590.408657:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201590.408659:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201590.408680:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727932288:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.408753:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201590.408761:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727932160:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.408835:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727932416:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.408894:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727932032:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.408907:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727931904:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.408927:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201590.408933:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727932544:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.408983:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a7480 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727931776:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201590.409051:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xf0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1788201590.409063:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201590.409119:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xf0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201590.409196:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0xf0:0x0](ffff8bc1459300c8) 00000008:00010000:1.0:1788201590.409241:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 2659 blocks 1 [cma]time 1788201556 1788201556 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000052b7c868/0xd138388016f6e3dd lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x17f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171093acd expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1788201590.409330:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.409341:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d2, flags=0 00010000:00010000:1.0:1788201590.409358:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1788201590.409371:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed8b from it ffffadd1c1923af8 00010000:00010000:1.0:1788201590.409376:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201590.409387:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200008:1.0:1788201590.409411:0:24460:0:(file.c:6283:ll_getattr_dentry()) START file d2:[0x200000bd7:0x135:0x0](ffff8bc145955b88), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201590.409418:0:24460:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88),name=d2 00000002:00010000:1.0:1788201590.409472:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x135:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201590.409485:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.409497:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201590.409505:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201590.409513:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x135:0x0](ffff8bc145955b88) 00000080:00010000:1.0:1788201590.409517:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x135:0x0](ffff8bc145955b88) for lock 0xd138388016f6ed8b 00000080:00010000:1.0:1788201590.409522:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed8b from it ffffadd1c1923cb8 00010000:00010000:1.0:1788201590.409526:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.409534:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1788201590.409580:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.409586:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d2, flags=258 00000080:00200000:1.0:1788201590.409591:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 44 00000080:00200008:1.0:1788201590.409600:0:24460:0:(file.c:1090:ll_file_open()) START file d2:[0x200000bd7:0x135:0x0](ffff8bc145955b88), flags 704400 00000002:00010000:1.0:1788201590.409614:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x135:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1788201590.409659:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee79 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.409668:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee79 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201590.409682:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201590.409691:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a7100 x1875064727932800/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201590.409703:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee79 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201590.409720:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a7100 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727932800:192.168.201.143@tcp:101:rm.0 00000100:00100000:1.0:1788201590.409874:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8000 going to sleep for 11 seconds 00010000:00010000:3.0:1788201590.410332:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201590.410679:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201590.410780:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201590.416386:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a7100 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727932800:192.168.201.143@tcp:101:rm.0 00010000:00010000:1.0:1788201590.416418:0:24460:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee79 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.416448:0:24460:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee79 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.416455:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee79 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.416463:0:24460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee79 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.416473:0:24460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee79 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.416480:0:24460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bdc00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201590.416485:0:24460:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee79 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.416494:0:24460:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee79 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.416502:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee79 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x20e400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.416510:0:24460:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201590.416518:0:24460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee79 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.416525:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bdc00/0xd138388016f6ee79 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201590.416547:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff8bc1724a7100 x1875064727932800/t8589937313(8589937313) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201606 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201590.416562:0:24460:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a7100 x1875064727932800/t8589937313(8589937313) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201606 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201590.416576:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1788201590.416616:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x135:0x0], updating i_size 7680 00000002:00100000:1.0:1788201590.416641:0:24460:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a7100 x1875064727932800/t8589937313(8589937313) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201606 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1788201590.416723:0:24460:0:(file.c:6283:ll_getattr_dentry()) START file d2:[0x200000bd7:0x135:0x0](ffff8bc145955b88), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201590.416731:0:24460:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88),name=d2 00000002:00010000:1.0:1788201590.416931:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x135:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201590.416950:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.416965:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1788201590.416975:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201590.416981:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x135:0x0](ffff8bc145955b88) 00000080:00010000:1.0:1788201590.416986:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x135:0x0](ffff8bc145955b88) for lock 0xd138388016f6ed8b 00000080:00010000:1.0:1788201590.416992:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed8b from it ffffadd1c1923cd8 00010000:00010000:1.0:1788201590.416996:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.417006:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201590.417045:0:24460:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88) pos/size0/7680 32bit_api 0 00000002:00010000:1.0:1788201590.417060:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x135:0x0]) in obj [0x200000bd7:0x135:0x0], intent: readdir flags 0 00010000:00010000:1.0:1788201590.417066:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201590.417075:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000100:00100000:3.0:1788201590.418537:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727932544:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201590.418551:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727932416:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.420661:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a5880 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727933184:192.168.201.143@tcp:37:rm.0 00000100:00100000:1.0:1788201590.420787:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.431949:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201590.432611:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201590.432747:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201590.432766:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201590.432777:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201590.432824:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201590.434370:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727933440:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201590.434402:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172759880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727933952:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201590.434435:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788201590.434442:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727933312:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201590.434462:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727933824:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201590.438589:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727933440:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201590.438601:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172759880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727933952:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201590.443073:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727933312:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201590.443106:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727933824:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201590.448695:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:1.0:1788201590.450886:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201590.450897:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000dbcdbffe/0xd138388016f6e55e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093fff expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.450911:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172735400 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201590.450918:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000dbcdbffe/0xd138388016f6e55e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171093fff expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.451027:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000dbcdbffe/0xd138388016f6e55e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093fff expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.451036:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201590.451074:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000dbcdbffe/0xd138388016f6e55e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093fff expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.451083:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000dbcdbffe/0xd138388016f6e55e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093fff expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.451127:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201590.451129:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201590.451131:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201590.451374:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201590.451397:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727934080:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201590.462082:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727934080:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.463945:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a5880 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727933184:192.168.201.143@tcp:37:rm.0 00010000:00010000:1.0:1788201590.464680:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201590.464700:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200008:1.0:1788201590.464847:0:24460:0:(file.c:479:ll_file_release()) START file d2:[0x200000bd7:0x135:0x0](ffff8bc145955b88), flags 704000 00000002:00100000:1.0:1788201590.464931:0:24460:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1724a7100 x1875064727932800/t8589937313(8589937313) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201606 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201590.464945:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201590.464952:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a5880 x1875064727934336/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201590.464978:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a5880 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727934336:192.168.201.143@tcp:35:rm.0 00000100:00100000:1.0:1788201590.465098:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201590.475470:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a5880 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727934336:192.168.201.143@tcp:35:rm.0 00000002:00100000:1.0:1788201590.475519:0:24460:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1724a7100 x1875064727932800/t8589937313(8589937313) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201606 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201590.475626:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.475638:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d2, flags=258 00000080:00200000:1.0:1788201590.475649:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 44 00000080:00200008:1.0:1788201590.475660:0:24460:0:(file.c:1090:ll_file_open()) START file d2:[0x200000bd7:0x135:0x0](ffff8bc145955b88), flags 704400 00000002:00010000:1.0:1788201590.475687:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x135:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open flags 0104240704401 00010000:00010000:0.0:1788201590.476366:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6ee80 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.476381:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6ee80 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1788201590.476397:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1788201590.476406:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a5880 x1875064727934592/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1788201590.476417:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6ee80 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201590.476455:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a5880 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727934592:192.168.201.143@tcp:101:rm.0 00000100:00100000:0.0:1788201590.476667:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.481000:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a5880 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727934592:192.168.201.143@tcp:101:rm.0 00010000:00010000:0.0:1788201590.481043:0:24460:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6ee80 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096838 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.481057:0:24460:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6ee80 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096838 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.481072:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6ee80 lrc: 4/1,0 mode: CR/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096838 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.481085:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6ee80 lrc: 4/1,0 mode: CR/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096838 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201590.481115:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff8bc1724a5880 x1875064727934592/t8589937315(8589937315) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201606 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201590.481138:0:24460:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a5880 x1875064727934592/t8589937315(8589937315) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201606 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201590.481151:0:24460:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6ee80 lrc: 3/1,0 mode: CR/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096838 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.481163:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 16 res 8589937623/309 (0 0) 00000080:00200000:0.0:1788201590.481171:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1788201590.481198:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x135:0x0], updating i_size 7680 00000080:00010000:0.0:1788201590.481203:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x135:0x0](ffff8bc145955b88) for lock 0xd138388016f6ee80 00000080:00010000:0.0:1788201590.481488:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ee80 from it ffffadd1c1923bd0 00010000:00010000:0.0:1788201590.481494:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6ee80 lrc: 3/1,0 mode: CR/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096838 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.481507:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6ee80 lrc: 2/0,0 mode: CR/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096838 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00100000:0.0:1788201590.481543:0:24460:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a5880 x1875064727934592/t8589937315(8589937315) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201606 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1788201590.481690:0:24460:0:(file.c:6283:ll_getattr_dentry()) START file d2:[0x200000bd7:0x135:0x0](ffff8bc145955b88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201590.481698:0:24460:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88),name=d2 00000002:00010000:0.0:1788201590.481722:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x135:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201590.481736:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:0.0:1788201590.481762:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:0.0:1788201590.481770:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201590.481776:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x135:0x0](ffff8bc145955b88) 00000080:00010000:0.0:1788201590.481780:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x135:0x0](ffff8bc145955b88) for lock 0xd138388016f6ed8b 00000080:00010000:0.0:1788201590.481784:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ed8b from it ffffadd1c1923cd8 00010000:00010000:0.0:1788201590.481788:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:0.0:1788201590.481927:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 1 00000080:00200000:0.0:1788201590.481970:0:24460:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88) pos/size0/7680 32bit_api 0 00000080:00200000:0.0:1788201590.482005:0:24460:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88) pos/size18446744073709551614/7680 32bit_api 0 00000080:00200000:0.0:1788201590.482567:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.482590:0:24460:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88), flags=0 00000080:00200000:0.0:1788201590.482596:0:24460:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f1, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88), intent=getattr 00000002:00010000:0.0:1788201590.482677:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f1,[0x0:0x0:0x0]) in obj [0x200000bd7:0x135:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201590.482731:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee87 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.482860:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee87 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.482874:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee87 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201590.482902:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b2a00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727934720:192.168.201.143@tcp:101:rm.0 00000100:00100000:0.0:1788201590.483055:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.490318:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b2a00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727934720:192.168.201.143@tcp:101:rm.0 00010000:00010000:0.0:1788201590.490402:0:24460:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee87 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109685b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.490441:0:24460:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee87 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x148:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109685b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.490451:0:24460:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee87 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109685b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.490464:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee87 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109685b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.490476:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee87 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109685b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.490493:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee87 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109685b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.490502:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee87 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109685b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.490511:0:24460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee87 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109685b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201590.490525:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc1725b2a00 x1875064727934720/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201606 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201590.490540:0:24460:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109685b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.490553:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/328 (0 0) 00000080:00200000:0.0:1788201590.490875:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x135:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201590.490903:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x148:0x0], updating i_size 0 00000080:00200000:0.0:1788201590.490907:0:24460:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x148:0x0](ffff8bc1446bd348): rc = 0 00000080:00200000:0.0:1788201590.490961:0:24460:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x148:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1788201590.490983:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x148:0x0](ffff8bc1446bd348) for lock 0xd138388016f6ee87 00000080:00010000:0.0:1788201590.490995:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x148:0x0](ffff8bc1446bd348) 00000080:00010000:0.0:1788201590.490999:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ee87 from it ffffadd1c1923df8 00010000:00010000:0.0:1788201590.491003:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109685b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.491013:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee87 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109685b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201590.491053:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.491065:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=f1, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88) 00010000:00010000:0.0:1788201590.491163:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 1 00010000:00010000:0.0:1788201590.491188:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6ecf8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710954f8 expref: -99 pid: 23737 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201590.491319:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee87 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e217109685b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201590.491342:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x148:0x0]: losing layout lock 00010000:00010000:0.0:1788201590.491498:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee87 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109685b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201590.491507:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 1 00010000:00010000:0.0:1788201590.491513:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1788201590.491516:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee87 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109685b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201590.491531:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd800/0xd138388016f6ed8b lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171095a5b expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 1 00000020:00100000:0.0:1788201590.491547:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201590.491556:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b2a00 x1875064727934976/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201590.491582:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b2a00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727934976:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201590.493766:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.501918:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b2a00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727934976:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.502032:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x148:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201590.502044:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x148:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201590.502069:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x148:0x0](ffff8bc1446bd348) 00000080:00200000:0.0:1788201590.502170:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.502194:0:24460:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f2, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88), flags=0 00000080:00200000:0.0:1788201590.502200:0:24460:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f2, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88), intent=getattr 00000002:00010000:0.0:1788201590.502226:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f2,[0x0:0x0:0x0]) in obj [0x200000bd7:0x135:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201590.502293:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee8e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.502310:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee8e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.502323:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee8e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201590.502347:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b3b80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727935104:192.168.201.143@tcp:101:rm.0 00000100:00100000:0.0:1788201590.502433:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.505128:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b3b80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727935104:192.168.201.143@tcp:101:rm.0 00010000:00010000:0.0:1788201590.505161:0:24460:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee8e lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096893 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.505186:0:24460:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee8e lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x149:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096893 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.505196:0:24460:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee8e lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096893 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.505210:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee8e lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096893 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.505224:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee8e lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096893 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.505240:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee8e lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096893 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.505255:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee8e lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096893 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.505264:0:24460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee8e lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096893 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201590.505279:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc1725b3b80 x1875064727935104/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201606 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201590.505295:0:24460:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096893 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.505307:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/329 (0 0) 00000080:00200000:0.0:1788201590.505315:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x135:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201590.505343:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x149:0x0], updating i_size 0 00000080:00200000:0.0:1788201590.505346:0:24460:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x149:0x0](ffff8bc1446baa08): rc = 0 00000080:00200000:0.0:1788201590.505400:0:24460:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x149:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1788201590.505433:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x149:0x0](ffff8bc1446baa08) for lock 0xd138388016f6ee8e 00000080:00010000:0.0:1788201590.505447:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x149:0x0](ffff8bc1446baa08) 00000080:00010000:0.0:1788201590.505451:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ee8e from it ffffadd1c1923df8 00010000:00010000:0.0:1788201590.505455:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096893 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.505465:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee8e lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096893 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201590.505505:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.505515:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=f2, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88) 00010000:00010000:0.0:1788201590.505564:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee8e lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171096893 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201590.505588:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x149:0x0]: losing layout lock 00010000:00010000:0.0:1788201590.505911:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee8e lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096893 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201590.505921:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201590.505924:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6ee8e lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096893 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1788201590.505953:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201590.505962:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b3b80 x1875064727935360/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201590.505989:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b3b80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727935360:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201590.506082:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.510670:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b3b80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727935360:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.510776:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x149:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201590.510788:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x149:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201590.510845:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x149:0x0](ffff8bc1446baa08) 00000080:00200000:0.0:1788201590.510929:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.510953:0:24460:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f0, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88), flags=0 00000080:00200000:0.0:1788201590.510959:0:24460:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f0, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88), intent=getattr 00000002:00010000:0.0:1788201590.510985:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f0,[0x0:0x0:0x0]) in obj [0x200000bd7:0x135:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201590.511052:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9400/0xd138388016f6ee95 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.511070:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9400/0xd138388016f6ee95 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.511083:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9400/0xd138388016f6ee95 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201590.511109:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b0380 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727935488:192.168.201.143@tcp:101:rm.0 00000100:00100000:0.0:1788201590.511179:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201590.519027:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b0380 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727935488:192.168.201.143@tcp:101:rm.0 00010000:00010000:1.0:1788201590.519062:0:24460:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9400/0xd138388016f6ee95 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710968cb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.519084:0:24460:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9400/0xd138388016f6ee95 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x147:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710968cb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.519091:0:24460:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9400/0xd138388016f6ee95 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x147:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710968cb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.519106:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9400/0xd138388016f6ee95 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x147:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710968cb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.519119:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9400/0xd138388016f6ee95 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x147:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710968cb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.519137:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9400/0xd138388016f6ee95 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x147:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710968cb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.519146:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9400/0xd138388016f6ee95 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x147:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710968cb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.519155:0:24460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9400/0xd138388016f6ee95 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x147:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710968cb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201590.519175:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc1725b0380 x1875064727935488/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201606 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201590.519191:0:24460:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9400/0xd138388016f6ee95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x147:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710968cb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.519205:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/327 (0 0) 00000080:00200000:1.0:1788201590.519213:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x135:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201590.519242:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x147:0x0], updating i_size 0 00000080:00200000:1.0:1788201590.519246:0:24460:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x147:0x0](ffff8bc1446bcb08): rc = 0 00000080:00200000:1.0:1788201590.519307:0:24460:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x147:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1788201590.519337:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x147:0x0](ffff8bc1446bcb08) for lock 0xd138388016f6ee95 00000080:00010000:1.0:1788201590.519349:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x147:0x0](ffff8bc1446bcb08) 00000080:00010000:1.0:1788201590.519353:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ee95 from it ffffadd1c1923df8 00010000:00010000:1.0:1788201590.519355:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9400/0xd138388016f6ee95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x147:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710968cb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.519363:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9400/0xd138388016f6ee95 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x147:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710968cb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201590.519401:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 3 00000080:00200000:1.0:1788201590.519477:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=f0, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88) 00010000:00010000:1.0:1788201590.519522:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9400/0xd138388016f6ee95 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x147:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710968cb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201590.519540:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x147:0x0]: losing layout lock 00010000:00010000:1.0:1788201590.519584:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9400/0xd138388016f6ee95 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x147:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710968cb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201590.519589:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201590.519592:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9400/0xd138388016f6ee95 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x147:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710968cb expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1788201590.519618:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201590.519626:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a7100 x1875064727935744/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201590.519655:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a7100 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727935744:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201590.519893:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.529856:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a7100 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727935744:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.530004:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x147:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201590.530016:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x147:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201590.530043:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x147:0x0](ffff8bc1446bcb08) 00000080:00200000:0.0:1788201590.530170:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.530203:0:24460:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f3, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88), flags=0 00000080:00200000:0.0:1788201590.530209:0:24460:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f3, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88), intent=getattr 00000002:00010000:0.0:1788201590.530239:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f3,[0x0:0x0:0x0]) in obj [0x200000bd7:0x135:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201590.530309:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6ee9c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.530321:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6ee9c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.530333:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6ee9c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201590.530359:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b0380 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727935872:192.168.201.143@tcp:101:rm.0 00000100:00100000:0.0:1788201590.530464:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.543768:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b0380 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727935872:192.168.201.143@tcp:101:rm.0 00010000:00010000:0.0:1788201590.543843:0:24460:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6ee9c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096903 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.543872:0:24460:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6ee9c lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x14a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096903 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.543882:0:24460:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6ee9c lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096903 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.543896:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6ee9c lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096903 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.543909:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6ee9c lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096903 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.543925:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6ee9c lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096903 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.543936:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6ee9c lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096903 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.543945:0:24460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6ee9c lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096903 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201590.543960:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc1725b0380 x1875064727935872/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201606 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201590.543976:0:24460:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6ee9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096903 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.543990:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/330 (0 0) 00000080:00200000:0.0:1788201590.544000:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x135:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201590.544030:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x14a:0x0], updating i_size 0 00000080:00200000:0.0:1788201590.544033:0:24460:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x14a:0x0](ffff8bc1446bdb88): rc = 0 00000080:00200000:0.0:1788201590.544092:0:24460:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x14a:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1788201590.544116:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x14a:0x0](ffff8bc1446bdb88) for lock 0xd138388016f6ee9c 00000080:00010000:0.0:1788201590.544128:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x14a:0x0](ffff8bc1446bdb88) 00000080:00010000:0.0:1788201590.544132:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ee9c from it ffffadd1c1923df8 00010000:00010000:0.0:1788201590.544136:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6ee9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096903 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.544146:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6ee9c lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096903 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201590.544185:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.544195:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=f3, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88) 00010000:00010000:0.0:1788201590.544245:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6ee9c lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171096903 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201590.544268:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x14a:0x0]: losing layout lock 00010000:00010000:0.0:1788201590.544323:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6ee9c lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096903 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201590.544331:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201590.544335:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6ee9c lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096903 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1788201590.544372:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201590.544381:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b0380 x1875064727936128/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201590.544408:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b0380 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727936128:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201590.544589:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.562886:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b0380 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727936128:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.563005:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x14a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201590.563017:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x14a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201590.563042:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x14a:0x0](ffff8bc1446bdb88) 00000080:00200000:0.0:1788201590.563135:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.563160:0:24460:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88), flags=0 00000080:00200000:0.0:1788201590.563166:0:24460:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f4, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88), intent=getattr 00000002:00010000:0.0:1788201590.563192:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f4,[0x0:0x0:0x0]) in obj [0x200000bd7:0x135:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201590.563274:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6eea3 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.563286:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6eea3 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.563298:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6eea3 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201590.563322:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b3480 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727936256:192.168.201.143@tcp:101:rm.0 00000100:00100000:0.0:1788201590.563408:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.579666:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b3480 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727936256:192.168.201.143@tcp:101:rm.0 00010000:00010000:0.0:1788201590.579701:0:24460:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6eea3 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109693b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.579730:0:24460:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6eea3 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x14b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109693b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.579740:0:24460:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6eea3 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109693b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.579763:0:24460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6eea3 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109693b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.579775:0:24460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6eea3 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109693b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.579809:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6eea3 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109693b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.579819:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6eea3 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109693b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.579827:0:24460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6eea3 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109693b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201590.579840:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc1725b3480 x1875064727936256/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201606 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201590.579856:0:24460:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6eea3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109693b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.579869:0:24460:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/331 (0 0) 00000080:00200000:0.0:1788201590.579877:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x135:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201590.579903:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x14b:0x0], updating i_size 0 00000080:00200000:0.0:1788201590.579907:0:24460:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x14b:0x0](ffff8bc1459d00c8): rc = 0 00000080:00200000:0.0:1788201590.579963:0:24460:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x14b:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1788201590.579998:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x14b:0x0](ffff8bc1459d00c8) for lock 0xd138388016f6eea3 00000080:00010000:0.0:1788201590.580012:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x14b:0x0](ffff8bc1459d00c8) 00000080:00010000:0.0:1788201590.580016:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eea3 from it ffffadd1c1923df8 00010000:00010000:0.0:1788201590.580020:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6eea3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109693b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.580031:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6eea3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109693b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201590.580069:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.580078:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=f4, dir=[0x200000bd7:0x135:0x0](ffff8bc145955b88) 00010000:00010000:0.0:1788201590.580124:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6eea3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e217109693b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201590.580146:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x14b:0x0]: losing layout lock 00010000:00010000:0.0:1788201590.580198:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6eea3 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109693b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201590.580216:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201590.580220:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6eea3 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109693b expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1788201590.580254:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201590.580262:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b3480 x1875064727936512/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201590.580299:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b3480 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727936512:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201590.580427:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.584975:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b3480 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727936512:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.585105:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x14b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201590.585118:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x14b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201590.585144:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x14b:0x0](ffff8bc1459d00c8) 00000080:00200008:0.0:1788201590.585239:0:24460:0:(file.c:479:ll_file_release()) START file d2:[0x200000bd7:0x135:0x0](ffff8bc145955b88), flags 704000 00010000:00010000:0.0:1788201590.585271:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6ee80 lrc: 2/0,0 mode: CR/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096838 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201590.585318:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.585331:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d2, flags=0 00000080:00200000:0.0:1788201590.585338:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.585344:0:24460:0:(namei.c:2328:ll_rmdir()) VFS Op:name=d2, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:0.0:1788201590.585384:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6ee80 lrc: 2/0,0 mode: CR/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e2171096838 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00100000:0.0:1788201590.585453:0:24460:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1724a5880 x1875064727934592/t8589937315(8589937315) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201606 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1788201590.585468:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1788201590.585474:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b2680 x1875064727936768/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1788201590.585500:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b2680 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727936768:192.168.201.143@tcp:35:rm.0 00000100:00100000:0.0:1788201590.585593:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.591607:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b2680 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727936768:192.168.201.143@tcp:35:rm.0 00000002:00100000:0.0:1788201590.591656:0:24460:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1724a5880 x1875064727934592/t8589937315(8589937315) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201606 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1788201590.591726:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6ecf8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e21710954f8 expref: -99 pid: 23737 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201590.591817:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6ee80 lrc: 1/0,0 mode: --/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171096838 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201590.591827:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6ecf8 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e21710954f8 expref: -99 pid: 23737 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201590.591833:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1788201590.591837:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6ee80 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x135:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171096838 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201590.591851:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6ecf8 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x135:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e21710954f8 expref: -99 pid: 23737 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000020:00100000:0.0:1788201590.591877:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201590.591885:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b2680 x1875064727937024/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201590.591911:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b2680 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727937024:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201590.592030:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.600486:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b2680 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727937024:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.600552:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x135:0x0](ffff8bc145955b88) 00000080:00200000:0.0:1788201590.600631:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.600645:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=ost_oos.sh, flags=0 00010000:00010000:0.0:1788201590.600667:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722600/0xd138388016f6e5b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710940fb expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:0.0:1788201590.600682:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e5b9 from it ffffadd1c1923d78 00010000:00010000:0.0:1788201590.600687:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722600/0xd138388016f6e5b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710940fb expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201590.600699:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722600/0xd138388016f6e5b9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710940fb expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.600727:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.600733:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=ost_oos.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:0.0:1788201590.600864:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722600/0xd138388016f6e5b9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710940fb expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.600895:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0xfe:0x0]: losing layout lock 00010000:00010000:0.0:1788201590.600949:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722600/0xd138388016f6e5b9 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710940fb expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1788201590.600958:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201590.600961:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172722600/0xd138388016f6e5b9 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0xfe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710940fb expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:0.0:1788201590.600995:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201590.601006:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b0a80 x1875064727937280/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201590.601032:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b0a80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727937280:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201590.601123:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.613465:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b0a80 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727937280:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.613585:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0xfe:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201590.613600:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201590.613663:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0xfe:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201590.613744:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0xfe:0x0](ffff8bc145937448) 00000008:00010000:0.0:1788201590.613851:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 938 blocks 1 [cma]time 1788201556 1788201556 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f97ad2a0/0xd138388016f6e5c7 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x186:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094110 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1788201590.613963:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.613984:0:24460:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f3, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=0 00000080:00200000:0.0:1788201590.613990:0:24460:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f3, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00010000:00010000:0.0:1788201590.614013:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6eda7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x13b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095a77 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1788201590.614029:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eda7 from it ffffadd1c1923bd8 00010000:00010000:0.0:1788201590.614035:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6eda7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x13b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095a77 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201590.614046:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6eda7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x13b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095a77 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201590.614074:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.614080:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=f3, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:0.0:1788201590.614131:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6eda7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x13b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171095a77 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201590.614159:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x13b:0x0]: losing layout lock 00010000:00010000:0.0:1788201590.614215:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6eda7 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x13b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171095a77 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201590.614223:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201590.614226:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6eda7 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x13b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171095a77 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:0.0:1788201590.614255:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201590.614266:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b1880 x1875064727937536/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201590.614292:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1880 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727937536:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201590.614705:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.628388:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1880 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727937536:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.628553:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x13b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201590.628565:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x13b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201590.628590:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x13b:0x0](ffff8bc144659148) 00000080:00200000:0.0:1788201590.629355:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.629372:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=replay-single.sh, flags=0 00010000:00010000:0.0:1788201590.629395:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:0.0:1788201590.629410:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e852 from it ffffadd1c1923d78 00010000:00010000:0.0:1788201590.629415:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201590.629436:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.629461:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.629468:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=replay-single.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:0.0:1788201590.629522:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.629553:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x111:0x0]: losing layout lock 00010000:00010000:0.0:1788201590.629733:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1788201590.629742:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201590.629829:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9600/0xd138388016f6e852 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710947bc expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:0.0:1788201590.629860:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201590.629873:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b3100 x1875064727937792/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201590.629899:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b3100 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727937792:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201590.630062:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.635878:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b3100 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727937792:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.635995:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x111:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201590.636008:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201590.636070:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x111:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201590.636216:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x111:0x0](ffff8bc1459d21c8) 00000008:00010000:0.0:1788201590.636307:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 158554 blocks 1 [cma]time 1788201557 1788201557 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084c24abf/0xd138388016f6e860 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x18f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710947d1 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1788201590.636430:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.636445:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=yaml.sh, flags=0 00010000:00010000:0.0:1788201590.636468:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:0.0:1788201590.636479:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ecd5 from it ffffadd1c1923d78 00010000:00010000:0.0:1788201590.636484:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201590.636493:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.636518:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.636524:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=yaml.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:0.0:1788201590.636578:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.636605:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x132:0x0]: losing layout lock 00010000:00010000:0.0:1788201590.636661:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1788201590.636673:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201590.636676:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ecd5 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x132:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171095377 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:0.0:1788201590.636702:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201590.636713:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b3800 x1875064727938048/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201590.636740:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b3800 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727938048:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201590.636865:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.643280:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b3800 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727938048:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.643390:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x132:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201590.643402:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:0.0:1788201590.643459:0:24460:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000cd0be2df ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201590.643498:0:24460:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000cd0be2df ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201590.643533:0:24460:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000cd0be2df ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201590.643576:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x132:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201590.643647:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x132:0x0](ffff8bc1446580c8) 00000008:00010000:0.0:1788201590.643698:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 4512 blocks 1 [cma]time 1788201559 1788201559 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201590.643833:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.643849:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=pjdfstest.sh, flags=0 00010000:00010000:0.0:1788201590.643876:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e6d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x106:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710943d3 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:0.0:1788201590.643889:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e6d1 from it ffffadd1c1923d78 00010000:00010000:0.0:1788201590.643895:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e6d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x106:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710943d3 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201590.643907:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e6d1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x106:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710943d3 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.643935:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.643942:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=pjdfstest.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:0.0:1788201590.643996:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e6d1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x106:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710943d3 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.644025:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x106:0x0]: losing layout lock 00010000:00010000:0.0:1788201590.644086:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e6d1 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x106:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710943d3 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1788201590.644094:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201590.644097:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14400d400/0xd138388016f6e6d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x106:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710943d3 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:0.0:1788201590.644124:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201590.644136:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b0000 x1875064727938304/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201590.644170:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b0000 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727938304:192.168.201.143@tcp:36:rm.0 00000100:00100000:0.0:1788201590.644279:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.652360:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b0000 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727938304:192.168.201.143@tcp:36:rm.0 00000080:00200000:0.0:1788201590.652491:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x106:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201590.652505:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201590.652568:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x106:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201590.652668:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x106:0x0](ffff8bc14592b248) 00000008:00010000:0.0:1788201590.652720:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 4150 blocks 1 [cma]time 1788201557 1788201557 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f6fd8f72/0xd138388016f6e6df lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x18a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710943e8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1788201590.652852:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.652866:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=run_IOR.sh, flags=0 00010000:00010000:0.0:1788201590.652888:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172724a00/0xd138388016f6e901 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x116:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094983 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:0.0:1788201590.652900:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e901 from it ffffadd1c1923d78 00010000:00010000:0.0:1788201590.652905:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172724a00/0xd138388016f6e901 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x116:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171094983 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201590.652916:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172724a00/0xd138388016f6e901 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x116:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171094983 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.652941:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.652947:0:24460:0:(namei.c:2418:ll_unlink()) VFS Op:name=run_IOR.sh, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:0.0:1788201590.653001:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172724a00/0xd138388016f6e901 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x116:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171094983 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1788201590.653029:0:24460:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd7:0x116:0x0]: losing layout lock 00010000:00010000:0.0:1788201590.653082:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172724a00/0xd138388016f6e901 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x116:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094983 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1788201590.653102:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201590.653106:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172724a00/0xd138388016f6e901 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x116:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171094983 expref: -99 pid: 23731 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000020:00100000:0.0:1788201590.653690:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201590.653706:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b1500 x1875064727938560/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201590.653893:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1500 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727938560:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201590.654002:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201590.661188:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1500 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727938560:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201590.661333:0:24460:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x116:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1788201590.661348:0:24460:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:1.0:1788201590.661400:0:24460:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000c88bdffc ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e90f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094998 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201590.661448:0:24460:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000c88bdffc ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e90f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094998 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201590.661482:0:24460:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000c88bdffc ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e90f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094998 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201590.661537:0:24460:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x116:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201590.661640:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x116:0x0](ffff8bc145982a08) 00000008:00010000:1.0:1788201590.661689:0:24460:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 1753 blocks 1 [cma]time 1788201558 1788201558 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e90f lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x192:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171094998 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201590.661778:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.661860:0:24460:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=e1, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags=0 00000080:00200000:1.0:1788201590.661866:0:24460:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=e1, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248), intent=getattr 00010000:00010000:1.0:1788201590.661891:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1788201590.661910:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6edae from it ffffadd1c1923900 00010000:00010000:1.0:1788201590.661916:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201590.661928:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200008:1.0:1788201590.661969:0:24460:0:(file.c:6283:ll_getattr_dentry()) START file e1:[0x200000bd7:0x157:0x0](ffff8bc1446bc2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201590.661976:0:24460:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x157:0x0](ffff8bc1446bc2c8),name=e1 00000002:00010000:1.0:1788201590.661998:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x157:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201590.662010:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.662024:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201590.662034:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201590.662042:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x157:0x0](ffff8bc1446bc2c8) 00000080:00010000:1.0:1788201590.662046:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x157:0x0](ffff8bc1446bc2c8) for lock 0xd138388016f6edae 00000080:00010000:1.0:1788201590.662052:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6edae from it ffffadd1c1923cb8 00010000:00010000:1.0:1788201590.662055:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.662064:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1788201590.662098:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.662104:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=e1, flags=258 00000080:00200000:1.0:1788201590.662110:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x157:0x0](ffff8bc1446bc2c8), inode mode 41ed mask 44 00000080:00200008:1.0:1788201590.662119:0:24460:0:(file.c:1090:ll_file_open()) START file e1:[0x200000bd7:0x157:0x0](ffff8bc1446bc2c8), flags 704400 00000002:00010000:1.0:1788201590.662133:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x157:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: open flags 0100240704401 00010000:00010000:1.0:1788201590.662198:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6eeaa lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.662207:0:24460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6eeaa lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201590.662221:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201590.662234:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a6300 x1875064727938816/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201590.662246:0:24460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6eeaa lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201590.662272:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a6300 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727938816:192.168.201.143@tcp:101:rm.0 00000100:00100000:1.0:1788201590.662487:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201590.666680:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a6300 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727938816:192.168.201.143@tcp:101:rm.0 00010000:00010000:1.0:1788201590.666711:0:24460:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6eeaa lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.666727:0:24460:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6eeaa lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.666736:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6eeaa lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.666743:0:24460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6eeaa lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.667003:0:24460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6eeaa lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.667010:0:24460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bc600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201590.667016:0:24460:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6eeaa lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.667022:0:24460:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6eeaa lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x206400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.667030:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6eeaa lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x20e400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.667038:0:24460:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201590.667045:0:24460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6eeaa lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.667051:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6eeaa lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 24460 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201590.667080:0:24460:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff8bc1724a6300 x1875064727938816/t8589937329(8589937329) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201606 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201590.667180:0:24460:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a6300 x1875064727938816/t8589937329(8589937329) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201606 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201590.667195:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1788201590.667283:0:24460:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x157:0x0], updating i_size 7680 00000002:00100000:1.0:1788201590.667305:0:24460:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a6300 x1875064727938816/t8589937329(8589937329) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201606 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1788201590.667392:0:24460:0:(file.c:6283:ll_getattr_dentry()) START file e1:[0x200000bd7:0x157:0x0](ffff8bc1446bc2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201590.667399:0:24460:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x157:0x0](ffff8bc1446bc2c8),name=e1 00000002:00010000:1.0:1788201590.667433:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x157:0x0]) in obj [0x200000bd7:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201590.667452:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.667466:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1788201590.667474:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201590.667480:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x157:0x0](ffff8bc1446bc2c8) 00000080:00010000:1.0:1788201590.667483:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x157:0x0](ffff8bc1446bc2c8) for lock 0xd138388016f6edae 00000080:00010000:1.0:1788201590.667489:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6edae from it ffffadd1c1923cd8 00010000:00010000:1.0:1788201590.667493:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.667501:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201590.667536:0:24460:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200000bd7:0x157:0x0](ffff8bc1446bc2c8) pos/size0/7680 32bit_api 0 00000002:00010000:1.0:1788201590.667548:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x157:0x0]) in obj [0x200000bd7:0x157:0x0], intent: readdir flags 0 00010000:00010000:1.0:1788201590.667554:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201590.667563:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000100:00100000:1.0:1788201590.668845:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a6a00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727938944:192.168.201.143@tcp:37:rm.0 00000100:00100000:1.0:1788201590.668985:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201590.678437:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a6a00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727938944:192.168.201.143@tcp:37:rm.0 00010000:00010000:1.0:1788201590.679399:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201590.679430:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:1.0:1788201590.679501:0:24460:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200000bd7:0x157:0x0](ffff8bc1446bc2c8) pos/size18446744073709551614/7680 32bit_api 0 00000080:00200008:1.0:1788201590.679526:0:24460:0:(file.c:479:ll_file_release()) START file e1:[0x200000bd7:0x157:0x0](ffff8bc1446bc2c8), flags 704000 00000002:00100000:1.0:1788201590.679671:0:24460:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1724a6300 x1875064727938816/t8589937329(8589937329) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201606 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201590.679687:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201590.679694:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a6a00 x1875064727939200/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201590.679721:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a6a00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727939200:192.168.201.143@tcp:35:rm.0 00000100:00100000:1.0:1788201590.680389:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201590.683475:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a6a00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727939200:192.168.201.143@tcp:35:rm.0 00000002:00100000:1.0:1788201590.683522:0:24460:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1724a6300 x1875064727938816/t8589937329(8589937329) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201606 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201590.683673:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.683689:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=e1, flags=0 00000080:00200000:1.0:1788201590.683697:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248), inode mode 41ed mask 3 00000080:00200000:1.0:1788201590.683704:0:24460:0:(namei.c:2328:ll_rmdir()) VFS Op:name=e1, dir=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00010000:00010000:1.0:1788201590.683903:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:1.0:1788201590.684048:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:1.0:1788201590.684058:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201590.684063:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12aa00/0xd138388016f6edae lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x157:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171095a93 expref: -99 pid: 24461 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000020:00100000:1.0:1788201590.684092:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201590.684100:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a6a00 x1875064727939456/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 488/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201590.684126:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a6a00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727939456:192.168.201.143@tcp:36:rm.0 00000100:00100000:1.0:1788201590.684220:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201590.689442:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a6a00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727939456:192.168.201.143@tcp:36:rm.0 00000080:00200000:1.0:1788201590.689508:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x157:0x0](ffff8bc1446bc2c8) 00000080:00200008:1.0:1788201590.689611:0:24460:0:(file.c:479:ll_file_release()) START file d6b.sanity-lfsck:[0x200000bd7:0xe5:0x0](ffff8bc145933248), flags 704000 00010000:00010000:1.0:1788201590.689660:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a000/0xd138388016f6ed1b lrc: 2/0,0 mode: CR/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171095744 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201590.689709:0:24460:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201590.689730:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201590.689742:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201590.689752:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201590.689761:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201590.689767:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201590.689771:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201590.689779:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c1923c10 00010000:00010000:1.0:1788201590.689784:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201590.689826:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201590.689846:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.689858:0:24460:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d6b.sanity-lfsck, flags=0 00000080:00200000:1.0:1788201590.689865:0:24460:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201590.689871:0:24460:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201590.689878:0:24460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201590.689887:0:24460:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201590.689895:0:24460:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201590.689899:0:24460:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201590.689902:0:24460:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6e24e 00000080:00010000:1.0:1788201590.689905:0:24460:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6e24e from it ffffadd1c1923d88 00010000:00010000:1.0:1788201590.689909:0:24460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201590.689918:0:24460:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201590.689927:0:24460:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201590.689933:0:24460:0:(namei.c:2328:ll_rmdir()) VFS Op:name=d6b.sanity-lfsck, dir=[0x200000007:0x1:0x0](ffff8bc1459f00c8) 00010000:00010000:1.0:1788201590.689955:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201590.690043:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a000/0xd138388016f6ed1b lrc: 2/0,0 mode: CR/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e2171095744 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00100000:1.0:1788201590.690110:0:24460:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1726cf800 x1875064727891072/t8589937184(8589937184) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201604 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201590.690125:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201590.690132:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a6300 x1875064727939712/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201590.690159:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a6300 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727939712:192.168.201.143@tcp:35:rm.0 00000100:00100000:1.0:1788201590.690238:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201590.694387:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a6300 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727939712:192.168.201.143@tcp:35:rm.0 00000002:00100000:3.0:1788201590.694439:0:24460:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1726cf800 x1875064727891072/t8589937184(8589937184) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201604 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1788201590.694536:0:24460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48c00/0xd138388016f6e27f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e217109373f expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201590.694609:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a000/0xd138388016f6ed1b lrc: 1/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171095744 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201590.694619:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48c00/0xd138388016f6e27f lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e217109373f expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201590.694628:0:24460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201590.694635:0:24460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:3.0:1788201590.694639:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a000/0xd138388016f6ed1b lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171095744 expref: -99 pid: 24460 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201590.694657:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48c00/0xd138388016f6e27f lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0xe5:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e217109373f expref: -99 pid: 23731 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201590.694674:0:24460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6e24e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e21710936b3 expref: -99 pid: 23576 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000020:00100000:3.0:1788201590.694696:0:24460:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1788201590.694703:0:24460:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a2a00 x1875064727939968/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 512/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201590.694730:0:24460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2a00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727939968:192.168.201.143@tcp:36:rm.0 00000100:00100000:3.0:1788201590.694873:0:24460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201590.701064:0:24460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a2a00 pname:cluuid:pid:xid:nid:opc:job rm:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24460:1875064727939968:192.168.201.143@tcp:36:rm.0 00000080:00200000:3.0:1788201590.701135:0:24460:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0xe5:0x0](ffff8bc145933248) 00000080:00200000:3.0:1788201590.720205:0:24463:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201590.720246:0:24463:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201590.720329:0:24463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 24463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.720342:0:24463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.720355:0:24463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24463 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201590.720391:0:24463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a3b80 pname:cluuid:pid:xid:nid:opc:job lfs:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24463:1875064727940096:192.168.201.143@tcp:101:lfs.0 00000100:00100000:3.0:1788201590.720543:0:24463:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201590.725152:0:24463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a3b80 pname:cluuid:pid:xid:nid:opc:job lfs:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24463:1875064727940096:192.168.201.143@tcp:101:lfs.0 00010000:00010000:3.0:1788201590.725191:0:24463:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.725206:0:24463:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.725221:0:24463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.725236:0:24463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.725253:0:24463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.725262:0:24463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.725271:0:24463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201590.725285:0:24463:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc1724a3b80 x1875064727940096/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/688 e 0 to 0 dl 1788201606 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201590.725302:0:24463:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.725318:0:24463:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1788201590.725325:0:24463:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1788201590.725369:0:24463:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 6656 00000080:00010000:3.0:1788201590.725375:0:24463:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eeb1 00000080:00010000:3.0:1788201590.725380:0:24463:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201590.725383:0:24463:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eeb1 from it ffffadd1c7db3b58 00010000:00010000:3.0:1788201590.725386:0:24463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.725397:0:24463:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201590.725433:0:24463:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201590.725461:0:24463:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d7a.sanity-lfsck, dir=[0x200000007:0x1:0x0](ffff8bc1459f00c8), flags=13 00000080:00200000:3.0:1788201590.725467:0:24463:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=d7a.sanity-lfsck, dir=[0x200000007:0x1:0x0](ffff8bc1459f00c8), intent=getattr 00000002:00010000:3.0:1788201590.725491:0:24463:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d7a.sanity-lfsck,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201590.725535:0:24463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eeb8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.725541:0:24463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eeb8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.725548:0:24463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eeb8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24463 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201590.725568:0:24463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a3b80 pname:cluuid:pid:xid:nid:opc:job lfs:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24463:1875064727940224:192.168.201.143@tcp:101:lfs.0 00000100:00100000:3.0:1788201590.725670:0:24463:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201590.728731:0:24463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a3b80 pname:cluuid:pid:xid:nid:opc:job lfs:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24463:1875064727940224:192.168.201.143@tcp:101:lfs.0 00010000:00010000:3.0:1788201590.728844:0:24463:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eeb8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.728861:0:24463:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eeb8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.728869:0:24463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eeb8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.728882:0:24463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eeb8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.728893:0:24463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eeb8 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.728900:0:24463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1725a1c00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201590.728905:0:24463:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eeb8 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.728914:0:24463:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eeb8 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.728922:0:24463:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eeb8 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.728930:0:24463:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201590.728939:0:24463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eeb8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.728947:0:24463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eeb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24463 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201590.728971:0:24463:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a3b80 x1875064727940224/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201606 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201590.728989:0:24463:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201590.729020:0:24463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201590.729036:0:24463:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1788201590.729047:0:24463:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eeb1 from it ffffadd1c7db3930 00010000:00010000:3.0:1788201590.729052:0:24463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201590.729060:0:24463:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201590.729592:0:24463:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201590.729679:0:24463:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201590.729689:0:24463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201590.729699:0:24463:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201590.729706:0:24463:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201590.729712:0:24463:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201590.729715:0:24463:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eeb1 00000080:00010000:3.0:1788201590.729720:0:24463:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eeb1 from it ffffadd1c7db3be8 00010000:00010000:3.0:1788201590.729724:0:24463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201590.729731:0:24463:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201590.729741:0:24463:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201590.729838:0:24463:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=16392 00000080:00200008:3.0:1788201590.729870:0:24463:0:(file.c:6283:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8bc1459f00c8), request_mask 0, flags 0, foreign 0 00000080:00200000:3.0:1788201590.729876:0:24463:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201590.729882:0:24463:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201590.729891:0:24463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.729899:0:24463:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201590.729905:0:24463:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201590.729909:0:24463:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201590.729911:0:24463:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eeb1 00000080:00010000:3.0:1788201590.729915:0:24463:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eeb1 from it ffffadd1c7db3cb8 00010000:00010000:3.0:1788201590.729917:0:24463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201590.729924:0:24463:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200008:3.0:1788201590.731184:0:24463:0:(file.c:6283:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8bc1459f00c8), request_mask 0, flags 0, foreign 0 00000080:00200000:3.0:1788201590.731193:0:24463:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201590.731272:0:24463:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201590.731289:0:24463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201590.731302:0:24463:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1788201590.731309:0:24463:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201590.731317:0:24463:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201590.731320:0:24463:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eeb1 00000080:00010000:3.0:1788201590.731327:0:24463:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eeb1 from it ffffadd1c7db3cb8 00010000:00010000:3.0:1788201590.731330:0:24463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201590.731338:0:24463:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1788201590.731679:0:24463:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201590.731688:0:24463:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201590.731695:0:24463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1788201590.731704:0:24463:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1788201590.731711:0:24463:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201590.731715:0:24463:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201590.731717:0:24463:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eeb1 00000080:00010000:3.0:1788201590.731721:0:24463:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eeb1 from it ffffadd1c7db3bb0 00010000:00010000:3.0:1788201590.731724:0:24463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1788201590.731731:0:24463:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:3.0:1788201590.731740:0:24463:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 44 00000080:00200008:3.0:1788201590.731906:0:24463:0:(file.c:1090:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8bc1459f00c8), flags 300000 00000080:00200080:3.0:1788201590.731928:0:24463:0:(dir.c:2003:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8) cmd=c03066f0 arg=7ffeaab253a0 00000080:00200000:3.0:1788201590.731945:0:24463:0:(dir.c:451:ll_dir_setdirstripe()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8) name=d7a.sanity-lfsck stripe_offset=0 stripe_count=1, hash_type=0 00010000:00010000:3.0:1788201590.731977:0:24463:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1788201590.732054:0:24463:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1788201590.732061:0:24463:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201590.732063:0:24463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eeb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171096a5a expref: -99 pid: 24463 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000020:00100000:3.0:1788201590.732149:0:24463:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1788201590.732166:0:24463:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a3b80 x1875064727940480/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 568/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201590.732196:0:24463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a3b80 pname:cluuid:pid:xid:nid:opc:job lfs:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24463:1875064727940480:192.168.201.143@tcp:36:lfs.0 00000100:00100000:3.0:1788201590.732448:0:24463:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201590.740562:0:24463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a3b80 pname:cluuid:pid:xid:nid:opc:job lfs:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24463:1875064727940480:192.168.201.143@tcp:36:lfs.0 00000080:00200000:3.0:1788201590.740628:0:24463:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8) 00000080:00200000:3.0:1788201590.740637:0:24463:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x15b:0x0], updating i_size 512 00000080:00200008:3.0:1788201590.740681:0:24463:0:(file.c:479:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8bc1459f00c8), flags 300000 00000080:00200000:3.0:1788201590.772761:0:24313:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201590.772915:0:24313:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201590.773089:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 24313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.773106:0:24313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.773119:0:24313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24313 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201590.773156:0:24313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2300 pname:cluuid:pid:xid:nid:opc:job bash:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24313:1875064727940608:192.168.201.143@tcp:101:bash.0 00000100:00100000:3.0:1788201590.773322:0:24313:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201590.776745:0:24313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a2300 pname:cluuid:pid:xid:nid:opc:job bash:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24313:1875064727940608:192.168.201.143@tcp:101:bash.0 00010000:00010000:3.0:1788201590.776782:0:24313:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.776930:0:24313:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.776945:0:24313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.776959:0:24313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.776975:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.777053:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.777071:0:24313:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201590.777085:0:24313:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc1724a2300 x1875064727940608/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/688 e 0 to 0 dl 1788201606 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201590.777156:0:24313:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.777172:0:24313:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1788201590.777181:0:24313:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1788201590.777284:0:24313:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 6656 00000080:00010000:3.0:1788201590.777292:0:24313:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201590.777299:0:24313:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201590.777302:0:24313:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7df3bf8 00010000:00010000:3.0:1788201590.777306:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.777317:0:24313:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201590.777351:0:24313:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201590.777365:0:24313:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=.lustre, flags=27 00000080:00200000:3.0:1788201590.777373:0:24313:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000002:0x1:0x0](ffff8bc1459b9148), inode mode 41ed mask 1 00000080:00200000:3.0:1788201590.777377:0:24313:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=lost+found, flags=27 00000080:00200000:3.0:1788201590.777380:0:24313:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000002:0x3:0x0](ffff8bc1459b8908), inode mode 4140 mask 1 00000080:00200000:3.0:1788201590.777385:0:24313:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=MDT0000, flags=267 00000080:00200000:3.0:1788201590.777391:0:24313:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000402:0x1:0x0](ffff8bc1459bcb08), inode mode 41c0 mask 44 00000080:00200008:3.0:1788201590.777402:0:24313:0:(file.c:1090:ll_file_open()) START file MDT0000:[0x200000402:0x1:0x0](ffff8bc1459bcb08), flags 304000 00000002:00010000:3.0:1788201590.777437:0:24313:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x1:0x0]) in obj [0x200000002:0x3:0x0], intent: open flags 0100240304001 00010000:00010000:3.0:1788201590.777498:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eec6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.777507:0:24313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eec6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24313 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1788201590.777520:0:24313:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1788201590.777528:0:24313:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a2300 x1875064727940864/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1788201590.777539:0:24313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eec6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24313 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201590.777564:0:24313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2300 pname:cluuid:pid:xid:nid:opc:job bash:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24313:1875064727940864:192.168.201.143@tcp:101:bash.0 00000100:00100000:3.0:1788201590.778767:0:24313:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201590.782785:0:24313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a2300 pname:cluuid:pid:xid:nid:opc:job bash:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24313:1875064727940864:192.168.201.143@tcp:101:bash.0 00010000:00010000:3.0:1788201590.782854:0:24313:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eec6 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.782871:0:24313:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eec6 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.782879:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eec6 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.782889:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eec6 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.782904:0:24313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eec6 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.782912:0:24313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1725a1c00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201590.782917:0:24313:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eec6 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 24313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.782925:0:24313:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eec6 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 24313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.782933:0:24313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eec6 lrc: 5/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.782940:0:24313:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201590.782948:0:24313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eec6 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.782955:0:24313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1c00/0xd138388016f6eec6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24313 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201590.782976:0:24313:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff8bc1724a2300 x1875064727940864/t8589937335(8589937335) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201606 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1788201590.783167:0:24313:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a2300 x1875064727940864/t8589937335(8589937335) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/608 e 0 to 0 dl 1788201606 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201590.783182:0:24313:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000002:0x3:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1788201590.783275:0:24313:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000402:0x1:0x0], updating i_size 6656 00010000:00010000:3.0:1788201590.785183:0:24466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6eecd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.785199:0:24466:0:(ldlm_request.c:1275:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6eecd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790221:0:10052:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6eecd lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 10 type: IBT flags: 0x0 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790247:0:10052:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6eecd lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 10 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790254:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6eecd lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 10 type: IBT flags: 0x10206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790263:0:10052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6eecd lrc: 3/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 10 type: IBT flags: 0x10206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790274:0:10052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6eecd lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 10 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790281:0:10052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1725a1000 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201590.790286:0:10052:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6eecd lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 10 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790294:0:10052:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6eecd lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 10 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790303:0:10052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6eecd lrc: 5/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 10 type: IBT flags: 0x20e400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790311:0:10052:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201590.790318:0:10052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6eecd lrc: 3/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 10 type: IBT flags: 0x4a0f400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790326:0:10052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6eecd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 10 type: IBT flags: 0x4a0f400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790356:0:10052:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6eed4 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 9 type: IBT flags: 0x0 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790364:0:10052:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6eed4 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 9 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790370:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6eed4 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 9 type: IBT flags: 0x10206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790377:0:10052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6eed4 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 9 type: IBT flags: 0x10206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790384:0:10052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6eed4 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 9 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790389:0:10052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1427dc600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201590.790393:0:10052:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6eed4 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 9 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790399:0:10052:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6eed4 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 9 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790406:0:10052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6eed4 lrc: 5/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 9 type: IBT flags: 0x20e400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790412:0:10052:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201590.790425:0:10052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6eed4 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 9 type: IBT flags: 0x4a0f400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790432:0:10052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6eed4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 9 type: IBT flags: 0x4a0f400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790448:0:10052:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6eedb lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x0 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790458:0:10052:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6eedb lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790464:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6eedb lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x10206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790471:0:10052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6eedb lrc: 3/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x10206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790477:0:10052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6eedb lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790482:0:10052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1427dd600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201590.790486:0:10052:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6eedb lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 8 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790492:0:10052:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6eedb lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 8 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790499:0:10052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6eedb lrc: 5/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 8 type: IBT flags: 0x20e400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790505:0:10052:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201590.790509:0:10052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6eedb lrc: 3/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 8 type: IBT flags: 0x4a0f400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790517:0:10052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6eedb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 8 type: IBT flags: 0x4a0f400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790530:0:10052:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dcc00/0xd138388016f6eee2 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x0 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790541:0:10052:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dcc00/0xd138388016f6eee2 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790547:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dcc00/0xd138388016f6eee2 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x10206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790554:0:10052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dcc00/0xd138388016f6eee2 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x10206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790560:0:10052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dcc00/0xd138388016f6eee2 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790566:0:10052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1427dcc00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201590.790569:0:10052:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dcc00/0xd138388016f6eee2 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 7 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790576:0:10052:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dcc00/0xd138388016f6eee2 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 7 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790582:0:10052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dcc00/0xd138388016f6eee2 lrc: 5/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 7 type: IBT flags: 0x20e400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790587:0:10052:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201590.790590:0:10052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dcc00/0xd138388016f6eee2 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 7 type: IBT flags: 0x4a0f400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790603:0:10052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dcc00/0xd138388016f6eee2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 7 type: IBT flags: 0x4a0f400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790615:0:10052:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dde00/0xd138388016f6eee9 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x0 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790627:0:10052:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dde00/0xd138388016f6eee9 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790633:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dde00/0xd138388016f6eee9 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x10206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790640:0:10052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dde00/0xd138388016f6eee9 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x10206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790647:0:10052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dde00/0xd138388016f6eee9 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790652:0:10052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1427dde00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201590.790655:0:10052:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dde00/0xd138388016f6eee9 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 6 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790662:0:10052:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dde00/0xd138388016f6eee9 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 6 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790669:0:10052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dde00/0xd138388016f6eee9 lrc: 5/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 6 type: IBT flags: 0x20e400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790674:0:10052:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201590.790677:0:10052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dde00/0xd138388016f6eee9 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 6 type: IBT flags: 0x4a0f400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790684:0:10052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dde00/0xd138388016f6eee9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 6 type: IBT flags: 0x4a0f400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790696:0:10052:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6eef0 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x0 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790706:0:10052:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6eef0 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790712:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6eef0 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x10206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790719:0:10052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6eef0 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x10206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790725:0:10052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6eef0 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790731:0:10052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1427dca00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201590.790734:0:10052:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6eef0 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 5 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790740:0:10052:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6eef0 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 5 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790745:0:10052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6eef0 lrc: 5/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 5 type: IBT flags: 0x20e400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790750:0:10052:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201590.790753:0:10052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6eef0 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 5 type: IBT flags: 0x4a0f400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790758:0:10052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6eef0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 5 type: IBT flags: 0x4a0f400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790770:0:10052:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6eef7 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x0 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790779:0:10052:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6eef7 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790785:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6eef7 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790833:0:10052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6eef7 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790840:0:10052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6eef7 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790845:0:10052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1427dd400 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201590.790848:0:10052:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6eef7 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 4 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790854:0:10052:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6eef7 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 4 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790861:0:10052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6eef7 lrc: 5/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 4 type: IBT flags: 0x20e400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790867:0:10052:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201590.790871:0:10052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6eef7 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790878:0:10052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6eef7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790892:0:10052:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6eefe lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790903:0:10052:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6eefe lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790910:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6eefe lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790916:0:10052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6eefe lrc: 3/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790923:0:10052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6eefe lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790929:0:10052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1427dd000 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201590.790932:0:10052:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6eefe lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 3 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790939:0:10052:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6eefe lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 3 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790946:0:10052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6eefe lrc: 5/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790952:0:10052:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201590.790955:0:10052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6eefe lrc: 3/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.790961:0:10052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6eefe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201590.791482:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727941248:192.168.201.143@tcp:63:ll_sa.0 00000080:00200000:0.0:1788201590.800344:0:24468:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201590.800381:0:24468:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201590.800404:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201590.801537:0:24468:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201590.801554:0:24468:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201590.801565:0:24468:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201590.801570:0:24468:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201590.801581:0:24468:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7dabb58 00010000:00010000:0.0:1788201590.801586:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201590.801615:0:24468:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201590.801637:0:24468:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.801649:0:24468:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=.lustre, flags=24 00000080:00200000:0.0:1788201590.801657:0:24468:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000002:0x1:0x0](ffff8bc1459b9148), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.801661:0:24468:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=lost+found, flags=24 00000080:00200000:0.0:1788201590.801664:0:24468:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000002:0x3:0x0](ffff8bc1459b8908), inode mode 4140 mask 1 00000080:00200000:0.0:1788201590.801669:0:24468:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=MDT0000, flags=24 00000080:00200000:0.0:1788201590.801672:0:24468:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000402:0x1:0x0](ffff8bc1459bcb08), inode mode 41c0 mask 1 00000080:00200000:0.0:1788201590.801675:0:24468:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=*, flags=8 00000080:00200000:0.0:1788201590.801710:0:24468:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201590.801722:0:24468:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201590.801734:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201590.801744:0:24468:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201590.801751:0:24468:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201590.801755:0:24468:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201590.801757:0:24468:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201590.801761:0:24468:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7dabc10 00010000:00010000:0.0:1788201590.801764:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201590.801771:0:24468:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201590.801780:0:24468:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.801784:0:24468:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=.lustre, flags=24 00000080:00200000:0.0:1788201590.801788:0:24468:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000002:0x1:0x0](ffff8bc1459b9148), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.802012:0:24468:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=lost+found, flags=24 00000080:00200000:0.0:1788201590.802017:0:24468:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000002:0x3:0x0](ffff8bc1459b8908), inode mode 4140 mask 1 00000080:00200000:0.0:1788201590.802019:0:24468:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=MDT0000, flags=24 00000080:00200000:0.0:1788201590.802022:0:24468:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000402:0x1:0x0](ffff8bc1459bcb08), inode mode 41c0 mask 1 00000080:00200000:0.0:1788201590.802028:0:24468:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=*, flags=0 00000080:00200000:1.0:1788201590.833332:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201590.833371:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201590.833397:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.833428:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201590.833438:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201590.833447:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201590.833452:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201590.833461:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201590.833466:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.833477:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1788201590.833496:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.833511:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d7a.sanity-lfsck, dir=[0x200000007:0x1:0x0](ffff8bc1459f00c8), flags=11 00000080:00200000:1.0:1788201590.833516:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=d7a.sanity-lfsck, dir=[0x200000007:0x1:0x0](ffff8bc1459f00c8), intent=getattr 00000002:00010000:1.0:1788201590.833528:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d7a.sanity-lfsck,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201590.833582:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ef05 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.833590:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ef05 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.833607:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ef05 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201590.833639:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a4000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727941376:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201590.833773:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201590.838397:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a4000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727941376:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201590.838446:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ef05 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096aca expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.838476:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ef05 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096aca expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.838486:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ef05 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096aca expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.838501:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ef05 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096aca expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.838516:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ef05 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096aca expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.838533:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ef05 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096aca expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.838543:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ef05 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096aca expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.838560:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ef05 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096aca expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201590.838574:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff8bc1724a4000 x1875064727941376/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201606 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201590.838589:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ef05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096aca expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.838611:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201590.838620:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201590.838647:0:24470:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x15b:0x0], updating i_size 512 00000080:00200000:1.0:1788201590.838651:0:24470:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x15b:0x0](ffff8bc1459d63c8): rc = 0 00000080:00010000:1.0:1788201590.838658:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x15b:0x0](ffff8bc1459d63c8) for lock 0xd138388016f6ef05 00000080:00010000:1.0:1788201590.838672:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x15b:0x0](ffff8bc1459d63c8) 00000080:00010000:1.0:1788201590.838676:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ef05 from it ffffadd1c7debb20 00010000:00010000:1.0:1788201590.838680:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ef05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096aca expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.838701:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ef05 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096aca expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:1.0:1788201590.838752:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file d7a.sanity-lfsck:[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201590.838760:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8),name=d7a.sanity-lfsck 00000002:00010000:1.0:1788201590.838784:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x15b:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201590.838834:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ef05 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096aca expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201590.838848:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ef05 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096aca expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201590.838856:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201590.838862:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x15b:0x0](ffff8bc1459d63c8) 00000080:00010000:1.0:1788201590.838866:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x15b:0x0](ffff8bc1459d63c8) for lock 0xd138388016f6ef05 00000080:00010000:1.0:1788201590.838870:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ef05 from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201590.838874:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ef05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096aca expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201590.838882:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ef05 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096aca expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201590.838964:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201590.838971:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201590.838980:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.839382:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1788201590.839390:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201590.839396:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201590.839399:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201590.839404:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201590.839407:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201590.839425:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201590.839437:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.839445:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201590.839450:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.839465:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=acceptance-small.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201590.839469:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=acceptance-small.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201590.839480:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: acceptance-small.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201590.839533:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ef0c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.839542:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ef0c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.839553:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ef0c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201590.839579:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a4000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727941504:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201590.840359:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201590.846637:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a4000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727941504:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201590.846669:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ef0c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.846686:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ef0c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.846709:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ef0c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.846717:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ef0c lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.846727:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ef0c lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.846734:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bd600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201590.846739:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ef0c lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.846747:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ef0c lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.846755:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ef0c lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.846764:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201590.846771:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ef0c lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.846779:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd600/0xd138388016f6ef0c lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201590.846822:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a4000 x1875064727941504/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201606 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201590.846842:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201590.846878:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ef05 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096aca expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201590.846895:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ef05 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096aca expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1788201590.846906:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ef05 from it ffffadd1c7deb930 00010000:00010000:1.0:1788201590.846910:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ef05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096aca expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201590.846921:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ef05 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096aca expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201590.847022:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201590.847040:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201590.847050:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201590.847059:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1788201590.847067:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201590.847073:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201590.847077:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201590.847182:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201590.847186:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1788201590.847196:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:1.0:1788201590.847282:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.847290:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201590.847297:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.847300:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=acceptance-small.sh, flags=8 00000080:00200000:1.0:1788201590.847362:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201590.847371:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201590.847379:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:1.0:1788201590.847388:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:1.0:1788201590.847395:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201590.847399:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201590.847402:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201590.847406:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:1.0:1788201590.847409:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:1.0:1788201590.847427:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00000080:00200000:1.0:1788201590.847437:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.847441:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201590.847444:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.847450:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=acceptance-small.sh, flags=1801 00000080:00200000:1.0:1788201590.847454:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201590.847460:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=acceptance-small.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14304a600, open_flags 80c1, mode 81ed opened 0 00000080:00200000:1.0:1788201590.847473:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=acceptance-small.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:1.0:1788201590.847498:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: acceptance-small.sh,[0x200000bd7:0x15c:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201590.847511:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ef05 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e2171096aca expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.847568:0:24470:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ef05 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171096aca expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.847576:0:24470:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201590.847580:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6ef05 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171096aca expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201590.847629:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.847637:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201590.847652:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201590.847661:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a4000 x1875064727941760/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201590.847672:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201590.847696:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a4000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727941760:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201590.848923:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201590.857177:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a4000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727941760:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201590.857223:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096afb expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.857267:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x15c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096afb expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.857277:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x15c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096afb expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.857290:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x15c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096afb expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.857303:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x15c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096afb expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.857320:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x15c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096afb expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.857329:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x15c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096afb expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.857337:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x15c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096afb expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201590.857350:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1724a4000 x1875064727941760/t8589937337(8589937337) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201606 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201590.857365:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a4000 x1875064727941760/t8589937337(8589937337) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201606 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201590.857383:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x15c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096afb expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201590.857398:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x15c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096afb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.857409:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/348 (0 0) 00000080:00200000:1.0:1788201590.857434:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201590.857451:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=acceptance-small.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:1.0:1788201590.857492:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x15c:0x0](ffff8bc1446bc2c8) 00000080:00200000:1.0:1788201590.857646:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x15c:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201590.857657:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x15c:0x0](ffff8bc1446bc2c8) 00000080:00010000:1.0:1788201590.857660:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x15c:0x0](ffff8bc1446bc2c8) for lock 0xd138388016f6ef13 00000080:00010000:1.0:1788201590.857672:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x15c:0x0](ffff8bc1446bc2c8) 00000080:00200008:1.0:1788201590.857689:0:24470:0:(file.c:1090:ll_file_open()) START file acceptance-small.sh:[0x200000bd7:0x15c:0x0](ffff8bc1446bc2c8), flags 100301 00000002:00100000:1.0:1788201590.857887:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a4000 x1875064727941760/t8589937337(8589937337) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201606 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201590.857938:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ef13 from it ffff8bc144cb57e0 00010000:00010000:1.0:1788201590.857943:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x15c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096afb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.857954:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x15c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096afb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201590.857981:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15c:0x0](ffff8bc1446bc2c8), inode mode 81ed mask 40 00000080:00200008:1.0:1788201590.858433:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file acceptance-small.sh:[0x200000bd7:0x15c:0x0](ffff8bc1446bc2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201590.858443:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x15c:0x0](ffff8bc1446bc2c8),name=acceptance-small.sh 00000002:00010000:1.0:1788201590.858468:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x15c:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201590.858481:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x15c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096afb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201590.858494:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x15c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096afb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201590.858502:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201590.858508:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x15c:0x0](ffff8bc1446bc2c8) 00000080:00010000:1.0:1788201590.858513:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x15c:0x0](ffff8bc1446bc2c8) for lock 0xd138388016f6ef13 00000080:00010000:1.0:1788201590.858518:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ef13 from it ffffadd1c7debcd8 00010000:00010000:1.0:1788201590.858521:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x15c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096afb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201590.858529:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x15c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096afb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201590.858568:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x15c:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201590.858579:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x15c:0x0] 00000008:00010000:1.0:1788201590.858624:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201590.858629:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d45b0, osc lock ffff8bc145d08850, flags 0x400001002 00010000:00010000:1.0:1788201590.858683:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6ef1a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.859527:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6ef1a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201590.859637:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000020:00200000:1.0:1788201590.859660:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1788201590.860555:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727941888:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201590.865438:0:10055:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8bc143fc0000: committing for last_committed 8589935298 gen 1 00010000:00010000:0.0:1788201590.866302:0:10055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6ef1a lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.866339:0:10055:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6ef1a lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096b09 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.866359:0:10055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6ef1a lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096b09 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.866375:0:10055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6ef1a lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096b09 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201590.866394:0:10055:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6ef1a lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096b09 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201590.866427:0:10055:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201590.866506:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6ef1a lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171096b09 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.866517:0:10055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6ef1a lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171096b09 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.866527:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6ef1a lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171096b09 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.866538:0:10055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6ef1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171096b09 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201590.866567:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727941888:192.168.201.143@tcp:101:cp.0 00000080:00200000:1.0:1788201590.866782:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x15c:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201590.866856:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201590.866861:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201590.866867:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d45b0 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201590.866871:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201590.866874:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d45b0 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201590.866924:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x15c:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201590.867329:0:24470:0:(file.c:2638:do_file_write_iter()) START file acceptance-small.sh:[0x200000bd7:0x15c:0x0], ppos: 0, count: 903 00000080:00200000:1.0:1788201590.867349:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 903 bytes 00000080:00200000:1.0:1788201590.867355:0:24470:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 903 00000080:00200000:1.0:1788201590.867384:0:24470:0:(file.c:2090:ll_file_io_generic()) acceptance-small.sh: write ppos: 0, bytes: 903 00000080:00200000:1.0:1788201590.867389:0:24470:0:(file.c:1848:ll_io_set_mirror()) acceptance-small.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201590.867396:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@000000007551f957[0x110, 1, [0x200000bd7:0x15c:0x0] hash] 00000020:00200000:1.0:1788201590.867398:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 903) 0 0 00000080:00200000:1.0:1788201590.867403:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x15c:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201590.867425:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1788201590.867434:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 903) 903, 903 00020000:00200000:1.0:1788201590.867438:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201590.867470:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1788201590.867484:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201590.867491:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d45b0, osc lock ffff8bc145d08850, flags 0x0 00010000:00010000:1.0:1788201590.867510:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/416 (0 4095) 00010000:00010000:1.0:1788201590.867561:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.867572:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.867589:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201590.867687:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a6680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727942016:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201590.867949:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8180 going to sleep for 11 seconds 00000100:00100000:3.0:1788201590.871444:0:21781:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201590.871468:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743470080 00000100:00100000:3.0:1788201590.871479:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743470080 00000100:00100000:3.0:1788201590.871588:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 687 00000100:00100000:3.0:1788201590.871611:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc143d01850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:24636:x1875064743470080:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201590.871633:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6ef1a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171096b09 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201590.871744:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201590.871751:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc143d01850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:24636:x1875064743470080:12345-192.168.201.143@tcp:104: Request processed in 145us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201590.871759:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 687 00010000:00010000:0.0:1788201590.871861:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201590.871871:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6ef1a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171096b09 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201590.871883:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bc400 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201590.871890:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6ef1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171096b09 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201590.871956:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x15c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201590.871971:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x15c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1788201590.872068:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6ef1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096b09 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201590.872077:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201590.872105:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6ef1a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096b09 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201590.872116:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6ef1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096b09 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201590.872136:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201590.872138:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201590.872140:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201590.872159:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727942144:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201590.877563:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743470208 00000100:00100000:0.0:1788201590.877576:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743470208 00000100:00100000:0.0:1788201590.877657:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 688 00000100:00100000:0.0:1788201590.877670:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172758000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23412:x1875064743470208:12345-192.168.201.143@tcp:105: 00010000:00010000:0.0:1788201590.877692:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.877718:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.877730:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.877751:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.877763:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.877776:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.877977:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1460bd600) 00000100:00100000:0.0:1788201590.878365:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172758000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23412:x1875064743470208:12345-192.168.201.143@tcp:105: Request processed in 696us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201590.878374:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 688 00000100:00100000:1.0:1788201590.878487:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a6680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727942016:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201590.878513:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.878537:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201590.878552:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.878567:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.878577:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201590.878625:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) acceptance-small.sh: write [0, 903) append 0 append lockpos 0 00000080:00200000:1.0:1788201590.878649:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 903 bytes 00000080:00200000:1.0:1788201590.878893:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 903, copied 903 00000080:00200000:1.0:1788201590.878906:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008dcfd20f[3 00000000dc4774e3 2 1 000000008c769856 0 0 0] 00000080:00200000:1.0:1788201590.878911:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003a0ef581 17ffffc0001001 3:0 ffff8bc166523b60 0 lru 00000080:00200000:1.0:1788201590.878920:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a1f9ffa9 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000e2279ad9 > 3< 0 0 > 4< 0 0 8 28966912 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.878923:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008dcfd20f 00000080:00200000:1.0:1788201590.878925:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201590.878931:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 903 prio 0 00000008:00010000:1.0:1788201590.878959:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000436963de ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201590.878994:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1446bc478, count 1, dirtied 1 00000080:00200000:1.0:1788201590.879546:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 903 bytes, tot: 903 00000080:00200000:1.0:1788201590.879552:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) acceptance-small.sh: write bytes 0, result: 903 00000020:00010000:1.0:1788201590.879576:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c4128 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201590.879581:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c4128 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201590.879584:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d45b0 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201590.879603:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.879618:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201590.879639:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c4128 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201590.879643:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d45b0 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201590.879655:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 903 bytes 00000080:00200000:1.0:1788201590.879663:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1788201590.879917:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x15c:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201590.879923:0:24470:0:(file.c:2238:ll_file_io_generic()) acceptance-small.sh: 2 io complete with rc: 0, result: 903, restart: 0 00000080:00200000:1.0:1788201590.879933:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x15c:0x0] updating i_size 903 i_blocks 1 00000080:00200000:1.0:1788201590.879940:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 903 00000080:00200008:1.0:1788201590.880291:0:24470:0:(file.c:479:ll_file_release()) START file acceptance-small.sh:[0x200000bd7:0x15c:0x0](ffff8bc1446bc2c8), flags 100001 00000002:00100000:1.0:1788201590.880370:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1724a4000 x1875064727941760/t8589937337(8589937337) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201606 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201590.880385:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201590.880393:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a6680 x1875064727942400/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201590.880433:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a6680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727942400:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201590.880515:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8180 going to sleep for 11 seconds 00000100:00100000:3.0:1788201590.885174:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a6680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727942400:192.168.201.143@tcp:35:cp.0 00000002:00100000:3.0:1788201590.885271:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1724a4000 x1875064727941760/t8589937337(8589937337) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201606 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201590.885480:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201590.885506:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201590.885530:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00010000:00010000:3.0:1788201590.885547:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00000080:00200000:3.0:1788201590.885562:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201590.885569:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201590.885573:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201590.885582:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201590.885587:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00000100:00100000:0.0:1788201590.885856:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727942144:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201590.885958:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00000080:00200000:3.0:1788201590.885979:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000100:00100000:1.0:1788201590.891074:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172759f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727942528:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201590.891118:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6ef28 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096b2c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.891148:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6ef28 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096b2c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.891159:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6ef28 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096b2c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.891173:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6ef28 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096b2c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.891186:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6ef28 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096b2c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.891429:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6ef28 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096b2c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.891441:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6ef28 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096b2c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.891450:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6ef28 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096b2c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201590.891465:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x10 disposition=0xb, status=0 req@ffff8bc172759f80 x1875064727942528/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201606 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201590.891480:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6ef28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096b2c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.891493:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201590.891503:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 16 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201590.891532:0:24470:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x15b:0x0], updating i_size 512 00000080:00200000:1.0:1788201590.891536:0:24470:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x15b:0x0](ffff8bc1459d63c8): rc = 0 00000080:00010000:1.0:1788201590.891544:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x15b:0x0](ffff8bc1459d63c8) for lock 0xd138388016f6ef28 00000080:00010000:1.0:1788201590.891562:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x15b:0x0](ffff8bc1459d63c8) 00000080:00010000:1.0:1788201590.891567:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ef28 from it ffffadd1c7deba28 00010000:00010000:1.0:1788201590.891570:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6ef28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096b2c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.891581:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6ef28 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096b2c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201590.891712:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.891724:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=acceptance-small.sh, flags=8 00000080:00200008:1.0:1788201590.891738:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file acceptance-small.sh:[0x200000bd7:0x15c:0x0](ffff8bc1446bc2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201590.891745:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x15c:0x0](ffff8bc1446bc2c8),name=acceptance-small.sh 00000002:00010000:1.0:1788201590.891770:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x15c:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201590.891784:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x15c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096afb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201590.891841:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x15c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096afb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201590.891849:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201590.891857:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x15c:0x0](ffff8bc1446bc2c8) 00000080:00010000:1.0:1788201590.891860:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x15c:0x0](ffff8bc1446bc2c8) for lock 0xd138388016f6ef13 00000080:00010000:1.0:1788201590.891865:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ef13 from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201590.891869:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x15c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096afb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201590.891878:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x15c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096afb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201590.891940:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x15c:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201590.891953:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x15c:0x0] 00000008:00010000:1.0:1788201590.891995:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201590.892006:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4e30, osc lock ffff8bc145d08850, flags 0x400001002 00010000:00010000:1.0:1788201590.892026:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201590.892040:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201590.892054:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201590.892059:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201590.892068:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201590.892079:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201590.892099:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x15c:0x0] updating i_size 903 i_blocks 1 00000020:00010000:1.0:1788201590.892104:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201590.892107:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201590.892110:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4e30 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201590.892115:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201590.892118:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4e30 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201590.892152:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x15c:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201590.892521:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201590.892534:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201590.892544:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00010000:00010000:1.0:1788201590.892555:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00000080:00200000:1.0:1788201590.892562:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201590.892568:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201590.892571:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201590.892576:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201590.892580:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 0 00010000:00010000:1.0:1788201590.892663:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 1 00000080:00200000:1.0:1788201590.892675:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.892682:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201590.892687:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.892768:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=conf-sanity-framework.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201590.892773:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=conf-sanity-framework.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201590.892784:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: conf-sanity-framework.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201590.892865:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ef2f lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.892874:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ef2f lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.892887:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ef2f lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201590.892916:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a5500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727942656:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201590.893405:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201590.897467:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a5500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727942656:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201590.897498:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ef2f lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.897515:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ef2f lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.897528:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ef2f lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.897535:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ef2f lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.897545:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ef2f lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.897553:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bcc00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201590.897558:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ef2f lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.897567:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ef2f lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.897575:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ef2f lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.897582:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201590.897659:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ef2f lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.897670:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bcc00/0xd138388016f6ef2f lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201590.897764:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a5500 x1875064727942656/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 600/584 e 0 to 0 dl 1788201606 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201590.897784:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201590.897892:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201590.897970:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201590.898160:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201590.898175:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1788201590.898190:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 1 00000080:00200000:1.0:1788201590.898197:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201590.898274:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201590.898278:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201590.898285:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201590.898290:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1788201590.898300:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 1 00000080:00200000:1.0:1788201590.898319:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.898328:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201590.898336:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.898353:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=conf-sanity-framework.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:1.0:1788201590.898357:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=conf-sanity-framework.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201590.898370:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: conf-sanity-framework.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201590.898433:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ef36 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.898442:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ef36 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.898455:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ef36 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201590.898482:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a5500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727942784:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201590.898762:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201590.903382:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a5500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727942784:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201590.903423:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ef36 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.903441:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ef36 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.903449:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ef36 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.903457:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ef36 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.903467:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ef36 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.903475:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bc600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201590.903480:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ef36 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.903488:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ef36 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.903496:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ef36 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.903504:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201590.903512:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ef36 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.903519:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc600/0xd138388016f6ef36 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201590.903546:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a5500 x1875064727942784/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 600/584 e 0 to 0 dl 1788201606 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201590.903565:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201590.903666:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201590.904368:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201590.904392:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201590.904409:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 1 00010000:00010000:1.0:1788201590.904437:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 1 00000080:00200000:1.0:1788201590.904447:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201590.904453:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201590.904457:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201590.904465:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:1.0:1788201590.904469:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 1 00010000:00010000:1.0:1788201590.904479:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00000080:00200000:1.0:1788201590.904498:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.904506:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201590.904513:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.904527:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201590.904534:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=conf-sanity-framework.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14304a300, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:1.0:1788201590.904543:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=conf-sanity-framework.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:1.0:1788201590.904566:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: conf-sanity-framework.sh,[0x200000bd7:0x15d:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201590.904780:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ef3d lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.904815:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ef3d lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201590.904831:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201590.904845:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a5500 x1875064727943040/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 672/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201590.904856:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ef3d lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201590.904883:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a5500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727943040:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201590.905445:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201590.915029:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201590.917440:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172759c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727943168:192.168.201.143@tcp:101:cp.0 00000080:00200000:1.0:1788201590.924087:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x15d:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201590.924146:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc146006060 (ffff8bc1469191b8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201590.924152:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146006060 (ffff8bc1469191b8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201590.924159:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d930 (ffff8bc146919098/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201590.924165:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146006060 (ffff8bc1469191b8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201590.924169:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d930 (ffff8bc1469191b8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201590.924278:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x15d:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201590.924472:0:24470:0:(file.c:2638:do_file_write_iter()) START file conf-sanity-framework.sh:[0x200000bd7:0x15d:0x0], ppos: 0, count: 5634 00000080:00200000:1.0:1788201590.924517:0:24470:0:(file.c:2090:ll_file_io_generic()) conf-sanity-framework.sh: write ppos: 0, bytes: 5634 00000080:00200000:1.0:1788201590.924524:0:24470:0:(file.c:1848:ll_io_set_mirror()) conf-sanity-framework.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201590.924532:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000edbe95dc[0x110, 1, [0x200000bd7:0x15d:0x0] hash] 00000020:00200000:1.0:1788201590.924535:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5634) 0 0 00000080:00200000:1.0:1788201590.924541:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x15d:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201590.924555:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 1] 00020000:00200000:1.0:1788201590.924563:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5634) 5634, 5634 00020000:00200000:1.0:1788201590.924568:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201590.924668:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 1] 00000008:00010000:1.0:1788201590.924684:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201590.924689:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4e30, osc lock ffff8bc145d08850, flags 0x0 00010000:00010000:1.0:1788201590.924776:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/417 (0 8191) 00010000:00010000:1.0:1788201590.925173:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.925187:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.925271:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201590.925307:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a6d80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727943296:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201590.925500:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201590.928482:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201590.932506:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a6d80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727943296:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201590.932547:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.932572:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.932584:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201590.936331:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201590.936436:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743470464 00000100:00100000:0.0:1788201590.936449:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743470464 00000100:00100000:0.0:1788201590.936557:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 690 00000100:00100000:0.0:1788201590.936571:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21003:x1875064743470464:12345-192.168.201.143@tcp:105: 00010000:00010000:0.0:1788201590.936604:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.936624:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.936637:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.936652:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.936664:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.936676:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.936942:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1460bc600) 00000100:00100000:0.0:1788201590.937183:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21003:x1875064743470464:12345-192.168.201.143@tcp:105: Request processed in 614us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201590.937193:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 690 00010000:00010000:1.0:1788201590.939717:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.939744:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.939766:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201590.939781:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.939836:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.939847:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201590.939891:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) conf-sanity-framework.sh: write [0, 5634) append 0 append lockpos 0 00000080:00200000:1.0:1788201590.939914:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.939970:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:1.0:1788201590.939994:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001dcfa8c4[3 000000006bd389d0 2 1 000000008c769856 0 0 0] 00000080:00200000:1.0:1788201590.940004:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004eab3006 17ffffc0001001 3:0 ffff8bc1665232a0 0 lru 00000080:00200000:1.0:1788201590.940013:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000027c71539 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 00000000d01be84b > 3< 0 0 > 4< 0 0 8 25559040 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.940016:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001dcfa8c4 00000080:00200000:1.0:1788201590.940018:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201590.940022:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 1538 bytes 00000080:00200000:1.0:1788201590.940081:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 1538, copied 1538 00000080:00200000:1.0:1788201590.940087:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000540562c5[3 000000006bd389d0 2 1 000000008c769856 0 0 1] 00000080:00200000:1.0:1788201590.940090:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e1c4bf73 17ffffc0001021 2:0 ffff8bc166523460 1 lru 00000080:00200000:1.0:1788201590.940096:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c4bfa726 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 00000000d01be84b > 3< 0 0 > 4< 0 0 8 25559040 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.940098:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000540562c5 00000080:00200000:1.0:1788201590.940100:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:1.0:1788201590.940103:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 2, from 0, to 1538 prio 0 00000008:00010000:1.0:1788201590.940128:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 000000003ce7f60e ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201590.940153:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459f75f8, count 2, dirtied 2 00000080:00200000:1.0:1788201590.940158:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 2 pages 5634 bytes, tot: 5634 00000080:00200000:1.0:1788201590.940162:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) conf-sanity-framework.sh: write bytes 0, result: 5634 00000020:00010000:1.0:1788201590.940179:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c4128 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201590.940183:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c4128 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201590.940188:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4e30 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201590.940194:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.940223:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201590.940244:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c4128 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201590.940248:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4e30 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201590.940259:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 5634 bytes 00000080:00200000:1.0:1788201590.940267:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 1] 00000080:00200000:1.0:1788201590.940307:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x15d:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201590.940312:0:24470:0:(file.c:2238:ll_file_io_generic()) conf-sanity-framework.sh: 2 io complete with rc: 0, result: 5634, restart: 0 00000080:00200000:1.0:1788201590.940321:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x15d:0x0] updating i_size 5634 i_blocks 1 00000080:00200000:1.0:1788201590.940327:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5634 00000080:00200008:1.0:1788201590.940386:0:24470:0:(file.c:479:ll_file_release()) START file conf-sanity-framework.sh:[0x200000bd7:0x15d:0x0](ffff8bc1459f7448), flags 100001 00000002:00100000:1.0:1788201590.940483:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1724a5500 x1875064727943040/t8589937339(8589937339) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 600/664 e 0 to 0 dl 1788201606 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201590.940497:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201590.940503:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a6d80 x1875064727943680/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201590.940529:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a6d80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727943680:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201590.940620:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201590.944051:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a6d80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727943680:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201590.944094:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1724a5500 x1875064727943040/t8589937339(8589937339) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 600/664 e 0 to 0 dl 1788201606 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201590.944190:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201590.944225:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201590.944250:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1788201590.944267:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00000080:00200000:1.0:1788201590.944277:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201590.944284:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201590.944288:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201590.944298:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201590.944303:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1788201590.944316:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 12 lru_type: 1 00000080:00200000:1.0:1788201590.944335:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.944342:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201590.944349:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.944353:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=conf-sanity-framework.sh, flags=8 00000080:00200008:1.0:1788201590.944363:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file conf-sanity-framework.sh:[0x200000bd7:0x15d:0x0](ffff8bc1459f7448), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201590.944369:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x15d:0x0](ffff8bc1459f7448),name=conf-sanity-framework.sh 00000002:00010000:1.0:1788201590.944383:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x15d:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201590.944393:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ef3d lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x15d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096b72 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201590.944403:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ef3d lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x15d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096b72 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201590.944428:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201590.944434:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x15d:0x0](ffff8bc1459f7448) 00000080:00010000:1.0:1788201590.944437:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x15d:0x0](ffff8bc1459f7448) for lock 0xd138388016f6ef3d 00000080:00010000:1.0:1788201590.944441:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ef3d from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201590.944444:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ef3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x15d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096b72 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201590.944453:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ef3d lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x15d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096b72 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201590.944513:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x15d:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201590.944526:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x15d:0x0] 00000008:00010000:1.0:1788201590.944566:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201590.944570:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4e30, osc lock ffff8bc145d08850, flags 0x400001002 00010000:00010000:1.0:1788201590.944589:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201590.944616:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201590.944633:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201590.944638:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201590.944648:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201590.944666:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201590.944677:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x15d:0x0] updating i_size 5634 i_blocks 1 00000020:00010000:1.0:1788201590.944682:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201590.944686:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201590.944690:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4e30 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201590.945113:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201590.945116:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4e30 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201590.945157:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x15d:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201590.945438:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201590.945455:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201590.945472:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 12 lru_type: 1 00010000:00010000:1.0:1788201590.945486:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 12 lru_type: 1 00000080:00200000:1.0:1788201590.945496:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201590.945505:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201590.945508:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201590.945514:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201590.945518:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 12 lru_type: 1 00010000:00010000:1.0:1788201590.945528:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 13 lru_type: 1 00000080:00200000:1.0:1788201590.945549:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.945556:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201590.945561:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201590.945579:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=conf-sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201590.945585:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=conf-sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201590.945669:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: conf-sanity.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201590.945889:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ef52 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.945900:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ef52 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.945913:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ef52 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201590.945950:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a5c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727943808:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201590.946271:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172759c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727943424:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.946550:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201590.950868:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a5c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727943808:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201590.950903:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ef52 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.950922:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ef52 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.950931:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ef52 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.950939:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ef52 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.950956:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ef52 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.950963:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bce00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201590.950969:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ef52 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.950978:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ef52 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.951185:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ef52 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.951195:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201590.951273:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ef52 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.951281:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6ef52 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201590.951305:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a5c00 x1875064727943808/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201606 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201590.951324:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201590.951360:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:3.0:1788201590.951457:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201590.951478:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201590.951490:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 13 lru_type: 1 00010000:00010000:3.0:1788201590.951509:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 13 lru_type: 1 00000080:00200000:3.0:1788201590.951518:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201590.951525:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201590.951530:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201590.951536:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201590.951541:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 13 lru_type: 1 00010000:00010000:3.0:1788201590.951551:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 14 lru_type: 1 00000080:00200000:3.0:1788201590.951569:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201590.951578:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201590.951585:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201590.951789:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=conf-sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:3.0:1788201590.951843:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=conf-sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:3.0:1788201590.951859:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: conf-sanity.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201590.951912:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6ef59 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.951920:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6ef59 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201590.951933:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6ef59 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201590.951969:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2d80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727943936:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201590.952549:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.955547:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a2d80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727943936:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201590.955578:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6ef59 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.955607:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6ef59 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.955616:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6ef59 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.955631:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6ef59 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.955642:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6ef59 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.955650:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1725a1600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201590.955656:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6ef59 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.955664:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6ef59 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.955673:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6ef59 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.955682:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201590.955689:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6ef59 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.955860:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6ef59 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201590.955887:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a2d80 x1875064727943936/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201606 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201590.955906:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201590.955938:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201590.956074:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201590.956102:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201590.956113:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 14 lru_type: 1 00010000:00010000:0.0:1788201590.956128:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 14 lru_type: 1 00000080:00200000:0.0:1788201590.956137:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201590.956143:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201590.956147:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201590.956154:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:0.0:1788201590.956159:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 14 lru_type: 1 00010000:00010000:0.0:1788201590.956169:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 15 lru_type: 1 00000080:00200000:0.0:1788201590.956185:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.956194:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201590.956551:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201590.956571:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201590.956576:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=conf-sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc152c96600, open_flags 80c1, mode 81ed opened 0 00000080:00200000:0.0:1788201590.956586:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=conf-sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:0.0:1788201590.956672:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: conf-sanity.sh,[0x200000bd7:0x15e:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00000100:00100000:0.0:1788201590.964065:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727944192:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201590.964334:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6ef60 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096bcd expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.964450:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6ef60 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x15e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096bcd expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.964461:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6ef60 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096bcd expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.964474:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6ef60 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096bcd expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.964486:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6ef60 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096bcd expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.964505:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6ef60 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096bcd expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.964514:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6ef60 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096bcd expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.964522:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6ef60 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096bcd expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201590.964536:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1725b1c00 x1875064727944192/t8589937341(8589937341) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201606 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201590.964550:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725b1c00 x1875064727944192/t8589937341(8589937341) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201606 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201590.964565:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6ef60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096bcd expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201590.964580:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6ef60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096bcd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.964603:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/350 (0 0) 00000080:00200000:1.0:1788201590.964612:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201590.964629:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=conf-sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:1.0:1788201590.964669:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x15e:0x0](ffff8bc1446b80c8) 00000080:00200000:1.0:1788201590.964880:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x15e:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201590.964891:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x15e:0x0](ffff8bc1446b80c8) 00000080:00010000:1.0:1788201590.964895:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x15e:0x0](ffff8bc1446b80c8) for lock 0xd138388016f6ef60 00000080:00010000:1.0:1788201590.964908:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x15e:0x0](ffff8bc1446b80c8) 00000080:00200008:1.0:1788201590.964926:0:24470:0:(file.c:1090:ll_file_open()) START file conf-sanity.sh:[0x200000bd7:0x15e:0x0](ffff8bc1446b80c8), flags 100301 00000002:00100000:1.0:1788201590.964950:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725b1c00 x1875064727944192/t8589937341(8589937341) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201606 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201590.965188:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ef60 from it ffff8bc146937e40 00010000:00010000:1.0:1788201590.965194:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6ef60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096bcd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.965275:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6ef60 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096bcd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201590.965306:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15e:0x0](ffff8bc1446b80c8), inode mode 81ed mask 40 00000080:00200008:1.0:1788201590.965343:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file conf-sanity.sh:[0x200000bd7:0x15e:0x0](ffff8bc1446b80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201590.965350:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x15e:0x0](ffff8bc1446b80c8),name=conf-sanity.sh 00000002:00010000:1.0:1788201590.965373:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x15e:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201590.965386:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6ef60 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096bcd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201590.965398:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6ef60 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096bcd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201590.965407:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201590.965422:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x15e:0x0](ffff8bc1446b80c8) 00000080:00010000:1.0:1788201590.965427:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x15e:0x0](ffff8bc1446b80c8) for lock 0xd138388016f6ef60 00000080:00010000:1.0:1788201590.965432:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ef60 from it ffffadd1c7debcd8 00010000:00010000:1.0:1788201590.965435:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6ef60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096bcd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201590.965444:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6ef60 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096bcd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201590.965475:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x15e:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201590.965486:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x15e:0x0] 00000008:00010000:1.0:1788201590.965517:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201590.965522:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4c30, osc lock ffff8bc145d08850, flags 0x400001002 00010000:00010000:1.0:1788201590.965573:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004373584d/0xd138388016f6ef67 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.965585:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004373584d/0xd138388016f6ef67 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201590.965938:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727944320:192.168.201.143@tcp:101:cp.0 00000020:00200000:1.0:1788201590.966370:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:1.0:1788201590.970551:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x15e:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201590.970558:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201590.970562:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201590.970567:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4c30 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201590.970571:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201590.970574:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4c30 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201590.970689:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x15e:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201590.972770:0:24470:0:(file.c:2638:do_file_write_iter()) START file conf-sanity.sh:[0x200000bd7:0x15e:0x0], ppos: 0, count: 394763 00000080:00200000:1.0:1788201590.972909:0:24470:0:(file.c:2090:ll_file_io_generic()) conf-sanity.sh: write ppos: 0, bytes: 394763 00000080:00200000:1.0:1788201590.972918:0:24470:0:(file.c:1848:ll_io_set_mirror()) conf-sanity.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201590.972927:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@0000000010bfade1[0x110, 1, [0x200000bd7:0x15e:0x0] hash] 00000020:00200000:1.0:1788201590.972931:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 394763) 0 0 00000080:00200000:1.0:1788201590.972936:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x15e:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201590.972954:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 96] 00020000:00200000:1.0:1788201590.972964:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 394763) 394763, 394763 00020000:00200000:1.0:1788201590.972968:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201590.973125:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 96] 00000008:00010000:1.0:1788201590.973145:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201590.973153:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4c30, osc lock ffff8bc145d08850, flags 0x0 00010000:00010000:1.0:1788201590.973178:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/417 (0 397311) 00010000:00010000:1.0:1788201590.973326:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.973339:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 3 type: EXT [0->397311] (req 0->397311) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.973351:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 3 type: EXT [0->397311] (req 0->397311) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201590.973386:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a4700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727944448:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201590.973719:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201590.977517:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:1.0:1788201590.979026:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201590.979040:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004373584d/0xd138388016f6ef67 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171096bdb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201590.979055:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bde00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201590.979064:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004373584d/0xd138388016f6ef67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171096bdb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201590.979136:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x15e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201590.979151:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x15e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201590.979258:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004373584d/0xd138388016f6ef67 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096bdb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201590.979266:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201590.979307:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004373584d/0xd138388016f6ef67 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096bdb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201590.979317:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004373584d/0xd138388016f6ef67 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096bdb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201590.979338:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201590.979340:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201590.979342:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201590.979478:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727944576:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201590.982145:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a4700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727944448:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201590.982185:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->397311] (req 0->397311) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.982217:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->397311] (req 0->397311) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.982228:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->397311] (req 0->397311) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201590.984305:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201590.984854:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743470720 00000100:00100000:0.0:1788201590.984867:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743470720 00000100:00100000:0.0:1788201590.984936:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 692 00000100:00100000:0.0:1788201590.984949:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23418:x1875064743470720:12345-192.168.201.143@tcp:105: 00010000:00010000:0.0:1788201590.984970:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->397311] (req 0->397311) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.985003:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->397311] (req 0->397311) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.985016:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.985029:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.985042:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.985055:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201590.985091:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1460bdc00) 00000100:00100000:0.0:1788201590.985160:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23418:x1875064743470720:12345-192.168.201.143@tcp:105: Request processed in 214us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201590.985169:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 692 00010000:00010000:1.0:1788201590.985489:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.985502:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.985522:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201590.985536:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.985551:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.985561:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201590.985603:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) conf-sanity.sh: write [0, 394763) append 0 append lockpos 0 00000080:00200000:1.0:1788201590.985625:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.985684:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:1.0:1788201590.985707:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000043566d32[3 000000004e9a4122 2 1 000000008c769856 0 0 0] 00000080:00200000:1.0:1788201590.985711:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001a71cc15 17ffffc0001001 3:0 ffff8bc166523d20 0 lru 00000080:00200000:1.0:1788201590.985720:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004618de43 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.985723:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000043566d32 00000080:00200000:1.0:1788201590.985724:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201590.985728:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.985753:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:1.0:1788201590.985758:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b2f71825[3 000000004e9a4122 2 1 000000008c769856 0 0 1] 00000080:00200000:1.0:1788201590.985760:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000037bd6df1 17ffffc0001001 3:0 ffff8bc166523000 1 lru 00000080:00200000:1.0:1788201590.985766:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005574fde4 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.985768:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b2f71825 00000080:00200000:1.0:1788201590.985769:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:1.0:1788201590.985772:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.985810:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:1.0:1788201590.985816:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006b149951[3 000000004e9a4122 2 1 000000008c769856 0 0 2] 00000080:00200000:1.0:1788201590.985819:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002bf29933 17ffffc0001001 3:0 ffff8bc166523700 2 lru 00000080:00200000:1.0:1788201590.985825:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000006119486 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.985828:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006b149951 00000080:00200000:1.0:1788201590.985829:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:1.0:1788201590.985832:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.985848:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:1.0:1788201590.985853:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000738fa808[3 000000004e9a4122 2 1 000000008c769856 0 0 3] 00000080:00200000:1.0:1788201590.985856:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008e0d47cd 17ffffc0001001 3:0 ffff8bc1665237e0 3 lru 00000080:00200000:1.0:1788201590.985862:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000955e6814 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.985864:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000738fa808 00000080:00200000:1.0:1788201590.985866:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:1.0:1788201590.985867:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.985880:0:24470:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:1.0:1788201590.985884:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a01f8f2d[3 000000004e9a4122 2 1 000000008c769856 0 0 4] 00000080:00200000:1.0:1788201590.985888:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000095894e7f 17ffffc0001001 3:0 ffff8bc166523620 4 lru 00000080:00200000:1.0:1788201590.985894:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006b2971b3 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.985896:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a01f8f2d 00000080:00200000:1.0:1788201590.985898:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:1.0:1788201590.985900:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.985912:0:24470:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:1.0:1788201590.985916:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000066180c16[3 000000004e9a4122 2 1 000000008c769856 0 0 5] 00000080:00200000:1.0:1788201590.985919:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000782deb75 17ffffc0001001 3:0 ffff8bc166523ee0 5 lru 00000080:00200000:1.0:1788201590.985925:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003eb6f6d2 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.985927:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000066180c16 00000080:00200000:1.0:1788201590.985928:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:1.0:1788201590.985930:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.985945:0:24470:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:1.0:1788201590.985949:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000013598e45[3 000000004e9a4122 2 1 000000008c769856 0 0 6] 00000080:00200000:1.0:1788201590.985952:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004cdea4cb 17ffffc0001001 3:0 ffff8bc166523e00 6 lru 00000080:00200000:1.0:1788201590.985958:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000044172f25 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.985961:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000013598e45 00000080:00200000:1.0:1788201590.985962:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:1.0:1788201590.985964:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.985977:0:24470:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:1.0:1788201590.985982:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b1ccae26[3 000000004e9a4122 2 1 000000008c769856 0 0 7] 00000080:00200000:1.0:1788201590.985985:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008b6f52f2 17ffffc0001001 3:0 ffff8bc1665238c0 7 lru 00000080:00200000:1.0:1788201590.985991:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b18cb039 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.985993:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b1ccae26 00000080:00200000:1.0:1788201590.985995:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:1.0:1788201590.986065:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.986082:0:24470:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:1.0:1788201590.986087:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b4506aba[3 000000004e9a4122 2 1 000000008c769856 0 0 8] 00000080:00200000:1.0:1788201590.986090:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000037507f41 17ffffc0001001 3:0 ffff8bc166523540 8 lru 00000080:00200000:1.0:1788201590.986096:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e9a189f0 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.986099:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b4506aba 00000080:00200000:1.0:1788201590.986100:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:1.0:1788201590.986102:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.986126:0:24470:0:(rw26.c:898:ll_write_end()) pos 36864, len 4096, copied 4096 00000080:00200000:1.0:1788201590.986131:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000058187681[3 000000004e9a4122 2 1 000000008c769856 0 0 9] 00000080:00200000:1.0:1788201590.986134:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000033c3d3e5 17ffffc0001021 2:0 ffff8bc166523a80 9 lru 00000080:00200000:1.0:1788201590.986140:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006225a0e5 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.986143:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000058187681 00000080:00200000:1.0:1788201590.986144:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:1.0:1788201590.986146:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 10 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.986158:0:24470:0:(rw26.c:898:ll_write_end()) pos 40960, len 4096, copied 4096 00000080:00200000:1.0:1788201590.986163:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f153c5f4[3 000000004e9a4122 2 1 000000008c769856 0 0 10] 00000080:00200000:1.0:1788201590.986166:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001f17ef88 17ffffc0001001 3:0 ffff8bc166523c40 10 lru 00000080:00200000:1.0:1788201590.986172:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000062b0e2a 10: 1< 0 - - > 2< 40960 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.986175:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f153c5f4 00000080:00200000:1.0:1788201590.986176:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 11. 00000080:00200000:1.0:1788201590.986179:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 11 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.986191:0:24470:0:(rw26.c:898:ll_write_end()) pos 45056, len 4096, copied 4096 00000080:00200000:1.0:1788201590.986385:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a6aa459f[3 000000004e9a4122 2 1 000000008c769856 0 0 11] 00000080:00200000:1.0:1788201590.986390:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006cce39fd 17ffffc0001001 3:0 ffff8bc1665239a0 11 lru 00000080:00200000:1.0:1788201590.986396:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000063c4cd36 11: 1< 0 - - > 2< 45056 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.986399:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a6aa459f 00000080:00200000:1.0:1788201590.986400:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 12. 00000080:00200000:1.0:1788201590.986403:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 12 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.986431:0:24470:0:(rw26.c:898:ll_write_end()) pos 49152, len 4096, copied 4096 00000080:00200000:1.0:1788201590.986436:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000085a1fd64[3 000000004e9a4122 2 1 000000008c769856 0 0 12] 00000080:00200000:1.0:1788201590.986439:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b0de332f 17ffffc0001001 3:0 ffff8bc1665230e0 12 lru 00000080:00200000:1.0:1788201590.986444:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000074baeb3a 12: 1< 0 - - > 2< 49152 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.986447:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000085a1fd64 00000080:00200000:1.0:1788201590.986448:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 13. 00000080:00200000:1.0:1788201590.986450:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 13 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.986467:0:24470:0:(rw26.c:898:ll_write_end()) pos 53248, len 4096, copied 4096 00000080:00200000:1.0:1788201590.986471:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e3244264[3 000000004e9a4122 2 1 000000008c769856 0 0 13] 00000080:00200000:1.0:1788201590.986473:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003321fe95 17ffffc0001001 3:0 ffff8bc1665231c0 13 lru 00000080:00200000:1.0:1788201590.986478:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005c2f0b37 13: 1< 0 - - > 2< 53248 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.986480:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e3244264 00000080:00200000:1.0:1788201590.986481:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 14. 00000080:00200000:1.0:1788201590.986483:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 14 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.986497:0:24470:0:(rw26.c:898:ll_write_end()) pos 57344, len 4096, copied 4096 00000080:00200000:1.0:1788201590.986502:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c49f931f[3 000000004e9a4122 2 1 000000008c769856 0 0 14] 00000080:00200000:1.0:1788201590.986504:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009ebbbb06 17ffffc0001001 3:0 ffff8bc166523380 14 lru 00000080:00200000:1.0:1788201590.986510:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000314a7ce1 14: 1< 0 - - > 2< 57344 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.986513:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c49f931f 00000080:00200000:1.0:1788201590.986514:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 15. 00000080:00200000:1.0:1788201590.986516:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 15 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.986533:0:24470:0:(rw26.c:898:ll_write_end()) pos 61440, len 4096, copied 4096 00000080:00200000:1.0:1788201590.986538:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002db3cd17[3 000000004e9a4122 2 1 000000008c769856 0 0 15] 00000080:00200000:1.0:1788201590.986541:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ad0d9f2b 17ffffc0001001 3:0 ffff8bc145c55d20 15 lru 00000080:00200000:1.0:1788201590.986548:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f4600e76 15: 1< 0 - - > 2< 61440 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.986550:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002db3cd17 00000080:00200000:1.0:1788201590.986552:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 16. 00000080:00200000:1.0:1788201590.986554:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 16 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.986570:0:24470:0:(rw26.c:898:ll_write_end()) pos 65536, len 4096, copied 4096 00000080:00200000:1.0:1788201590.986575:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000190aacef[3 000000004e9a4122 2 1 000000008c769856 0 0 16] 00000080:00200000:1.0:1788201590.986578:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005353547d 17ffffc0001001 3:0 ffff8bc145c55460 16 lru 00000080:00200000:1.0:1788201590.986584:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004bf9aaad 16: 1< 0 - - > 2< 65536 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.986586:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000190aacef 00000080:00200000:1.0:1788201590.986588:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 17. 00000080:00200000:1.0:1788201590.986590:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 17 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.986602:0:24470:0:(rw26.c:898:ll_write_end()) pos 69632, len 4096, copied 4096 00000080:00200000:1.0:1788201590.986607:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f6fb333a[3 000000004e9a4122 2 1 000000008c769856 0 0 17] 00000080:00200000:1.0:1788201590.986610:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001217b3be 17ffffc0001001 3:0 ffff8bc145c552a0 17 lru 00000080:00200000:1.0:1788201590.986616:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d52f6a3a 17: 1< 0 - - > 2< 69632 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.986618:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f6fb333a 00000080:00200000:1.0:1788201590.986619:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 18. 00000080:00200000:1.0:1788201590.986620:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 18 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.986633:0:24470:0:(rw26.c:898:ll_write_end()) pos 73728, len 4096, copied 4096 00000080:00200000:1.0:1788201590.986637:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c59d5246[3 000000004e9a4122 2 1 000000008c769856 0 0 18] 00000080:00200000:1.0:1788201590.986640:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f0bf1f22 17ffffc0001001 3:0 ffff8bc145c55b60 18 lru 00000080:00200000:1.0:1788201590.986646:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c0b36206 18: 1< 0 - - > 2< 73728 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.986649:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c59d5246 00000080:00200000:1.0:1788201590.986650:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 19. 00000080:00200000:1.0:1788201590.986652:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 19 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.986664:0:24470:0:(rw26.c:898:ll_write_end()) pos 77824, len 4096, copied 4096 00000080:00200000:1.0:1788201590.986668:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000156612c5[3 000000004e9a4122 2 1 000000008c769856 0 0 19] 00000080:00200000:1.0:1788201590.986671:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003c70fd1f 17ffffc0001001 3:0 ffff8bc145c55700 19 lru 00000080:00200000:1.0:1788201590.986677:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f644b5dc 19: 1< 0 - - > 2< 77824 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.986679:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000156612c5 00000080:00200000:1.0:1788201590.986681:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 20. 00000080:00200000:1.0:1788201590.986683:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 20 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.987817:0:24470:0:(rw26.c:898:ll_write_end()) pos 81920, len 4096, copied 4096 00000080:00200000:1.0:1788201590.987832:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a2251a2b[3 000000004e9a4122 2 1 000000008c769856 0 0 20] 00000080:00200000:1.0:1788201590.987837:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000094b46029 17ffffc0001001 3:0 ffff8bc145c557e0 20 lru 00000080:00200000:1.0:1788201590.987844:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000030ff6915 20: 1< 0 - - > 2< 81920 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.987847:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a2251a2b 00000080:00200000:1.0:1788201590.987848:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 21. 00000080:00200000:1.0:1788201590.987853:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 21 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.987872:0:24470:0:(rw26.c:898:ll_write_end()) pos 86016, len 4096, copied 4096 00000080:00200000:1.0:1788201590.987877:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f48217ff[3 000000004e9a4122 2 1 000000008c769856 0 0 21] 00000080:00200000:1.0:1788201590.987880:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005e60a9e8 17ffffc0001001 3:0 ffff8bc145c55620 21 lru 00000080:00200000:1.0:1788201590.987886:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000605525cf 21: 1< 0 - - > 2< 86016 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.987888:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f48217ff 00000080:00200000:1.0:1788201590.987890:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 22. 00000080:00200000:1.0:1788201590.987892:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 22 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.987905:0:24470:0:(rw26.c:898:ll_write_end()) pos 90112, len 4096, copied 4096 00000080:00200000:1.0:1788201590.987910:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000078452a0a[3 000000004e9a4122 2 1 000000008c769856 0 0 22] 00000080:00200000:1.0:1788201590.987913:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000063add4d8 17ffffc0001001 3:0 ffff8bc145c55000 22 lru 00000080:00200000:1.0:1788201590.987919:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000286041b6 22: 1< 0 - - > 2< 90112 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.987921:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000078452a0a 00000080:00200000:1.0:1788201590.987923:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 23. 00000080:00200000:1.0:1788201590.987924:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 23 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.987936:0:24470:0:(rw26.c:898:ll_write_end()) pos 94208, len 4096, copied 4096 00000080:00200000:1.0:1788201590.987941:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006098fcc0[3 000000004e9a4122 2 1 000000008c769856 0 0 23] 00000080:00200000:1.0:1788201590.987944:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000518bb245 17ffffc0001001 3:0 ffff8bc145c559a0 23 lru 00000080:00200000:1.0:1788201590.987950:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000709bcdae 23: 1< 0 - - > 2< 94208 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.987952:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006098fcc0 00000080:00200000:1.0:1788201590.987954:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 24. 00000080:00200000:1.0:1788201590.987955:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 24 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.987978:0:24470:0:(rw26.c:898:ll_write_end()) pos 98304, len 4096, copied 4096 00000080:00200000:1.0:1788201590.989433:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007c1a3155[3 000000004e9a4122 2 1 000000008c769856 0 0 24] 00000080:00200000:1.0:1788201590.989438:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f5ce30ad 17ffffc0001021 2:0 ffff8bc145c550e0 24 lru 00000080:00200000:1.0:1788201590.989447:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000de10301d 24: 1< 0 - - > 2< 98304 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.989449:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007c1a3155 00000080:00200000:1.0:1788201590.989451:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 25. 00000080:00200000:1.0:1788201590.989457:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 25 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.989511:0:24470:0:(rw26.c:898:ll_write_end()) pos 102400, len 4096, copied 4096 00000080:00200000:1.0:1788201590.989515:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000007300e53[3 000000004e9a4122 2 1 000000008c769856 0 0 25] 00000080:00200000:1.0:1788201590.989518:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000fc9241a2 17ffffc0001001 3:0 ffff8bc145c551c0 25 lru 00000080:00200000:1.0:1788201590.989522:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000032a56c8a 25: 1< 0 - - > 2< 102400 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.989524:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000007300e53 00000080:00200000:1.0:1788201590.989526:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 26. 00000080:00200000:1.0:1788201590.989527:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 26 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.989543:0:24470:0:(rw26.c:898:ll_write_end()) pos 106496, len 4096, copied 4096 00000080:00200000:1.0:1788201590.989547:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000dda666dd[3 000000004e9a4122 2 1 000000008c769856 0 0 26] 00000080:00200000:1.0:1788201590.989550:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000074f72e95 17ffffc0001001 3:0 ffff8bc145c55380 26 lru 00000080:00200000:1.0:1788201590.989554:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c2023e6e 26: 1< 0 - - > 2< 106496 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.989556:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000dda666dd 00000080:00200000:1.0:1788201590.989557:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 27. 00000080:00200000:1.0:1788201590.989559:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 27 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.989574:0:24470:0:(rw26.c:898:ll_write_end()) pos 110592, len 4096, copied 4096 00000080:00200000:1.0:1788201590.989577:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003b03086f[3 000000004e9a4122 2 1 000000008c769856 0 0 27] 00000080:00200000:1.0:1788201590.989580:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a1ecffcd 17ffffc0001001 3:0 ffff8bc145c55ee0 27 lru 00000080:00200000:1.0:1788201590.989585:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007b6377ac 27: 1< 0 - - > 2< 110592 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.989587:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003b03086f 00000080:00200000:1.0:1788201590.989588:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 28. 00000080:00200000:1.0:1788201590.989590:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 28 of 0 to 4096 bytes 00000100:00100000:3.0:1788201590.990429:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727944576:192.168.201.143@tcp:103:ldlm_bl.0 00000080:00200000:1.0:1788201590.990826:0:24470:0:(rw26.c:898:ll_write_end()) pos 114688, len 4096, copied 4096 00000080:00200000:1.0:1788201590.990837:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009dcba75c[3 000000004e9a4122 2 1 000000008c769856 0 0 28] 00000080:00200000:1.0:1788201590.990841:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006f6e12e2 17ffffc0001001 3:0 ffff8bc145c55e00 28 lru 00000080:00200000:1.0:1788201590.990848:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007947275d 28: 1< 0 - - > 2< 114688 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.990851:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009dcba75c 00000080:00200000:1.0:1788201590.990853:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 29. 00000080:00200000:1.0:1788201590.990857:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 29 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.990876:0:24470:0:(rw26.c:898:ll_write_end()) pos 118784, len 4096, copied 4096 00000080:00200000:1.0:1788201590.990880:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f0459675[3 000000004e9a4122 2 1 000000008c769856 0 0 29] 00000080:00200000:1.0:1788201590.990884:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005132d4fa 17ffffc0001001 3:0 ffff8bc145c558c0 29 lru 00000080:00200000:1.0:1788201590.990890:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000005dea91b 29: 1< 0 - - > 2< 118784 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.990893:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f0459675 00000080:00200000:1.0:1788201590.990894:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 30. 00000080:00200000:1.0:1788201590.990896:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 30 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.990909:0:24470:0:(rw26.c:898:ll_write_end()) pos 122880, len 4096, copied 4096 00000080:00200000:1.0:1788201590.990914:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f9b0643b[3 000000004e9a4122 2 1 000000008c769856 0 0 30] 00000080:00200000:1.0:1788201590.990917:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000084d451e2 17ffffc0001001 3:0 ffff8bc145c55540 30 lru 00000080:00200000:1.0:1788201590.990923:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000093bc3229 30: 1< 0 - - > 2< 122880 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.990925:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f9b0643b 00000080:00200000:1.0:1788201590.990927:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 31. 00000080:00200000:1.0:1788201590.990929:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 31 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.990941:0:24470:0:(rw26.c:898:ll_write_end()) pos 126976, len 4096, copied 4096 00000080:00200000:1.0:1788201590.990945:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008762fe45[3 000000004e9a4122 2 1 000000008c769856 0 0 31] 00000080:00200000:1.0:1788201590.990949:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000035393ee0 17ffffc0001001 3:0 ffff8bc145c55a80 31 lru 00000080:00200000:1.0:1788201590.990955:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000da5746ee 31: 1< 0 - - > 2< 126976 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.990957:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008762fe45 00000080:00200000:1.0:1788201590.990958:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 32. 00000080:00200000:1.0:1788201590.990960:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 32 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.990973:0:24470:0:(rw26.c:898:ll_write_end()) pos 131072, len 4096, copied 4096 00000080:00200000:1.0:1788201590.990977:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009427250a[3 000000004e9a4122 2 1 000000008c769856 0 0 32] 00000080:00200000:1.0:1788201590.991354:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000042564cd3 17ffffc0001001 3:0 ffff8bc145c55c40 32 lru 00000080:00200000:1.0:1788201590.991361:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000070a342aa 32: 1< 0 - - > 2< 131072 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.991364:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009427250a 00000080:00200000:1.0:1788201590.991366:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 33. 00000080:00200000:1.0:1788201590.991369:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 33 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.991392:0:24470:0:(rw26.c:898:ll_write_end()) pos 135168, len 4096, copied 4096 00000080:00200000:1.0:1788201590.991397:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000028d3f733[3 000000004e9a4122 2 1 000000008c769856 0 0 33] 00000080:00200000:1.0:1788201590.991401:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000014168c66 17ffffc0001001 3:0 ffff8bc149f69d20 33 lru 00000080:00200000:1.0:1788201590.991408:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d401cf43 33: 1< 0 - - > 2< 135168 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.991410:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000028d3f733 00000080:00200000:1.0:1788201590.991411:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 34. 00000080:00200000:1.0:1788201590.991423:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 34 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.991443:0:24470:0:(rw26.c:898:ll_write_end()) pos 139264, len 4096, copied 4096 00000080:00200000:1.0:1788201590.991448:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000341faf70[3 000000004e9a4122 2 1 000000008c769856 0 0 34] 00000080:00200000:1.0:1788201590.991451:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a7ccdbf8 17ffffc0001001 3:0 ffff8bc149f69460 34 lru 00000080:00200000:1.0:1788201590.991457:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000784855c3 34: 1< 0 - - > 2< 139264 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.991459:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000341faf70 00000080:00200000:1.0:1788201590.991460:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 35. 00000080:00200000:1.0:1788201590.991462:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 35 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.991478:0:24470:0:(rw26.c:898:ll_write_end()) pos 143360, len 4096, copied 4096 00000080:00200000:1.0:1788201590.991483:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f6d8c39b[3 000000004e9a4122 2 1 000000008c769856 0 0 35] 00000080:00200000:1.0:1788201590.991485:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000da431255 17ffffc0001001 3:0 ffff8bc149f69b60 35 lru 00000080:00200000:1.0:1788201590.991491:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000039d0b01e 35: 1< 0 - - > 2< 143360 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.991493:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f6d8c39b 00000080:00200000:1.0:1788201590.991494:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 36. 00000080:00200000:1.0:1788201590.991496:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 36 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.991512:0:24470:0:(rw26.c:898:ll_write_end()) pos 147456, len 4096, copied 4096 00000080:00200000:1.0:1788201590.991517:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000379f1aec[3 000000004e9a4122 2 1 000000008c769856 0 0 36] 00000080:00200000:1.0:1788201590.991520:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000738f0c9b 17ffffc0001001 3:0 ffff8bc149f69700 36 lru 00000080:00200000:1.0:1788201590.991526:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004e5f7745 36: 1< 0 - - > 2< 147456 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.991528:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000379f1aec 00000080:00200000:1.0:1788201590.991530:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 37. 00000080:00200000:1.0:1788201590.991532:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 37 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.991547:0:24470:0:(rw26.c:898:ll_write_end()) pos 151552, len 4096, copied 4096 00000080:00200000:1.0:1788201590.991552:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003bec762c[3 000000004e9a4122 2 1 000000008c769856 0 0 37] 00000080:00200000:1.0:1788201590.991555:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a32c8375 17ffffc0001001 3:0 ffff8bc149f697e0 37 lru 00000080:00200000:1.0:1788201590.991561:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000069afce49 37: 1< 0 - - > 2< 151552 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.991563:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003bec762c 00000080:00200000:1.0:1788201590.991565:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 38. 00000080:00200000:1.0:1788201590.991567:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 38 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.991580:0:24470:0:(rw26.c:898:ll_write_end()) pos 155648, len 4096, copied 4096 00000080:00200000:1.0:1788201590.991584:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000096b905ea[3 000000004e9a4122 2 1 000000008c769856 0 0 38] 00000080:00200000:1.0:1788201590.991588:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e8d54d5e 17ffffc0001001 3:0 ffff8bc149f69620 38 lru 00000080:00200000:1.0:1788201590.991668:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007d8b2689 38: 1< 0 - - > 2< 155648 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.991671:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000096b905ea 00000080:00200000:1.0:1788201590.991673:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 39. 00000080:00200000:1.0:1788201590.991675:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 39 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.991773:0:24470:0:(rw26.c:898:ll_write_end()) pos 159744, len 4096, copied 4096 00000080:00200000:1.0:1788201590.991779:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c8da4773[3 000000004e9a4122 2 1 000000008c769856 0 0 39] 00000080:00200000:1.0:1788201590.991782:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000934b3e15 17ffffc0001021 2:0 ffff8bc149f692a0 39 lru 00000080:00200000:1.0:1788201590.991787:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e68ddc65 39: 1< 0 - - > 2< 159744 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.991894:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c8da4773 00000080:00200000:1.0:1788201590.991897:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 40. 00000080:00200000:1.0:1788201590.991900:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 40 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.991918:0:24470:0:(rw26.c:898:ll_write_end()) pos 163840, len 4096, copied 4096 00000080:00200000:1.0:1788201590.991923:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000245743b6[3 000000004e9a4122 2 1 000000008c769856 0 0 40] 00000080:00200000:1.0:1788201590.991927:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000a5eb977 17ffffc0001001 3:0 ffff8bc149f69ee0 40 lru 00000080:00200000:1.0:1788201590.991932:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000005836156 40: 1< 0 - - > 2< 163840 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.991935:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000245743b6 00000080:00200000:1.0:1788201590.991936:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 41. 00000080:00200000:1.0:1788201590.991938:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 41 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.991953:0:24470:0:(rw26.c:898:ll_write_end()) pos 167936, len 4096, copied 4096 00000080:00200000:1.0:1788201590.991958:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004e82ec8b[3 000000004e9a4122 2 1 000000008c769856 0 0 41] 00000080:00200000:1.0:1788201590.991961:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000366ff42e 17ffffc0001001 3:0 ffff8bc149f69e00 41 lru 00000080:00200000:1.0:1788201590.991967:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b89755f4 41: 1< 0 - - > 2< 167936 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.991970:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004e82ec8b 00000080:00200000:1.0:1788201590.991971:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 42. 00000080:00200000:1.0:1788201590.991973:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 42 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.992330:0:24470:0:(rw26.c:898:ll_write_end()) pos 172032, len 4096, copied 4096 00000080:00200000:1.0:1788201590.992336:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e1f00c9d[3 000000004e9a4122 2 1 000000008c769856 0 0 42] 00000080:00200000:1.0:1788201590.992340:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000049c20f41 17ffffc0001001 3:0 ffff8bc149f698c0 42 lru 00000080:00200000:1.0:1788201590.992347:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f7648946 42: 1< 0 - - > 2< 172032 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.992349:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e1f00c9d 00000080:00200000:1.0:1788201590.992351:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 43. 00000080:00200000:1.0:1788201590.992353:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 43 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.992370:0:24470:0:(rw26.c:898:ll_write_end()) pos 176128, len 4096, copied 4096 00000080:00200000:1.0:1788201590.992375:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e1a9f858[3 000000004e9a4122 2 1 000000008c769856 0 0 43] 00000080:00200000:1.0:1788201590.992378:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e7663a13 17ffffc0001001 3:0 ffff8bc149f69540 43 lru 00000080:00200000:1.0:1788201590.992384:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a9c4cf18 43: 1< 0 - - > 2< 176128 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.992386:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e1a9f858 00000080:00200000:1.0:1788201590.992388:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 44. 00000080:00200000:1.0:1788201590.992390:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 44 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.992402:0:24470:0:(rw26.c:898:ll_write_end()) pos 180224, len 4096, copied 4096 00000080:00200000:1.0:1788201590.992407:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008925883a[3 000000004e9a4122 2 1 000000008c769856 0 0 44] 00000080:00200000:1.0:1788201590.992410:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b4e22817 17ffffc0001001 3:0 ffff8bc149f69a80 44 lru 00000080:00200000:1.0:1788201590.992426:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000045ddce9e 44: 1< 0 - - > 2< 180224 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.992428:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008925883a 00000080:00200000:1.0:1788201590.992430:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 45. 00000080:00200000:1.0:1788201590.992432:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 45 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.992449:0:24470:0:(rw26.c:898:ll_write_end()) pos 184320, len 4096, copied 4096 00000080:00200000:1.0:1788201590.992453:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000006d93702[3 000000004e9a4122 2 1 000000008c769856 0 0 45] 00000080:00200000:1.0:1788201590.992457:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000df8dd49d 17ffffc0001001 3:0 ffff8bc149f69c40 45 lru 00000080:00200000:1.0:1788201590.992462:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003f8ada3d 45: 1< 0 - - > 2< 184320 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.992464:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000006d93702 00000080:00200000:1.0:1788201590.992465:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 46. 00000080:00200000:1.0:1788201590.992467:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 46 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.992482:0:24470:0:(rw26.c:898:ll_write_end()) pos 188416, len 4096, copied 4096 00000080:00200000:1.0:1788201590.992487:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b380654c[3 000000004e9a4122 2 1 000000008c769856 0 0 46] 00000080:00200000:1.0:1788201590.992490:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004304edc6 17ffffc0001001 3:0 ffff8bc149f699a0 46 lru 00000080:00200000:1.0:1788201590.992496:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000002cdf925 46: 1< 0 - - > 2< 188416 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.992498:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b380654c 00000080:00200000:1.0:1788201590.992500:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 47. 00000080:00200000:1.0:1788201590.992502:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 47 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.992518:0:24470:0:(rw26.c:898:ll_write_end()) pos 192512, len 4096, copied 4096 00000080:00200000:1.0:1788201590.992523:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000e9485e0[3 000000004e9a4122 2 1 000000008c769856 0 0 47] 00000080:00200000:1.0:1788201590.992526:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a875c7fd 17ffffc0001001 3:0 ffff8bc149f690e0 47 lru 00000080:00200000:1.0:1788201590.992532:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000034f9aef5 47: 1< 0 - - > 2< 192512 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.992534:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000e9485e0 00000080:00200000:1.0:1788201590.992535:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 48. 00000080:00200000:1.0:1788201590.992537:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 48 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.992553:0:24470:0:(rw26.c:898:ll_write_end()) pos 196608, len 4096, copied 4096 00000080:00200000:1.0:1788201590.992558:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000088928cf2[3 000000004e9a4122 2 1 000000008c769856 0 0 48] 00000080:00200000:1.0:1788201590.992561:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000da73b306 17ffffc0001001 3:0 ffff8bc149f691c0 48 lru 00000080:00200000:1.0:1788201590.992567:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b980aa6f 48: 1< 0 - - > 2< 196608 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.992569:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000088928cf2 00000080:00200000:1.0:1788201590.992571:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 49. 00000080:00200000:1.0:1788201590.992572:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 49 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.992584:0:24470:0:(rw26.c:898:ll_write_end()) pos 200704, len 4096, copied 4096 00000080:00200000:1.0:1788201590.992589:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007feb3f1b[3 000000004e9a4122 2 1 000000008c769856 0 0 49] 00000080:00200000:1.0:1788201590.992667:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001cdd405f 17ffffc0001001 3:0 ffff8bc149f69380 49 lru 00000080:00200000:1.0:1788201590.992673:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c8cc7a1a 49: 1< 0 - - > 2< 200704 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.992675:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007feb3f1b 00000080:00200000:1.0:1788201590.992677:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 50. 00000080:00200000:1.0:1788201590.992679:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 50 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.992764:0:24470:0:(rw26.c:898:ll_write_end()) pos 204800, len 4096, copied 4096 00000080:00200000:1.0:1788201590.992769:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000097d5bc4e[3 000000004e9a4122 2 1 000000008c769856 0 0 50] 00000080:00200000:1.0:1788201590.992772:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008aeeb3d7 17ffffc0001001 3:0 ffff8bc149f69000 50 lru 00000080:00200000:1.0:1788201590.992778:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001023f47d 50: 1< 0 - - > 2< 204800 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.992780:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000097d5bc4e 00000080:00200000:1.0:1788201590.992781:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 51. 00000080:00200000:1.0:1788201590.992783:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 51 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.992835:0:24470:0:(rw26.c:898:ll_write_end()) pos 208896, len 4096, copied 4096 00000080:00200000:1.0:1788201590.992840:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000087204d70[3 000000004e9a4122 2 1 000000008c769856 0 0 51] 00000080:00200000:1.0:1788201590.992843:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ef685503 17ffffc0001001 3:0 ffff8bc1724d7380 51 lru 00000080:00200000:1.0:1788201590.992849:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000305bc74a 51: 1< 0 - - > 2< 208896 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.992851:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000087204d70 00000080:00200000:1.0:1788201590.992852:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 52. 00000080:00200000:1.0:1788201590.992854:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 52 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.992870:0:24470:0:(rw26.c:898:ll_write_end()) pos 212992, len 4096, copied 4096 00000080:00200000:1.0:1788201590.992874:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000043157d20[3 000000004e9a4122 2 1 000000008c769856 0 0 52] 00000080:00200000:1.0:1788201590.992877:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008060cb08 17ffffc0001001 3:0 ffff8bc1724d71c0 52 lru 00000080:00200000:1.0:1788201590.992882:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000052500b05 52: 1< 0 - - > 2< 212992 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.992884:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000043157d20 00000080:00200000:1.0:1788201590.992885:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 53. 00000080:00200000:1.0:1788201590.992887:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 53 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.992901:0:24470:0:(rw26.c:898:ll_write_end()) pos 217088, len 4096, copied 4096 00000080:00200000:1.0:1788201590.992906:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000064d5b3c4[3 000000004e9a4122 2 1 000000008c769856 0 0 53] 00000080:00200000:1.0:1788201590.992909:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003c5edc72 17ffffc0001001 3:0 ffff8bc1724d70e0 53 lru 00000080:00200000:1.0:1788201590.992914:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000027c02d6d 53: 1< 0 - - > 2< 217088 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.992916:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000064d5b3c4 00000080:00200000:1.0:1788201590.992918:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 54. 00000080:00200000:1.0:1788201590.992919:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 54 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.992941:0:24470:0:(rw26.c:898:ll_write_end()) pos 221184, len 4096, copied 4096 00000080:00200000:1.0:1788201590.992946:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000cff5c5f[3 000000004e9a4122 2 1 000000008c769856 0 0 54] 00000080:00200000:1.0:1788201590.992949:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000008d0c6b9 17ffffc0001021 2:0 ffff8bc1724d79a0 54 lru 00000080:00200000:1.0:1788201590.992955:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000055c96e94 54: 1< 0 - - > 2< 221184 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.992957:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000cff5c5f 00000080:00200000:1.0:1788201590.992959:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 55. 00000080:00200000:1.0:1788201590.992961:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 55 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.992976:0:24470:0:(rw26.c:898:ll_write_end()) pos 225280, len 4096, copied 4096 00000080:00200000:1.0:1788201590.993098:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000161fe99a[3 000000004e9a4122 2 1 000000008c769856 0 0 55] 00000080:00200000:1.0:1788201590.993102:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004232b729 17ffffc0001001 3:0 ffff8bc1724d7c40 55 lru 00000080:00200000:1.0:1788201590.993109:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000065f7f91f 55: 1< 0 - - > 2< 225280 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.993111:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000161fe99a 00000080:00200000:1.0:1788201590.993113:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 56. 00000080:00200000:1.0:1788201590.993116:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 56 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.993137:0:24470:0:(rw26.c:898:ll_write_end()) pos 229376, len 4096, copied 4096 00000080:00200000:1.0:1788201590.993142:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f8409f5a[3 000000004e9a4122 2 1 000000008c769856 0 0 56] 00000080:00200000:1.0:1788201590.993145:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000bff5452c 17ffffc0001001 3:0 ffff8bc1724d7a80 56 lru 00000080:00200000:1.0:1788201590.993151:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000030fc3c0d 56: 1< 0 - - > 2< 229376 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.993153:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f8409f5a 00000080:00200000:1.0:1788201590.993155:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 57. 00000080:00200000:1.0:1788201590.993157:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 57 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.993170:0:24470:0:(rw26.c:898:ll_write_end()) pos 233472, len 4096, copied 4096 00000080:00200000:1.0:1788201590.993174:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000031956304[3 000000004e9a4122 2 1 000000008c769856 0 0 57] 00000080:00200000:1.0:1788201590.993178:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000009e0a16b 17ffffc0001001 3:0 ffff8bc1724d7540 57 lru 00000080:00200000:1.0:1788201590.993184:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000010c04eeb 57: 1< 0 - - > 2< 233472 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.993186:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000031956304 00000080:00200000:1.0:1788201590.993187:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 58. 00000080:00200000:1.0:1788201590.993189:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 58 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.993274:0:24470:0:(rw26.c:898:ll_write_end()) pos 237568, len 4096, copied 4096 00000080:00200000:1.0:1788201590.993280:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008403a592[3 000000004e9a4122 2 1 000000008c769856 0 0 58] 00000080:00200000:1.0:1788201590.993283:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009caf76e9 17ffffc0001001 3:0 ffff8bc1724d78c0 58 lru 00000080:00200000:1.0:1788201590.993288:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008513dcb2 58: 1< 0 - - > 2< 237568 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.993290:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008403a592 00000080:00200000:1.0:1788201590.993292:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 59. 00000080:00200000:1.0:1788201590.993294:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 59 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.993311:0:24470:0:(rw26.c:898:ll_write_end()) pos 241664, len 4096, copied 4096 00000080:00200000:1.0:1788201590.993315:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000119cc930[3 000000004e9a4122 2 1 000000008c769856 0 0 59] 00000080:00200000:1.0:1788201590.993318:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000051ff6d10 17ffffc0001001 3:0 ffff8bc1724d7e00 59 lru 00000080:00200000:1.0:1788201590.993324:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b8ef8cfd 59: 1< 0 - - > 2< 241664 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.993326:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000119cc930 00000080:00200000:1.0:1788201590.993327:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 60. 00000080:00200000:1.0:1788201590.993329:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 60 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.993345:0:24470:0:(rw26.c:898:ll_write_end()) pos 245760, len 4096, copied 4096 00000080:00200000:1.0:1788201590.993349:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b5daf315[3 000000004e9a4122 2 1 000000008c769856 0 0 60] 00000080:00200000:1.0:1788201590.993352:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001346aac6 17ffffc0001001 3:0 ffff8bc1724d7ee0 60 lru 00000080:00200000:1.0:1788201590.993358:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001124ec3b 60: 1< 0 - - > 2< 245760 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.993360:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b5daf315 00000080:00200000:1.0:1788201590.993362:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 61. 00000080:00200000:1.0:1788201590.993364:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 61 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.993379:0:24470:0:(rw26.c:898:ll_write_end()) pos 249856, len 4096, copied 4096 00000080:00200000:1.0:1788201590.993384:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005591541e[3 000000004e9a4122 2 1 000000008c769856 0 0 61] 00000080:00200000:1.0:1788201590.993387:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e985a02b 17ffffc0001001 3:0 ffff8bc1724d7620 61 lru 00000080:00200000:1.0:1788201590.993393:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003877c0a1 61: 1< 0 - - > 2< 249856 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.993395:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005591541e 00000080:00200000:1.0:1788201590.993396:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 62. 00000080:00200000:1.0:1788201590.993398:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 62 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.993426:0:24470:0:(rw26.c:898:ll_write_end()) pos 253952, len 4096, copied 4096 00000080:00200000:1.0:1788201590.993431:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000588b756c[3 000000004e9a4122 2 1 000000008c769856 0 0 62] 00000080:00200000:1.0:1788201590.993434:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000061403663 17ffffc0001001 3:0 ffff8bc1724d77e0 62 lru 00000080:00200000:1.0:1788201590.993439:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a560b67e 62: 1< 0 - - > 2< 253952 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.993441:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000588b756c 00000080:00200000:1.0:1788201590.993442:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 63. 00000080:00200000:1.0:1788201590.993444:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 63 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.993460:0:24470:0:(rw26.c:898:ll_write_end()) pos 258048, len 4096, copied 4096 00000080:00200000:1.0:1788201590.993465:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000037af4c4f[3 000000004e9a4122 2 1 000000008c769856 0 0 63] 00000080:00200000:1.0:1788201590.993468:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000bc58a62c 17ffffc0001001 3:0 ffff8bc1724d7700 63 lru 00000080:00200000:1.0:1788201590.993473:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000786c0dd4 63: 1< 0 - - > 2< 258048 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.993475:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000037af4c4f 00000080:00200000:1.0:1788201590.993477:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 64. 00000080:00200000:1.0:1788201590.993479:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 64 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.993504:0:24470:0:(rw26.c:898:ll_write_end()) pos 262144, len 4096, copied 4096 00000080:00200000:1.0:1788201590.993509:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d86bcdb6[3 000000004e9a4122 2 1 000000008c769856 0 0 64] 00000080:00200000:1.0:1788201590.993512:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000613031eb 17ffffc0001001 3:0 ffff8bc1724d7b60 64 lru 00000080:00200000:1.0:1788201590.993518:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e17027ba 64: 1< 0 - - > 2< 262144 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.993521:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d86bcdb6 00000080:00200000:1.0:1788201590.993523:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 65. 00000080:00200000:1.0:1788201590.993525:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 65 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.993539:0:24470:0:(rw26.c:898:ll_write_end()) pos 266240, len 4096, copied 4096 00000080:00200000:1.0:1788201590.993544:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000067083f4b[3 000000004e9a4122 2 1 000000008c769856 0 0 65] 00000080:00200000:1.0:1788201590.993547:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000be1b33be 17ffffc0001001 3:0 ffff8bc1724d72a0 65 lru 00000080:00200000:1.0:1788201590.993553:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004e00c155 65: 1< 0 - - > 2< 266240 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.993555:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000067083f4b 00000080:00200000:1.0:1788201590.993556:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 66. 00000080:00200000:1.0:1788201590.993558:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 66 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.993571:0:24470:0:(rw26.c:898:ll_write_end()) pos 270336, len 4096, copied 4096 00000080:00200000:1.0:1788201590.993575:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000065789b31[3 000000004e9a4122 2 1 000000008c769856 0 0 66] 00000080:00200000:1.0:1788201590.993579:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000df2811b6 17ffffc0001001 3:0 ffff8bc1724d7460 66 lru 00000080:00200000:1.0:1788201590.993585:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ea7303a5 66: 1< 0 - - > 2< 270336 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.993587:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000065789b31 00000080:00200000:1.0:1788201590.993589:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 67. 00000080:00200000:1.0:1788201590.993659:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 67 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.993676:0:24470:0:(rw26.c:898:ll_write_end()) pos 274432, len 4096, copied 4096 00000080:00200000:1.0:1788201590.993681:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c418f56c[3 000000004e9a4122 2 1 000000008c769856 0 0 67] 00000080:00200000:1.0:1788201590.993685:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003dce96a6 17ffffc0001001 3:0 ffff8bc1724d7d20 67 lru 00000080:00200000:1.0:1788201590.993758:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000663f6cc4 67: 1< 0 - - > 2< 274432 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.993761:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c418f56c 00000080:00200000:1.0:1788201590.993763:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 68. 00000080:00200000:1.0:1788201590.993765:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 68 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.993783:0:24470:0:(rw26.c:898:ll_write_end()) pos 278528, len 4096, copied 4096 00000080:00200000:1.0:1788201590.993787:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001d7e865e[3 000000004e9a4122 2 1 000000008c769856 0 0 68] 00000080:00200000:1.0:1788201590.994140:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000093ba4dcb 17ffffc0001001 3:0 ffff8bc1724d7000 68 lru 00000080:00200000:1.0:1788201590.994147:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f09b7f92 68: 1< 0 - - > 2< 278528 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.994149:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001d7e865e 00000080:00200000:1.0:1788201590.994151:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 69. 00000080:00200000:1.0:1788201590.994153:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 69 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.994180:0:24470:0:(rw26.c:898:ll_write_end()) pos 282624, len 4096, copied 4096 00000080:00200000:1.0:1788201590.994185:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003c2e820b[3 000000004e9a4122 2 1 000000008c769856 0 0 69] 00000080:00200000:1.0:1788201590.994189:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007d0234ce 17ffffc0001021 2:0 ffff8bc150734620 69 lru 00000080:00200000:1.0:1788201590.994195:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000bcffdcd4 69: 1< 0 - - > 2< 282624 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.994265:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003c2e820b 00000080:00200000:1.0:1788201590.994267:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 70. 00000080:00200000:1.0:1788201590.994270:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 70 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.994288:0:24470:0:(rw26.c:898:ll_write_end()) pos 286720, len 4096, copied 4096 00000080:00200000:1.0:1788201590.994292:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006bf42ead[3 000000004e9a4122 2 1 000000008c769856 0 0 70] 00000080:00200000:1.0:1788201590.994296:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ce232827 17ffffc0001001 3:0 ffff8bc1507347e0 70 lru 00000080:00200000:1.0:1788201590.994301:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000050fb84dd 70: 1< 0 - - > 2< 286720 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.994303:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006bf42ead 00000080:00200000:1.0:1788201590.994305:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 71. 00000080:00200000:1.0:1788201590.994307:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 71 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.994323:0:24470:0:(rw26.c:898:ll_write_end()) pos 290816, len 4096, copied 4096 00000080:00200000:1.0:1788201590.994328:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008f530e19[3 000000004e9a4122 2 1 000000008c769856 0 0 71] 00000080:00200000:1.0:1788201590.994330:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000016e1663e 17ffffc0001001 3:0 ffff8bc150734700 71 lru 00000080:00200000:1.0:1788201590.994335:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005ac47bf3 71: 1< 0 - - > 2< 290816 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.994337:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008f530e19 00000080:00200000:1.0:1788201590.994339:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 72. 00000080:00200000:1.0:1788201590.994341:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 72 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.994356:0:24470:0:(rw26.c:898:ll_write_end()) pos 294912, len 4096, copied 4096 00000080:00200000:1.0:1788201590.994361:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006ca75685[3 000000004e9a4122 2 1 000000008c769856 0 0 72] 00000080:00200000:1.0:1788201590.994364:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a41f4338 17ffffc0001001 3:0 ffff8bc150734b60 72 lru 00000080:00200000:1.0:1788201590.994370:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000345c297b 72: 1< 0 - - > 2< 294912 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.994372:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006ca75685 00000080:00200000:1.0:1788201590.994373:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 73. 00000080:00200000:1.0:1788201590.994375:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 73 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.994391:0:24470:0:(rw26.c:898:ll_write_end()) pos 299008, len 4096, copied 4096 00000080:00200000:1.0:1788201590.994396:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005b11b544[3 000000004e9a4122 2 1 000000008c769856 0 0 73] 00000080:00200000:1.0:1788201590.994398:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ef3702f6 17ffffc0001001 3:0 ffff8bc1507342a0 73 lru 00000080:00200000:1.0:1788201590.994403:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000946c32b9 73: 1< 0 - - > 2< 299008 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.994405:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005b11b544 00000080:00200000:1.0:1788201590.994407:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 74. 00000080:00200000:1.0:1788201590.994408:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 74 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.994433:0:24470:0:(rw26.c:898:ll_write_end()) pos 303104, len 4096, copied 4096 00000080:00200000:1.0:1788201590.994437:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000085ac3fc5[3 000000004e9a4122 2 1 000000008c769856 0 0 74] 00000080:00200000:1.0:1788201590.994440:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000075a27023 17ffffc0001001 3:0 ffff8bc150734460 74 lru 00000080:00200000:1.0:1788201590.994446:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000053e7ac90 74: 1< 0 - - > 2< 303104 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.994448:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000085ac3fc5 00000080:00200000:1.0:1788201590.994449:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 75. 00000080:00200000:1.0:1788201590.994451:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 75 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.994467:0:24470:0:(rw26.c:898:ll_write_end()) pos 307200, len 4096, copied 4096 00000080:00200000:1.0:1788201590.994471:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000045574335[3 000000004e9a4122 2 1 000000008c769856 0 0 75] 00000080:00200000:1.0:1788201590.994474:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000054cda9c6 17ffffc0001001 3:0 ffff8bc150734d20 75 lru 00000080:00200000:1.0:1788201590.994480:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000ae4f1e6 75: 1< 0 - - > 2< 307200 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.994482:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000045574335 00000080:00200000:1.0:1788201590.994483:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 76. 00000080:00200000:1.0:1788201590.994485:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 76 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.994497:0:24470:0:(rw26.c:898:ll_write_end()) pos 311296, len 4096, copied 4096 00000080:00200000:1.0:1788201590.994500:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d633d4c6[3 000000004e9a4122 2 1 000000008c769856 0 0 76] 00000080:00200000:1.0:1788201590.994504:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000067f2cf71 17ffffc0001001 3:0 ffff8bc150734000 76 lru 00000080:00200000:1.0:1788201590.994509:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000728afcf3 76: 1< 0 - - > 2< 311296 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.994511:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d633d4c6 00000080:00200000:1.0:1788201590.994513:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 77. 00000080:00200000:1.0:1788201590.994514:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 77 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.994524:0:24470:0:(rw26.c:898:ll_write_end()) pos 315392, len 4096, copied 4096 00000080:00200000:1.0:1788201590.994527:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006c11b185[3 000000004e9a4122 2 1 000000008c769856 0 0 77] 00000080:00200000:1.0:1788201590.994529:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000c94146b 17ffffc0001001 3:0 ffff8bc150734380 77 lru 00000080:00200000:1.0:1788201590.994535:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f11fd4b4 77: 1< 0 - - > 2< 315392 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.994536:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006c11b185 00000080:00200000:1.0:1788201590.994538:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 78. 00000080:00200000:1.0:1788201590.994539:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 78 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.994549:0:24470:0:(rw26.c:898:ll_write_end()) pos 319488, len 4096, copied 4096 00000080:00200000:1.0:1788201590.994553:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000cff48e6f[3 000000004e9a4122 2 1 000000008c769856 0 0 78] 00000080:00200000:1.0:1788201590.994556:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e062e2bc 17ffffc0001001 3:0 ffff8bc1507341c0 78 lru 00000080:00200000:1.0:1788201590.994561:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000014bba292 78: 1< 0 - - > 2< 319488 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.994562:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000cff48e6f 00000080:00200000:1.0:1788201590.994563:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 79. 00000080:00200000:1.0:1788201590.994565:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 79 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.994575:0:24470:0:(rw26.c:898:ll_write_end()) pos 323584, len 4096, copied 4096 00000080:00200000:1.0:1788201590.994578:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d86290d2[3 000000004e9a4122 2 1 000000008c769856 0 0 79] 00000080:00200000:1.0:1788201590.994580:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000002b8a149 17ffffc0001001 3:0 ffff8bc1507340e0 79 lru 00000080:00200000:1.0:1788201590.994585:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b8604b2a 79: 1< 0 - - > 2< 323584 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.994587:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d86290d2 00000080:00200000:1.0:1788201590.994588:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 80. 00000080:00200000:1.0:1788201590.994650:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 80 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.994666:0:24470:0:(rw26.c:898:ll_write_end()) pos 327680, len 4096, copied 4096 00000080:00200000:1.0:1788201590.994670:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000825690d9[3 000000004e9a4122 2 1 000000008c769856 0 0 80] 00000080:00200000:1.0:1788201590.994672:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009c149f96 17ffffc0001001 3:0 ffff8bc1507349a0 80 lru 00000080:00200000:1.0:1788201590.994678:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000aa8c64a2 80: 1< 0 - - > 2< 327680 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.994680:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000825690d9 00000080:00200000:1.0:1788201590.994681:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 81. 00000080:00200000:1.0:1788201590.994684:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 81 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.994757:0:24470:0:(rw26.c:898:ll_write_end()) pos 331776, len 4096, copied 4096 00000080:00200000:1.0:1788201590.994762:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000031c33824[3 000000004e9a4122 2 1 000000008c769856 0 0 81] 00000080:00200000:1.0:1788201590.994765:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a8b4a740 17ffffc0001001 3:0 ffff8bc150734c40 81 lru 00000080:00200000:1.0:1788201590.994770:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000045b246cb 81: 1< 0 - - > 2< 331776 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.994772:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000031c33824 00000080:00200000:1.0:1788201590.994774:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 82. 00000080:00200000:1.0:1788201590.994775:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 82 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.994814:0:24470:0:(rw26.c:898:ll_write_end()) pos 335872, len 4096, copied 4096 00000080:00200000:1.0:1788201590.994818:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000fad1ea9b[3 000000004e9a4122 2 1 000000008c769856 0 0 82] 00000080:00200000:1.0:1788201590.994822:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004aa4eb43 17ffffc0001001 3:0 ffff8bc150734a80 82 lru 00000080:00200000:1.0:1788201590.994827:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000001aba1d4 82: 1< 0 - - > 2< 335872 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.994830:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000fad1ea9b 00000080:00200000:1.0:1788201590.994831:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 83. 00000080:00200000:1.0:1788201590.994833:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 83 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.994847:0:24470:0:(rw26.c:898:ll_write_end()) pos 339968, len 4096, copied 4096 00000080:00200000:1.0:1788201590.994851:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ffacbb57[3 000000004e9a4122 2 1 000000008c769856 0 0 83] 00000080:00200000:1.0:1788201590.994854:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d8691f5f 17ffffc0001001 3:0 ffff8bc150734540 83 lru 00000080:00200000:1.0:1788201590.994859:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000002d55b1dc 83: 1< 0 - - > 2< 339968 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.994861:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ffacbb57 00000080:00200000:1.0:1788201590.994862:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 84. 00000080:00200000:1.0:1788201590.994864:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 84 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.994878:0:24470:0:(rw26.c:898:ll_write_end()) pos 344064, len 4096, copied 4096 00000080:00200000:1.0:1788201590.994881:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002067b86d[3 000000004e9a4122 2 1 000000008c769856 0 0 84] 00000080:00200000:1.0:1788201590.994884:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ecfe9b97 17ffffc0001021 2:0 ffff8bc1507348c0 84 lru 00000080:00200000:1.0:1788201590.994889:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f923d6f4 84: 1< 0 - - > 2< 344064 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.994890:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002067b86d 00000080:00200000:1.0:1788201590.994891:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 85. 00000080:00200000:1.0:1788201590.994893:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 85 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.994903:0:24470:0:(rw26.c:898:ll_write_end()) pos 348160, len 4096, copied 4096 00000080:00200000:1.0:1788201590.994907:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c94a3fc1[3 000000004e9a4122 2 1 000000008c769856 0 0 85] 00000080:00200000:1.0:1788201590.994910:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f0fa7518 17ffffc0001001 3:0 ffff8bc150734e00 85 lru 00000080:00200000:1.0:1788201590.994915:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d550b848 85: 1< 0 - - > 2< 348160 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.994918:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c94a3fc1 00000080:00200000:1.0:1788201590.994919:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 86. 00000080:00200000:1.0:1788201590.994920:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 86 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.994930:0:24470:0:(rw26.c:898:ll_write_end()) pos 352256, len 4096, copied 4096 00000080:00200000:1.0:1788201590.994933:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c05ce104[3 000000004e9a4122 2 1 000000008c769856 0 0 86] 00000080:00200000:1.0:1788201590.994936:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008c58fd3f 17ffffc0001001 3:0 ffff8bc150734ee0 86 lru 00000080:00200000:1.0:1788201590.994941:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000077424d18 86: 1< 0 - - > 2< 352256 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.994943:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c05ce104 00000080:00200000:1.0:1788201590.994944:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 87. 00000080:00200000:1.0:1788201590.994945:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 87 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.994956:0:24470:0:(rw26.c:898:ll_write_end()) pos 356352, len 4096, copied 4096 00000080:00200000:1.0:1788201590.994960:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003d10d73f[3 000000004e9a4122 2 1 000000008c769856 0 0 87] 00000080:00200000:1.0:1788201590.994963:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003392af88 17ffffc0001001 3:0 ffff8bc143eedd20 87 lru 00000080:00200000:1.0:1788201590.994969:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000081c674ef 87: 1< 0 - - > 2< 356352 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.994971:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003d10d73f 00000080:00200000:1.0:1788201590.994972:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 88. 00000080:00200000:1.0:1788201590.994974:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 88 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.995059:0:24470:0:(rw26.c:898:ll_write_end()) pos 360448, len 4096, copied 4096 00000080:00200000:1.0:1788201590.995063:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000dfeb011b[3 000000004e9a4122 2 1 000000008c769856 0 0 88] 00000080:00200000:1.0:1788201590.995066:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000023b02de7 17ffffc0001001 3:0 ffff8bc143eed000 88 lru 00000080:00200000:1.0:1788201590.995072:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000762dd019 88: 1< 0 - - > 2< 360448 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.995074:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000dfeb011b 00000080:00200000:1.0:1788201590.995075:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 89. 00000080:00200000:1.0:1788201590.995077:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 89 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.995090:0:24470:0:(rw26.c:898:ll_write_end()) pos 364544, len 4096, copied 4096 00000080:00200000:1.0:1788201590.995094:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008c29354c[3 000000004e9a4122 2 1 000000008c769856 0 0 89] 00000080:00200000:1.0:1788201590.995097:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000058b9f666 17ffffc0001001 3:0 ffff8bc143eed380 89 lru 00000080:00200000:1.0:1788201590.995102:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006704cdcb 89: 1< 0 - - > 2< 364544 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.995105:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008c29354c 00000080:00200000:1.0:1788201590.995106:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 90. 00000080:00200000:1.0:1788201590.995108:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 90 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.995119:0:24470:0:(rw26.c:898:ll_write_end()) pos 368640, len 4096, copied 4096 00000080:00200000:1.0:1788201590.995123:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002afd3346[3 000000004e9a4122 2 1 000000008c769856 0 0 90] 00000080:00200000:1.0:1788201590.995125:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003780894a 17ffffc0001001 3:0 ffff8bc143eed1c0 90 lru 00000080:00200000:1.0:1788201590.995130:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000002eb7c8b9 90: 1< 0 - - > 2< 368640 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.995133:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002afd3346 00000080:00200000:1.0:1788201590.995134:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 91. 00000080:00200000:1.0:1788201590.995135:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 91 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.995145:0:24470:0:(rw26.c:898:ll_write_end()) pos 372736, len 4096, copied 4096 00000080:00200000:1.0:1788201590.995149:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ce698628[3 000000004e9a4122 2 1 000000008c769856 0 0 91] 00000080:00200000:1.0:1788201590.995151:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000002e54040 17ffffc0001001 3:0 ffff8bc143eed0e0 91 lru 00000080:00200000:1.0:1788201590.995157:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003eb7a22d 91: 1< 0 - - > 2< 372736 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.995158:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ce698628 00000080:00200000:1.0:1788201590.995160:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 92. 00000080:00200000:1.0:1788201590.995162:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 92 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.995171:0:24470:0:(rw26.c:898:ll_write_end()) pos 376832, len 4096, copied 4096 00000080:00200000:1.0:1788201590.995175:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002ae25873[3 000000004e9a4122 2 1 000000008c769856 0 0 92] 00000080:00200000:1.0:1788201590.995178:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007aa4aad0 17ffffc0001001 3:0 ffff8bc143eed9a0 92 lru 00000080:00200000:1.0:1788201590.995183:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005386b465 92: 1< 0 - - > 2< 376832 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.995185:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002ae25873 00000080:00200000:1.0:1788201590.995187:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 93. 00000080:00200000:1.0:1788201590.995188:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 93 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.995300:0:24470:0:(rw26.c:898:ll_write_end()) pos 380928, len 4096, copied 4096 00000080:00200000:1.0:1788201590.995306:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000bfec721a[3 000000004e9a4122 2 1 000000008c769856 0 0 93] 00000080:00200000:1.0:1788201590.995309:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000063e71b04 17ffffc0001001 3:0 ffff8bc143eedc40 93 lru 00000080:00200000:1.0:1788201590.995314:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000006e3e793 93: 1< 0 - - > 2< 380928 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.995316:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000bfec721a 00000080:00200000:1.0:1788201590.995317:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 94. 00000080:00200000:1.0:1788201590.995320:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 94 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.995335:0:24470:0:(rw26.c:898:ll_write_end()) pos 385024, len 4096, copied 4096 00000080:00200000:1.0:1788201590.995339:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000caf07fd9[3 000000004e9a4122 2 1 000000008c769856 0 0 94] 00000080:00200000:1.0:1788201590.995342:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000fa1bb98c 17ffffc0001001 3:0 ffff8bc143eeda80 94 lru 00000080:00200000:1.0:1788201590.995348:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004f4b7dc7 94: 1< 0 - - > 2< 385024 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.995350:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000caf07fd9 00000080:00200000:1.0:1788201590.995351:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 95. 00000080:00200000:1.0:1788201590.995353:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 95 of 0 to 4096 bytes 00000080:00200000:1.0:1788201590.995363:0:24470:0:(rw26.c:898:ll_write_end()) pos 389120, len 4096, copied 4096 00000080:00200000:1.0:1788201590.995367:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000054d8ee2b[3 000000004e9a4122 2 1 000000008c769856 0 0 95] 00000080:00200000:1.0:1788201590.995370:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000103fdfa3 17ffffc0001001 3:0 ffff8bc143eed540 95 lru 00000080:00200000:1.0:1788201590.995376:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d9593a0f 95: 1< 0 - - > 2< 389120 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.995378:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000054d8ee2b 00000080:00200000:1.0:1788201590.995379:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 96. 00000080:00200000:1.0:1788201590.995380:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 96 of 0 to 1547 bytes 00000080:00200000:1.0:1788201590.995399:0:24470:0:(rw26.c:898:ll_write_end()) pos 393216, len 1547, copied 1547 00000080:00200000:1.0:1788201590.995403:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000094b1d157[3 000000004e9a4122 2 1 000000008c769856 0 0 96] 00000080:00200000:1.0:1788201590.995406:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000010c2ab94 17ffffc0001001 3:0 ffff8bc143eed8c0 96 lru 00000080:00200000:1.0:1788201590.995411:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000073c5eab1 96: 1< 0 - - > 2< 393216 0 0 0x0 0x0 | 000000000ce25486 00000000c3d3de39 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201590.995424:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000094b1d157 00000080:00200000:1.0:1788201590.995425:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 97. 00000080:00200000:1.0:1788201590.995430:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 97, from 0, to 1547 prio 0 00000008:00010000:1.0:1788201590.995475:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 000000004c75ab65 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201590.995514:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1446b8278, count 15, dirtied 15 00000080:00200000:1.0:1788201590.995534:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1446b8278, count 15, dirtied 15 00000080:00200000:1.0:1788201590.995550:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1446b8278, count 15, dirtied 15 00000080:00200000:1.0:1788201590.995565:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1446b8278, count 15, dirtied 15 00000080:00200000:1.0:1788201590.995580:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1446b8278, count 15, dirtied 15 00000080:00200000:1.0:1788201590.995657:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1446b8278, count 15, dirtied 15 00000080:00200000:1.0:1788201590.995668:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1446b8278, count 7, dirtied 7 00000080:00200000:1.0:1788201590.995672:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 97 pages 394763 bytes, tot: 394763 00000080:00200000:1.0:1788201590.995676:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) conf-sanity.sh: write bytes 0, result: 394763 00000020:00010000:1.0:1788201590.995755:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c4128 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201590.995759:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c4128 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201590.995763:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4c30 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201590.995773:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201590.995787:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201590.995906:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c4128 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201590.995909:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4c30 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201590.995924:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 394763 bytes 00000080:00200000:1.0:1788201590.995933:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 96] 00000080:00200000:1.0:1788201590.995971:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x15e:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201590.995976:0:24470:0:(file.c:2238:ll_file_io_generic()) conf-sanity.sh: 2 io complete with rc: 0, result: 394763, restart: 0 00000080:00200000:1.0:1788201590.995994:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x15e:0x0] updating i_size 394763 i_blocks 1 00000080:00200000:1.0:1788201590.996094:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 394763 00000080:00200008:1.0:1788201590.996154:0:24470:0:(file.c:479:ll_file_release()) START file conf-sanity.sh:[0x200000bd7:0x15e:0x0](ffff8bc1446b80c8), flags 100001 00000002:00100000:1.0:1788201590.996287:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1725b1c00 x1875064727944192/t8589937341(8589937341) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201606 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201590.996302:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201590.996308:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a4700 x1875064727944832/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201590.996337:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a4700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727944832:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201590.996533:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8d80 going to sleep for 11 seconds 00000002:00100000:0.0:1788201591.001153:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1725b1c00 x1875064727944192/t8589937341(8589937341) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201606 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201591.001316:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201591.001342:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.001366:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 15 lru_type: 1 00010000:00010000:0.0:1788201591.001385:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 15 lru_type: 1 00000080:00200000:0.0:1788201591.001396:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.001403:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201591.001407:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201591.001426:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201591.001431:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 15 lru_type: 1 00010000:00010000:0.0:1788201591.001443:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 16 lru_type: 1 00000080:00200000:0.0:1788201591.001463:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.001472:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201591.001480:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.001483:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=conf-sanity.sh, flags=8 00000080:00200008:0.0:1788201591.001492:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file conf-sanity.sh:[0x200000bd7:0x15e:0x0](ffff8bc1446b80c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201591.001498:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x15e:0x0](ffff8bc1446b80c8),name=conf-sanity.sh 00000002:00010000:0.0:1788201591.001513:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x15e:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.001523:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6ef60 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096bcd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201591.001532:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6ef60 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096bcd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201591.001540:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.001543:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x15e:0x0](ffff8bc1446b80c8) 00000080:00010000:0.0:1788201591.001546:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x15e:0x0](ffff8bc1446b80c8) for lock 0xd138388016f6ef60 00000080:00010000:0.0:1788201591.001550:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ef60 from it ffffadd1c7debcb8 00010000:00010000:0.0:1788201591.001554:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6ef60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096bcd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201591.001562:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6ef60 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096bcd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201591.001757:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x15e:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201591.001770:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x15e:0x0] 00000008:00010000:0.0:1788201591.001958:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201591.001963:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1724569b0, osc lock ffff8bc145d350a0, flags 0x400001002 00010000:00010000:0.0:1788201591.002101:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.002124:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:0.0:1788201591.002139:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1788201591.002145:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.002155:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1788201591.002167:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1788201591.002179:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x15e:0x0] updating i_size 394763 i_blocks 1 00000020:00010000:0.0:1788201591.002183:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9720 (ffff8bc1499c4878/0) at cl_lock_release():245 00000020:00010000:0.0:1788201591.002187:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9720 (ffff8bc1499c4878/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201591.002190:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1724569b0 (ffff8bc1499c4098/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201591.002195:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9720 (ffff8bc1499c4878/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201591.002305:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1724569b0 (ffff8bc1499c4878/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201591.002337:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x15e:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201591.002401:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201591.002423:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.002434:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 16 lru_type: 1 00010000:00010000:0.0:1788201591.002444:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 16 lru_type: 1 00000080:00200000:0.0:1788201591.002455:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.002460:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201591.002463:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201591.002468:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201591.002471:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 16 lru_type: 1 00010000:00010000:0.0:1788201591.002478:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 17 lru_type: 1 00000080:00200000:0.0:1788201591.002487:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.002493:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201591.002496:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.002512:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=dne_sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:0.0:1788201591.002515:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=dne_sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201591.002527:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: dne_sanity.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201591.002585:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6ef75 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.002663:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6ef75 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.002676:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6ef75 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201591.002785:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727944960:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201591.003147:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201591.007499:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727944960:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201591.007532:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6ef75 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.007550:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6ef75 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.007558:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6ef75 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.007566:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6ef75 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.007578:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6ef75 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.007654:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1727c9c00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201591.007661:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6ef75 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.007671:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6ef75 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.007681:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6ef75 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.007689:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201591.007763:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6ef75 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.007771:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6ef75 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201591.007904:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14415aa00 x1875064727944960/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201607 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201591.007925:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201591.007956:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201591.008276:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201591.008303:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201591.008315:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 17 lru_type: 1 00010000:00010000:1.0:1788201591.008330:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 17 lru_type: 1 00000080:00200000:1.0:1788201591.008343:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201591.008351:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201591.008355:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201591.008362:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201591.008367:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 17 lru_type: 1 00010000:00010000:1.0:1788201591.008377:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 18 lru_type: 1 00000080:00200000:1.0:1788201591.008398:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201591.008409:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201591.008428:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201591.008448:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=dne_sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:1.0:1788201591.008454:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=dne_sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201591.008472:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: dne_sanity.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201591.008536:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ef7c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.008545:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ef7c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.008559:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ef7c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201591.008676:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a5880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727945088:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201591.009515:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201591.014519:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a5880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727945088:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201591.014554:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ef7c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.014573:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ef7c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.014582:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ef7c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.014660:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ef7c lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.014674:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ef7c lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.014683:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bde00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201591.014697:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ef7c lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.014707:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ef7c lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.014716:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ef7c lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.014724:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201591.014732:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ef7c lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.014740:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6ef7c lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201591.014770:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a5880 x1875064727945088/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201607 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201591.014810:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201591.014842:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201591.015003:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201591.015027:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201591.015040:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 18 lru_type: 1 00010000:00010000:1.0:1788201591.015054:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 18 lru_type: 1 00000080:00200000:1.0:1788201591.015062:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201591.015069:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201591.015073:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201591.015079:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:1.0:1788201591.015083:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 18 lru_type: 1 00010000:00010000:1.0:1788201591.015406:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 19 lru_type: 1 00000080:00200000:1.0:1788201591.015437:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201591.015446:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201591.015452:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201591.015468:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201591.015474:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=dne_sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14304a300, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:1.0:1788201591.015483:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=dne_sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:1.0:1788201591.015508:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: dne_sanity.sh,[0x200000bd7:0x15f:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201591.015569:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc200/0xd138388016f6ef83 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.015576:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc200/0xd138388016f6ef83 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201591.015745:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201591.015756:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a5880 x1875064727945344/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201591.015768:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc200/0xd138388016f6ef83 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201591.015836:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a5880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727945344:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201591.016067:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201591.021707:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a5880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727945344:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201591.021747:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc200/0xd138388016f6ef83 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096c28 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.021778:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc200/0xd138388016f6ef83 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x15f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096c28 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.021788:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc200/0xd138388016f6ef83 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x15f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096c28 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.021838:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc200/0xd138388016f6ef83 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x15f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096c28 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.021852:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc200/0xd138388016f6ef83 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x15f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096c28 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.021867:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc200/0xd138388016f6ef83 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x15f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096c28 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.021875:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc200/0xd138388016f6ef83 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x15f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096c28 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.021883:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc200/0xd138388016f6ef83 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x15f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096c28 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201591.021894:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1724a5880 x1875064727945344/t8589937343(8589937343) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201591.021908:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a5880 x1875064727945344/t8589937343(8589937343) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201591.021922:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc200/0xd138388016f6ef83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x15f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096c28 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201591.021936:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc200/0xd138388016f6ef83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x15f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096c28 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.021948:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/351 (0 0) 00000080:00200000:1.0:1788201591.021956:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201591.021975:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=dne_sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:1.0:1788201591.022036:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x15f:0x0](ffff8bc1446b8908) 00000080:00200000:1.0:1788201591.022517:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x15f:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201591.022530:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x15f:0x0](ffff8bc1446b8908) 00000080:00010000:1.0:1788201591.022535:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x15f:0x0](ffff8bc1446b8908) for lock 0xd138388016f6ef83 00000080:00010000:1.0:1788201591.022548:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x15f:0x0](ffff8bc1446b8908) 00000080:00200008:1.0:1788201591.022567:0:24470:0:(file.c:1090:ll_file_open()) START file dne_sanity.sh:[0x200000bd7:0x15f:0x0](ffff8bc1446b8908), flags 100301 00000002:00100000:1.0:1788201591.022592:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a5880 x1875064727945344/t8589937343(8589937343) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201591.022644:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ef83 from it ffff8bc144cb59c0 00010000:00010000:1.0:1788201591.022651:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc200/0xd138388016f6ef83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x15f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096c28 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.022663:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc200/0xd138388016f6ef83 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x15f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096c28 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201591.022697:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15f:0x0](ffff8bc1446b8908), inode mode 81a4 mask 40 00000080:00200008:1.0:1788201591.022735:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file dne_sanity.sh:[0x200000bd7:0x15f:0x0](ffff8bc1446b8908), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201591.022742:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x15f:0x0](ffff8bc1446b8908),name=dne_sanity.sh 00000002:00010000:1.0:1788201591.022768:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x15f:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201591.022782:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc200/0xd138388016f6ef83 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x15f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096c28 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.022838:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc200/0xd138388016f6ef83 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x15f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096c28 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201591.022848:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201591.022854:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x15f:0x0](ffff8bc1446b8908) 00000080:00010000:1.0:1788201591.022859:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x15f:0x0](ffff8bc1446b8908) for lock 0xd138388016f6ef83 00000080:00010000:1.0:1788201591.022863:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6ef83 from it ffffadd1c7debcd8 00010000:00010000:1.0:1788201591.022867:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc200/0xd138388016f6ef83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x15f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096c28 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.022876:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc200/0xd138388016f6ef83 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x15f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096c28 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201591.022907:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x15f:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201591.022920:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x15f:0x0] 00000008:00010000:1.0:1788201591.022959:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201591.022963:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d41b0, osc lock ffff8bc145d08850, flags 0x400001002 00010000:00010000:1.0:1788201591.023398:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6ef8a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.023423:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6ef8a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201591.023478:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1788201591.023716:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727945472:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201591.028304:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6ef8a lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.028349:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6ef8a lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096c36 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.028369:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6ef8a lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096c36 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.028385:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6ef8a lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096c36 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201591.028404:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6ef8a lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096c36 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201591.028429:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201591.028452:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6ef8a lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171096c36 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.028463:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6ef8a lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171096c36 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.028472:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6ef8a lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171096c36 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.028489:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6ef8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171096c36 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201591.028515:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727945472:192.168.201.143@tcp:101:cp.0 00000080:00200000:3.0:1788201591.028634:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x15f:0x0] updating i_size 0 i_blocks 1 00000020:00010000:3.0:1788201591.028642:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:3.0:1788201591.028646:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201591.028652:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d41b0 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201591.028657:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e244a0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201591.028660:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d41b0 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201591.028867:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x15f:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1788201591.029158:0:24470:0:(file.c:2638:do_file_write_iter()) START file dne_sanity.sh:[0x200000bd7:0x15f:0x0], ppos: 0, count: 1735 00000080:00200000:3.0:1788201591.029176:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 1735 bytes 00000080:00200000:3.0:1788201591.029182:0:24470:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 1735 00000080:00200000:3.0:1788201591.029286:0:24470:0:(file.c:2090:ll_file_io_generic()) dne_sanity.sh: write ppos: 0, bytes: 1735 00000080:00200000:3.0:1788201591.029293:0:24470:0:(file.c:1848:ll_io_set_mirror()) dne_sanity.sh: desiginated mirror: 0 00000020:00200000:3.0:1788201591.029300:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@0000000070743e1c[0x110, 1, [0x200000bd7:0x15f:0x0] hash] 00000020:00200000:3.0:1788201591.029303:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 1735) 0 0 00000080:00200000:3.0:1788201591.029308:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x15f:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201591.029323:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1788201591.029332:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 1735) 1735, 1735 00020000:00200000:3.0:1788201591.029336:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1788201591.029369:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1788201591.029384:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1788201591.029390:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149fec630, osc lock ffff8bc14691a850, flags 0x0 00010000:00010000:3.0:1788201591.029408:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/418 (0 4095) 00010000:00010000:3.0:1788201591.029475:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.029487:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.029499:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201591.029526:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a0700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727945600:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201591.029842:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201591.033872:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201591.033994:0:20877:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788201591.034130:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743470848 00000100:00100000:0.0:1788201591.034143:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743470848 00000100:00100000:0.0:1788201591.034305:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 693 00000100:00100000:0.0:1788201591.034321:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17257cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23391:x1875064743470848:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201591.034348:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6ef8a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171096c36 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.034468:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201591.034476:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17257cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23391:x1875064743470848:12345-192.168.201.143@tcp:104: Request processed in 159us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201591.034484:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 693 00010000:00010000:0.0:1788201591.034532:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201591.034540:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6ef8a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171096c36 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.034551:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bd800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201591.034558:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6ef8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171096c36 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201591.034641:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x15f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201591.034656:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x15f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1788201591.034755:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6ef8a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096c36 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.034763:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201591.034819:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6ef8a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096c36 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.034828:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6ef8a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096c36 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.034848:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201591.034850:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201591.034852:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201591.034864:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201591.034882:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727945728:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201591.037971:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201591.040922:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743470976 00000100:00100000:1.0:1788201591.040943:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743470976 00000100:00100000:3.0:1788201591.041248:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a0700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727945600:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201591.041284:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.041303:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.041314:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201591.041481:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 694 00000100:00100000:1.0:1788201591.041494:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23412:x1875064743470976:12345-192.168.201.143@tcp:105: 00010000:00010000:1.0:1788201591.041507:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.041519:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.041536:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.041548:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.041560:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.041573:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.041672:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1725a1c00) 00000100:00100000:1.0:1788201591.041753:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23412:x1875064743470976:12345-192.168.201.143@tcp:105: Request processed in 262us (3801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201591.041762:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 694 00010000:00010000:3.0:1788201591.044299:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.044327:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.044352:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201591.044368:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.044382:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.044391:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201591.044443:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) dne_sanity.sh: write [0, 1735) append 0 append lockpos 0 00000080:00200000:3.0:1788201591.044470:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 1735 bytes 00000080:00200000:3.0:1788201591.044549:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 1735, copied 1735 00000080:00200000:3.0:1788201591.044563:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007d8b09de[3 0000000031ecc83a 2 1 00000000cdc6f84b 0 0 0] 00000080:00200000:3.0:1788201591.044567:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000087beff7c 17ffffc0001001 3:0 ffff8bc1460722a0 0 lru 00000080:00200000:3.0:1788201591.044577:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000028b57636 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 00000000f3084894 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201591.044579:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007d8b09de 00000080:00200000:3.0:1788201591.044581:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201591.045367:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 1735 prio 0 00000008:00010000:3.0:1788201591.045400:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000354268d1 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201591.045440:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1446b8ab8, count 1, dirtied 1 00000080:00200000:3.0:1788201591.045447:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 1735 bytes, tot: 1735 00000080:00200000:3.0:1788201591.045452:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) dne_sanity.sh: write bytes 0, result: 1735 00000020:00010000:3.0:1788201591.045478:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460e6b78 (ffff8bc1460e9488/0) at cl_lock_release():245 00000020:00010000:3.0:1788201591.045482:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460e6b78 (ffff8bc1460e9488/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201591.045486:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149fec630 (ffff8bc1460e9008/1) at cl_lock_cancel():142 00010000:00010000:3.0:1788201591.045494:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.045507:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1788201591.045529:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460e6b78 (ffff8bc1460e9488/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201591.045533:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149fec630 (ffff8bc1460e9488/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201591.045543:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 1735 bytes 00000080:00200000:3.0:1788201591.045553:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000100:00100000:0.0:1788201591.045684:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727945728:192.168.201.143@tcp:103:ldlm_bl.0 00000080:00200000:3.0:1788201591.046133:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x15f:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201591.046139:0:24470:0:(file.c:2238:ll_file_io_generic()) dne_sanity.sh: 2 io complete with rc: 0, result: 1735, restart: 0 00000100:00100000:0.0:1788201591.080401:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17275bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727946624:192.168.201.143@tcp:101:cp.0 00000080:00200000:3.0:1788201591.086539:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x160:0x0] updating i_size 0 i_blocks 1 00000020:00010000:3.0:1788201591.086547:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc146005bc0 (ffff8bc146919d88/0) at cl_lock_release():245 00000020:00010000:3.0:1788201591.086551:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146005bc0 (ffff8bc146919d88/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201591.086556:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d8b0 (ffff8bc146919128/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201591.086561:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146005bc0 (ffff8bc146919d88/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201591.086564:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d8b0 (ffff8bc146919d88/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201591.086613:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x160:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1788201591.086702:0:24470:0:(file.c:2638:do_file_write_iter()) START file dom-performance.sh:[0x200000bd7:0x160:0x0], ppos: 0, count: 9974 00000080:00200000:3.0:1788201591.086740:0:24470:0:(file.c:2090:ll_file_io_generic()) dom-performance.sh: write ppos: 0, bytes: 9974 00000080:00200000:3.0:1788201591.086747:0:24470:0:(file.c:1848:ll_io_set_mirror()) dom-performance.sh: desiginated mirror: 0 00000020:00200000:3.0:1788201591.086754:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000d7c45b7c[0x110, 1, [0x200000bd7:0x160:0x0] hash] 00000020:00200000:3.0:1788201591.086756:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 9974) 0 0 00000080:00200000:3.0:1788201591.086761:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x160:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201591.086775:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 2] 00020000:00200000:3.0:1788201591.086783:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 9974) 9974, 9974 00020000:00200000:3.0:1788201591.086787:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1788201591.086876:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 2] 00000008:00010000:3.0:1788201591.086891:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1788201591.086897:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149fec630, osc lock ffff8bc14691a850, flags 0x0 00010000:00010000:3.0:1788201591.086915:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/418 (0 12287) 00010000:00010000:3.0:1788201591.086961:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.086972:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.086983:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201591.087101:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a0700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727946752:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201591.087267:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201591.090906:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201591.091089:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743471104 00000100:00100000:0.0:1788201591.091106:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743471104 00000100:00100000:0.0:1788201591.091331:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 695 00000100:00100000:0.0:1788201591.091347:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23416:x1875064743471104:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201591.091383:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000bc5851ad/0xd138388016f6efad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171096c91 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.091527:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201591.091536:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23416:x1875064743471104:12345-192.168.201.143@tcp:104: Request processed in 193us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201591.091546:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 695 00010000:00010000:1.0:1788201591.091619:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201591.091630:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000bc5851ad/0xd138388016f6efad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171096c91 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.091642:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1427dc600 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201591.091649:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000bc5851ad/0xd138388016f6efad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171096c91 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201591.091733:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x160:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201591.091748:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x160:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201591.091854:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000bc5851ad/0xd138388016f6efad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096c91 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.091864:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201591.091891:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000bc5851ad/0xd138388016f6efad lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096c91 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.091901:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000bc5851ad/0xd138388016f6efad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096c91 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.091923:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201591.091925:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201591.091928:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201591.091938:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201591.091955:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727946880:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201591.094758:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201591.096488:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a0700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727946752:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201591.096535:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096c98 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.096555:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096c98 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.096565:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096c98 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.097844:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096c98 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.097856:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096c98 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.097877:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096c98 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201591.097892:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171096c98 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.097907:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096c98 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.097916:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096c98 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201591.097952:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) dom-performance.sh: write [0, 9974) append 0 append lockpos 0 00000080:00200000:3.0:1788201591.097974:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:3.0:1788201591.098051:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:3.0:1788201591.098065:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f85cf815[3 00000000e6711095 2 1 00000000c4285bd5 0 0 0] 00000080:00200000:3.0:1788201591.098068:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f4cc9c11 17ffffc0001001 3:0 ffff8bc146072460 0 lru 00000080:00200000:3.0:1788201591.098078:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ec201fd9 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 25559040 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201591.098080:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f85cf815 00000080:00200000:3.0:1788201591.098082:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201591.098087:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:3.0:1788201591.098127:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:3.0:1788201591.098132:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000031e3767d[3 00000000e6711095 2 1 00000000c4285bd5 0 0 1] 00000080:00200000:3.0:1788201591.098136:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000089bb7d22 17ffffc0001001 3:0 ffff8bc146072d20 1 lru 00000080:00200000:3.0:1788201591.098141:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000f819ce2 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 25559040 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201591.098144:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000031e3767d 00000080:00200000:3.0:1788201591.098145:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:3.0:1788201591.098147:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 1782 bytes 00000080:00200000:3.0:1788201591.098171:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 1782, copied 1782 00000080:00200000:3.0:1788201591.098175:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000226af96c[3 00000000e6711095 2 1 00000000c4285bd5 0 0 2] 00000080:00200000:3.0:1788201591.098179:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002a2ef6bb 17ffffc0001001 3:0 ffff8bc146072000 2 lru 00000080:00200000:3.0:1788201591.098185:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d7df0abf 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000000ce25486 00000000587dcf31 > 3< 0 0 > 4< 0 0 8 25559040 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201591.098187:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000226af96c 00000080:00200000:3.0:1788201591.098188:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:3.0:1788201591.098193:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 3, from 0, to 1782 prio 0 00000008:00010000:3.0:1788201591.098232:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000390cd994 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096c98 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201591.098257:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459f6578, count 3, dirtied 3 00000080:00200000:3.0:1788201591.098263:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 3 pages 9974 bytes, tot: 9974 00000080:00200000:3.0:1788201591.098266:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) dom-performance.sh: write bytes 0, result: 9974 00000020:00010000:3.0:1788201591.098285:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460e63f8 (ffff8bc1460e9008/0) at cl_lock_release():245 00000020:00010000:3.0:1788201591.098289:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460e63f8 (ffff8bc1460e9008/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201591.098292:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149fec630 (ffff8bc1460e9878/1) at cl_lock_cancel():142 00010000:00010000:3.0:1788201591.098297:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096c98 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.098308:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096c98 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1788201591.098333:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460e63f8 (ffff8bc1460e9008/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201591.098336:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149fec630 (ffff8bc1460e9008/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201591.098344:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 9974 bytes 00000080:00200000:3.0:1788201591.098353:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 2] 00000080:00200000:3.0:1788201591.098394:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x160:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201591.098398:0:24470:0:(file.c:2238:ll_file_io_generic()) dom-performance.sh: 2 io complete with rc: 0, result: 9974, restart: 0 00000080:00200000:3.0:1788201591.098407:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x160:0x0] updating i_size 9974 i_blocks 1 00000080:00200000:3.0:1788201591.098425:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 9974 00000080:00200008:3.0:1788201591.098483:0:24470:0:(file.c:479:ll_file_release()) START file dom-performance.sh:[0x200000bd7:0x160:0x0](ffff8bc1459f63c8), flags 100001 00000002:00100000:3.0:1788201591.098557:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc17275b480 x1875064727946496/t8589937345(8589937345) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201607 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1788201591.098571:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1788201591.098577:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a0700 x1875064727947136/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1788201591.098603:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a0700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727947136:192.168.201.143@tcp:35:cp.0 00000100:00100000:3.0:1788201591.098665:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201591.103182:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a0700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727947136:192.168.201.143@tcp:35:cp.0 00000002:00100000:3.0:1788201591.103238:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc17275b480 x1875064727946496/t8589937345(8589937345) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201607 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201591.103333:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201591.103359:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201591.103384:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 23 lru_type: 1 00010000:00010000:3.0:1788201591.103407:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 23 lru_type: 1 00000080:00200000:3.0:1788201591.103429:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201591.103435:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201591.103439:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201591.103449:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201591.103455:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 23 lru_type: 1 00010000:00010000:3.0:1788201591.103466:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 24 lru_type: 1 00000080:00200000:3.0:1788201591.103486:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201591.103494:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201591.103501:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201591.103505:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=dom-performance.sh, flags=8 00000080:00200008:3.0:1788201591.103514:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file dom-performance.sh:[0x200000bd7:0x160:0x0](ffff8bc1459f63c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201591.103520:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x160:0x0](ffff8bc1459f63c8),name=dom-performance.sh 00000002:00010000:3.0:1788201591.103533:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x160:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201591.103543:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dcc00/0xd138388016f6efa6 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x160:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096c83 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201591.103553:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dcc00/0xd138388016f6efa6 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x160:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096c83 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201591.103567:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201591.103571:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x160:0x0](ffff8bc1459f63c8) 00000080:00010000:3.0:1788201591.103574:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x160:0x0](ffff8bc1459f63c8) for lock 0xd138388016f6efa6 00000080:00010000:3.0:1788201591.103578:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6efa6 from it ffffadd1c7debcb8 00010000:00010000:3.0:1788201591.103581:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dcc00/0xd138388016f6efa6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x160:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096c83 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201591.103920:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dcc00/0xd138388016f6efa6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x160:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096c83 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201591.103981:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x160:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201591.103993:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x160:0x0] 00000008:00010000:3.0:1788201591.104095:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201591.104099:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149fec630, osc lock ffff8bc14691a850, flags 0x400001002 00010000:00010000:3.0:1788201591.104119:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096c98 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201591.104133:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096c98 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:3.0:1788201591.104148:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1788201591.104153:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096c98 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201591.104163:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096c98 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1788201591.104182:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1788201591.104328:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x160:0x0] updating i_size 9974 i_blocks 1 00000020:00010000:3.0:1788201591.104335:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc6bf0 (ffff8bc1460e9008/0) at cl_lock_release():245 00000020:00010000:3.0:1788201591.104338:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc6bf0 (ffff8bc1460e9008/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201591.104342:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149fec630 (ffff8bc1460e9878/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201591.104347:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc6bf0 (ffff8bc1460e9008/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201591.104351:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149fec630 (ffff8bc1460e9008/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201591.104385:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x160:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201591.104461:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201591.104472:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201591.104480:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 24 lru_type: 1 00010000:00010000:3.0:1788201591.104488:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 24 lru_type: 1 00000080:00200000:3.0:1788201591.104495:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201591.104500:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201591.104504:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201591.104508:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201591.104512:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 24 lru_type: 1 00010000:00010000:3.0:1788201591.104519:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 25 lru_type: 1 00000080:00200000:3.0:1788201591.104533:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201591.104538:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201591.104542:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201591.104556:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=functions.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:3.0:1788201591.104561:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=functions.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:3.0:1788201591.104572:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: functions.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201591.104839:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efbb lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.104849:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efbb lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.104862:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efbb lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201591.104892:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727947264:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201591.105222:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201591.108493:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a2680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727947264:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201591.108524:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efbb lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.108542:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efbb lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.108550:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efbb lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.108559:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efbb lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.108570:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efbb lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.108579:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1725a0800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201591.108585:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efbb lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.108605:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efbb lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.108614:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efbb lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.108623:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201591.108631:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efbb lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.108640:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efbb lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201591.108663:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a2680 x1875064727947264/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201607 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201591.108682:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201591.108722:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:3.0:1788201591.108844:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201591.108901:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201591.108912:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 25 lru_type: 1 00010000:00010000:3.0:1788201591.108933:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 25 lru_type: 1 00000080:00200000:3.0:1788201591.108941:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201591.108947:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201591.108952:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201591.108959:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201591.108963:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 25 lru_type: 1 00010000:00010000:3.0:1788201591.108973:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 26 lru_type: 1 00000080:00200000:3.0:1788201591.108990:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201591.109007:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201591.109014:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201591.109032:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=functions.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:3.0:1788201591.109037:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=functions.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:3.0:1788201591.109050:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: functions.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201591.109109:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6efc2 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.109117:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6efc2 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.109129:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6efc2 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201591.109159:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727947392:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201591.109262:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc600 going to sleep for 11 seconds 00010000:00010000:1.0:1788201591.109870:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201591.111467:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727946880:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201591.117175:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a2680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727947392:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201591.117216:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6efc2 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.117233:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6efc2 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.117243:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6efc2 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.117252:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6efc2 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.117264:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6efc2 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.117271:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1725a0200 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201591.117278:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6efc2 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.117287:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6efc2 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.117301:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6efc2 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.117308:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201591.117316:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6efc2 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.117323:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6efc2 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201591.117347:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a2680 x1875064727947392/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201607 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201591.117365:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201591.117395:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201591.117566:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201591.117584:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.117606:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 26 lru_type: 1 00010000:00010000:0.0:1788201591.117622:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 26 lru_type: 1 00000080:00200000:0.0:1788201591.117630:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.117636:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201591.117641:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201591.117647:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:0.0:1788201591.117651:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 26 lru_type: 1 00010000:00010000:0.0:1788201591.117667:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 27 lru_type: 1 00000080:00200000:0.0:1788201591.117684:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.117700:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201591.117708:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.117725:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201591.117731:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=functions.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc152c96600, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:0.0:1788201591.117740:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=functions.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:0.0:1788201591.117762:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: functions.sh,[0x200000bd7:0x161:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:0.0:1788201591.117872:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.117881:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1788201591.117895:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1788201591.117903:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144158e00 x1875064727947648/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1788201591.117913:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201591.117937:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144158e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727947648:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201591.118287:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201591.124218:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144158e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727947648:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201591.124250:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096cde expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.124277:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x161:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096cde expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.124287:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096cde expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.124300:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096cde expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.124310:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096cde expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.124325:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096cde expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.124334:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096cde expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.124342:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096cde expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201591.124354:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc144158e00 x1875064727947648/t8589937347(8589937347) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201591.124368:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc144158e00 x1875064727947648/t8589937347(8589937347) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201591.124384:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096cde expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1788201591.124397:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096cde expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.124408:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/353 (0 0) 00000080:00200000:0.0:1788201591.124429:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201591.124445:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=functions.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:0.0:1788201591.124484:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x161:0x0](ffff8bc144683248) 00000080:00200000:0.0:1788201591.124622:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x161:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1788201591.124631:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x161:0x0](ffff8bc144683248) 00000080:00010000:0.0:1788201591.124634:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x161:0x0](ffff8bc144683248) for lock 0xd138388016f6efc9 00000080:00010000:0.0:1788201591.124645:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x161:0x0](ffff8bc144683248) 00000080:00200008:0.0:1788201591.124662:0:24470:0:(file.c:1090:ll_file_open()) START file functions.sh:[0x200000bd7:0x161:0x0](ffff8bc144683248), flags 100301 00000002:00100000:0.0:1788201591.124681:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc144158e00 x1875064727947648/t8589937347(8589937347) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1788201591.124741:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6efc9 from it ffff8bc146937cc0 00010000:00010000:0.0:1788201591.124746:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096cde expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.124757:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096cde expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201591.124783:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x161:0x0](ffff8bc144683248), inode mode 81a4 mask 40 00000080:00200008:0.0:1788201591.124834:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file functions.sh:[0x200000bd7:0x161:0x0](ffff8bc144683248), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201591.124841:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x161:0x0](ffff8bc144683248),name=functions.sh 00000002:00010000:0.0:1788201591.124861:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x161:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.124871:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096cde expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.124883:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096cde expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201591.124890:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.124894:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x161:0x0](ffff8bc144683248) 00000080:00010000:0.0:1788201591.124898:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x161:0x0](ffff8bc144683248) for lock 0xd138388016f6efc9 00000080:00010000:0.0:1788201591.124901:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6efc9 from it ffffadd1c7debcd8 00010000:00010000:0.0:1788201591.124904:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096cde expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.124911:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096cde expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201591.124935:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x161:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201591.124944:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x161:0x0] 00000008:00010000:0.0:1788201591.124972:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201591.124976:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1724561b0, osc lock ffff8bc145d350a0, flags 0x400001002 00010000:00010000:0.0:1788201591.125614:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000647389f/0xd138388016f6efd0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.125629:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000647389f/0xd138388016f6efd0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201591.125726:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000020:00200000:0.0:1788201591.125981:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1788201591.128290:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727947776:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201591.131768:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000647389f/0xd138388016f6efd0 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.131887:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000647389f/0xd138388016f6efd0 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096cec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.131909:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000647389f/0xd138388016f6efd0 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096cec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.131925:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000647389f/0xd138388016f6efd0 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096cec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201591.131945:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000647389f/0xd138388016f6efd0 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096cec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201591.131960:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201591.132017:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000647389f/0xd138388016f6efd0 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171096cec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.132028:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000647389f/0xd138388016f6efd0 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171096cec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.132038:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000647389f/0xd138388016f6efd0 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171096cec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.132048:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000647389f/0xd138388016f6efd0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171096cec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201591.132075:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727947776:192.168.201.143@tcp:101:cp.0 00000080:00200000:0.0:1788201591.134191:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x161:0x0] updating i_size 0 i_blocks 1 00000020:00010000:0.0:1788201591.134271:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9720 (ffff8bc1499c4878/0) at cl_lock_release():245 00000020:00010000:0.0:1788201591.134277:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9720 (ffff8bc1499c4878/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201591.134283:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1724561b0 (ffff8bc1499c4098/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201591.134289:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9720 (ffff8bc1499c4878/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201591.134301:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1724561b0 (ffff8bc1499c4878/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201591.134348:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x161:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1788201591.134456:0:24470:0:(file.c:2638:do_file_write_iter()) START file functions.sh:[0x200000bd7:0x161:0x0], ppos: 0, count: 38517 00000080:00200000:0.0:1788201591.134495:0:24470:0:(file.c:2090:ll_file_io_generic()) functions.sh: write ppos: 0, bytes: 38517 00000080:00200000:0.0:1788201591.134502:0:24470:0:(file.c:1848:ll_io_set_mirror()) functions.sh: desiginated mirror: 0 00000020:00200000:0.0:1788201591.134510:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@0000000037da2e70[0x110, 1, [0x200000bd7:0x161:0x0] hash] 00000020:00200000:0.0:1788201591.134513:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 38517) 0 0 00000080:00200000:0.0:1788201591.134518:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x161:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201591.134532:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 9] 00020000:00200000:0.0:1788201591.134540:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 38517) 38517, 38517 00020000:00200000:0.0:1788201591.134545:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201591.134579:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 9] 00000008:00010000:0.0:1788201591.135297:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1788201591.135308:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1724561b0, osc lock ffff8bc145d350a0, flags 0x0 00010000:00010000:0.0:1788201591.135331:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/419 (0 40959) 00010000:00010000:0.0:1788201591.135396:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.135421:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.135435:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201591.135468:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727947904:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201591.135911:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201591.144398:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:1.0:1788201591.144930:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201591.144939:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000647389f/0xd138388016f6efd0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171096cec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.144957:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1727c8400 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201591.144964:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000647389f/0xd138388016f6efd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171096cec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201591.145028:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x161:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201591.145043:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x161:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201591.145121:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000647389f/0xd138388016f6efd0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096cec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.145130:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201591.145161:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000647389f/0xd138388016f6efd0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096cec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.145171:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000647389f/0xd138388016f6efd0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096cec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.145190:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201591.145192:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201591.145193:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201591.149456:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743471488 00000100:00100000:1.0:1788201591.149469:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743471488 00000100:00100000:1.0:1788201591.149541:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 698 00000100:00100000:1.0:1788201591.149554:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17275bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21004:x1875064743471488:12345-192.168.201.143@tcp:105: 00010000:00010000:1.0:1788201591.149575:0:20877:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.149611:0:20877:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.149622:0:20877:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.149636:0:20877:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.149649:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.149661:0:20877:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.149685:0:20877:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1727c8000) 00000100:00100000:1.0:1788201591.149755:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17275bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21004:x1875064743471488:12345-192.168.201.143@tcp:105: Request processed in 204us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201591.149763:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 698 00000100:00100000:3.0:1788201591.152083:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727948032:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201591.155407:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727947904:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201591.155459:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.155488:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201591.155504:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.155519:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.155530:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201591.158776:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) functions.sh: write [0, 38517) append 0 append lockpos 0 00000080:00200000:1.0:1788201591.159310:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:1.0:1788201591.159386:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:1.0:1788201591.159402:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004ad832e8[3 0000000040f8be4f 2 1 000000000c537962 0 0 0] 00000080:00200000:1.0:1788201591.159406:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005d462eb3 17ffffc0001001 3:0 ffff8bc143eede00 0 lru 00000080:00200000:1.0:1788201591.159426:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000dbc2a9dc 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 000000003b58ec7d > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201591.159431:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004ad832e8 00000080:00200000:1.0:1788201591.159433:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201591.159437:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:1.0:1788201591.159463:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:1.0:1788201591.159468:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000006e5673d[3 0000000040f8be4f 2 1 000000000c537962 0 0 1] 00000080:00200000:1.0:1788201591.159471:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004c4bafd3 17ffffc0001001 3:0 ffff8bc143eedee0 1 lru 00000080:00200000:1.0:1788201591.159476:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001b7aec53 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 000000003b58ec7d > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201591.159478:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000006e5673d 00000080:00200000:1.0:1788201591.159479:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:1.0:1788201591.159482:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:1.0:1788201591.159510:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:1.0:1788201591.159515:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000004189a46[3 0000000040f8be4f 2 1 000000000c537962 0 0 2] 00000080:00200000:1.0:1788201591.159518:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000729b5731 17ffffc0001021 2:0 ffff8bc143eed620 2 lru 00000080:00200000:1.0:1788201591.159524:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000099b28825 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000008930e75a 000000003b58ec7d > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201591.159526:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000004189a46 00000080:00200000:1.0:1788201591.159527:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:1.0:1788201591.159529:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:1.0:1788201591.159545:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:1.0:1788201591.159550:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000053748183[3 0000000040f8be4f 2 1 000000000c537962 0 0 3] 00000080:00200000:1.0:1788201591.159552:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a63148dd 17ffffc0001001 3:0 ffff8bc143eed7e0 3 lru 00000080:00200000:1.0:1788201591.159557:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005ba1a62a 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000008930e75a 000000003b58ec7d > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201591.159560:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000053748183 00000080:00200000:1.0:1788201591.159561:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:1.0:1788201591.159563:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:1.0:1788201591.159578:0:24470:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:1.0:1788201591.159582:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c055c8e7[3 0000000040f8be4f 2 1 000000000c537962 0 0 4] 00000080:00200000:1.0:1788201591.159584:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000047d9bebc 17ffffc0001001 3:0 ffff8bc143eed700 4 lru 00000080:00200000:1.0:1788201591.160321:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000055a39867 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000008930e75a 000000003b58ec7d > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201591.160327:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c055c8e7 00000080:00200000:1.0:1788201591.160328:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:1.0:1788201591.160331:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:1.0:1788201591.160361:0:24470:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:1.0:1788201591.160366:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009058b28e[3 0000000040f8be4f 2 1 000000000c537962 0 0 5] 00000080:00200000:1.0:1788201591.160369:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ae4c2916 17ffffc0001001 3:0 ffff8bc143eedb60 5 lru 00000080:00200000:1.0:1788201591.160374:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007bd4118a 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000008930e75a 000000003b58ec7d > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201591.160377:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009058b28e 00000080:00200000:1.0:1788201591.160378:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:1.0:1788201591.160381:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:1.0:1788201591.160396:0:24470:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:1.0:1788201591.160401:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f0df03db[3 0000000040f8be4f 2 1 000000000c537962 0 0 6] 00000080:00200000:1.0:1788201591.160405:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000066a59086 17ffffc0001001 3:0 ffff8bc143eed2a0 6 lru 00000080:00200000:1.0:1788201591.160421:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005af92133 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000008930e75a 000000003b58ec7d > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201591.160424:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f0df03db 00000080:00200000:1.0:1788201591.160425:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:1.0:1788201591.160427:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:1.0:1788201591.160447:0:24470:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:1.0:1788201591.160452:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000000f861cc[3 0000000040f8be4f 2 1 000000000c537962 0 0 7] 00000080:00200000:1.0:1788201591.160454:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000050c52509 17ffffc0001001 3:0 ffff8bc143eed460 7 lru 00000080:00200000:1.0:1788201591.160460:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000076a05f91 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000008930e75a 000000003b58ec7d > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201591.160462:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000000f861cc 00000080:00200000:1.0:1788201591.160463:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:1.0:1788201591.160465:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:1.0:1788201591.160483:0:24470:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:1.0:1788201591.160487:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007d179656[3 0000000040f8be4f 2 1 000000000c537962 0 0 8] 00000080:00200000:1.0:1788201591.160490:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000042ebf5a9 17ffffc0001001 3:0 ffff8bc148ec79a0 8 lru 00000080:00200000:1.0:1788201591.160494:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000af65c084 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000008930e75a 000000003b58ec7d > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201591.160496:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007d179656 00000080:00200000:1.0:1788201591.160498:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:1.0:1788201591.160500:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 1653 bytes 00000080:00200000:1.0:1788201591.160526:0:24470:0:(rw26.c:898:ll_write_end()) pos 36864, len 1653, copied 1653 00000080:00200000:1.0:1788201591.160530:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000749e94aa[3 0000000040f8be4f 2 1 000000000c537962 0 0 9] 00000080:00200000:1.0:1788201591.160533:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000003f05979 17ffffc0001001 3:0 ffff8bc148ec70e0 9 lru 00000080:00200000:1.0:1788201591.160537:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000590c822c 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000008930e75a 000000003b58ec7d > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201591.160540:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000749e94aa 00000080:00200000:1.0:1788201591.160541:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:1.0:1788201591.160546:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 10, from 0, to 1653 prio 0 00000008:00010000:1.0:1788201591.160576:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000298588cb ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201591.160688:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1446833f8, count 10, dirtied 10 00000080:00200000:1.0:1788201591.160695:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 10 pages 38517 bytes, tot: 38517 00000080:00200000:1.0:1788201591.160699:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) functions.sh: write bytes 0, result: 38517 00000020:00010000:1.0:1788201591.160721:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc148fb1308 (ffff8bc1499c4878/0) at cl_lock_release():245 00000020:00010000:1.0:1788201591.160724:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc148fb1308 (ffff8bc1499c4878/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201591.160728:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1724561b0 (ffff8bc1499c4098/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201591.160738:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.160753:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201591.160774:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc148fb1308 (ffff8bc1499c4878/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201591.160777:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1724561b0 (ffff8bc1499c4878/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201591.160892:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 38517 bytes 00000080:00200000:1.0:1788201591.160902:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 9] 00000080:00200000:1.0:1788201591.160945:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x161:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201591.160949:0:24470:0:(file.c:2238:ll_file_io_generic()) functions.sh: 2 io complete with rc: 0, result: 38517, restart: 0 00000080:00200000:1.0:1788201591.160959:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x161:0x0] updating i_size 38517 i_blocks 1 00000080:00200000:1.0:1788201591.160966:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 38517 00000080:00200008:1.0:1788201591.161025:0:24470:0:(file.c:479:ll_file_release()) START file functions.sh:[0x200000bd7:0x161:0x0](ffff8bc144683248), flags 100001 00000002:00100000:1.0:1788201591.161111:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc144158e00 x1875064727947648/t8589937347(8589937347) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201607 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201591.161132:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201591.161139:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a4a80 x1875064727948288/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201591.161168:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a4a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727948288:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201591.163044:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788201591.174561:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a4a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727948288:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201591.174623:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc144158e00 x1875064727947648/t8589937347(8589937347) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201607 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201591.174734:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201591.174759:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201591.174785:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 27 lru_type: 1 00010000:00010000:1.0:1788201591.174851:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 27 lru_type: 1 00000080:00200000:1.0:1788201591.174862:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201591.174869:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201591.174874:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201591.174885:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201591.174890:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 27 lru_type: 1 00010000:00010000:1.0:1788201591.174902:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 28 lru_type: 1 00000080:00200000:1.0:1788201591.174930:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201591.174940:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201591.174947:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201591.174952:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=functions.sh, flags=8 00000080:00200008:1.0:1788201591.174963:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file functions.sh:[0x200000bd7:0x161:0x0](ffff8bc144683248), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201591.174969:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x161:0x0](ffff8bc144683248),name=functions.sh 00000002:00010000:1.0:1788201591.174982:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x161:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201591.174992:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096cde expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201591.175002:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096cde expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201591.175008:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201591.175012:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x161:0x0](ffff8bc144683248) 00000080:00010000:1.0:1788201591.175014:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x161:0x0](ffff8bc144683248) for lock 0xd138388016f6efc9 00000080:00010000:1.0:1788201591.175019:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6efc9 from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201591.175022:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096cde expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201591.175030:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096cde expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201591.175097:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x161:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201591.175111:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x161:0x0] 00000008:00010000:1.0:1788201591.175148:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201591.175152:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4ab0, osc lock ffff8bc145d09560, flags 0x400001002 00010000:00010000:1.0:1788201591.175170:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.175185:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201591.175463:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201591.175469:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.175480:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201591.175493:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201591.175506:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x161:0x0] updating i_size 38517 i_blocks 1 00000020:00010000:1.0:1788201591.175511:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e272e0 (ffff8bc148e3b368/0) at cl_lock_release():245 00000020:00010000:1.0:1788201591.175515:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e272e0 (ffff8bc148e3b368/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201591.175518:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4ab0 (ffff8bc148e3b098/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201591.175523:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e272e0 (ffff8bc148e3b368/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201591.175526:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4ab0 (ffff8bc148e3b368/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201591.175565:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x161:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201591.175686:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201591.175698:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201591.175706:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 28 lru_type: 1 00010000:00010000:1.0:1788201591.175716:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 28 lru_type: 1 00000080:00200000:1.0:1788201591.175724:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201591.175729:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201591.175733:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201591.175737:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201591.175740:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 28 lru_type: 1 00010000:00010000:1.0:1788201591.175749:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 29 lru_type: 1 00000080:00200000:1.0:1788201591.175758:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201591.175762:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201591.175766:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201591.175780:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=ha.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201591.175785:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=ha.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201591.175826:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ha.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201591.175883:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc800/0xd138388016f6efde lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.175892:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc800/0xd138388016f6efde lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.175905:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc800/0xd138388016f6efde lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201591.175933:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a5c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727948416:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201591.176999:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8180 going to sleep for 11 seconds 00000100:00100000:3.0:1788201591.179379:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a5c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727948416:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201591.179406:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc800/0xd138388016f6efde lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.179433:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc800/0xd138388016f6efde lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.179440:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc800/0xd138388016f6efde lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.179447:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc800/0xd138388016f6efde lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.179457:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc800/0xd138388016f6efde lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.179464:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bc800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201591.179470:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc800/0xd138388016f6efde lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.179478:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc800/0xd138388016f6efde lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.179486:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc800/0xd138388016f6efde lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.179495:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201591.179503:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc800/0xd138388016f6efde lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.179510:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc800/0xd138388016f6efde lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201591.179534:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a5c00 x1875064727948416/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201607 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201591.179551:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201591.179601:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:3.0:1788201591.179683:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201591.179704:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201591.179713:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 29 lru_type: 1 00010000:00010000:3.0:1788201591.179725:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 29 lru_type: 1 00000080:00200000:3.0:1788201591.179731:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201591.179738:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201591.179742:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201591.179748:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201591.179752:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 29 lru_type: 1 00010000:00010000:3.0:1788201591.179760:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 30 lru_type: 1 00000080:00200000:3.0:1788201591.179775:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201591.179782:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201591.179788:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201591.179831:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=ha.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:3.0:1788201591.179835:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=ha.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:3.0:1788201591.179848:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ha.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201591.179901:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efe5 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.179909:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efe5 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.179919:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efe5 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201591.179944:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727948544:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201591.181997:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201591.184538:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a2680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727948544:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201591.184567:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efe5 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.184600:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efe5 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.184609:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efe5 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.184618:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efe5 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.184629:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efe5 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.184636:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1725a0800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201591.184642:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efe5 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.184650:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efe5 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.184659:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efe5 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.184667:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201591.184675:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efe5 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.184681:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6efe5 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201591.184704:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a2680 x1875064727948544/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201607 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201591.184723:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201591.184754:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:3.0:1788201591.184908:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201591.184924:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201591.184935:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 30 lru_type: 1 00010000:00010000:3.0:1788201591.184949:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 30 lru_type: 1 00000080:00200000:3.0:1788201591.184956:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201591.184962:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201591.184966:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201591.184972:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:3.0:1788201591.184976:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 30 lru_type: 1 00010000:00010000:3.0:1788201591.184986:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00000080:00200000:3.0:1788201591.185002:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201591.185010:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201591.185016:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201591.185030:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:3.0:1788201591.185035:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=ha.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc146420f00, open_flags 80c1, mode 81ed opened 0 00000080:00200000:3.0:1788201591.185043:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=ha.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:3.0:1788201591.185062:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ha.sh,[0x200000bd7:0x162:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:3.0:1788201591.185131:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.185140:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1788201591.185154:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1788201591.185162:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a2680 x1875064727948800/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1788201591.185172:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201591.185196:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727948800:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201591.185357:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201591.195126:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a2680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727948800:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201591.195165:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096d39 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.195226:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x162:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096d39 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.195236:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096d39 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.195250:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096d39 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.195269:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096d39 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.195286:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096d39 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.195296:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096d39 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.195304:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096d39 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201591.195318:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1724a2680 x1875064727948800/t8589937349(8589937349) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1788201591.195333:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a2680 x1875064727948800/t8589937349(8589937349) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201591.195349:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096d39 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1788201591.195363:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096d39 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.195376:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/354 (0 0) 00000080:00200000:3.0:1788201591.195385:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1788201591.195403:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=ha.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:3.0:1788201591.195455:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x162:0x0](ffff8bc1459d4b08) 00000080:00200000:3.0:1788201591.195683:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x162:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1788201591.195693:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x162:0x0](ffff8bc1459d4b08) 00000080:00010000:3.0:1788201591.195697:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x162:0x0](ffff8bc1459d4b08) for lock 0xd138388016f6efec 00000080:00010000:3.0:1788201591.195709:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x162:0x0](ffff8bc1459d4b08) 00000080:00200008:3.0:1788201591.195728:0:24470:0:(file.c:1090:ll_file_open()) START file ha.sh:[0x200000bd7:0x162:0x0](ffff8bc1459d4b08), flags 100301 00000002:00100000:3.0:1788201591.195748:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a2680 x1875064727948800/t8589937349(8589937349) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1788201591.195821:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6efec from it ffff8bc148c9bd80 00010000:00010000:3.0:1788201591.195826:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096d39 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.195837:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096d39 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201591.195866:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x162:0x0](ffff8bc1459d4b08), inode mode 81ed mask 40 00000080:00200008:3.0:1788201591.195900:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file ha.sh:[0x200000bd7:0x162:0x0](ffff8bc1459d4b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201591.195906:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x162:0x0](ffff8bc1459d4b08),name=ha.sh 00000002:00010000:3.0:1788201591.195926:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x162:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201591.195938:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096d39 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201591.195950:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096d39 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201591.195957:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201591.195962:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x162:0x0](ffff8bc1459d4b08) 00000080:00010000:3.0:1788201591.195965:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x162:0x0](ffff8bc1459d4b08) for lock 0xd138388016f6efec 00000080:00010000:3.0:1788201591.195969:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6efec from it ffffadd1c7debcd8 00010000:00010000:3.0:1788201591.195973:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096d39 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201591.195980:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096d39 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201591.196006:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x162:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201591.196016:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x162:0x0] 00000008:00010000:3.0:1788201591.196047:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201591.196051:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149fec2b0, osc lock ffff8bc14691a850, flags 0x400001002 00010000:00010000:3.0:1788201591.196105:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005d8fb7a0/0xd138388016f6eff3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.196115:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005d8fb7a0/0xd138388016f6eff3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201591.196174:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1788201591.196373:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201591.196395:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727948928:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201591.201372:0:10055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005d8fb7a0/0xd138388016f6eff3 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.201421:0:10055:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005d8fb7a0/0xd138388016f6eff3 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096d47 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.201442:0:10055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005d8fb7a0/0xd138388016f6eff3 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096d47 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.201465:0:10055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005d8fb7a0/0xd138388016f6eff3 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096d47 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201591.201485:0:10055:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005d8fb7a0/0xd138388016f6eff3 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096d47 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201591.201499:0:10055:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201591.201555:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005d8fb7a0/0xd138388016f6eff3 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171096d47 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.201566:0:10055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005d8fb7a0/0xd138388016f6eff3 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171096d47 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.201576:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005d8fb7a0/0xd138388016f6eff3 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171096d47 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.201586:0:10055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005d8fb7a0/0xd138388016f6eff3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171096d47 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201591.201674:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727948928:192.168.201.143@tcp:101:cp.0 00000080:00200000:3.0:1788201591.201757:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x162:0x0] updating i_size 0 i_blocks 1 00000020:00010000:3.0:1788201591.201765:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc6bf0 (ffff8bc1460e9008/0) at cl_lock_release():245 00000020:00010000:3.0:1788201591.201769:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc6bf0 (ffff8bc1460e9008/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201591.201775:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149fec2b0 (ffff8bc1460e9878/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201591.201780:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc6bf0 (ffff8bc1460e9008/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201591.201782:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149fec2b0 (ffff8bc1460e9008/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201591.208516:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x162:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1788201591.208760:0:24470:0:(file.c:2638:do_file_write_iter()) START file ha.sh:[0x200000bd7:0x162:0x0], ppos: 0, count: 39343 00000080:00200000:0.0:1788201591.209072:0:24470:0:(file.c:2090:ll_file_io_generic()) ha.sh: write ppos: 0, bytes: 39343 00000080:00200000:0.0:1788201591.209080:0:24470:0:(file.c:1848:ll_io_set_mirror()) ha.sh: desiginated mirror: 0 00000020:00200000:0.0:1788201591.209089:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@000000000bb24103[0x110, 1, [0x200000bd7:0x162:0x0] hash] 00000020:00200000:0.0:1788201591.209094:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 39343) 0 0 00000080:00200000:0.0:1788201591.209099:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x162:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201591.209114:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 9] 00020000:00200000:0.0:1788201591.209123:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 39343) 39343, 39343 00020000:00200000:0.0:1788201591.209127:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201591.209162:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 9] 00000008:00010000:0.0:1788201591.209178:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1788201591.209184:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456bb0, osc lock ffff8bc145d34980, flags 0x0 00010000:00010000:0.0:1788201591.209218:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/419 (0 40959) 00010000:00010000:0.0:1788201591.209283:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.209297:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.209311:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201591.209342:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727949056:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201591.209460:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201591.211654:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201591.211860:0:20876:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788201591.211884:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743471616 00000100:00100000:0.0:1788201591.211898:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743471616 00000100:00100000:0.0:1788201591.211974:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 699 00000100:00100000:0.0:1788201591.211989:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17270f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23407:x1875064743471616:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201591.212017:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005d8fb7a0/0xd138388016f6eff3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171096d47 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.212118:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201591.212127:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17270f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23407:x1875064743471616:12345-192.168.201.143@tcp:104: Request processed in 141us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201591.212134:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 699 00000100:00100000:3.0:1788201591.213875:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201591.213898:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727949184:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201591.216027:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727949056:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201591.216063:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096d4e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.216082:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096d4e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.216093:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096d4e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201591.217964:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201591.223694:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727949184:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201591.226849:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096d4e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.226882:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096d4e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.226908:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096d4e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201591.226927:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171096d4e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.226942:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096d4e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.226952:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096d4e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201591.227027:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) ha.sh: write [0, 39343) append 0 append lockpos 0 00000080:00200000:1.0:1788201591.227056:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:1.0:1788201591.227126:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:1.0:1788201591.227139:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000079db9e67[3 000000009018b452 2 1 000000008c565d42 0 0 0] 00000080:00200000:1.0:1788201591.227143:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000619727e6 17ffffc0001001 3:0 ffff8bc148ec71c0 0 lru 00000080:00200000:1.0:1788201591.227152:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c3bc0cfc 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 000000008ca30d07 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201591.227155:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000079db9e67 00000080:00200000:1.0:1788201591.227156:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201591.227160:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:1.0:1788201591.227186:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:1.0:1788201591.227203:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000068ee3c0c[3 000000009018b452 2 1 000000008c565d42 0 0 1] 00000080:00200000:1.0:1788201591.227207:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004abbffe4 17ffffc0001001 3:0 ffff8bc148ec7000 1 lru 00000080:00200000:1.0:1788201591.227212:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b7fc8a1a 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 000000008ca30d07 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201591.227214:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000068ee3c0c 00000080:00200000:1.0:1788201591.227216:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:1.0:1788201591.227217:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:1.0:1788201591.227239:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:1.0:1788201591.227245:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000062b9a7c7[3 000000009018b452 2 1 000000008c565d42 0 0 2] 00000080:00200000:1.0:1788201591.227248:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b67cbc67 17ffffc0001001 3:0 ffff8bc148ec7d20 2 lru 00000080:00200000:1.0:1788201591.227252:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000046223739 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000000ce25486 000000008ca30d07 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201591.227254:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000062b9a7c7 00000080:00200000:1.0:1788201591.227255:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:1.0:1788201591.227257:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:1.0:1788201591.227272:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:1.0:1788201591.227277:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000040f103da[3 000000009018b452 2 1 000000008c565d42 0 0 3] 00000080:00200000:1.0:1788201591.227280:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004a961c52 17ffffc0001001 3:0 ffff8bc148ec7380 3 lru 00000080:00200000:1.0:1788201591.227284:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008565ae28 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000000ce25486 000000008ca30d07 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201591.227286:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000040f103da 00000080:00200000:1.0:1788201591.227287:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:1.0:1788201591.227289:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:1.0:1788201591.227306:0:24470:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:1.0:1788201591.227311:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000000a0fb7e[3 000000009018b452 2 1 000000008c565d42 0 0 4] 00000080:00200000:1.0:1788201591.227314:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ec1f796f 17ffffc0001001 3:0 ffff8bc148ec7460 4 lru 00000080:00200000:1.0:1788201591.227319:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b7e872aa 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000000ce25486 000000008ca30d07 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201591.227321:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000000a0fb7e 00000080:00200000:1.0:1788201591.227322:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:1.0:1788201591.227324:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:1.0:1788201591.227339:0:24470:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:1.0:1788201591.227343:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a6b8d39c[3 000000009018b452 2 1 000000008c565d42 0 0 5] 00000080:00200000:1.0:1788201591.227346:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000056ebb932 17ffffc0001001 3:0 ffff8bc148ec72a0 5 lru 00000080:00200000:1.0:1788201591.227351:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000033806ada 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000000ce25486 000000008ca30d07 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201591.227355:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a6b8d39c 00000080:00200000:1.0:1788201591.227356:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:1.0:1788201591.227358:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:1.0:1788201591.227372:0:24470:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:1.0:1788201591.227376:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009836002e[3 000000009018b452 2 1 000000008c565d42 0 0 6] 00000080:00200000:1.0:1788201591.227379:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f2e6df74 17ffffc0001001 3:0 ffff8bc148ec7b60 6 lru 00000080:00200000:1.0:1788201591.227384:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007085218a 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000000ce25486 000000008ca30d07 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201591.227386:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009836002e 00000080:00200000:1.0:1788201591.227388:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:1.0:1788201591.227390:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:1.0:1788201591.227426:0:24470:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:1.0:1788201591.227430:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000de1353b8[3 000000009018b452 2 1 000000008c565d42 0 0 7] 00000080:00200000:1.0:1788201591.227432:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006f455357 17ffffc0001021 2:0 ffff8bc148ec7700 7 lru 00000080:00200000:1.0:1788201591.227437:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000050bc9498 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000000ce25486 000000008ca30d07 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201591.227439:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000de1353b8 00000080:00200000:1.0:1788201591.227440:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:1.0:1788201591.227441:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:1.0:1788201591.227458:0:24470:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:1.0:1788201591.227463:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000595e7ad5[3 000000009018b452 2 1 000000008c565d42 0 0 8] 00000080:00200000:1.0:1788201591.227465:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000048e46e64 17ffffc0001001 3:0 ffff8bc148ec77e0 8 lru 00000080:00200000:1.0:1788201591.227470:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000121b2812 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000000ce25486 000000008ca30d07 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201591.227472:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000595e7ad5 00000080:00200000:1.0:1788201591.227473:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:1.0:1788201591.227475:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 2479 bytes 00000080:00200000:1.0:1788201591.227503:0:24470:0:(rw26.c:898:ll_write_end()) pos 36864, len 2479, copied 2479 00000080:00200000:1.0:1788201591.227506:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b3ce492d[3 000000009018b452 2 1 000000008c565d42 0 0 9] 00000080:00200000:1.0:1788201591.227508:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c648867c 17ffffc0001001 3:0 ffff8bc148ec7620 9 lru 00000080:00200000:1.0:1788201591.227512:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e568a4e7 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000000ce25486 000000008ca30d07 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201591.227515:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b3ce492d 00000080:00200000:1.0:1788201591.227515:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:1.0:1788201591.227519:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 10, from 0, to 2479 prio 0 00000008:00010000:1.0:1788201591.227544:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 000000005de6e866 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096d4e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201591.227572:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d4cb8, count 10, dirtied 10 00000080:00200000:1.0:1788201591.227579:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 10 pages 39343 bytes, tot: 39343 00000080:00200000:1.0:1788201591.227582:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) ha.sh: write bytes 0, result: 39343 00000020:00010000:1.0:1788201591.227616:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc148fb15d8 (ffff8bc1499c4a28/0) at cl_lock_release():245 00000020:00010000:1.0:1788201591.227621:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc148fb15d8 (ffff8bc1499c4a28/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201591.227625:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456bb0 (ffff8bc1499c45a8/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201591.227630:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096d4e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.227642:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096d4e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201591.227662:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc148fb15d8 (ffff8bc1499c4a28/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201591.227665:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456bb0 (ffff8bc1499c4a28/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201591.227675:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 39343 bytes 00000080:00200000:1.0:1788201591.227684:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 9] 00000080:00200000:1.0:1788201591.227721:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x162:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201591.227726:0:24470:0:(file.c:2238:ll_file_io_generic()) ha.sh: 2 io complete with rc: 0, result: 39343, restart: 0 00000080:00200000:1.0:1788201591.227735:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x162:0x0] updating i_size 39343 i_blocks 1 00000080:00200000:1.0:1788201591.227741:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 39343 00000080:00200008:1.0:1788201591.227826:0:24470:0:(file.c:479:ll_file_release()) START file ha.sh:[0x200000bd7:0x162:0x0](ffff8bc1459d4b08), flags 100001 00000002:00100000:1.0:1788201591.227908:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1724a2680 x1875064727948800/t8589937349(8589937349) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/664 e 0 to 0 dl 1788201607 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201591.227924:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201591.227932:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a5180 x1875064727949440/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201591.227962:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a5180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727949440:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201591.228093:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201591.235120:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a5180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727949440:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201591.235163:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1724a2680 x1875064727948800/t8589937349(8589937349) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/664 e 0 to 0 dl 1788201607 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201591.235273:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201591.235302:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201591.235327:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00010000:00010000:1.0:1788201591.235344:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00000080:00200000:1.0:1788201591.235355:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201591.235362:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201591.235366:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201591.235377:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201591.235382:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00010000:00010000:1.0:1788201591.235393:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00000080:00200000:1.0:1788201591.235912:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201591.235922:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201591.235930:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201591.235934:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=ha.sh, flags=8 00000080:00200008:1.0:1788201591.235943:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file ha.sh:[0x200000bd7:0x162:0x0](ffff8bc1459d4b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201591.235949:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x162:0x0](ffff8bc1459d4b08),name=ha.sh 00000002:00010000:1.0:1788201591.235965:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x162:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201591.235987:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096d39 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201591.235999:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096d39 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201591.236007:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201591.236012:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x162:0x0](ffff8bc1459d4b08) 00000080:00010000:1.0:1788201591.236015:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x162:0x0](ffff8bc1459d4b08) for lock 0xd138388016f6efec 00000080:00010000:1.0:1788201591.236019:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6efec from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201591.236023:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096d39 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201591.236032:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096d39 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201591.236090:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x162:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201591.236101:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x162:0x0] 00000008:00010000:1.0:1788201591.236130:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201591.236135:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4ab0, osc lock ffff8bc145d09560, flags 0x400001002 00010000:00010000:1.0:1788201591.236155:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096d4e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.236168:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096d4e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201591.236185:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201591.236900:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096d4e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.236916:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096d4e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201591.236931:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201591.236960:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x162:0x0] updating i_size 39343 i_blocks 1 00000020:00010000:1.0:1788201591.236965:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e272e0 (ffff8bc148e3b368/0) at cl_lock_release():245 00000020:00010000:1.0:1788201591.236969:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e272e0 (ffff8bc148e3b368/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201591.236983:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4ab0 (ffff8bc148e3b098/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201591.236988:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e272e0 (ffff8bc148e3b368/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201591.236992:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4ab0 (ffff8bc148e3b368/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201591.237029:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x162:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201591.237110:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201591.237126:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201591.237140:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00010000:00010000:1.0:1788201591.237152:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00000080:00200000:1.0:1788201591.237160:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201591.237166:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201591.237169:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201591.237175:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201591.237179:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00010000:00010000:1.0:1788201591.237188:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 33 lru_type: 1 00000080:00200000:1.0:1788201591.237648:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201591.237658:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000100:00100000:0.0:1788201591.268769:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275b800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727949696:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201591.268839:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6f008 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.268857:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6f008 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.268865:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6f008 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.268874:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6f008 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.268892:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6f008 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.268900:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1427dca00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201591.268906:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6f008 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.268915:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6f008 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.268924:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6f008 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.268933:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201591.268941:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6f008 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.268948:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6f008 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201591.268982:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc17275b800 x1875064727949696/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201607 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201591.269001:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201591.269034:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201591.269164:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201591.269181:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.269203:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 34 lru_type: 1 00010000:00010000:0.0:1788201591.269225:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 34 lru_type: 1 00000080:00200000:0.0:1788201591.269233:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.269245:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201591.269249:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201591.269256:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:0.0:1788201591.269260:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 34 lru_type: 1 00010000:00010000:0.0:1788201591.269271:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 35 lru_type: 1 00000080:00200000:0.0:1788201591.269288:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.269297:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201591.269303:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.269663:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201591.269671:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=insanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc152c97c80, open_flags 80c1, mode 81ed opened 0 00000080:00200000:0.0:1788201591.269680:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=insanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:0.0:1788201591.269702:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: insanity.sh,[0x200000bd7:0x163:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:0.0:1788201591.269991:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6f00f lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.270002:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6f00f lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1788201591.270018:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1788201591.270029:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144159880 x1875064727949952/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1788201591.270041:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6f00f lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201591.270070:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144159880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727949952:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201591.270674:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201591.278538:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201591.278565:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17275aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727950080:192.168.201.143@tcp:101:cp.0 00000080:00200000:0.0:1788201591.284007:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x163:0x0] updating i_size 0 i_blocks 1 00000020:00010000:0.0:1788201591.284015:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc146005970 (ffff8bc146919248/0) at cl_lock_release():245 00000020:00010000:0.0:1788201591.284019:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146005970 (ffff8bc146919248/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201591.284024:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261db30 (ffff8bc146919008/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201591.284029:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146005970 (ffff8bc146919248/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201591.284032:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261db30 (ffff8bc146919248/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201591.284074:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x163:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1788201591.284165:0:24470:0:(file.c:2638:do_file_write_iter()) START file insanity.sh:[0x200000bd7:0x163:0x0], ppos: 0, count: 15476 00000080:00200000:0.0:1788201591.284204:0:24470:0:(file.c:2090:ll_file_io_generic()) insanity.sh: write ppos: 0, bytes: 15476 00000080:00200000:0.0:1788201591.284212:0:24470:0:(file.c:1848:ll_io_set_mirror()) insanity.sh: desiginated mirror: 0 00000020:00200000:0.0:1788201591.284218:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@000000005cce8b93[0x110, 1, [0x200000bd7:0x163:0x0] hash] 00000020:00200000:0.0:1788201591.284221:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 15476) 0 0 00000080:00200000:0.0:1788201591.284225:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x163:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201591.284250:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 3] 00020000:00200000:0.0:1788201591.284259:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 15476) 15476, 15476 00020000:00200000:0.0:1788201591.284263:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201591.284299:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 3] 00000008:00010000:0.0:1788201591.284316:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1788201591.284322:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456230, osc lock ffff8bc145d34be0, flags 0x0 00010000:00010000:0.0:1788201591.284341:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/420 (0 16383) 00010000:00010000:0.0:1788201591.284390:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.284402:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.285573:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201591.285617:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144158000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727950208:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201591.285740:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201591.295715:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:1.0:1788201591.296675:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201591.296685:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f016 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171096da2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.296696:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1427ddc00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201591.296703:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f016 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171096da2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201591.296778:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x163:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201591.296825:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x163:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201591.296913:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f016 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096da2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.296921:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201591.296952:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f016 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096da2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.296966:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f016 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096da2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201591.299946:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201591.300557:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144158000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727950208:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201591.300591:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096da9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.300594:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201591.300598:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201591.300601:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201591.300609:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096da9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.300619:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096da9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.301815:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096da9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.301827:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096da9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.301851:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096da9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201591.301866:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171096da9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.301880:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096da9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.301889:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096da9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201591.301925:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) insanity.sh: write [0, 15476) append 0 append lockpos 0 00000080:00200000:0.0:1788201591.301949:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:0.0:1788201591.302014:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:0.0:1788201591.302028:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000069eddd74[3 00000000d907ce34 2 1 000000007c1afdde 0 0 0] 00000080:00200000:0.0:1788201591.302033:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000014395003 17ffffc0001001 3:0 ffff8bc1727a62a0 0 lru 00000080:00200000:0.0:1788201591.302041:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004bd0d839 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201591.302043:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000069eddd74 00000080:00200000:0.0:1788201591.302045:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1788201591.302049:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:0.0:1788201591.302077:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:0.0:1788201591.302081:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ec8b5b93[3 00000000d907ce34 2 1 000000007c1afdde 0 0 1] 00000080:00200000:0.0:1788201591.302084:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d707de59 17ffffc0001001 3:0 ffff8bc1727a6460 1 lru 00000080:00200000:0.0:1788201591.302089:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000916302f8 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201591.302091:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ec8b5b93 00000080:00200000:0.0:1788201591.302093:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:0.0:1788201591.302095:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:0.0:1788201591.302112:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:0.0:1788201591.302117:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b14a12ef[3 00000000d907ce34 2 1 000000007c1afdde 0 0 2] 00000080:00200000:0.0:1788201591.302120:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000737f5159 17ffffc0001001 3:0 ffff8bc1727a6b60 2 lru 00000080:00200000:0.0:1788201591.302125:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000ccd293e 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201591.302127:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b14a12ef 00000080:00200000:0.0:1788201591.302129:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:0.0:1788201591.302130:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 3188 bytes 00000080:00200000:0.0:1788201591.302154:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 3188, copied 3188 00000080:00200000:0.0:1788201591.302158:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002f5e8d56[3 00000000d907ce34 2 1 000000007c1afdde 0 0 3] 00000080:00200000:0.0:1788201591.302161:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009bfa118a 17ffffc0001001 3:0 ffff8bc1727a6700 3 lru 00000080:00200000:0.0:1788201591.302167:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f6a12729 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000008930e75a 00000000bd717378 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201591.302169:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002f5e8d56 00000080:00200000:0.0:1788201591.302170:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:0.0:1788201591.302174:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 4, from 0, to 3188 prio 0 00000008:00010000:0.0:1788201591.302202:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 0000000041ed5eb8 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096da9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201591.302228:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459f2378, count 4, dirtied 4 00000080:00200000:0.0:1788201591.302246:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 4 pages 15476 bytes, tot: 15476 00000080:00200000:0.0:1788201591.302250:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) insanity.sh: write bytes 0, result: 15476 00000020:00010000:0.0:1788201591.302269:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc148fb15d8 (ffff8bc1499c4ab8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201591.302273:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc148fb15d8 (ffff8bc1499c4ab8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201591.302277:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456230 (ffff8bc1499c4008/1) at cl_lock_cancel():142 00010000:00010000:0.0:1788201591.302283:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096da9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.302294:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096da9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1788201591.302320:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc148fb15d8 (ffff8bc1499c4ab8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201591.302324:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456230 (ffff8bc1499c4ab8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201591.302336:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 15476 bytes 00000080:00200000:0.0:1788201591.302345:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 3] 00000080:00200000:0.0:1788201591.302384:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x163:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201591.302388:0:24470:0:(file.c:2238:ll_file_io_generic()) insanity.sh: 2 io complete with rc: 0, result: 15476, restart: 0 00000080:00200000:0.0:1788201591.302397:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x163:0x0] updating i_size 15476 i_blocks 1 00000080:00200000:0.0:1788201591.302403:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 15476 00000080:00200008:0.0:1788201591.302606:0:24470:0:(file.c:479:ll_file_release()) START file insanity.sh:[0x200000bd7:0x163:0x0](ffff8bc1459f21c8), flags 100001 00000002:00100000:0.0:1788201591.302676:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc144159880 x1875064727949952/t8589937351(8589937351) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201607 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1788201591.302689:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1788201591.302696:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144158000 x1875064727950592/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1788201591.302723:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144158000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727950592:192.168.201.143@tcp:35:cp.0 00000100:00100000:0.0:1788201591.302839:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201591.316878:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144158000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727950592:192.168.201.143@tcp:35:cp.0 00000002:00100000:0.0:1788201591.316925:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc144159880 x1875064727949952/t8589937351(8589937351) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201607 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201591.317019:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201591.317043:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.317067:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 35 lru_type: 1 00010000:00010000:0.0:1788201591.317092:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 35 lru_type: 1 00000080:00200000:0.0:1788201591.317101:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.317107:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201591.317111:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201591.317120:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201591.317124:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 35 lru_type: 1 00010000:00010000:0.0:1788201591.317134:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 36 lru_type: 1 00000080:00200000:0.0:1788201591.317154:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.317162:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201591.317168:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.317172:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=insanity.sh, flags=8 00000080:00200008:0.0:1788201591.317181:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file insanity.sh:[0x200000bd7:0x163:0x0](ffff8bc1459f21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201591.317187:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x163:0x0](ffff8bc1459f21c8),name=insanity.sh 00000002:00010000:0.0:1788201591.317200:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x163:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.317209:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6f00f lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x163:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096d94 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201591.317218:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6f00f lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x163:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096d94 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201591.317224:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.317229:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x163:0x0](ffff8bc1459f21c8) 00000080:00010000:0.0:1788201591.317232:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x163:0x0](ffff8bc1459f21c8) for lock 0xd138388016f6f00f 00000080:00010000:0.0:1788201591.317236:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f00f from it ffffadd1c7debcb8 00010000:00010000:0.0:1788201591.317240:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6f00f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x163:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096d94 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201591.317249:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6f00f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x163:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096d94 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201591.317304:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x163:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201591.317315:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x163:0x0] 00000008:00010000:0.0:1788201591.317349:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201591.317354:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456230, osc lock ffff8bc145d34be0, flags 0x400001002 00010000:00010000:0.0:1788201591.317373:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096da9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.317386:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096da9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:0.0:1788201591.317399:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1788201591.317404:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096da9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.317505:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096da9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1788201591.317518:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1788201591.317530:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x163:0x0] updating i_size 15476 i_blocks 1 00000020:00010000:0.0:1788201591.317536:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449dbc20 (ffff8bc1499c4ab8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201591.317539:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449dbc20 (ffff8bc1499c4ab8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201591.317542:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456230 (ffff8bc1499c4008/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201591.317546:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449dbc20 (ffff8bc1499c4ab8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201591.317549:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456230 (ffff8bc1499c4ab8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201591.317581:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x163:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201591.317639:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201591.317647:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.317655:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 36 lru_type: 1 00010000:00010000:0.0:1788201591.317663:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 36 lru_type: 1 00000080:00200000:0.0:1788201591.317669:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.317674:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201591.317676:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201591.317680:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201591.317684:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 36 lru_type: 1 00010000:00010000:0.0:1788201591.317691:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 37 lru_type: 1 00000080:00200000:0.0:1788201591.317700:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.317705:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201591.317708:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.317722:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=krb5_login.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:0.0:1788201591.317728:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=krb5_login.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201591.317740:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: krb5_login.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201591.317842:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f024 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.317850:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f024 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.317862:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f024 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201591.317890:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415a680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727950720:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201591.318021:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201591.324451:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415a680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727950720:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201591.324488:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f024 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.324504:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f024 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.324512:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f024 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.324520:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f024 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.324532:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f024 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.324540:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1727c8800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201591.324547:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f024 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.324555:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f024 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.324564:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f024 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.324572:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201591.324580:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f024 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.324588:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f024 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201591.324614:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14415a680 x1875064727950720/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201607 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201591.324634:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201591.324674:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201591.324756:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201591.324776:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.324788:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 37 lru_type: 1 00010000:00010000:0.0:1788201591.325027:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 37 lru_type: 1 00000080:00200000:0.0:1788201591.325036:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.325043:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201591.325048:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201591.325055:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201591.325059:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 37 lru_type: 1 00010000:00010000:0.0:1788201591.325068:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 38 lru_type: 1 00000080:00200000:0.0:1788201591.325087:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.325096:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201591.325104:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.325128:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=krb5_login.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:0.0:1788201591.325133:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=krb5_login.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201591.325147:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: krb5_login.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201591.325203:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6f02b lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.325210:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6f02b lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.325221:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6f02b lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201591.325382:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415a680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727950848:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201591.326788:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201591.343893:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415a680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727950848:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201591.343926:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6f02b lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.343950:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6f02b lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.343958:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6f02b lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.343966:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6f02b lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.343975:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6f02b lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.343982:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1727c9c00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201591.343987:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6f02b lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.343997:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6f02b lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.344005:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6f02b lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.344013:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201591.344021:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6f02b lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.344028:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9c00/0xd138388016f6f02b lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201591.344051:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14415a680 x1875064727950848/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201607 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201591.344071:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201591.344102:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201591.344295:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201591.344313:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.344324:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 38 lru_type: 1 00010000:00010000:0.0:1788201591.344338:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 38 lru_type: 1 00000080:00200000:0.0:1788201591.344345:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.344351:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201591.344355:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201591.344361:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:0.0:1788201591.344365:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 38 lru_type: 1 00010000:00010000:0.0:1788201591.344375:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 39 lru_type: 1 00000080:00200000:0.0:1788201591.344392:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.344399:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201591.344417:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.344436:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201591.344442:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=krb5_login.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc152c97c80, open_flags 80c1, mode 81ed opened 0 00000080:00200000:0.0:1788201591.344451:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=krb5_login.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:0.0:1788201591.344475:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: krb5_login.sh,[0x200000bd7:0x164:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:0.0:1788201591.344529:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.344537:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1788201591.344549:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1788201591.344556:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14415a680 x1875064727951104/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1788201591.344566:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201591.344590:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415a680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727951104:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201591.344977:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201591.353382:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415a680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727951104:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201591.353431:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096def expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.353461:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x164:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096def expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.353471:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x164:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096def expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.353485:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x164:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096def expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.353505:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x164:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096def expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.353521:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x164:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096def expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.353531:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x164:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096def expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.353539:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x164:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096def expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201591.353550:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc14415a680 x1875064727951104/t8589937353(8589937353) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201591.353562:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14415a680 x1875064727951104/t8589937353(8589937353) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201591.353577:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x164:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096def expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1788201591.353593:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x164:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096def expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.353605:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/356 (0 0) 00000080:00200000:0.0:1788201591.353613:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201591.353630:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=krb5_login.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:0.0:1788201591.353667:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x164:0x0](ffff8bc144683a88) 00000080:00200000:0.0:1788201591.353858:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x164:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1788201591.353870:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x164:0x0](ffff8bc144683a88) 00000080:00010000:0.0:1788201591.353874:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x164:0x0](ffff8bc144683a88) for lock 0xd138388016f6f032 00000080:00010000:0.0:1788201591.353886:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x164:0x0](ffff8bc144683a88) 00000080:00200008:0.0:1788201591.353905:0:24470:0:(file.c:1090:ll_file_open()) START file krb5_login.sh:[0x200000bd7:0x164:0x0](ffff8bc144683a88), flags 100301 00000002:00100000:0.0:1788201591.353925:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14415a680 x1875064727951104/t8589937353(8589937353) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1788201591.353976:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f032 from it ffff8bc146937ea0 00010000:00010000:0.0:1788201591.353982:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x164:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096def expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.353992:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x164:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096def expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201591.354024:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x164:0x0](ffff8bc144683a88), inode mode 81ed mask 40 00000080:00200008:0.0:1788201591.354062:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file krb5_login.sh:[0x200000bd7:0x164:0x0](ffff8bc144683a88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201591.354070:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x164:0x0](ffff8bc144683a88),name=krb5_login.sh 00000002:00010000:0.0:1788201591.354093:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x164:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.354105:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x164:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096def expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.354118:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x164:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096def expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201591.354126:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.354131:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x164:0x0](ffff8bc144683a88) 00000080:00010000:0.0:1788201591.354135:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x164:0x0](ffff8bc144683a88) for lock 0xd138388016f6f032 00000080:00010000:0.0:1788201591.354140:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f032 from it ffffadd1c7debcd8 00010000:00010000:0.0:1788201591.354143:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x164:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096def expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.354150:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x164:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096def expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201591.354176:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x164:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201591.354185:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x164:0x0] 00000008:00010000:0.0:1788201591.354214:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201591.354218:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456530, osc lock ffff8bc145d34be0, flags 0x400001002 00010000:00010000:0.0:1788201591.354285:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f039 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.354296:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f039 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201591.354334:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1788201591.354348:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201591.354367:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727951232:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201591.359399:0:10055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f039 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.359453:0:10055:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f039 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096dfd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.359473:0:10055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f039 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096dfd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.359490:0:10055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f039 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096dfd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201591.359510:0:10055:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f039 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096dfd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201591.359525:0:10055:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201591.359551:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f039 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171096dfd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.359562:0:10055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f039 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171096dfd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.359572:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f039 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171096dfd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.359583:0:10055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f039 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171096dfd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201591.359621:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727951232:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201591.364724:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201591.370153:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727951360:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201591.370218:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000083541a8b/0xd138388016f6f040 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096e04 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.370256:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000083541a8b/0xd138388016f6f040 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096e04 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.370272:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000083541a8b/0xd138388016f6f040 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096e04 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.370913:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201591.370925:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f039 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171096dfd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.370938:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1727c9c00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201591.370946:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f039 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171096dfd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201591.371022:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x164:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201591.371039:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x164:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201591.371135:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f039 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096dfd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.371144:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788201591.371221:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727951488:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201591.372694:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f039 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096dfd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.372713:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f039 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096dfd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.372745:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201591.372747:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201591.372750:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201591.376706:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:1.0:1788201591.378049:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000083541a8b/0xd138388016f6f040 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096e04 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.378065:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000083541a8b/0xd138388016f6f040 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096e04 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.378086:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000083541a8b/0xd138388016f6f040 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096e04 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201591.378101:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000083541a8b/0xd138388016f6f040 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171096e04 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.378115:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000083541a8b/0xd138388016f6f040 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096e04 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.378123:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000083541a8b/0xd138388016f6f040 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096e04 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201591.378160:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) krb5_login.sh: write [0, 674) append 0 append lockpos 0 00000080:00200000:1.0:1788201591.378182:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 674 bytes 00000080:00200000:1.0:1788201591.378715:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 674, copied 674 00000080:00200000:1.0:1788201591.378730:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000ab299b9[3 000000005c629e53 2 1 000000002c23fcb5 0 0 0] 00000080:00200000:1.0:1788201591.378734:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001492f142 17ffffc0001001 3:0 ffff8bc148ec7ee0 0 lru 00000080:00200000:1.0:1788201591.378744:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000120bafc5 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000358e3769 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201591.378747:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000ab299b9 00000080:00200000:1.0:1788201591.378749:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201591.378755:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 674 prio 0 00000008:00010000:1.0:1788201591.378781:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000ba6985c4 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000083541a8b/0xd138388016f6f040 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096e04 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201591.378832:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc144683c38, count 1, dirtied 1 00000080:00200000:1.0:1788201591.378837:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 674 bytes, tot: 674 00000080:00200000:1.0:1788201591.378841:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) krb5_login.sh: write bytes 0, result: 674 00000020:00010000:1.0:1788201591.378859:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc149844b78 (ffff8bc1469193f8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201591.378863:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149844b78 (ffff8bc1469193f8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201591.378865:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261de30 (ffff8bc146919bd8/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201591.378870:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000083541a8b/0xd138388016f6f040 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096e04 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.378881:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000083541a8b/0xd138388016f6f040 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096e04 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201591.379102:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149844b78 (ffff8bc1469193f8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201591.379107:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261de30 (ffff8bc1469193f8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201591.379116:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 674 bytes 00000080:00200000:1.0:1788201591.379124:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1788201591.379164:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x164:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201591.379168:0:24470:0:(file.c:2238:ll_file_io_generic()) krb5_login.sh: 2 io complete with rc: 0, result: 674, restart: 0 00000080:00200000:1.0:1788201591.379178:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x164:0x0] updating i_size 674 i_blocks 1 00000080:00200000:1.0:1788201591.379185:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 674 00000080:00200008:1.0:1788201591.379509:0:24470:0:(file.c:479:ll_file_release()) START file krb5_login.sh:[0x200000bd7:0x164:0x0](ffff8bc144683a88), flags 100001 00000002:00100000:1.0:1788201591.379648:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc14415a680 x1875064727951104/t8589937353(8589937353) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201607 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201591.379665:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201591.379672:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a5c00 x1875064727951744/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201591.379699:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a5c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727951744:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201591.379973:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201591.388847:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727951488:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201591.389431:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a5c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727951744:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201591.389470:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc14415a680 x1875064727951104/t8589937353(8589937353) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201607 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201591.389592:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201591.389618:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201591.389642:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 39 lru_type: 1 00010000:00010000:1.0:1788201591.389659:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 39 lru_type: 1 00000080:00200000:1.0:1788201591.389669:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201591.389675:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201591.389680:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201591.389688:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201591.389693:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 39 lru_type: 1 00010000:00010000:1.0:1788201591.389703:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 40 lru_type: 1 00000080:00200000:1.0:1788201591.389727:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201591.389734:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201591.389741:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201591.389745:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=krb5_login.sh, flags=8 00000080:00200008:1.0:1788201591.389756:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file krb5_login.sh:[0x200000bd7:0x164:0x0](ffff8bc144683a88), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201591.389761:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x164:0x0](ffff8bc144683a88),name=krb5_login.sh 00000002:00010000:1.0:1788201591.389773:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x164:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201591.389781:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x164:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096def expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201591.389881:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x164:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096def expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201591.389898:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201591.389903:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x164:0x0](ffff8bc144683a88) 00000080:00010000:1.0:1788201591.389905:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x164:0x0](ffff8bc144683a88) for lock 0xd138388016f6f032 00000080:00010000:1.0:1788201591.389909:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f032 from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201591.389913:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x164:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096def expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201591.389922:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x164:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096def expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201591.389985:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x164:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201591.389997:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x164:0x0] 00000008:00010000:1.0:1788201591.390031:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201591.390035:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4ab0, osc lock ffff8bc145d09560, flags 0x400001002 00010000:00010000:1.0:1788201591.390055:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000083541a8b/0xd138388016f6f040 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096e04 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.390069:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000083541a8b/0xd138388016f6f040 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096e04 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201591.390083:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201591.390088:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000083541a8b/0xd138388016f6f040 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096e04 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.390097:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000083541a8b/0xd138388016f6f040 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096e04 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201591.390108:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201591.390117:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x164:0x0] updating i_size 674 i_blocks 1 00000020:00010000:1.0:1788201591.390121:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e272e0 (ffff8bc148e3b368/0) at cl_lock_release():245 00000020:00010000:1.0:1788201591.390125:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e272e0 (ffff8bc148e3b368/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201591.390128:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4ab0 (ffff8bc148e3b098/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201591.390132:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e272e0 (ffff8bc148e3b368/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201591.390136:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4ab0 (ffff8bc148e3b368/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201591.390168:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x164:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201591.390358:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201591.390368:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201591.390376:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 40 lru_type: 1 00010000:00010000:1.0:1788201591.390386:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 40 lru_type: 1 00000080:00200000:1.0:1788201591.390394:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201591.390399:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201591.390402:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201591.390418:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201591.390423:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 40 lru_type: 1 00010000:00010000:1.0:1788201591.390430:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 41 lru_type: 1 00000080:00200000:1.0:1788201591.390440:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201591.390445:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201591.390450:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201591.390466:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=large-lun.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201591.390472:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=large-lun.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201591.390483:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: large-lun.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201591.390537:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f047 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.390546:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f047 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.390559:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f047 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201591.390586:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a6300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727951872:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201591.390697:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201591.397916:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a6300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727951872:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201591.397950:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f047 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.397967:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f047 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.397985:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f047 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.397996:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f047 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.398008:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f047 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.398017:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bce00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201591.398024:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f047 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.398033:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f047 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.398042:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f047 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.398050:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201591.398059:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f047 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.398067:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f047 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201591.398107:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a6300 x1875064727951872/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201607 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201591.398130:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201591.398165:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201591.398459:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201591.398481:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201591.398494:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 41 lru_type: 1 00010000:00010000:1.0:1788201591.398507:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 41 lru_type: 1 00000080:00200000:1.0:1788201591.398516:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201591.398522:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201591.398526:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201591.398532:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201591.398537:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 41 lru_type: 1 00010000:00010000:1.0:1788201591.398546:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 42 lru_type: 1 00000080:00200000:1.0:1788201591.398563:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201591.398573:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201591.398580:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201591.399162:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=large-lun.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:1.0:1788201591.399170:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=large-lun.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201591.399186:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: large-lun.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201591.399261:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f04e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.399271:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f04e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.399285:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f04e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201591.399327:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a6300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727952000:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201591.399446:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201591.408184:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a6300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727952000:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201591.408225:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f04e lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.408249:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f04e lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.408258:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f04e lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.408267:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f04e lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.408277:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f04e lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.408284:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bde00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201591.408290:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f04e lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.408298:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f04e lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.408312:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f04e lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.408321:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201591.408328:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f04e lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.408337:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f04e lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201591.408359:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a6300 x1875064727952000/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201607 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201591.408377:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201591.408416:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201591.408564:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201591.408585:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201591.408597:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 42 lru_type: 1 00010000:00010000:1.0:1788201591.408611:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 42 lru_type: 1 00000080:00200000:1.0:1788201591.408620:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201591.408625:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201591.408631:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201591.408638:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:1.0:1788201591.408642:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 42 lru_type: 1 00010000:00010000:1.0:1788201591.408652:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 43 lru_type: 1 00000080:00200000:1.0:1788201591.408671:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201591.408680:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201591.408687:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201591.408704:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201591.408710:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=large-lun.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14304a000, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:1.0:1788201591.408719:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=large-lun.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:1.0:1788201591.408741:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: large-lun.sh,[0x200000bd7:0x165:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201591.408840:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f055 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.408849:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f055 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201591.408863:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201591.408872:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a6300 x1875064727952256/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201591.408882:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f055 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201591.408906:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a6300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727952256:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201591.409090:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201591.416416:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a6300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727952256:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201591.416454:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f055 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096e4a expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.416485:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f055 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x165:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096e4a expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.416495:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f055 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x165:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096e4a expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.416510:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f055 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x165:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096e4a expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.416524:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f055 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x165:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096e4a expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.416543:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f055 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x165:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096e4a expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.416552:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f055 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x165:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096e4a expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.416561:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f055 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x165:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096e4a expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201591.416575:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1724a6300 x1875064727952256/t8589937355(8589937355) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201591.416592:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a6300 x1875064727952256/t8589937355(8589937355) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201591.416608:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f055 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x165:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096e4a expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201591.416623:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f055 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x165:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096e4a expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.416635:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/357 (0 0) 00000080:00200000:1.0:1788201591.416644:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201591.416659:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=large-lun.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:1.0:1788201591.416693:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x165:0x0](ffff8bc1446bf448) 00000080:00200000:1.0:1788201591.416871:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x165:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201591.416882:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x165:0x0](ffff8bc1446bf448) 00000080:00010000:1.0:1788201591.416897:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x165:0x0](ffff8bc1446bf448) for lock 0xd138388016f6f055 00000080:00010000:1.0:1788201591.416910:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x165:0x0](ffff8bc1446bf448) 00000080:00200008:1.0:1788201591.416929:0:24470:0:(file.c:1090:ll_file_open()) START file large-lun.sh:[0x200000bd7:0x165:0x0](ffff8bc1446bf448), flags 100301 00000002:00100000:1.0:1788201591.416952:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a6300 x1875064727952256/t8589937355(8589937355) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201591.417013:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f055 from it ffff8bc144cb5420 00010000:00010000:1.0:1788201591.417018:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f055 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x165:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096e4a expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.417030:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f055 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x165:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096e4a expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201591.417065:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x165:0x0](ffff8bc1446bf448), inode mode 81a4 mask 40 00000080:00200008:1.0:1788201591.417100:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file large-lun.sh:[0x200000bd7:0x165:0x0](ffff8bc1446bf448), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201591.417107:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x165:0x0](ffff8bc1446bf448),name=large-lun.sh 00000002:00010000:1.0:1788201591.417129:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x165:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201591.417140:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f055 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x165:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096e4a expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.417153:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f055 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x165:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096e4a expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201591.417161:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201591.417166:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x165:0x0](ffff8bc1446bf448) 00000080:00010000:1.0:1788201591.417169:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x165:0x0](ffff8bc1446bf448) for lock 0xd138388016f6f055 00000080:00010000:1.0:1788201591.417173:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f055 from it ffffadd1c7debcd8 00010000:00010000:1.0:1788201591.417177:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f055 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x165:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096e4a expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.417185:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f055 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x165:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096e4a expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201591.417212:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x165:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201591.417223:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x165:0x0] 00000008:00010000:1.0:1788201591.417262:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201591.417267:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4030, osc lock ffff8bc145d09560, flags 0x400001002 00010000:00010000:1.0:1788201591.417320:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004373584d/0xd138388016f6f05c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.417339:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004373584d/0xd138388016f6f05c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201591.417390:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1788201591.417599:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201591.417621:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727952384:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201591.432717:0:10053:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8bc143fc0000: committing for last_committed 8589935290 gen 1 00010000:00010000:0.0:1788201591.433493:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004373584d/0xd138388016f6f05c lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.433525:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004373584d/0xd138388016f6f05c lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096e58 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.433544:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004373584d/0xd138388016f6f05c lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096e58 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.433560:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004373584d/0xd138388016f6f05c lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096e58 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201591.434057:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004373584d/0xd138388016f6f05c lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096e58 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201591.434075:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201591.434087:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004373584d/0xd138388016f6f05c lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171096e58 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.434099:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004373584d/0xd138388016f6f05c lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171096e58 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.434107:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004373584d/0xd138388016f6f05c lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171096e58 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.434117:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004373584d/0xd138388016f6f05c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171096e58 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201591.434147:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727952384:192.168.201.143@tcp:101:cp.0 00000080:00200000:1.0:1788201591.434381:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x165:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201591.434389:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e272e0 (ffff8bc148e3b368/0) at cl_lock_release():245 00000020:00010000:1.0:1788201591.434392:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e272e0 (ffff8bc148e3b368/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201591.434397:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4030 (ffff8bc148e3b098/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201591.434401:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e272e0 (ffff8bc148e3b368/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201591.434654:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4030 (ffff8bc148e3b368/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201591.434703:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x165:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201591.434780:0:24470:0:(file.c:2638:do_file_write_iter()) START file large-lun.sh:[0x200000bd7:0x165:0x0], ppos: 0, count: 9198 00000080:00200000:1.0:1788201591.436121:0:24470:0:(file.c:2090:ll_file_io_generic()) large-lun.sh: write ppos: 0, bytes: 9198 00000080:00200000:1.0:1788201591.436133:0:24470:0:(file.c:1848:ll_io_set_mirror()) large-lun.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201591.436142:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000c337070d[0x110, 1, [0x200000bd7:0x165:0x0] hash] 00000020:00200000:1.0:1788201591.436145:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 9198) 0 0 00000080:00200000:1.0:1788201591.436150:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x165:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201591.436166:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 2] 00020000:00200000:1.0:1788201591.436175:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 9198) 9198, 9198 00020000:00200000:1.0:1788201591.436179:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201591.436680:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 2] 00000008:00010000:1.0:1788201591.436700:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201591.436708:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4030, osc lock ffff8bc145d09560, flags 0x0 00010000:00010000:1.0:1788201591.436731:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/421 (0 12287) 00010000:00010000:1.0:1788201591.436825:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6f063 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.436840:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6f063 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a5:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.436855:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6f063 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a5:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201591.437395:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416ed80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727952512:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201591.437833:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201591.449513:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:1.0:1788201591.457716:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201591.457728:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004373584d/0xd138388016f6f05c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171096e58 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.457741:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bde00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201591.457748:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004373584d/0xd138388016f6f05c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171096e58 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201591.457837:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x165:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201591.457853:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x165:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201591.457944:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004373584d/0xd138388016f6f05c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096e58 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.457954:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201591.458000:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004373584d/0xd138388016f6f05c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096e58 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.458010:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004373584d/0xd138388016f6f05c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096e58 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.458036:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201591.458038:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201591.458040:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201591.458509:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727952640:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201591.472006:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201591.472833:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743473408 00000100:00100000:0.0:1788201591.472848:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743473408 00000100:00100000:0.0:1788201591.472925:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 706 00000100:00100000:0.0:1788201591.472938:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14416d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23412:x1875064743473408:12345-192.168.201.143@tcp:105: 00010000:00010000:0.0:1788201591.472961:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6f063 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096e5f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.472981:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6f063 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096e5f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.472993:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6f063 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096e5f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.473006:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6f063 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171096e5f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.473018:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6f063 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171096e5f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.473030:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6f063 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171096e5f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.473055:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1460bd800) 00000100:00100000:0.0:1788201591.473143:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14416d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23412:x1875064743473408:12345-192.168.201.143@tcp:105: Request processed in 207us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201591.473151:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 706 00000100:00100000:0.0:1788201591.491390:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727952640:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201591.513161:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1486fa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201591.528400:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275b800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727953408:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201591.528450:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6f078 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096ea5 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.528485:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6f078 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x166:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096ea5 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.528494:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6f078 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x166:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096ea5 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.528507:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6f078 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x166:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096ea5 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.528520:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6f078 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x166:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096ea5 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.528536:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6f078 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x166:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096ea5 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.528545:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6f078 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x166:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096ea5 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.528552:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6f078 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x166:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096ea5 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201591.528565:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc17275b800 x1875064727953408/t8589937357(8589937357) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201591.528579:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc17275b800 x1875064727953408/t8589937357(8589937357) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201591.528595:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6f078 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x166:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096ea5 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1788201591.528609:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6f078 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x166:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096ea5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.528620:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/358 (0 0) 00000080:00200000:0.0:1788201591.528628:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201591.528643:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=large-scale.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:0.0:1788201591.528685:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x166:0x0](ffff8bc144680908) 00000080:00200000:0.0:1788201591.528870:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x166:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1788201591.528881:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x166:0x0](ffff8bc144680908) 00000080:00010000:0.0:1788201591.528948:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x166:0x0](ffff8bc144680908) for lock 0xd138388016f6f078 00000080:00010000:0.0:1788201591.528962:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x166:0x0](ffff8bc144680908) 00000080:00200008:0.0:1788201591.528982:0:24470:0:(file.c:1090:ll_file_open()) START file large-scale.sh:[0x200000bd7:0x166:0x0](ffff8bc144680908), flags 100301 00000002:00100000:0.0:1788201591.529004:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc17275b800 x1875064727953408/t8589937357(8589937357) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1788201591.529053:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f078 from it ffff8bc1507dbba0 00010000:00010000:0.0:1788201591.529059:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6f078 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x166:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096ea5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.529069:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6f078 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x166:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096ea5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201591.529097:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x166:0x0](ffff8bc144680908), inode mode 81a4 mask 40 00000080:00200008:0.0:1788201591.529134:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file large-scale.sh:[0x200000bd7:0x166:0x0](ffff8bc144680908), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201591.529142:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x166:0x0](ffff8bc144680908),name=large-scale.sh 00000002:00010000:0.0:1788201591.529164:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x166:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.529175:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6f078 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x166:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096ea5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.529419:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6f078 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x166:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096ea5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201591.529430:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.529436:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x166:0x0](ffff8bc144680908) 00000080:00010000:0.0:1788201591.529440:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x166:0x0](ffff8bc144680908) for lock 0xd138388016f6f078 00000080:00010000:0.0:1788201591.529444:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f078 from it ffffadd1c7debcd8 00010000:00010000:0.0:1788201591.529447:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6f078 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x166:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096ea5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.529456:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6f078 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x166:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096ea5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201591.529486:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x166:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201591.529496:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x166:0x0] 00000008:00010000:0.0:1788201591.529529:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201591.529533:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456830, osc lock ffff8bc145d357c0, flags 0x400001002 00010000:00010000:0.0:1788201591.529609:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f07f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.529622:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f07f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201591.529931:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:0.0:1788201591.540690:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x166:0x0] updating i_size 0 i_blocks 1 00000020:00010000:0.0:1788201591.540698:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449da2b0 (ffff8bc1499c4368/0) at cl_lock_release():245 00000020:00010000:0.0:1788201591.540702:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449da2b0 (ffff8bc1499c4368/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201591.540708:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456830 (ffff8bc1499c4cf8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201591.540713:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449da2b0 (ffff8bc1499c4368/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201591.540716:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456830 (ffff8bc1499c4368/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201591.540758:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x166:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1788201591.540861:0:24470:0:(file.c:2638:do_file_write_iter()) START file large-scale.sh:[0x200000bd7:0x166:0x0], ppos: 0, count: 2659 00000080:00200000:0.0:1788201591.540878:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 2659 bytes 00000080:00200000:0.0:1788201591.540883:0:24470:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 2659 00000080:00200000:0.0:1788201591.540917:0:24470:0:(file.c:2090:ll_file_io_generic()) large-scale.sh: write ppos: 0, bytes: 2659 00000080:00200000:0.0:1788201591.540923:0:24470:0:(file.c:1848:ll_io_set_mirror()) large-scale.sh: desiginated mirror: 0 00000020:00200000:0.0:1788201591.540929:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000f376a9da[0x110, 1, [0x200000bd7:0x166:0x0] hash] 00000020:00200000:0.0:1788201591.540931:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 2659) 0 0 00000080:00200000:0.0:1788201591.540936:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x166:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201591.540950:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1788201591.540959:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 2659) 2659, 2659 00020000:00200000:0.0:1788201591.540963:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201591.540992:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:0.0:1788201591.541006:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1788201591.541012:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456830, osc lock ffff8bc145d357c0, flags 0x0 00010000:00010000:0.0:1788201591.541031:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/421 (0 4095) 00010000:00010000:0.0:1788201591.541079:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.541090:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.541102:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201591.541127:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727953664:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201591.541226:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201591.546449:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:1.0:1788201591.552013:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201591.552031:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f07f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171096eb3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.552046:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1727c8e00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201591.552055:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f07f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171096eb3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201591.552145:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x166:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201591.552160:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x166:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201591.552267:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f07f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096eb3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.552277:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201591.552322:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f07f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096eb3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.552332:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f07f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096eb3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.552365:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201591.552367:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201591.552368:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201591.552882:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727953792:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201591.556258:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:21dcfac0-2fe1-402c-8fca-db923b83f76c:10052:1875064727953920:192.168.201.143@tcp:400:kworker.0 00000100:00100000:3.0:1788201591.556401:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201591.556420:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727954048:192.168.201.143@tcp:400:kworker.0 00000100:00100000:1.0:1788201591.557569:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201591.557647:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743473664 00000100:00100000:3.0:1788201591.557662:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743473664 00000100:00100000:3.0:1788201591.557731:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 708 00000100:00100000:3.0:1788201591.557743:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14416c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743473664:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201591.557767:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096eba expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.557785:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096eba expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.557817:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096eba expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.557833:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171096eba expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.557844:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171096eba expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.557859:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171096eba expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.557883:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1727c9400) 00000100:00100000:3.0:1788201591.557948:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14416c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743473664:12345-192.168.201.143@tcp:105: Request processed in 205us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201591.557956:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 708 00000100:00100000:0.0:1788201591.568339:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727953664:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201591.568603:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096eba expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.568630:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096eba expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201591.568645:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171096eba expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.568658:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096eba expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.568668:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096eba expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201591.568702:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) large-scale.sh: write [0, 2659) append 0 append lockpos 0 00000080:00200000:0.0:1788201591.568726:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 2659 bytes 00000080:00200000:0.0:1788201591.568915:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 2659, copied 2659 00000080:00200000:0.0:1788201591.568930:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d2980649[3 00000000164d3802 2 1 000000008d7686d0 0 0 0] 00000080:00200000:0.0:1788201591.568934:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001060a17f 17ffffc0001001 3:0 ffff8bc1727a67e0 0 lru 00000080:00200000:0.0:1788201591.568943:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007370330c 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 000000005ba44439 > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201591.568945:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d2980649 00000080:00200000:0.0:1788201591.568947:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1788201591.568952:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 2659 prio 0 00000008:00010000:0.0:1788201591.568979:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000c88bdffc ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096eba expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201591.569002:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc144680ab8, count 1, dirtied 1 00000080:00200000:0.0:1788201591.569008:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 2659 bytes, tot: 2659 00000080:00200000:0.0:1788201591.569011:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) large-scale.sh: write bytes 0, result: 2659 00000020:00010000:0.0:1788201591.569031:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc148fb1308 (ffff8bc1499c4368/0) at cl_lock_release():245 00000020:00010000:0.0:1788201591.569036:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc148fb1308 (ffff8bc1499c4368/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201591.569039:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456830 (ffff8bc1499c4cf8/1) at cl_lock_cancel():142 00010000:00010000:0.0:1788201591.569045:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096eba expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.569056:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096eba expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1788201591.569074:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc148fb1308 (ffff8bc1499c4368/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201591.569078:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456830 (ffff8bc1499c4368/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201591.569086:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 2659 bytes 00000080:00200000:0.0:1788201591.569095:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1788201591.569203:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x166:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201591.569208:0:24470:0:(file.c:2238:ll_file_io_generic()) large-scale.sh: 2 io complete with rc: 0, result: 2659, restart: 0 00000080:00200000:0.0:1788201591.569217:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x166:0x0] updating i_size 2659 i_blocks 1 00000080:00200000:0.0:1788201591.569223:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 2659 00000080:00200008:0.0:1788201591.569346:0:24470:0:(file.c:479:ll_file_release()) START file large-scale.sh:[0x200000bd7:0x166:0x0](ffff8bc144680908), flags 100001 00000002:00100000:0.0:1788201591.569674:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc17275b800 x1875064727953408/t8589937357(8589937357) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201607 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1788201591.569690:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1788201591.569697:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14415ad80 x1875064727954304/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1788201591.569733:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727954304:192.168.201.143@tcp:35:cp.0 00000100:00100000:0.0:1788201591.569915:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201591.575093:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727953792:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201591.575094:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727954048:192.168.201.143@tcp:400:kworker.0 00000100:00100000:0.0:1788201591.581725:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727954304:192.168.201.143@tcp:35:cp.0 00000002:00100000:0.0:1788201591.581770:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc17275b800 x1875064727953408/t8589937357(8589937357) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201607 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201591.581895:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201591.581922:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.581947:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 47 lru_type: 1 00010000:00010000:0.0:1788201591.581965:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 47 lru_type: 1 00000080:00200000:0.0:1788201591.581973:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.581980:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201591.581984:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201591.581993:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201591.581998:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 47 lru_type: 1 00010000:00010000:0.0:1788201591.582008:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 48 lru_type: 1 00000080:00200000:0.0:1788201591.582028:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.582037:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201591.582044:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.582048:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=large-scale.sh, flags=8 00000080:00200008:0.0:1788201591.582055:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file large-scale.sh:[0x200000bd7:0x166:0x0](ffff8bc144680908), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201591.582061:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x166:0x0](ffff8bc144680908),name=large-scale.sh 00000002:00010000:0.0:1788201591.582072:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x166:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.582081:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6f078 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x166:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096ea5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201591.582089:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6f078 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x166:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096ea5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201591.582095:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.582100:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x166:0x0](ffff8bc144680908) 00000080:00010000:0.0:1788201591.582102:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x166:0x0](ffff8bc144680908) for lock 0xd138388016f6f078 00000080:00010000:0.0:1788201591.582106:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f078 from it ffffadd1c7debcb8 00010000:00010000:0.0:1788201591.582109:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6f078 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x166:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096ea5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201591.582117:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6f078 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x166:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096ea5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201591.582169:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x166:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201591.582180:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x166:0x0] 00000008:00010000:0.0:1788201591.582212:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201591.582217:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456830, osc lock ffff8bc145d357c0, flags 0x400001002 00010000:00010000:0.0:1788201591.582237:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096eba expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.582257:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096eba expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:0.0:1788201591.582272:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1788201591.582276:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096eba expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.582285:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096eba expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1788201591.582297:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1788201591.582308:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x166:0x0] updating i_size 2659 i_blocks 1 00000020:00010000:0.0:1788201591.582312:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449da2b0 (ffff8bc1499c4368/0) at cl_lock_release():245 00000020:00010000:0.0:1788201591.582315:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449da2b0 (ffff8bc1499c4368/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201591.582318:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456830 (ffff8bc1499c4cf8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201591.582322:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449da2b0 (ffff8bc1499c4368/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201591.582324:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456830 (ffff8bc1499c4368/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201591.582351:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x166:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201591.582423:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201591.582432:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.582439:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 48 lru_type: 1 00010000:00010000:0.0:1788201591.582448:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 48 lru_type: 1 00000080:00200000:0.0:1788201591.582459:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.582462:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201591.582464:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201591.582468:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201591.582471:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 48 lru_type: 1 00010000:00010000:0.0:1788201591.582478:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 49 lru_type: 1 00000080:00200000:0.0:1788201591.582486:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.582489:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201591.582493:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.582511:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=lcov-merge.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:0.0:1788201591.582516:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=lcov-merge.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201591.582526:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: lcov-merge.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201591.582585:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f08d lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.582593:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f08d lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.582606:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f08d lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201591.582636:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415bb80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727954432:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201591.582743:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201591.583459:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:21dcfac0-2fe1-402c-8fca-db923b83f76c:10052:1875064727953920:192.168.201.143@tcp:400:kworker.0 00000100:00100000:0.0:1788201591.587999:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415bb80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727954432:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201591.588026:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f08d lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.588041:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f08d lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.588048:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f08d lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.588056:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f08d lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.588065:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f08d lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.588072:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1727c8400 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201591.588077:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f08d lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.588085:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f08d lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.588093:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f08d lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.588100:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201591.588108:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f08d lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.588114:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f08d lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201591.588140:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14415bb80 x1875064727954432/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201607 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201591.588158:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201591.588186:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201591.588259:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201591.588277:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.588288:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 49 lru_type: 1 00010000:00010000:0.0:1788201591.588301:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 49 lru_type: 1 00000080:00200000:0.0:1788201591.588309:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.588314:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201591.588318:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201591.588324:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201591.588328:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 49 lru_type: 1 00010000:00010000:0.0:1788201591.588337:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 50 lru_type: 1 00000080:00200000:0.0:1788201591.588354:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.588363:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201591.588370:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.588388:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=lcov-merge.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:0.0:1788201591.588393:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=lcov-merge.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201591.588416:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: lcov-merge.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201591.588465:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6f094 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.588473:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6f094 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.588484:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6f094 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201591.588506:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415bb80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727954560:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201591.588593:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201591.592659:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415bb80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727954560:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201591.592691:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6f094 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.592708:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6f094 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.592716:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6f094 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.592723:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6f094 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.592733:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6f094 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.592739:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1727c8e00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201591.592746:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6f094 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.592753:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6f094 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.592761:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6f094 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.592768:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201591.592776:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6f094 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.592783:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8e00/0xd138388016f6f094 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201591.592845:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14415bb80 x1875064727954560/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201607 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201591.592865:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201591.592895:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201591.593024:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201591.593040:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.593050:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 50 lru_type: 1 00010000:00010000:0.0:1788201591.593064:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 50 lru_type: 1 00000080:00200000:0.0:1788201591.593070:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.593075:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201591.593080:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201591.593085:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:0.0:1788201591.593089:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 50 lru_type: 1 00010000:00010000:0.0:1788201591.593099:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 51 lru_type: 1 00000080:00200000:0.0:1788201591.593117:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.593126:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201591.593132:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.593146:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201591.593151:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=lcov-merge.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc152c97800, open_flags 80c1, mode 81ed opened 0 00000080:00200000:0.0:1788201591.593161:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=lcov-merge.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:0.0:1788201591.593183:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: lcov-merge.sh,[0x200000bd7:0x167:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:0.0:1788201591.593244:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8600/0xd138388016f6f09b lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.593251:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8600/0xd138388016f6f09b lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1788201591.593266:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1788201591.593274:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14415bb80 x1875064727954816/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1788201591.593284:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8600/0xd138388016f6f09b lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201591.593308:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415bb80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727954816:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201591.593466:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201591.602765:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415bb80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727954816:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201591.602833:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8600/0xd138388016f6f09b lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096f00 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.602863:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8600/0xd138388016f6f09b lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096f00 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.602873:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8600/0xd138388016f6f09b lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096f00 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.602887:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8600/0xd138388016f6f09b lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096f00 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.602900:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8600/0xd138388016f6f09b lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096f00 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.602918:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8600/0xd138388016f6f09b lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096f00 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.602927:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8600/0xd138388016f6f09b lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096f00 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.602936:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8600/0xd138388016f6f09b lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096f00 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201591.602952:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc14415bb80 x1875064727954816/t8589937359(8589937359) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201591.602969:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14415bb80 x1875064727954816/t8589937359(8589937359) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201591.602988:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8600/0xd138388016f6f09b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096f00 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1788201591.603004:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8600/0xd138388016f6f09b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096f00 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.603015:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/359 (0 0) 00000080:00200000:0.0:1788201591.603023:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201591.603039:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=lcov-merge.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:0.0:1788201591.603081:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x167:0x0](ffff8bc1446863c8) 00000080:00200000:0.0:1788201591.603223:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x167:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1788201591.603233:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x167:0x0](ffff8bc1446863c8) 00000080:00010000:0.0:1788201591.603250:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x167:0x0](ffff8bc1446863c8) for lock 0xd138388016f6f09b 00000080:00010000:0.0:1788201591.603263:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x167:0x0](ffff8bc1446863c8) 00000080:00200008:0.0:1788201591.603280:0:24470:0:(file.c:1090:ll_file_open()) START file lcov-merge.sh:[0x200000bd7:0x167:0x0](ffff8bc1446863c8), flags 100301 00000002:00100000:0.0:1788201591.603301:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14415bb80 x1875064727954816/t8589937359(8589937359) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1788201591.603350:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f09b from it ffff8bc146937e40 00010000:00010000:0.0:1788201591.603355:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8600/0xd138388016f6f09b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096f00 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.603366:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8600/0xd138388016f6f09b lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096f00 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201591.603397:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x167:0x0](ffff8bc1446863c8), inode mode 81ed mask 40 00000080:00200008:0.0:1788201591.603438:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file lcov-merge.sh:[0x200000bd7:0x167:0x0](ffff8bc1446863c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201591.603445:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x167:0x0](ffff8bc1446863c8),name=lcov-merge.sh 00000002:00010000:0.0:1788201591.603463:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x167:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.603474:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8600/0xd138388016f6f09b lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096f00 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.603487:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8600/0xd138388016f6f09b lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096f00 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201591.603494:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.603498:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x167:0x0](ffff8bc1446863c8) 00000080:00010000:0.0:1788201591.603502:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x167:0x0](ffff8bc1446863c8) for lock 0xd138388016f6f09b 00000080:00010000:0.0:1788201591.603505:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f09b from it ffffadd1c7debcd8 00010000:00010000:0.0:1788201591.603509:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8600/0xd138388016f6f09b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096f00 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.603516:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8600/0xd138388016f6f09b lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096f00 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201591.603540:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x167:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201591.603550:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x167:0x0] 00000008:00010000:0.0:1788201591.603575:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201591.603578:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456d30, osc lock ffff8bc145d357c0, flags 0x400001002 00010000:00010000:0.0:1788201591.603626:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000647389f/0xd138388016f6f0a2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.603645:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000647389f/0xd138388016f6f0a2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201591.603694:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:0.0:1788201591.615266:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x167:0x0] updating i_size 0 i_blocks 1 00000020:00010000:0.0:1788201591.615275:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449da2b0 (ffff8bc1499c4368/0) at cl_lock_release():245 00000020:00010000:0.0:1788201591.615278:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449da2b0 (ffff8bc1499c4368/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201591.615284:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456d30 (ffff8bc1499c4cf8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201591.615289:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449da2b0 (ffff8bc1499c4368/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201591.615292:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456d30 (ffff8bc1499c4368/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201591.615332:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x167:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1788201591.615428:0:24470:0:(file.c:2638:do_file_write_iter()) START file lcov-merge.sh:[0x200000bd7:0x167:0x0], ppos: 0, count: 4207 00000080:00200000:0.0:1788201591.615466:0:24470:0:(file.c:2090:ll_file_io_generic()) lcov-merge.sh: write ppos: 0, bytes: 4207 00000080:00200000:0.0:1788201591.615475:0:24470:0:(file.c:1848:ll_io_set_mirror()) lcov-merge.sh: desiginated mirror: 0 00000020:00200000:0.0:1788201591.615481:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@000000003b98fbac[0x110, 1, [0x200000bd7:0x167:0x0] hash] 00000020:00200000:0.0:1788201591.615484:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4207) 0 0 00000080:00200000:0.0:1788201591.615489:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x167:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201591.615503:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 1] 00020000:00200000:0.0:1788201591.615513:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4207) 4207, 4207 00020000:00200000:0.0:1788201591.615517:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201591.615551:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 1] 00000008:00010000:0.0:1788201591.615568:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1788201591.615575:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456d30, osc lock ffff8bc145d357c0, flags 0x0 00010000:00010000:0.0:1788201591.615595:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/422 (0 8191) 00010000:00010000:0.0:1788201591.615645:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.615657:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.615669:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201591.615696:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144159c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727955072:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201591.615993:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201591.631900:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201591.635246:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 709 00000100:00100000:0.0:1788201591.635261:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14416c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23415:x1875064743473792:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201591.635285:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000647389f/0xd138388016f6f0a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171096f0e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.635526:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201591.635535:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14416c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23415:x1875064743473792:12345-192.168.201.143@tcp:104: Request processed in 278us (3661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201591.635544:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 709 00000100:00100000:1.0:1788201591.635919:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201591.635948:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727955200:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201591.642690:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201591.643339:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 710 00000100:00100000:3.0:1788201591.643368:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21004:x1875064743473920:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201591.643390:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096f15 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.643417:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096f15 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.643429:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096f15 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.643442:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171096f15 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.643460:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171096f15 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.643472:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171096f15 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.643519:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1727c8e00) 00000100:00100000:3.0:1788201591.643605:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21004:x1875064743473920:12345-192.168.201.143@tcp:105: Request processed in 254us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201591.643614:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 710 00010000:00010000:0.0:1788201591.644274:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096f15 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.644291:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096f15 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.644312:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096f15 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201591.644327:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171096f15 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.644348:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096f15 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.644358:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096f15 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201591.645846:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) lcov-merge.sh: write [0, 4207) append 0 append lockpos 0 00000080:00200000:0.0:1788201591.645878:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:0.0:1788201591.645941:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:0.0:1788201591.645956:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a3397aae[3 00000000aa14e2d7 2 1 000000008d7686d0 0 0 0] 00000080:00200000:0.0:1788201591.645960:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000033536745 17ffffc0001001 3:0 ffff8bc1727a6620 0 lru 00000080:00200000:0.0:1788201591.645969:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000efd83dee 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 0000000036c60208 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201591.645971:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a3397aae 00000080:00200000:0.0:1788201591.645973:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1788201591.645978:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 111 bytes 00000080:00200000:0.0:1788201591.646013:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 111, copied 111 00000080:00200000:0.0:1788201591.646018:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008a83fcfb[3 00000000aa14e2d7 2 1 000000008d7686d0 0 0 1] 00000080:00200000:0.0:1788201591.646034:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000080554341 17ffffc0001001 3:0 ffff8bc1727a6ee0 1 lru 00000080:00200000:0.0:1788201591.646039:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000048cbf099 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 0000000036c60208 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201591.646041:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008a83fcfb 00000080:00200000:0.0:1788201591.646043:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:0.0:1788201591.646047:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 2, from 0, to 111 prio 0 00000008:00010000:0.0:1788201591.646074:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 000000000ce1d5f3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096f15 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201591.646101:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc144686578, count 2, dirtied 2 00000080:00200000:0.0:1788201591.646107:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 2 pages 4207 bytes, tot: 4207 00000080:00200000:0.0:1788201591.646111:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) lcov-merge.sh: write bytes 0, result: 4207 00000020:00010000:0.0:1788201591.646132:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc148fb1308 (ffff8bc1499c4368/0) at cl_lock_release():245 00000020:00010000:0.0:1788201591.646136:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc148fb1308 (ffff8bc1499c4368/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201591.646140:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456d30 (ffff8bc1499c4cf8/1) at cl_lock_cancel():142 00010000:00010000:0.0:1788201591.646149:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096f15 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.646162:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096f15 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1788201591.646183:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc148fb1308 (ffff8bc1499c4368/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201591.646187:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456d30 (ffff8bc1499c4368/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201591.646196:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 4207 bytes 00000080:00200000:0.0:1788201591.646204:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 1] 00000080:00200000:0.0:1788201591.646237:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x167:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201591.646241:0:24470:0:(file.c:2238:ll_file_io_generic()) lcov-merge.sh: 2 io complete with rc: 0, result: 4207, restart: 0 00000080:00200000:0.0:1788201591.646250:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x167:0x0] updating i_size 4207 i_blocks 1 00000080:00200000:0.0:1788201591.646255:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 4207 00000080:00200008:0.0:1788201591.646308:0:24470:0:(file.c:479:ll_file_release()) START file lcov-merge.sh:[0x200000bd7:0x167:0x0](ffff8bc1446863c8), flags 100001 00000002:00100000:0.0:1788201591.646375:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc14415bb80 x1875064727954816/t8589937359(8589937359) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201607 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1788201591.646389:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1788201591.646413:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144159c00 x1875064727955456/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1788201591.646441:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144159c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727955456:192.168.201.143@tcp:35:cp.0 00000100:00100000:0.0:1788201591.646532:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1788201591.655311:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6f0b0 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.655329:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6f0b0 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.655341:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6f0b0 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201591.655372:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17275bb80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727955584:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201591.655488:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201591.666227:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275bb80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727955584:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201591.666267:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6f0b0 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.666284:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6f0b0 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.666293:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6f0b0 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.666301:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6f0b0 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.666311:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6f0b0 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.666319:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1725a0800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201591.666324:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6f0b0 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.666331:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6f0b0 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.666339:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6f0b0 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.666348:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201591.666356:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6f0b0 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.666363:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0800/0xd138388016f6f0b0 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201591.666389:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc17275bb80 x1875064727955584/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201607 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201591.667088:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201591.667121:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:3.0:1788201591.667200:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201591.667217:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201591.667228:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 53 lru_type: 1 00010000:00010000:3.0:1788201591.667241:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 53 lru_type: 1 00000080:00200000:3.0:1788201591.667248:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201591.667254:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201591.667257:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201591.667262:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201591.667266:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 53 lru_type: 1 00010000:00010000:3.0:1788201591.667275:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 54 lru_type: 1 00000080:00200000:3.0:1788201591.667294:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201591.667302:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201591.667308:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201591.667325:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=lfsck-performance.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:3.0:1788201591.667330:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=lfsck-performance.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:3.0:1788201591.667344:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: lfsck-performance.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201591.667750:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f0b7 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.667761:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f0b7 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.667776:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f0b7 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201591.667847:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727955712:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201591.672377:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201591.685903:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727955712:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201591.686143:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f0b7 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.686163:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f0b7 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.686171:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f0b7 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.686180:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f0b7 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.686192:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f0b7 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.686199:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1725a1600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201591.686204:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f0b7 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.686212:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f0b7 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.686220:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f0b7 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.686228:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201591.686236:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f0b7 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.686242:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f0b7 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201591.686272:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a1180 x1875064727955712/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201607 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201591.686289:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201591.686319:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201591.686529:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201591.686549:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.686561:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 54 lru_type: 1 00010000:00010000:0.0:1788201591.686576:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 54 lru_type: 1 00000080:00200000:0.0:1788201591.686654:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.686661:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201591.686665:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201591.686672:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:0.0:1788201591.686676:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 54 lru_type: 1 00010000:00010000:0.0:1788201591.686684:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 55 lru_type: 1 00000080:00200000:0.0:1788201591.686703:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.686715:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201591.686723:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.686738:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201591.686743:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=lfsck-performance.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc152c96000, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:0.0:1788201591.686752:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=lfsck-performance.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:0.0:1788201591.686776:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: lfsck-performance.sh,[0x200000bd7:0x168:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:0.0:1788201591.687018:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f0be lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.687037:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f0be lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1788201591.687052:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1788201591.687061:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144159500 x1875064727955968/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1788201591.687071:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f0be lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201591.687098:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144159500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727955968:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201591.687258:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201591.690855:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144159500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727955968:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201591.690893:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f0be lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096f5b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.690914:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f0be lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x168:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096f5b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.690921:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f0be lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x168:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096f5b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.691030:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f0be lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x168:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096f5b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.691040:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f0be lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x168:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096f5b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.691055:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f0be lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x168:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096f5b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.691061:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f0be lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x168:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096f5b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.691066:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f0be lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x168:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096f5b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201591.691075:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc144159500 x1875064727955968/t8589937361(8589937361) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201591.691087:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc144159500 x1875064727955968/t8589937361(8589937361) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201591.691104:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f0be lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x168:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096f5b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1788201591.691118:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f0be lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x168:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096f5b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.691130:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/360 (0 0) 00000080:00200000:0.0:1788201591.691139:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201591.691156:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=lfsck-performance.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:0.0:1788201591.691202:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x168:0x0](ffff8bc144684b08) 00000080:00200000:0.0:1788201591.692425:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x168:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1788201591.692458:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x168:0x0](ffff8bc144684b08) 00000080:00010000:0.0:1788201591.692464:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x168:0x0](ffff8bc144684b08) for lock 0xd138388016f6f0be 00000080:00010000:0.0:1788201591.692481:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x168:0x0](ffff8bc144684b08) 00000080:00200008:0.0:1788201591.692499:0:24470:0:(file.c:1090:ll_file_open()) START file lfsck-performance.sh:[0x200000bd7:0x168:0x0](ffff8bc144684b08), flags 100301 00000002:00100000:0.0:1788201591.692529:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc144159500 x1875064727955968/t8589937361(8589937361) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1788201591.692574:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f0be from it ffff8bc146937e40 00010000:00010000:0.0:1788201591.692579:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f0be lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x168:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096f5b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.692591:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f0be lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x168:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096f5b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201591.692616:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x168:0x0](ffff8bc144684b08), inode mode 81a4 mask 40 00000080:00200008:0.0:1788201591.692647:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file lfsck-performance.sh:[0x200000bd7:0x168:0x0](ffff8bc144684b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201591.692652:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x168:0x0](ffff8bc144684b08),name=lfsck-performance.sh 00000002:00010000:0.0:1788201591.692670:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x168:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.692682:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f0be lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x168:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096f5b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.692692:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f0be lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x168:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096f5b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201591.692701:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.692704:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x168:0x0](ffff8bc144684b08) 00000080:00010000:0.0:1788201591.692707:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x168:0x0](ffff8bc144684b08) for lock 0xd138388016f6f0be 00000080:00010000:0.0:1788201591.692709:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f0be from it ffffadd1c7debcd8 00010000:00010000:0.0:1788201591.692711:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f0be lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x168:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096f5b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.692716:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f0be lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x168:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096f5b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201591.692742:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x168:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201591.692750:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x168:0x0] 00000008:00010000:0.0:1788201591.692779:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201591.692783:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456db0, osc lock ffff8bc145d357c0, flags 0x400001002 00010000:00010000:0.0:1788201591.692869:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f0c5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.692878:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f0c5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201591.692916:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1788201591.693332:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201591.693357:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727956096:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201591.697072:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f0c5 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.697116:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f0c5 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096f69 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.697142:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f0c5 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096f69 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.697158:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f0c5 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096f69 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201591.697177:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f0c5 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096f69 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201591.697310:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201591.697377:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f0c5 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171096f69 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.697388:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f0c5 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171096f69 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.697416:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f0c5 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171096f69 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.697428:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f0c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171096f69 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201591.697455:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727956096:192.168.201.143@tcp:101:cp.0 00000080:00200000:3.0:1788201591.697631:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x168:0x0] updating i_size 0 i_blocks 1 00000020:00010000:3.0:1788201591.697638:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449da2b0 (ffff8bc1499c4368/0) at cl_lock_release():245 00000020:00010000:3.0:1788201591.697641:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449da2b0 (ffff8bc1499c4368/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201591.697646:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456db0 (ffff8bc1499c4cf8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201591.697651:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449da2b0 (ffff8bc1499c4368/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201591.697653:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456db0 (ffff8bc1499c4368/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201591.697688:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x168:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1788201591.697771:0:24470:0:(file.c:2638:do_file_write_iter()) START file lfsck-performance.sh:[0x200000bd7:0x168:0x0], ppos: 0, count: 28245 00000080:00200000:3.0:1788201591.697873:0:24470:0:(file.c:2090:ll_file_io_generic()) lfsck-performance.sh: write ppos: 0, bytes: 28245 00000080:00200000:3.0:1788201591.697879:0:24470:0:(file.c:1848:ll_io_set_mirror()) lfsck-performance.sh: desiginated mirror: 0 00000020:00200000:3.0:1788201591.697893:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000a0fb566f[0x110, 1, [0x200000bd7:0x168:0x0] hash] 00000020:00200000:3.0:1788201591.697895:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 28245) 0 0 00000080:00200000:3.0:1788201591.697899:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x168:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201591.697911:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 6] 00020000:00200000:3.0:1788201591.697918:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 28245) 28245, 28245 00020000:00200000:3.0:1788201591.697921:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1788201591.697954:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 6] 00000008:00010000:3.0:1788201591.697968:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1788201591.697974:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149fec2b0, osc lock ffff8bc14691a850, flags 0x0 00010000:00010000:3.0:1788201591.697995:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/422 (0 28671) 00010000:00010000:3.0:1788201591.698047:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.698059:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.698066:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201591.698087:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a3800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727956224:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201591.698229:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201591.704106:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:0.0:1788201591.704903:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201591.704913:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f0c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171096f69 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.704925:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1727c9c00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201591.704933:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f0c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171096f69 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201591.705001:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x168:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201591.705017:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x168:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1788201591.705111:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f0c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096f69 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.705119:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201591.705156:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f0c5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096f69 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.705165:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f0c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096f69 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.705187:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201591.705189:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201591.705191:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201591.705497:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201591.705524:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727956352:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201591.708185:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a3800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727956224:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201591.708225:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.708242:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.708252:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201591.708922:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201591.709216:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743474176 00000100:00100000:0.0:1788201591.709226:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743474176 00000100:00100000:0.0:1788201591.709300:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 712 00000100:00100000:0.0:1788201591.709312:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23412:x1875064743474176:12345-192.168.201.143@tcp:105: 00010000:00010000:0.0:1788201591.709330:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.709343:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.709354:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.709366:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.709374:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.709385:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.709427:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1725a0800) 00000100:00100000:0.0:1788201591.709498:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23412:x1875064743474176:12345-192.168.201.143@tcp:105: Request processed in 186us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201591.709506:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 712 00010000:00010000:3.0:1788201591.709872:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.709884:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.709904:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201591.709919:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.709934:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.709944:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201591.709978:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) lfsck-performance.sh: write [0, 28245) append 0 append lockpos 0 00000080:00200000:3.0:1788201591.709999:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:3.0:1788201591.710070:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:3.0:1788201591.710084:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ddac23d5[3 000000002198c5fc 2 1 00000000c4285bd5 0 0 0] 00000080:00200000:3.0:1788201591.710088:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000cadfe63 17ffffc0001001 3:0 ffff8bc146072380 0 lru 00000080:00200000:3.0:1788201591.710374:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000020608795 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 0000000030c73a13 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201591.710377:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ddac23d5 00000080:00200000:3.0:1788201591.710379:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201591.710383:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:3.0:1788201591.710473:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:3.0:1788201591.710478:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002d36b171[3 000000002198c5fc 2 1 00000000c4285bd5 0 0 1] 00000080:00200000:3.0:1788201591.710482:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000091a467b8 17ffffc0001001 3:0 ffff8bc1460721c0 1 lru 00000080:00200000:3.0:1788201591.710488:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000fd096975 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 0000000030c73a13 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201591.710490:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002d36b171 00000080:00200000:3.0:1788201591.710492:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:3.0:1788201591.710495:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:3.0:1788201591.710513:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:3.0:1788201591.710518:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006a7b24fe[3 000000002198c5fc 2 1 00000000c4285bd5 0 0 2] 00000080:00200000:3.0:1788201591.710521:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004b9fa999 17ffffc0001001 3:0 ffff8bc1460720e0 2 lru 00000080:00200000:3.0:1788201591.710527:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b15719d0 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000000ce25486 0000000030c73a13 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201591.710529:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006a7b24fe 00000080:00200000:3.0:1788201591.710531:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:3.0:1788201591.710533:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:3.0:1788201591.710552:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:3.0:1788201591.710556:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c675167d[3 000000002198c5fc 2 1 00000000c4285bd5 0 0 3] 00000080:00200000:3.0:1788201591.710560:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e18841c2 17ffffc0001001 3:0 ffff8bc1460729a0 3 lru 00000080:00200000:3.0:1788201591.710566:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000dcb74cd2 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000000ce25486 0000000030c73a13 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201591.710568:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c675167d 00000080:00200000:3.0:1788201591.710570:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:3.0:1788201591.710572:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:3.0:1788201591.710644:0:24470:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:3.0:1788201591.710650:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005248699b[3 000000002198c5fc 2 1 00000000c4285bd5 0 0 4] 00000080:00200000:3.0:1788201591.710653:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006bff1562 17ffffc0001001 3:0 ffff8bc146072c40 4 lru 00000080:00200000:3.0:1788201591.710659:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f013dbe0 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000000ce25486 0000000030c73a13 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201591.710662:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005248699b 00000080:00200000:3.0:1788201591.710663:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:3.0:1788201591.710665:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:3.0:1788201591.710679:0:24470:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:3.0:1788201591.710684:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004387fee1[3 000000002198c5fc 2 1 00000000c4285bd5 0 0 5] 00000080:00200000:3.0:1788201591.710687:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001690c6bc 17ffffc0001001 3:0 ffff8bc146072a80 5 lru 00000080:00200000:3.0:1788201591.710693:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000091f1a56e 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000000ce25486 0000000030c73a13 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201591.710696:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004387fee1 00000080:00200000:3.0:1788201591.710697:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:3.0:1788201591.710699:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 3669 bytes 00000080:00200000:3.0:1788201591.710721:0:24470:0:(rw26.c:898:ll_write_end()) pos 24576, len 3669, copied 3669 00000080:00200000:3.0:1788201591.710726:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f7ce96e0[3 000000002198c5fc 2 1 00000000c4285bd5 0 0 6] 00000080:00200000:3.0:1788201591.710729:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005b3c8897 17ffffc0001001 3:0 ffff8bc146072540 6 lru 00000080:00200000:3.0:1788201591.710735:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008367ae47 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000000ce25486 0000000030c73a13 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201591.710738:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f7ce96e0 00000080:00200000:3.0:1788201591.710739:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:3.0:1788201591.710743:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 7, from 0, to 3669 prio 0 00000008:00010000:3.0:1788201591.710771:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000c5f1d161 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201591.714528:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc144684cb8, count 7, dirtied 7 00000080:00200000:3.0:1788201591.714546:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 7 pages 28245 bytes, tot: 28245 00000080:00200000:3.0:1788201591.714553:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) lfsck-performance.sh: write bytes 0, result: 28245 00000020:00010000:3.0:1788201591.714577:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460e63f8 (ffff8bc1460e9008/0) at cl_lock_release():245 00000020:00010000:3.0:1788201591.714581:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460e63f8 (ffff8bc1460e9008/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201591.714585:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149fec2b0 (ffff8bc1460e9878/1) at cl_lock_cancel():142 00010000:00010000:3.0:1788201591.714597:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.714616:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1788201591.714638:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460e63f8 (ffff8bc1460e9008/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201591.714641:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149fec2b0 (ffff8bc1460e9008/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201591.714656:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 28245 bytes 00000080:00200000:3.0:1788201591.714666:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 6] 00000080:00200000:3.0:1788201591.714706:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x168:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201591.714711:0:24470:0:(file.c:2238:ll_file_io_generic()) lfsck-performance.sh: 2 io complete with rc: 0, result: 28245, restart: 0 00000100:00100000:0.0:1788201591.716935:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727956352:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201591.740939:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172758000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727957120:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201591.741104:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201591.747210:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172758000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727957120:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201591.747243:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6f0e1 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096fb6 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.747269:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6f0e1 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x169:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096fb6 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.747278:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6f0e1 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096fb6 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.747294:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6f0e1 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096fb6 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.747311:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6f0e1 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096fb6 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.747327:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6f0e1 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096fb6 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.747334:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6f0e1 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096fb6 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.747340:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6f0e1 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096fb6 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201591.747349:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc172758000 x1875064727957120/t8589937363(8589937363) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1788201591.747358:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc172758000 x1875064727957120/t8589937363(8589937363) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201591.747372:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6f0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096fb6 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1788201591.747382:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6f0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096fb6 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.747392:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/361 (0 0) 00000080:00200000:3.0:1788201591.747410:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1788201591.747427:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=llmountcleanup.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:3.0:1788201591.747463:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x169:0x0](ffff8bc1459d0908) 00000080:00200000:3.0:1788201591.747603:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x169:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1788201591.747615:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x169:0x0](ffff8bc1459d0908) 00000080:00010000:3.0:1788201591.747618:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x169:0x0](ffff8bc1459d0908) for lock 0xd138388016f6f0e1 00000080:00010000:3.0:1788201591.747630:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x169:0x0](ffff8bc1459d0908) 00000080:00200008:3.0:1788201591.747647:0:24470:0:(file.c:1090:ll_file_open()) START file llmountcleanup.sh:[0x200000bd7:0x169:0x0](ffff8bc1459d0908), flags 100301 00000002:00100000:3.0:1788201591.747669:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc172758000 x1875064727957120/t8589937363(8589937363) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1788201591.747708:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f0e1 from it ffff8bc1507db7e0 00010000:00010000:3.0:1788201591.747711:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6f0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096fb6 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.747718:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6f0e1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096fb6 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201591.747741:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x169:0x0](ffff8bc1459d0908), inode mode 81ed mask 40 00000080:00200008:3.0:1788201591.747772:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file llmountcleanup.sh:[0x200000bd7:0x169:0x0](ffff8bc1459d0908), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201591.747779:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x169:0x0](ffff8bc1459d0908),name=llmountcleanup.sh 00000002:00010000:3.0:1788201591.747843:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x169:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201591.747852:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6f0e1 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096fb6 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201591.747860:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6f0e1 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096fb6 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201591.747866:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201591.747869:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x169:0x0](ffff8bc1459d0908) 00000080:00010000:3.0:1788201591.747872:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x169:0x0](ffff8bc1459d0908) for lock 0xd138388016f6f0e1 00000080:00010000:3.0:1788201591.747874:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f0e1 from it ffffadd1c7debcd8 00010000:00010000:3.0:1788201591.747877:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6f0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171096fb6 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201591.747882:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6f0e1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171096fb6 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201591.747906:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x169:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201591.747916:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x169:0x0] 00000008:00010000:3.0:1788201591.747945:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201591.747949:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149fec830, osc lock ffff8bc14691a850, flags 0x400001002 00010000:00010000:3.0:1788201591.747995:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6f0e8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.748002:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6f0e8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201591.750909:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1788201591.754550:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x169:0x0] updating i_size 0 i_blocks 1 00000020:00010000:3.0:1788201591.754557:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc5970 (ffff8bc1460e9878/0) at cl_lock_release():245 00000020:00010000:3.0:1788201591.754561:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc5970 (ffff8bc1460e9878/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201591.754566:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149fec830 (ffff8bc1460e95a8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201591.754571:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc5970 (ffff8bc1460e9878/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201591.754573:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149fec830 (ffff8bc1460e9878/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201591.754689:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x169:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1788201591.754758:0:24470:0:(file.c:2638:do_file_write_iter()) START file llmountcleanup.sh:[0x200000bd7:0x169:0x0], ppos: 0, count: 704 00000080:00200000:3.0:1788201591.754776:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 704 bytes 00000080:00200000:3.0:1788201591.754781:0:24470:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 704 00000080:00200000:3.0:1788201591.754905:0:24470:0:(file.c:2090:ll_file_io_generic()) llmountcleanup.sh: write ppos: 0, bytes: 704 00000080:00200000:3.0:1788201591.754913:0:24470:0:(file.c:1848:ll_io_set_mirror()) llmountcleanup.sh: desiginated mirror: 0 00000020:00200000:3.0:1788201591.754920:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b59f4cca[0x110, 1, [0x200000bd7:0x169:0x0] hash] 00000020:00200000:3.0:1788201591.754923:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 704) 0 0 00000080:00200000:3.0:1788201591.754927:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x169:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201591.754942:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1788201591.754950:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 704) 704, 704 00020000:00200000:3.0:1788201591.754954:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1788201591.754985:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1788201591.755000:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1788201591.755006:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149fec830, osc lock ffff8bc14691a850, flags 0x0 00010000:00010000:3.0:1788201591.755145:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/423 (0 4095) 00010000:00010000:3.0:1788201591.755273:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000009a4e707/0xd138388016f6f0ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.755285:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000009a4e707/0xd138388016f6f0ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.755359:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000009a4e707/0xd138388016f6f0ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201591.755387:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a3100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727957376:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201591.755672:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201591.760149:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:1.0:1788201591.761118:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201591.761129:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6f0e8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171096fc4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.761140:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1725a1000 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201591.761147:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6f0e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171096fc4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201591.761230:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x169:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201591.761245:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x169:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201591.761344:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6f0e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096fc4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.761352:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201591.761394:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6f0e8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096fc4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.761414:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6f0e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171096fc4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201591.761436:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201591.761438:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201591.761440:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201591.761616:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727957504:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201591.764750:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201591.764863:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a3100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727957376:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201591.764899:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000009a4e707/0xd138388016f6f0ef lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096fcb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.764915:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000009a4e707/0xd138388016f6f0ef lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096fcb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.764926:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000009a4e707/0xd138388016f6f0ef lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096fcb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201591.765725:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743474432 00000100:00100000:0.0:1788201591.765737:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743474432 00010000:00010000:1.0:1788201591.766282:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000009a4e707/0xd138388016f6f0ef lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096fcb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.766294:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000009a4e707/0xd138388016f6f0ef lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171096fcb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.766324:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000009a4e707/0xd138388016f6f0ef lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171096fcb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201591.766338:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000009a4e707/0xd138388016f6f0ef lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171096fcb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.766352:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000009a4e707/0xd138388016f6f0ef lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096fcb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.766360:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000009a4e707/0xd138388016f6f0ef lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096fcb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201591.766409:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) llmountcleanup.sh: write [0, 704) append 0 append lockpos 0 00000080:00200000:1.0:1788201591.766433:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 704 bytes 00000080:00200000:1.0:1788201591.766512:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 704, copied 704 00000080:00200000:1.0:1788201591.766527:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005ef67db4[3 00000000f630cec7 2 1 00000000d31530f9 0 0 0] 00000080:00200000:1.0:1788201591.766531:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b4e83d41 17ffffc0001001 3:0 ffff8bc148ec7e00 0 lru 00000080:00200000:1.0:1788201591.766540:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000032d3b21e 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 00000000838f2fc9 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201591.766542:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005ef67db4 00000080:00200000:1.0:1788201591.766544:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201591.766550:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 704 prio 0 00000008:00010000:1.0:1788201591.766587:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000781b57b3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000009a4e707/0xd138388016f6f0ef lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096fcb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201591.766611:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d0ab8, count 1, dirtied 1 00000080:00200000:1.0:1788201591.766618:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 704 bytes, tot: 704 00000080:00200000:1.0:1788201591.766621:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) llmountcleanup.sh: write bytes 0, result: 704 00000020:00010000:1.0:1788201591.766642:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460e68a8 (ffff8bc1460e9878/0) at cl_lock_release():245 00000020:00010000:1.0:1788201591.766646:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460e68a8 (ffff8bc1460e9878/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201591.766650:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149fec830 (ffff8bc1460e95a8/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201591.766656:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000009a4e707/0xd138388016f6f0ef lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171096fcb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.766666:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000009a4e707/0xd138388016f6f0ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096fcb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201591.766683:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460e68a8 (ffff8bc1460e9878/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201591.766686:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149fec830 (ffff8bc1460e9878/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201591.766695:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 704 bytes 00000080:00200000:1.0:1788201591.766703:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1788201591.766740:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x169:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201591.766746:0:24470:0:(file.c:2238:ll_file_io_generic()) llmountcleanup.sh: 2 io complete with rc: 0, result: 704, restart: 0 00000080:00200000:1.0:1788201591.766755:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x169:0x0] updating i_size 704 i_blocks 1 00000080:00200000:1.0:1788201591.766760:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 704 00000080:00200008:1.0:1788201591.766832:0:24470:0:(file.c:479:ll_file_release()) START file llmountcleanup.sh:[0x200000bd7:0x169:0x0](ffff8bc1459d0908), flags 100001 00000002:00100000:1.0:1788201591.766890:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc172758000 x1875064727957120/t8589937363(8589937363) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201607 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201591.766904:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201591.766911:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14416ea00 x1875064727957760/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201591.766936:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416ea00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727957760:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201591.766990:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201591.781997:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727957504:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201591.798114:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172759c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727957888:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201591.798150:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6f0f6 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.798170:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6f0f6 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.798177:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6f0f6 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.798186:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6f0f6 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.798197:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6f0f6 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.798209:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1427dd400 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201591.798215:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6f0f6 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.798224:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6f0f6 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.798232:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6f0f6 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.798239:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201591.798246:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6f0f6 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.798253:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6f0f6 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201591.798275:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc172759c00 x1875064727957888/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201607 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201591.798293:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201591.798336:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201591.798426:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201591.798449:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201591.798461:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 61 lru_type: 1 00010000:00010000:1.0:1788201591.798476:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 61 lru_type: 1 00000080:00200000:1.0:1788201591.798489:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201591.798497:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201591.798501:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201591.798507:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201591.798512:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 61 lru_type: 1 00010000:00010000:1.0:1788201591.798521:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 62 lru_type: 1 00000080:00200000:1.0:1788201591.798539:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201591.798547:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201591.798554:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201591.798593:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=llmount.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:1.0:1788201591.798598:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=llmount.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201591.798613:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: llmount.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201591.798667:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc800/0xd138388016f6f0fd lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.798675:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc800/0xd138388016f6f0fd lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.798686:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc800/0xd138388016f6f0fd lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201591.798712:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416d500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727958016:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201591.798889:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8000 going to sleep for 11 seconds 00010000:00010000:0.0:1788201591.826962:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6f104 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x16a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097011 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201591.826993:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.827010:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x16a:0x0](ffff8bc1459f3a88) 00000080:00010000:0.0:1788201591.827015:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x16a:0x0](ffff8bc1459f3a88) for lock 0xd138388016f6f104 00000080:00010000:0.0:1788201591.827027:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f104 from it ffffadd1c7debcd8 00010000:00010000:0.0:1788201591.827032:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6f104 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x16a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097011 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.827044:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6f104 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x16a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097011 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201591.827409:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x16a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201591.827420:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x16a:0x0] 00000008:00010000:0.0:1788201591.827457:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201591.827461:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456eb0, osc lock ffff8bc145d35690, flags 0x400001002 00010000:00010000:0.0:1788201591.827899:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f10b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.827915:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f10b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201591.827984:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1788201591.828173:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727958400:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201591.832713:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f10b lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.832753:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f10b lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109701f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.832778:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f10b lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109701f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.832900:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f10b lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109701f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201591.832922:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f10b lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109701f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201591.832936:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201591.833001:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f10b lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109701f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.833013:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f10b lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109701f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.833022:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f10b lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109701f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.833032:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f10b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e217109701f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201591.833060:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727958400:192.168.201.143@tcp:101:cp.0 00000080:00200000:0.0:1788201591.833382:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x16a:0x0] updating i_size 0 i_blocks 1 00000020:00010000:0.0:1788201591.833390:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449dabf0 (ffff8bc1499c43f8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201591.833394:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449dabf0 (ffff8bc1499c43f8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201591.833408:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456eb0 (ffff8bc1499c4758/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201591.833415:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449dabf0 (ffff8bc1499c43f8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201591.833418:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456eb0 (ffff8bc1499c43f8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201591.833464:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x16a:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1788201591.833538:0:24470:0:(file.c:2638:do_file_write_iter()) START file llmount.sh:[0x200000bd7:0x16a:0x0], ppos: 0, count: 1754 00000080:00200000:0.0:1788201591.833557:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 1754 bytes 00000080:00200000:0.0:1788201591.833562:0:24470:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 1754 00000080:00200000:0.0:1788201591.833666:0:24470:0:(file.c:2090:ll_file_io_generic()) llmount.sh: write ppos: 0, bytes: 1754 00000080:00200000:0.0:1788201591.833673:0:24470:0:(file.c:1848:ll_io_set_mirror()) llmount.sh: desiginated mirror: 0 00000020:00200000:0.0:1788201591.833679:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000e50a3e2f[0x110, 1, [0x200000bd7:0x16a:0x0] hash] 00000020:00200000:0.0:1788201591.833682:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 1754) 0 0 00000080:00200000:0.0:1788201591.833686:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x16a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201591.833701:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1788201591.833709:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 1754) 1754, 1754 00020000:00200000:0.0:1788201591.833713:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201591.833745:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:0.0:1788201591.833759:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1788201591.833764:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456eb0, osc lock ffff8bc145d35690, flags 0x0 00010000:00010000:0.0:1788201591.833782:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/423 (0 4095) 00010000:00010000:0.0:1788201591.833863:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b477b91d/0xd138388016f6f112 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.833875:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b477b91d/0xd138388016f6f112 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.833887:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b477b91d/0xd138388016f6f112 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201591.833914:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415a300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727958528:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201591.834085:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201591.838006:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201591.838120:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743474560 00000100:00100000:3.0:1788201591.838133:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743474560 00000100:00100000:3.0:1788201591.838213:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 715 00000100:00100000:3.0:1788201591.838225:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14415b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21821:x1875064743474560:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201591.838249:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f10b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109701f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201591.838584:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201591.838593:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14415b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21821:x1875064743474560:12345-192.168.201.143@tcp:104: Request processed in 370us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201591.838603:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 715 00000100:00100000:1.0:1788201591.839717:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201591.839741:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17275a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727958656:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201591.843981:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201591.844129:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743474688 00000100:00100000:3.0:1788201591.844144:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743474688 00000100:00100000:3.0:1788201591.844227:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 716 00000100:00100000:3.0:1788201591.844240:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc144158380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21004:x1875064743474688:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201591.844262:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b477b91d/0xd138388016f6f112 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097026 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.844280:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b477b91d/0xd138388016f6f112 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097026 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.844291:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b477b91d/0xd138388016f6f112 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097026 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.844493:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b477b91d/0xd138388016f6f112 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097026 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.844512:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b477b91d/0xd138388016f6f112 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097026 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.844525:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b477b91d/0xd138388016f6f112 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171097026 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.844549:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc143a49400) 00000100:00100000:3.0:1788201591.844647:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc144158380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21004:x1875064743474688:12345-192.168.201.143@tcp:105: Request processed in 408us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201591.844656:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 716 00000100:00100000:1.0:1788201591.847645:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727958656:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201591.864569:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172759180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727959040:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201591.864673:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc800/0xd138388016f6f119 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.864690:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc800/0xd138388016f6f119 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.864698:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc800/0xd138388016f6f119 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.864706:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc800/0xd138388016f6f119 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.864718:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc800/0xd138388016f6f119 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.864725:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1427dc800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201591.864731:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc800/0xd138388016f6f119 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.864738:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc800/0xd138388016f6f119 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.864746:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc800/0xd138388016f6f119 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.864753:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201591.864761:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc800/0xd138388016f6f119 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.864768:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc800/0xd138388016f6f119 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201591.865682:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc172759180 x1875064727959040/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201607 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201591.865704:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201591.866172:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201591.866394:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201591.866428:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.866443:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 65 lru_type: 1 00010000:00010000:0.0:1788201591.866458:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 65 lru_type: 1 00000080:00200000:0.0:1788201591.866466:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.866472:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201591.866476:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201591.866484:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201591.866488:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 65 lru_type: 1 00010000:00010000:0.0:1788201591.866498:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 66 lru_type: 1 00000080:00200000:0.0:1788201591.866517:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.866526:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201591.866533:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.866550:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=lnet-selftest.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:0.0:1788201591.866554:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=lnet-selftest.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201591.866568:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: lnet-selftest.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201591.866700:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49000/0xd138388016f6f120 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.866713:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49000/0xd138388016f6f120 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.866726:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49000/0xd138388016f6f120 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201591.866757:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144159180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727959168:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201591.867068:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201591.899374:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727959552:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201591.905999:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f12e lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.906045:0:10054:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f12e lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109707a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.906066:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f12e lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109707a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.906082:0:10054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f12e lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109707a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201591.906405:0:10054:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f12e lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109707a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201591.906422:0:10054:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201591.906520:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f12e lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109707a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.906535:0:10054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f12e lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109707a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.906554:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f12e lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109707a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.906565:0:10054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f12e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e217109707a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201591.906606:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727959552:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201591.914536:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201591.914754:0:21781:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201591.914780:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743474816 00000100:00100000:3.0:1788201591.914860:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743474816 00000100:00100000:3.0:1788201591.914938:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 717 00000100:00100000:3.0:1788201591.914952:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14bbcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23413:x1875064743474816:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201591.914975:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f12e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109707a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201591.915404:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201591.915414:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14bbcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23413:x1875064743474816:12345-192.168.201.143@tcp:104: Request processed in 466us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201591.915425:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 717 00010000:00010000:0.0:1788201591.915619:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201591.915633:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f12e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109707a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.915645:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1427ddc00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201591.915655:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f12e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e217109707a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201591.915738:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x16b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201591.915754:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x16b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1788201591.915881:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f12e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109707a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.915896:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201591.915933:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f12e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109707a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.915941:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f12e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109707a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.915960:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201591.915962:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201591.915964:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201591.921836:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201591.921891:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743474944 00000100:00100000:3.0:1788201591.921904:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743474944 00000100:00100000:3.0:1788201591.921980:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 718 00000100:00100000:3.0:1788201591.921993:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14416d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23412:x1875064743474944:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201591.922014:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003f09d801/0xd138388016f6f135 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097081 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.922030:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003f09d801/0xd138388016f6f135 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097081 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.922042:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003f09d801/0xd138388016f6f135 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097081 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.922054:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003f09d801/0xd138388016f6f135 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097081 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.922065:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003f09d801/0xd138388016f6f135 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097081 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.922078:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003f09d801/0xd138388016f6f135 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171097081 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201591.922116:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1427dc800) 00000100:00100000:3.0:1788201591.922210:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14416d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23412:x1875064743474944:12345-192.168.201.143@tcp:105: Request processed in 220us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201591.922219:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 718 00000080:00200000:0.0:1788201591.945441:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x16b:0x0](ffff8bc1459f42c8),name=lnet-selftest.sh 00000002:00010000:0.0:1788201591.945497:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x16b:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.945522:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6f127 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x16b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109706c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201591.945543:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6f127 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x16b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109706c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201591.945554:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.945566:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x16b:0x0](ffff8bc1459f42c8) 00000080:00010000:0.0:1788201591.945571:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x16b:0x0](ffff8bc1459f42c8) for lock 0xd138388016f6f127 00000080:00010000:0.0:1788201591.945580:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f127 from it ffffadd1c7debcb8 00010000:00010000:0.0:1788201591.945585:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6f127 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x16b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109706c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201591.945595:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6f127 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x16b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109706c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201591.945673:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x16b:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201591.945683:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x16b:0x0] 00000008:00010000:0.0:1788201591.945715:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201591.945719:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456cb0, osc lock ffff8bc145d344c0, flags 0x400001002 00010000:00010000:0.0:1788201591.945738:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003f09d801/0xd138388016f6f135 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097081 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.945751:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003f09d801/0xd138388016f6f135 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097081 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:0.0:1788201591.945766:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1788201591.945771:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003f09d801/0xd138388016f6f135 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097081 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201591.945779:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003f09d801/0xd138388016f6f135 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097081 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1788201591.946951:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1788201591.946972:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x16b:0x0] updating i_size 4915 i_blocks 1 00000020:00010000:0.0:1788201591.946980:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449db530 (ffff8bc1499c4bd8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201591.946983:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449db530 (ffff8bc1499c4bd8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201591.946988:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456cb0 (ffff8bc1499c4f38/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201591.946993:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449db530 (ffff8bc1499c4bd8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201591.946996:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456cb0 (ffff8bc1499c4bd8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201591.947040:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x16b:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201591.947407:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201591.947434:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.947454:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 68 lru_type: 1 00010000:00010000:0.0:1788201591.947470:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 68 lru_type: 1 00000080:00200000:0.0:1788201591.947479:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.947487:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201591.947491:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201591.947499:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201591.947503:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 68 lru_type: 1 00010000:00010000:0.0:1788201591.947512:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 69 lru_type: 1 00000080:00200000:0.0:1788201591.947527:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.947536:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201591.947543:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.947561:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=lockorder.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:0.0:1788201591.947566:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=lockorder.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201591.947580:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: lockorder.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201591.947647:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f13c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.947656:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f13c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.947672:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f13c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201591.947706:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144159f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727960192:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201591.948977:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201591.958568:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144159f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727960192:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201591.958604:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f13c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.958622:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f13c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.958629:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f13c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.958637:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f13c lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.958648:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f13c lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.958655:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc143a49e00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201591.958660:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f13c lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.958668:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f13c lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.958675:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f13c lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.958684:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201591.958692:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f13c lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.958699:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f13c lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201591.958721:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc144159f80 x1875064727960192/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201607 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201591.958738:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201591.958769:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201591.958913:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201591.958933:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.958944:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 69 lru_type: 1 00010000:00010000:0.0:1788201591.958958:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 69 lru_type: 1 00000080:00200000:0.0:1788201591.958966:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.958972:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201591.958976:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201591.958982:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201591.958986:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 69 lru_type: 1 00010000:00010000:0.0:1788201591.958995:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 70 lru_type: 1 00000080:00200000:0.0:1788201591.959014:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.959022:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201591.959028:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.959045:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=lockorder.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:0.0:1788201591.959049:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=lockorder.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201591.959062:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: lockorder.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201591.959112:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6f143 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.959120:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6f143 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.959132:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6f143 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201591.961486:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144159f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727960320:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201591.961638:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201591.969013:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144159f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727960320:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201591.969043:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6f143 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.969061:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6f143 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.969068:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6f143 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.969076:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6f143 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.969088:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6f143 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.969106:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc143a48800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201591.969111:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6f143 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.969120:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6f143 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.969128:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6f143 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.969137:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201591.969276:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6f143 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.969353:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6f143 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201591.969381:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc144159f80 x1875064727960320/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201607 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201591.969408:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201591.969445:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201591.969651:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201591.969671:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201591.969683:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 70 lru_type: 1 00010000:00010000:0.0:1788201591.969703:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 70 lru_type: 1 00000080:00200000:0.0:1788201591.969710:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201591.969716:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201591.969719:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201591.969726:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:0.0:1788201591.969730:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 70 lru_type: 1 00010000:00010000:0.0:1788201591.969739:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 71 lru_type: 1 00000080:00200000:0.0:1788201591.969756:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.969765:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201591.969772:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201591.969788:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201591.969853:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=lockorder.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc152c96300, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:0.0:1788201591.969862:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=lockorder.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:0.0:1788201591.969887:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: lockorder.sh,[0x200000bd7:0x16c:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:0.0:1788201591.969957:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f14a lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.969965:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f14a lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1788201591.969981:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1788201591.969990:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144159f80 x1875064727960576/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1788201591.970000:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f14a lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201591.970024:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144159f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727960576:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201591.972032:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201591.984656:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144159f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727960576:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201591.984698:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f14a lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710970c7 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.984725:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f14a lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710970c7 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.984734:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f14a lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x16c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710970c7 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.984747:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f14a lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x16c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710970c7 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.984759:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f14a lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x16c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710970c7 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.984775:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f14a lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x16c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710970c7 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.984785:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f14a lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x16c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710970c7 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.984842:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f14a lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x16c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710970c7 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201591.984857:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc144159f80 x1875064727960576/t8589937369(8589937369) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201591.984873:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc144159f80 x1875064727960576/t8589937369(8589937369) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201607 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201591.984889:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f14a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x16c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710970c7 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1788201591.984904:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f14a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x16c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710970c7 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201591.984917:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/364 (0 0) 00000080:00200000:0.0:1788201591.984926:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201591.984944:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=lockorder.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:0.0:1788201591.984981:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x16c:0x0](ffff8bc144685348) 00000080:00200000:0.0:1788201591.985124:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x16c:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1788201591.985134:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x16c:0x0](ffff8bc144685348) 00000080:00010000:0.0:1788201591.985138:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x16c:0x0](ffff8bc144685348) for lock 0xd138388016f6f14a 00000080:00010000:0.0:1788201591.985374:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x16c:0x0](ffff8bc144685348) 00000080:00200008:0.0:1788201591.985404:0:24470:0:(file.c:1090:ll_file_open()) START file lockorder.sh:[0x200000bd7:0x16c:0x0](ffff8bc144685348), flags 100301 00000100:00100000:1.0:1788201591.992860:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727960704:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201591.999515:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f151 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.999554:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f151 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710970d5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.999583:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f151 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710970d5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.999598:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f151 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710970d5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201591.999616:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f151 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710970d5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201591.999631:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1788201591.999651:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f151 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710970d5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.999667:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f151 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710970d5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.999676:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f151 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710970d5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.999686:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f151 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e21710970d5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201591.999712:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727960704:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201592.004859:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201592.009636:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727960832:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201592.009687:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ec3e6631/0xd138388016f6f158 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710970dc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.009703:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ec3e6631/0xd138388016f6f158 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710970dc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.009713:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ec3e6631/0xd138388016f6f158 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710970dc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.010868:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201592.010881:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f151 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710970d5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.010896:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1427ddc00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201592.010904:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f151 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e21710970d5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201592.010987:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x16c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201592.011003:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x16c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201592.011102:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f151 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710970d5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.011114:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788201592.011260:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727960960:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201592.011916:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f151 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710970d5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.011930:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e03208f7/0xd138388016f6f151 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710970d5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.011953:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201592.011955:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201592.011957:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201592.014729:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201592.017662:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743475200 00000100:00100000:0.0:1788201592.017689:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743475200 00000100:00100000:0.0:1788201592.017817:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 720 00000100:00100000:0.0:1788201592.017831:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743475200:12345-192.168.201.143@tcp:105: 00010000:00010000:0.0:1788201592.017854:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ec3e6631/0xd138388016f6f158 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710970dc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.017872:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ec3e6631/0xd138388016f6f158 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710970dc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.017883:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ec3e6631/0xd138388016f6f158 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710970dc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.017896:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ec3e6631/0xd138388016f6f158 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710970dc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.017907:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ec3e6631/0xd138388016f6f158 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710970dc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.017918:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ec3e6631/0xd138388016f6f158 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e21710970dc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.017951:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc172491000) 00000100:00100000:0.0:1788201592.018042:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743475200:12345-192.168.201.143@tcp:105: Request processed in 213us (3328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.018050:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 720 00000100:00100000:0.0:1788201592.021269:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727960960:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201592.043153:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727961856:192.168.201.143@tcp:101:cp.0 00000080:00200000:3.0:1788201592.051701:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x16d:0x0] updating i_size 0 i_blocks 1 00000020:00010000:3.0:1788201592.051710:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc146005720 (ffff8bc146919cf8/0) at cl_lock_release():245 00000020:00010000:3.0:1788201592.051713:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146005720 (ffff8bc146919cf8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201592.051718:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261dcb0 (ffff8bc1469195a8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201592.051722:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146005720 (ffff8bc146919cf8/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201592.051725:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261dcb0 (ffff8bc146919cf8/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201592.057043:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x16d:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:0.0:1788201592.073012:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:3.0:1788201592.077110:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201592.077133:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001c580987/0xd138388016f6f174 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097130 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.077153:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172490c00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201592.077165:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001c580987/0xd138388016f6f174 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171097130 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201592.077256:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x16d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201592.077272:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x16d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201592.077378:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001c580987/0xd138388016f6f174 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097130 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.077388:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201592.077446:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001c580987/0xd138388016f6f174 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097130 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.077455:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001c580987/0xd138388016f6f174 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097130 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.077475:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201592.077477:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201592.077479:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201592.078103:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727962112:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201592.084960:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201592.085186:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743475456 00000100:00100000:0.0:1788201592.085199:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743475456 00000100:00100000:0.0:1788201592.085275:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 722 00000100:00100000:0.0:1788201592.085287:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21004:x1875064743475456:12345-192.168.201.143@tcp:105: 00010000:00010000:0.0:1788201592.085308:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009b0557ef/0xd138388016f6f17b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097137 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.085325:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009b0557ef/0xd138388016f6f17b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097137 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.085335:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009b0557ef/0xd138388016f6f17b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097137 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.085347:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009b0557ef/0xd138388016f6f17b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097137 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.085357:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009b0557ef/0xd138388016f6f17b lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097137 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.085370:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009b0557ef/0xd138388016f6f17b lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171097137 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.085403:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc172490400) 00000100:00100000:0.0:1788201592.085478:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21004:x1875064743475456:12345-192.168.201.143@tcp:105: Request processed in 193us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.085486:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 722 00000100:00100000:1.0:1788201592.100989:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727962112:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201592.118212:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172759500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727962624:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.118245:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f189 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.118264:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f189 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.118271:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f189 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.118279:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f189 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.118288:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f189 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.118297:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172491800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201592.118303:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f189 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.118311:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f189 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.118320:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f189 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.118328:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201592.118339:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f189 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.118346:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f189 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201592.118373:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc172759500 x1875064727962624/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201592.118391:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201592.118433:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201592.118583:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.118607:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.118618:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 78 lru_type: 1 00010000:00010000:1.0:1788201592.118632:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 78 lru_type: 1 00000080:00200000:1.0:1788201592.118645:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.118652:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.118656:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.118663:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:1.0:1788201592.118668:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 78 lru_type: 1 00010000:00010000:1.0:1788201592.118971:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 79 lru_type: 1 00000080:00200000:1.0:1788201592.118990:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.118998:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201592.119005:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.119019:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201592.119024:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=maloo_upload.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14304b200, open_flags 80c1, mode 81ed opened 0 00000080:00200000:1.0:1788201592.119032:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=maloo_upload.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:1.0:1788201592.119056:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: maloo_upload.sh,[0x200000bd7:0x16e:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201592.119162:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.119170:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201592.119239:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201592.119248:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14416c700 x1875064727962880/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201592.119264:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.119292:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416c700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727962880:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.119466:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.127283:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416c700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727962880:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.127322:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109717d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.127351:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109717d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.127362:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109717d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.127378:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109717d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.127402:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109717d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.127423:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109717d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.127432:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109717d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.127447:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109717d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201592.127465:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc14416c700 x1875064727962880/t8589937374(8589937374) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201592.127480:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14416c700 x1875064727962880/t8589937374(8589937374) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201592.127496:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109717d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201592.127510:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109717d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.127523:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/366 (0 0) 00000080:00200000:1.0:1788201592.127532:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201592.127549:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=maloo_upload.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:1.0:1788201592.127602:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x16e:0x0](ffff8bc1446bb248) 00000080:00200000:1.0:1788201592.127750:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x16e:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201592.127760:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x16e:0x0](ffff8bc1446bb248) 00000080:00010000:1.0:1788201592.127764:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x16e:0x0](ffff8bc1446bb248) for lock 0xd138388016f6f190 00000080:00010000:1.0:1788201592.127774:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x16e:0x0](ffff8bc1446bb248) 00000080:00200008:1.0:1788201592.127830:0:24470:0:(file.c:1090:ll_file_open()) START file maloo_upload.sh:[0x200000bd7:0x16e:0x0](ffff8bc1446bb248), flags 100301 00000002:00100000:1.0:1788201592.127853:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14416c700 x1875064727962880/t8589937374(8589937374) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201592.127902:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f190 from it ffff8bc144cb5000 00010000:00010000:1.0:1788201592.127908:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109717d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.127919:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109717d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201592.127945:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x16e:0x0](ffff8bc1446bb248), inode mode 81ed mask 40 00000080:00200008:1.0:1788201592.127977:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file maloo_upload.sh:[0x200000bd7:0x16e:0x0](ffff8bc1446bb248), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201592.127984:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x16e:0x0](ffff8bc1446bb248),name=maloo_upload.sh 00000002:00010000:1.0:1788201592.128006:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x16e:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.128017:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109717d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.128032:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109717d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201592.128039:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.128044:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x16e:0x0](ffff8bc1446bb248) 00000080:00010000:1.0:1788201592.128047:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x16e:0x0](ffff8bc1446bb248) for lock 0xd138388016f6f190 00000080:00010000:1.0:1788201592.128051:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f190 from it ffffadd1c7debcd8 00010000:00010000:1.0:1788201592.128055:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109717d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.128062:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109717d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201592.128090:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x16e:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201592.128114:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x16e:0x0] 00000008:00010000:1.0:1788201592.128148:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201592.128153:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4930, osc lock ffff8bc145d09430, flags 0x400001002 00010000:00010000:1.0:1788201592.128221:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f197 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.128233:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f197 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201592.128277:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1788201592.132206:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:1.0:1788201592.134660:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x16e:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201592.134668:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e246f0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201592.134753:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e246f0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.134759:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4930 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.134764:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e246f0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201592.134767:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4930 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201592.134963:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x16e:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201592.135037:0:24470:0:(file.c:2638:do_file_write_iter()) START file maloo_upload.sh:[0x200000bd7:0x16e:0x0], ppos: 0, count: 838 00000080:00200000:1.0:1788201592.135056:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 838 bytes 00000080:00200000:1.0:1788201592.135064:0:24470:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 838 00000080:00200000:1.0:1788201592.135316:0:24470:0:(file.c:2090:ll_file_io_generic()) maloo_upload.sh: write ppos: 0, bytes: 838 00000080:00200000:1.0:1788201592.135324:0:24470:0:(file.c:1848:ll_io_set_mirror()) maloo_upload.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201592.135331:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b42d0f2e[0x110, 1, [0x200000bd7:0x16e:0x0] hash] 00000020:00200000:1.0:1788201592.135334:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 838) 0 0 00000080:00200000:1.0:1788201592.135339:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x16e:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201592.135354:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1788201592.135363:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 838) 838, 838 00020000:00200000:1.0:1788201592.135367:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201592.135418:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1788201592.135435:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201592.135442:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4930, osc lock ffff8bc145d09430, flags 0x0 00010000:00010000:1.0:1788201592.135462:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/425 (0 4095) 00010000:00010000:1.0:1788201592.135515:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.135527:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.135539:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.135568:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416d880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727963136:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.135920:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201592.138750:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:1.0:1788201592.141485:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201592.141505:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f197 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109718b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.141524:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bc400 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201592.141535:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f197 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e217109718b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201592.141844:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x16e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201592.141859:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x16e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201592.141953:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f197 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109718b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.141962:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201592.142159:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f197 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109718b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.142183:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f197 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109718b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.142203:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201592.142205:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201592.142208:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201592.145824:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201592.146356:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743475712 00000100:00100000:0.0:1788201592.146371:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743475712 00000100:00100000:0.0:1788201592.146447:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 724 00000100:00100000:0.0:1788201592.146459:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23412:x1875064743475712:12345-192.168.201.143@tcp:105: 00010000:00010000:0.0:1788201592.146492:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.146509:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.146521:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.146534:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.146546:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.146558:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.146599:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1460bc800) 00000100:00100000:0.0:1788201592.146827:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23412:x1875064743475712:12345-192.168.201.143@tcp:105: Request processed in 369us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.146836:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 724 00000100:00100000:1.0:1788201592.150028:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416d880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727963136:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.150064:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.150091:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201592.150106:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.150122:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.150132:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201592.150161:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) maloo_upload.sh: write [0, 838) append 0 append lockpos 0 00000080:00200000:1.0:1788201592.150255:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 838 bytes 00000080:00200000:1.0:1788201592.150331:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 838, copied 838 00000080:00200000:1.0:1788201592.150343:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f28e1d73[3 00000000b5d68cca 2 1 000000008c1ba057 0 0 0] 00000080:00200000:1.0:1788201592.150348:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009801a1a9 17ffffc0001001 3:0 ffff8bc148ec78c0 0 lru 00000080:00200000:1.0:1788201592.150356:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001328f98d 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000b57f6f7a > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201592.150358:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f28e1d73 00000080:00200000:1.0:1788201592.150360:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201592.150365:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 838 prio 0 00000008:00010000:1.0:1788201592.150391:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 0000000022ba4270 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201592.150429:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1446bb3f8, count 1, dirtied 1 00000080:00200000:1.0:1788201592.150435:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 838 bytes, tot: 838 00000080:00200000:1.0:1788201592.150439:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) maloo_upload.sh: write bytes 0, result: 838 00000020:00010000:1.0:1788201592.150459:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c4b78 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201592.150463:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c4b78 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.150467:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4930 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201592.150472:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.150483:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201592.150502:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c4b78 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201592.150506:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4930 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201592.150515:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 838 bytes 00000080:00200000:1.0:1788201592.150524:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1788201592.150558:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x16e:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201592.150563:0:24470:0:(file.c:2238:ll_file_io_generic()) maloo_upload.sh: 2 io complete with rc: 0, result: 838, restart: 0 00000080:00200000:1.0:1788201592.150646:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x16e:0x0] updating i_size 838 i_blocks 1 00000080:00200000:1.0:1788201592.150655:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 838 00000080:00200008:1.0:1788201592.150832:0:24470:0:(file.c:479:ll_file_release()) START file maloo_upload.sh:[0x200000bd7:0x16e:0x0](ffff8bc1446bb248), flags 100001 00000002:00100000:1.0:1788201592.150896:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc14416c700 x1875064727962880/t8589937374(8589937374) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201608 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201592.150909:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201592.150915:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14416d880 x1875064727963520/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201592.150941:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416d880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727963520:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201592.151086:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.154561:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416d880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727963520:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201592.154613:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc14416c700 x1875064727962880/t8589937374(8589937374) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201592.154773:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.154832:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.154858:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 79 lru_type: 1 00010000:00010000:1.0:1788201592.154877:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 79 lru_type: 1 00000080:00200000:1.0:1788201592.154887:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.154894:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.154899:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.154909:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201592.154913:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 79 lru_type: 1 00010000:00010000:1.0:1788201592.154930:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 80 lru_type: 1 00000080:00200000:1.0:1788201592.154950:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.154958:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201592.154966:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.154969:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=maloo_upload.sh, flags=8 00000080:00200008:1.0:1788201592.154979:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file maloo_upload.sh:[0x200000bd7:0x16e:0x0](ffff8bc1446bb248), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201592.154984:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x16e:0x0](ffff8bc1446bb248),name=maloo_upload.sh 00000002:00010000:1.0:1788201592.154998:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x16e:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.155007:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109717d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201592.155015:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109717d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201592.155021:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.155024:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x16e:0x0](ffff8bc1446bb248) 00000080:00010000:1.0:1788201592.155027:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x16e:0x0](ffff8bc1446bb248) for lock 0xd138388016f6f190 00000080:00010000:1.0:1788201592.155030:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f190 from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201592.155033:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109717d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201592.155040:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109717d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201592.155103:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x16e:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201592.155113:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x16e:0x0] 00000008:00010000:1.0:1788201592.155150:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201592.155154:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4930, osc lock ffff8bc145d09430, flags 0x400001002 00010000:00010000:1.0:1788201592.155173:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.155261:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201592.155276:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201592.155281:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.155290:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201592.155303:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201592.155314:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x16e:0x0] updating i_size 838 i_blocks 1 00000020:00010000:1.0:1788201592.155319:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e246f0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201592.155322:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e246f0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.155326:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4930 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.155331:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e246f0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201592.155334:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4930 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201592.155376:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x16e:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201592.155450:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.155460:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.155467:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 80 lru_type: 1 00010000:00010000:1.0:1788201592.155477:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 80 lru_type: 1 00000080:00200000:1.0:1788201592.155484:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.155488:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.155491:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.155495:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201592.155499:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 80 lru_type: 1 00010000:00010000:1.0:1788201592.155507:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 81 lru_type: 1 00000080:00200000:1.0:1788201592.155517:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.155522:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201592.155525:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.155541:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=mds-survey.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201592.155546:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=mds-survey.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201592.155557:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: mds-survey.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201592.155614:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1a5 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.155624:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1a5 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.155640:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1a5 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.155667:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416ed80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727963648:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.156029:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.160280:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416ed80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727963648:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.160311:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1a5 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.160327:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1a5 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.160335:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1a5 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.160343:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1a5 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.160354:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1a5 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.160361:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bde00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201592.160366:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1a5 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.160374:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1a5 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.160382:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1a5 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.160391:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201592.160410:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1a5 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.160417:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1a5 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201592.160439:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14416ed80 x1875064727963648/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201592.160458:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201592.160646:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201592.160911:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201592.160932:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201592.160942:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 81 lru_type: 1 00010000:00010000:0.0:1788201592.160955:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 81 lru_type: 1 00000080:00200000:0.0:1788201592.160961:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201592.160967:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201592.160970:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201592.160977:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201592.160980:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 81 lru_type: 1 00010000:00010000:0.0:1788201592.160988:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 82 lru_type: 1 00000080:00200000:0.0:1788201592.161005:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201592.161013:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201592.161020:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201592.161041:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=mds-survey.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:0.0:1788201592.161045:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=mds-survey.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201592.161058:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: mds-survey.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201592.161242:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f1ac lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.161253:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f1ac lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.161267:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f1ac lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201592.161295:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727963776:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201592.161438:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.185977:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17275a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727964160:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201592.189773:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f1ba lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.189829:0:10054:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f1ba lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710971e6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.189847:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f1ba lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710971e6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.189860:0:10054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f1ba lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710971e6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201592.189878:0:10054:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f1ba lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710971e6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201592.189898:0:10054:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201592.189959:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f1ba lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710971e6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.189971:0:10054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f1ba lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710971e6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.189979:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f1ba lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710971e6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.189989:0:10054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f1ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e21710971e6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201592.190014:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727964160:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201592.193145:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:1.0:1788201592.194851:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201592.194864:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f1ba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710971e6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.194877:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172491600 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201592.194885:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f1ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e21710971e6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201592.194954:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x16f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201592.194968:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x16f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201592.195051:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f1ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710971e6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.195059:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788201592.195134:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1788201592.195153:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f1ba lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710971e6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.195163:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f1ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710971e6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.195192:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201592.195194:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201592.195196:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201592.196863:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172759c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727964288:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201592.196898:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002dba747d/0xd138388016f6f1c1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710971ed expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.196912:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002dba747d/0xd138388016f6f1c1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710971ed expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.196926:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002dba747d/0xd138388016f6f1c1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710971ed expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201592.200315:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201592.200420:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743475968 00000100:00100000:3.0:1788201592.200433:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743475968 00000100:00100000:3.0:1788201592.200538:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 726 00000100:00100000:3.0:1788201592.200553:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14415aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21003:x1875064743475968:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201592.200647:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002dba747d/0xd138388016f6f1c1 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710971ed expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.200665:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002dba747d/0xd138388016f6f1c1 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710971ed expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.200757:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002dba747d/0xd138388016f6f1c1 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710971ed expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.200771:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002dba747d/0xd138388016f6f1c1 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710971ed expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.200781:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002dba747d/0xd138388016f6f1c1 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710971ed expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.200937:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002dba747d/0xd138388016f6f1c1 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e21710971ed expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.201038:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc172491400) 00000100:00100000:3.0:1788201592.201127:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14415aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21003:x1875064743475968:12345-192.168.201.143@tcp:105: Request processed in 576us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201592.201135:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 726 00000100:00100000:3.0:1788201592.217603:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275bb80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727964928:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201592.217632:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490a00/0xd138388016f6f1cf lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.217649:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490a00/0xd138388016f6f1cf lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.217656:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490a00/0xd138388016f6f1cf lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.217664:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490a00/0xd138388016f6f1cf lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.217685:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490a00/0xd138388016f6f1cf lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.217692:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172490a00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201592.217697:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490a00/0xd138388016f6f1cf lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.217705:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490a00/0xd138388016f6f1cf lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.217711:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490a00/0xd138388016f6f1cf lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.217720:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201592.217728:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490a00/0xd138388016f6f1cf lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.217736:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490a00/0xd138388016f6f1cf lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201592.217761:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc17275bb80 x1875064727964928/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201592.217780:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201592.217839:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:3.0:1788201592.217968:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201592.217985:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201592.217995:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 86 lru_type: 1 00010000:00010000:3.0:1788201592.218008:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 86 lru_type: 1 00000080:00200000:3.0:1788201592.218016:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201592.218022:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201592.218025:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201592.218031:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:3.0:1788201592.218035:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 86 lru_type: 1 00010000:00010000:3.0:1788201592.218046:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 87 lru_type: 1 00000080:00200000:3.0:1788201592.218064:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201592.218072:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201592.218078:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201592.218106:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:3.0:1788201592.218112:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=mmp.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc146421500, open_flags 80c1, mode 81ed opened 0 00000080:00200000:3.0:1788201592.218122:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=mmp.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:3.0:1788201592.218147:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: mmp.sh,[0x200000bd7:0x170:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:3.0:1788201592.218227:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.218235:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1788201592.218249:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1788201592.218257:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a1880 x1875064727965184/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1788201592.218267:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201592.218293:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727965184:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201592.219081:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201592.224871:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727965184:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201592.224908:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097233 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.224938:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x170:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097233 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.224948:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097233 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.224961:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097233 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.224975:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097233 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.224992:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097233 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.225000:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097233 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.225008:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097233 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201592.225020:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1724a1880 x1875064727965184/t8589937378(8589937378) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1788201592.225035:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a1880 x1875064727965184/t8589937378(8589937378) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201592.225051:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097233 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1788201592.225065:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097233 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.225078:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/368 (0 0) 00000080:00200000:3.0:1788201592.225086:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1788201592.225104:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=mmp.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:3.0:1788201592.225143:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x170:0x0](ffff8bc1459d6c08) 00000080:00200000:3.0:1788201592.225416:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x170:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1788201592.225429:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x170:0x0](ffff8bc1459d6c08) 00000080:00010000:3.0:1788201592.225433:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x170:0x0](ffff8bc1459d6c08) for lock 0xd138388016f6f1d6 00000080:00010000:3.0:1788201592.225445:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x170:0x0](ffff8bc1459d6c08) 00000080:00200008:3.0:1788201592.225464:0:24470:0:(file.c:1090:ll_file_open()) START file mmp.sh:[0x200000bd7:0x170:0x0](ffff8bc1459d6c08), flags 100301 00000002:00100000:3.0:1788201592.225487:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a1880 x1875064727965184/t8589937378(8589937378) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1788201592.225540:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f1d6 from it ffff8bc148c9b240 00010000:00010000:3.0:1788201592.225545:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097233 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.225555:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097233 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201592.225593:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x170:0x0](ffff8bc1459d6c08), inode mode 81ed mask 40 00000080:00200008:3.0:1788201592.225628:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file mmp.sh:[0x200000bd7:0x170:0x0](ffff8bc1459d6c08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201592.225635:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x170:0x0](ffff8bc1459d6c08),name=mmp.sh 00000002:00010000:3.0:1788201592.225656:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x170:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201592.225666:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097233 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.226823:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097233 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201592.226834:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201592.226842:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x170:0x0](ffff8bc1459d6c08) 00000080:00010000:3.0:1788201592.226846:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x170:0x0](ffff8bc1459d6c08) for lock 0xd138388016f6f1d6 00000080:00010000:3.0:1788201592.226853:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f1d6 from it ffffadd1c7debcd8 00010000:00010000:3.0:1788201592.226857:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097233 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.226867:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097233 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201592.226911:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x170:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201592.226922:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x170:0x0] 00000100:00100000:0.0:1788201592.227757:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17275bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727965312:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201592.233524:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004609b71d/0xd138388016f6f1dd lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.233561:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004609b71d/0xd138388016f6f1dd lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097241 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.233648:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004609b71d/0xd138388016f6f1dd lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097241 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.233664:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004609b71d/0xd138388016f6f1dd lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097241 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201592.233750:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004609b71d/0xd138388016f6f1dd lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097241 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201592.233763:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201592.233888:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004609b71d/0xd138388016f6f1dd lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097241 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.233899:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004609b71d/0xd138388016f6f1dd lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097241 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.233907:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004609b71d/0xd138388016f6f1dd lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097241 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.233917:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004609b71d/0xd138388016f6f1dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171097241 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201592.233943:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727965312:192.168.201.143@tcp:101:cp.0 00000008:00010000:0.0:1788201592.234988:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1788201592.234995:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1724566b0, osc lock ffff8bc145d344c0, flags 0x0 00010000:00010000:0.0:1788201592.235012:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/426 (0 20479) 00010000:00010000:0.0:1788201592.235063:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.235074:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.235085:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201592.235269:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727965440:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201592.235413:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.238908:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:3.0:1788201592.239481:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201592.239493:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004609b71d/0xd138388016f6f1dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097241 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.239505:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172490800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201592.239513:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004609b71d/0xd138388016f6f1dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171097241 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201592.239591:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x170:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201592.239608:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x170:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201592.239709:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004609b71d/0xd138388016f6f1dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097241 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.239719:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201592.239749:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004609b71d/0xd138388016f6f1dd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097241 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.239759:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004609b71d/0xd138388016f6f1dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097241 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.239780:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201592.239782:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201592.239784:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201592.239849:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727965568:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201592.243271:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201592.243452:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743476224 00000100:00100000:0.0:1788201592.243465:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743476224 00000100:00100000:0.0:1788201592.243532:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 728 00000100:00100000:0.0:1788201592.243544:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21004:x1875064743476224:12345-192.168.201.143@tcp:105: 00010000:00010000:0.0:1788201592.243577:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.243595:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.243606:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.243625:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.243636:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.243649:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.243681:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc143a48400) 00000100:00100000:0.0:1788201592.243756:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21004:x1875064743476224:12345-192.168.201.143@tcp:105: Request processed in 214us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.243765:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 728 00000100:00100000:0.0:1788201592.249465:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727965440:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201592.249504:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.249531:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201592.249548:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.249562:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.249584:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201592.249618:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) mmp.sh: write [0, 18269) append 0 append lockpos 0 00000080:00200000:0.0:1788201592.249644:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:0.0:1788201592.249720:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:0.0:1788201592.249734:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000086fe4a45[3 0000000012b426df 2 1 00000000d1f94df9 0 0 0] 00000080:00200000:0.0:1788201592.249738:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000061af2e22 17ffffc0001001 3:0 ffff8bc1727a6e00 0 lru 00000080:00200000:0.0:1788201592.249747:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000027189626 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 0000000073aeaabc > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201592.249749:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000086fe4a45 00000080:00200000:0.0:1788201592.249751:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1788201592.249755:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:0.0:1788201592.249783:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:0.0:1788201592.249788:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000da0e626e[3 0000000012b426df 2 1 00000000d1f94df9 0 0 1] 00000080:00200000:0.0:1788201592.249844:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003e229abb 17ffffc0001001 3:0 ffff8bc1727a68c0 1 lru 00000080:00200000:0.0:1788201592.249850:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000019171560 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 0000000073aeaabc > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201592.249852:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000da0e626e 00000080:00200000:0.0:1788201592.249853:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:0.0:1788201592.249856:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:0.0:1788201592.249876:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:0.0:1788201592.249881:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008ae94c66[3 0000000012b426df 2 1 00000000d1f94df9 0 0 2] 00000080:00200000:0.0:1788201592.249884:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000062de6c8 17ffffc0001001 3:0 ffff8bc1727a6540 2 lru 00000080:00200000:0.0:1788201592.249890:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000fcf8a505 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000000ce25486 0000000073aeaabc > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201592.249893:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008ae94c66 00000080:00200000:0.0:1788201592.249894:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:0.0:1788201592.249896:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:0.0:1788201592.249911:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:0.0:1788201592.249916:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000de68de33[3 0000000012b426df 2 1 00000000d1f94df9 0 0 3] 00000080:00200000:0.0:1788201592.249919:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c6ea4f1c 17ffffc0001001 3:0 ffff8bc1727a6a80 3 lru 00000080:00200000:0.0:1788201592.249925:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008c5dc329 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000000ce25486 0000000073aeaabc > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201592.249927:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000de68de33 00000080:00200000:0.0:1788201592.249928:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:0.0:1788201592.249930:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 1885 bytes 00000080:00200000:0.0:1788201592.249954:0:24470:0:(rw26.c:898:ll_write_end()) pos 16384, len 1885, copied 1885 00000080:00200000:0.0:1788201592.249959:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000052c389b6[3 0000000012b426df 2 1 00000000d1f94df9 0 0 4] 00000080:00200000:0.0:1788201592.249962:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001c73579c 17ffffc0001001 3:0 ffff8bc1727a6c40 4 lru 00000080:00200000:0.0:1788201592.249967:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000002defa4e2 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000000ce25486 0000000073aeaabc > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201592.249970:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000052c389b6 00000080:00200000:0.0:1788201592.249971:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:0.0:1788201592.249975:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 5, from 0, to 1885 prio 0 00000008:00010000:0.0:1788201592.250001:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000ac85aa45 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201592.250029:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d6db8, count 5, dirtied 5 00000080:00200000:0.0:1788201592.250036:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 5 pages 18269 bytes, tot: 18269 00000080:00200000:0.0:1788201592.250039:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) mmp.sh: write bytes 0, result: 18269 00000020:00010000:0.0:1788201592.250057:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1498445d8 (ffff8bc146919a28/0) at cl_lock_release():245 00000020:00010000:0.0:1788201592.250062:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1498445d8 (ffff8bc146919a28/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201592.250066:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1724566b0 (ffff8bc146919878/1) at cl_lock_cancel():142 00010000:00010000:0.0:1788201592.250072:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.250084:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1788201592.250105:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1498445d8 (ffff8bc146919a28/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201592.250109:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1724566b0 (ffff8bc146919a28/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201592.250118:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 18269 bytes 00000080:00200000:0.0:1788201592.250127:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 4] 00000080:00200000:0.0:1788201592.251048:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x170:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201592.251058:0:24470:0:(file.c:2238:ll_file_io_generic()) mmp.sh: 2 io complete with rc: 0, result: 18269, restart: 0 00000080:00200000:0.0:1788201592.251072:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x170:0x0] updating i_size 18269 i_blocks 1 00000080:00200000:0.0:1788201592.251081:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 18269 00000080:00200008:0.0:1788201592.251410:0:24470:0:(file.c:479:ll_file_release()) START file mmp.sh:[0x200000bd7:0x170:0x0](ffff8bc1459d6c08), flags 100001 00000002:00100000:0.0:1788201592.251489:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1724a1880 x1875064727965184/t8589937378(8589937378) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/664 e 0 to 0 dl 1788201608 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1788201592.251504:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1788201592.251511:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14415b100 x1875064727965824/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1788201592.251539:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727965824:192.168.201.143@tcp:35:cp.0 00000100:00100000:0.0:1788201592.251695:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201592.257353:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727965824:192.168.201.143@tcp:35:cp.0 00000002:00100000:3.0:1788201592.257410:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1724a1880 x1875064727965184/t8589937378(8589937378) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/664 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201592.257507:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201592.257531:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201592.257556:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 87 lru_type: 1 00010000:00010000:3.0:1788201592.257640:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 87 lru_type: 1 00000080:00200000:3.0:1788201592.257658:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201592.257665:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201592.257739:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201592.257750:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201592.257755:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 87 lru_type: 1 00010000:00010000:3.0:1788201592.257767:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 88 lru_type: 1 00000080:00200000:3.0:1788201592.257788:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201592.257868:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201592.257876:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201592.257880:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=mmp.sh, flags=8 00000080:00200008:3.0:1788201592.257888:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file mmp.sh:[0x200000bd7:0x170:0x0](ffff8bc1459d6c08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201592.257893:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x170:0x0](ffff8bc1459d6c08),name=mmp.sh 00000002:00010000:3.0:1788201592.257907:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x170:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201592.257916:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097233 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201592.257925:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097233 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201592.257932:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201592.257936:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x170:0x0](ffff8bc1459d6c08) 00000080:00010000:3.0:1788201592.257938:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x170:0x0](ffff8bc1459d6c08) for lock 0xd138388016f6f1d6 00000080:00010000:3.0:1788201592.257943:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f1d6 from it ffffadd1c7debcb8 00010000:00010000:3.0:1788201592.257945:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097233 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201592.257953:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097233 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201592.258006:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x170:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201592.258017:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x170:0x0] 00000008:00010000:3.0:1788201592.258056:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201592.258061:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149fec5b0, osc lock ffff8bc14691b560, flags 0x400001002 00010000:00010000:3.0:1788201592.258081:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.258094:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:3.0:1788201592.258110:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1788201592.258114:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.258122:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1788201592.258133:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1788201592.258145:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x170:0x0] updating i_size 18269 i_blocks 1 00000020:00010000:3.0:1788201592.258149:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc4250 (ffff8bc1460e9cf8/0) at cl_lock_release():245 00000020:00010000:3.0:1788201592.258152:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc4250 (ffff8bc1460e9cf8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201592.258156:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149fec5b0 (ffff8bc1460e9ab8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201592.258160:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc4250 (ffff8bc1460e9cf8/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201592.258163:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149fec5b0 (ffff8bc1460e9cf8/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201592.258208:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x170:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201592.258270:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201592.258279:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201592.258286:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 88 lru_type: 1 00010000:00010000:3.0:1788201592.258295:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 88 lru_type: 1 00000080:00200000:3.0:1788201592.258302:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201592.258307:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201592.258310:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201592.258314:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201592.258318:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 88 lru_type: 1 00010000:00010000:3.0:1788201592.258326:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 89 lru_type: 1 00000080:00200000:3.0:1788201592.258334:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201592.258339:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201592.258343:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201592.258358:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=obdfilter-survey.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:3.0:1788201592.258362:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=obdfilter-survey.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:3.0:1788201592.258372:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: obdfilter-survey.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201592.258439:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f1eb lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.258448:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f1eb lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.258461:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f1eb lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201592.258490:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2d80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727965952:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201592.258597:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201592.261889:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a2d80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727965952:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201592.261918:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f1eb lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.261935:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f1eb lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.261943:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f1eb lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.261952:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f1eb lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.261963:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f1eb lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.261975:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1725a0c00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201592.261981:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f1eb lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.261989:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f1eb lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.261999:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f1eb lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.262005:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201592.262012:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f1eb lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.262018:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f1eb lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201592.262043:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a2d80 x1875064727965952/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201592.262062:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201592.262160:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201592.262247:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201592.262267:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201592.262279:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 89 lru_type: 1 00010000:00010000:0.0:1788201592.262292:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 89 lru_type: 1 00000080:00200000:0.0:1788201592.262304:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201592.262310:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201592.262314:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201592.262321:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201592.262325:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 89 lru_type: 1 00010000:00010000:0.0:1788201592.262335:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 90 lru_type: 1 00000080:00200000:0.0:1788201592.262354:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201592.262365:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201592.262373:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201592.262401:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=obdfilter-survey.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:0.0:1788201592.262406:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=obdfilter-survey.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201592.262423:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: obdfilter-survey.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201592.262474:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f1f2 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.262482:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f1f2 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.262493:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f1f2 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201592.262520:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144158a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727966080:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201592.263104:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201592.267716:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144158a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727966080:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201592.267747:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f1f2 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.267763:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f1f2 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.267771:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f1f2 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.267778:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f1f2 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.267824:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f1f2 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.267832:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc143a49600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201592.267837:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f1f2 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.267849:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f1f2 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.267857:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f1f2 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.267866:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201592.267875:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f1f2 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.267881:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f1f2 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201592.267904:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc144158a80 x1875064727966080/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201592.267922:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201592.267953:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:3.0:1788201592.268089:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201592.268120:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201592.268132:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 90 lru_type: 1 00010000:00010000:3.0:1788201592.268145:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 90 lru_type: 1 00000080:00200000:3.0:1788201592.268152:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201592.268160:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201592.268164:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201592.268170:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:3.0:1788201592.268425:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 90 lru_type: 1 00010000:00010000:3.0:1788201592.268437:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 91 lru_type: 1 00000080:00200000:3.0:1788201592.268457:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201592.268468:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201592.269036:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.269061:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201592.269066:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=obdfilter-survey.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc146420180, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:1.0:1788201592.269076:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=obdfilter-survey.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:1.0:1788201592.269167:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: obdfilter-survey.sh,[0x200000bd7:0x171:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201592.269311:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.269321:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201592.269336:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201592.269350:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14416c000 x1875064727966336/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201592.269362:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.269388:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416c000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727966336:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.269696:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201592.276282:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416c000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727966336:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201592.276327:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109728e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.276361:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x171:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109728e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.276371:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109728e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.276386:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109728e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.276411:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109728e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.276431:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109728e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.276441:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109728e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.276449:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109728e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201592.276465:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc14416c000 x1875064727966336/t8589937380(8589937380) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201592.276481:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14416c000 x1875064727966336/t8589937380(8589937380) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201592.276499:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109728e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1788201592.276516:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109728e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.276529:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/369 (0 0) 00000080:00200000:0.0:1788201592.276538:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201592.276556:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=obdfilter-survey.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:0.0:1788201592.276655:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x171:0x0](ffff8bc1446842c8) 00000080:00200000:0.0:1788201592.276911:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x171:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1788201592.276923:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x171:0x0](ffff8bc1446842c8) 00000080:00010000:0.0:1788201592.276927:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x171:0x0](ffff8bc1446842c8) for lock 0xd138388016f6f1f9 00000080:00010000:0.0:1788201592.276939:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x171:0x0](ffff8bc1446842c8) 00000080:00200008:0.0:1788201592.276961:0:24470:0:(file.c:1090:ll_file_open()) START file obdfilter-survey.sh:[0x200000bd7:0x171:0x0](ffff8bc1446842c8), flags 100301 00000002:00100000:0.0:1788201592.276984:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14416c000 x1875064727966336/t8589937380(8589937380) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1788201592.277035:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f1f9 from it ffff8bc144cb5000 00010000:00010000:0.0:1788201592.277042:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109728e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.277053:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109728e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201592.277081:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x171:0x0](ffff8bc1446842c8), inode mode 81a4 mask 40 00000080:00200008:0.0:1788201592.277427:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file obdfilter-survey.sh:[0x200000bd7:0x171:0x0](ffff8bc1446842c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201592.277436:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x171:0x0](ffff8bc1446842c8),name=obdfilter-survey.sh 00000002:00010000:0.0:1788201592.277459:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x171:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201592.277472:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109728e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.277485:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109728e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201592.277493:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201592.277500:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x171:0x0](ffff8bc1446842c8) 00000080:00010000:0.0:1788201592.277503:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x171:0x0](ffff8bc1446842c8) for lock 0xd138388016f6f1f9 00000080:00010000:0.0:1788201592.277508:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f1f9 from it ffffadd1c7debcd8 00010000:00010000:0.0:1788201592.277511:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109728e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.277520:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109728e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201592.277551:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x171:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201592.277561:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x171:0x0] 00000008:00010000:0.0:1788201592.277735:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201592.277740:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456b30, osc lock ffff8bc145d344c0, flags 0x400001002 00010000:00010000:0.0:1788201592.277892:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f200 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.277905:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f200 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.277989:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000020:00200000:0.0:1788201592.278064:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1788201592.278255:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727966464:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201592.281530:0:10055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f200 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.281634:0:10055:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f200 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109729c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.281656:0:10055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f200 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109729c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.281744:0:10055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f200 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109729c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201592.281763:0:10055:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f200 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109729c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201592.281776:0:10055:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201592.281880:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f200 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109729c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.281891:0:10055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f200 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109729c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.281901:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f200 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109729c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.281912:0:10055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f200 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e217109729c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201592.281938:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727966464:192.168.201.143@tcp:101:cp.0 00000080:00200000:1.0:1788201592.282048:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x171:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201592.282055:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449db530 (ffff8bc1499c4bd8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201592.282059:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449db530 (ffff8bc1499c4bd8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.282065:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456b30 (ffff8bc1499c4f38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.282070:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449db530 (ffff8bc1499c4bd8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201592.282073:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456b30 (ffff8bc1499c4bd8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201592.282238:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x171:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201592.282323:0:24470:0:(file.c:2638:do_file_write_iter()) START file obdfilter-survey.sh:[0x200000bd7:0x171:0x0], ppos: 0, count: 4218 00000080:00200000:1.0:1788201592.282367:0:24470:0:(file.c:2090:ll_file_io_generic()) obdfilter-survey.sh: write ppos: 0, bytes: 4218 00000080:00200000:1.0:1788201592.282375:0:24470:0:(file.c:1848:ll_io_set_mirror()) obdfilter-survey.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201592.282382:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@000000008f48d104[0x110, 1, [0x200000bd7:0x171:0x0] hash] 00000020:00200000:1.0:1788201592.282385:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4218) 0 0 00000080:00200000:1.0:1788201592.282399:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x171:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201592.282414:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 1] 00020000:00200000:1.0:1788201592.282423:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4218) 4218, 4218 00020000:00200000:1.0:1788201592.282427:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201592.282465:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 1] 00000008:00010000:1.0:1788201592.282481:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201592.282487:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4930, osc lock ffff8bc145d09430, flags 0x0 00010000:00010000:1.0:1788201592.282506:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/427 (0 8191) 00010000:00010000:1.0:1788201592.282556:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.282645:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.282665:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.282768:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416e300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727966592:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.282950:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201592.285935:0:20876:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788201592.285956:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743476352 00000100:00100000:0.0:1788201592.285966:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743476352 00000100:00100000:0.0:1788201592.286057:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 729 00000100:00100000:0.0:1788201592.286068:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc150473450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23415:x1875064743476352:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201592.286103:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f200 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109729c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.286444:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201592.286452:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc150473450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23415:x1875064743476352:12345-192.168.201.143@tcp:104: Request processed in 386us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.286460:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 729 00010000:00010000:3.0:1788201592.286820:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201592.286831:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f200 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109729c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.286844:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc143a48800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201592.286852:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f200 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e217109729c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201592.286916:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x171:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201592.286932:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x171:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201592.287018:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f200 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109729c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.287026:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201592.287069:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f200 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109729c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.287078:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f200 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109729c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.287100:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201592.287102:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201592.287103:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201592.287113:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201592.287131:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727966720:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201592.290685:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416e300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727966592:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.290729:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710972a3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.290747:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710972a3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.290758:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710972a3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.291590:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:1.0:1788201592.295640:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710972a3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.295656:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710972a3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.295677:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710972a3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201592.295697:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e21710972a3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.295710:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710972a3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.295719:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710972a3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201592.295760:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) obdfilter-survey.sh: write [0, 4218) append 0 append lockpos 0 00000080:00200000:1.0:1788201592.295785:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:1.0:1788201592.298456:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:1.0:1788201592.298614:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005c9045c5[3 00000000ae8910ef 2 1 000000008c1ba057 0 0 0] 00000080:00200000:1.0:1788201592.298618:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000006eb8b8f 17ffffc0001001 3:0 ffff8bc148ec7540 0 lru 00000080:00200000:1.0:1788201592.298626:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003e33245c 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 000000000f9fd83d > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201592.298628:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005c9045c5 00000080:00200000:1.0:1788201592.298630:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201592.298636:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 122 bytes 00000080:00200000:1.0:1788201592.298675:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 122, copied 122 00000080:00200000:1.0:1788201592.298680:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008becb5d3[3 00000000ae8910ef 2 1 000000008c1ba057 0 0 1] 00000080:00200000:1.0:1788201592.298684:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007c3043bb 17ffffc0001001 3:0 ffff8bc148ec7a80 1 lru 00000080:00200000:1.0:1788201592.298690:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007843c147 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 000000000f9fd83d > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201592.298692:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008becb5d3 00000080:00200000:1.0:1788201592.298694:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:1.0:1788201592.298699:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 2, from 0, to 122 prio 0 00000008:00010000:1.0:1788201592.298728:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 000000003886946a ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710972a3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201592.298765:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc144684478, count 2, dirtied 2 00000080:00200000:1.0:1788201592.298771:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 2 pages 4218 bytes, tot: 4218 00000080:00200000:1.0:1788201592.298775:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) obdfilter-survey.sh: write bytes 0, result: 4218 00000020:00010000:1.0:1788201592.298811:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c4b78 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201592.298816:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c4b78 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.298819:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4930 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201592.298828:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710972a3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.298933:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710972a3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201592.298953:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c4b78 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201592.298956:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4930 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201592.298966:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 4218 bytes 00000080:00200000:1.0:1788201592.298974:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 1] 00000080:00200000:1.0:1788201592.299012:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x171:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201592.299016:0:24470:0:(file.c:2238:ll_file_io_generic()) obdfilter-survey.sh: 2 io complete with rc: 0, result: 4218, restart: 0 00000080:00200000:1.0:1788201592.299024:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x171:0x0] updating i_size 4218 i_blocks 1 00000080:00200000:1.0:1788201592.299030:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 4218 00000080:00200008:1.0:1788201592.299086:0:24470:0:(file.c:479:ll_file_release()) START file obdfilter-survey.sh:[0x200000bd7:0x171:0x0](ffff8bc1446842c8), flags 100001 00000002:00100000:1.0:1788201592.299258:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc14416c000 x1875064727966336/t8589937380(8589937380) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201608 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201592.299273:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201592.299343:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14416e300 x1875064727966976/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201592.299379:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416e300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727966976:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201592.299684:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.302755:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416e300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727966976:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201592.302822:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc14416c000 x1875064727966336/t8589937380(8589937380) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201592.302916:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.302936:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.302955:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 91 lru_type: 1 00010000:00010000:1.0:1788201592.302969:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 91 lru_type: 1 00000080:00200000:1.0:1788201592.302975:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.302980:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.302983:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.302991:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201592.302994:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 91 lru_type: 1 00010000:00010000:1.0:1788201592.303002:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 92 lru_type: 1 00000080:00200000:1.0:1788201592.303016:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.303022:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201592.303028:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.303031:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=obdfilter-survey.sh, flags=8 00000080:00200008:1.0:1788201592.303039:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file obdfilter-survey.sh:[0x200000bd7:0x171:0x0](ffff8bc1446842c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201592.303043:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x171:0x0](ffff8bc1446842c8),name=obdfilter-survey.sh 00000002:00010000:1.0:1788201592.303053:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x171:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.303058:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109728e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201592.303064:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109728e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201592.303068:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.303070:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x171:0x0](ffff8bc1446842c8) 00000080:00010000:1.0:1788201592.303071:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x171:0x0](ffff8bc1446842c8) for lock 0xd138388016f6f1f9 00000080:00010000:1.0:1788201592.303073:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f1f9 from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201592.303075:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109728e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201592.303079:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109728e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201592.303127:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x171:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201592.303136:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x171:0x0] 00000008:00010000:1.0:1788201592.303236:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201592.303242:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4930, osc lock ffff8bc145d09430, flags 0x400001002 00010000:00010000:1.0:1788201592.303260:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710972a3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.303274:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710972a3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201592.303293:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201592.303297:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710972a3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.303303:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710972a3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201592.303310:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201592.303319:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x171:0x0] updating i_size 4218 i_blocks 1 00000020:00010000:1.0:1788201592.303321:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e246f0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201592.303323:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e246f0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.303325:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4930 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.303329:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e246f0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201592.303331:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4930 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201592.303359:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x171:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201592.303424:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.303434:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.303441:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 92 lru_type: 1 00010000:00010000:1.0:1788201592.303449:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 92 lru_type: 1 00000080:00200000:1.0:1788201592.303462:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.303723:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.303727:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.303732:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201592.303736:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 92 lru_type: 1 00010000:00010000:1.0:1788201592.303745:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 93 lru_type: 1 00000080:00200000:1.0:1788201592.303755:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.303761:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201592.303765:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.303782:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=oos2.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201592.303787:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=oos2.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201592.303905:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: oos2.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201592.303967:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f20e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.303976:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f20e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.303988:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f20e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.304015:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416f800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727967104:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.304101:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.310478:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416f800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727967104:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.310514:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f20e lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.310656:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f20e lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.310664:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f20e lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.310672:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f20e lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.310683:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f20e lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.310690:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bc400 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201592.310696:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f20e lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.310704:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f20e lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.310713:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f20e lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.310722:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201592.310729:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f20e lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.310735:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f20e lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201592.310764:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14416f800 x1875064727967104/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201592.310784:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201592.310842:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201592.310923:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.310943:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.310955:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 93 lru_type: 1 00010000:00010000:1.0:1788201592.310970:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 93 lru_type: 1 00000080:00200000:1.0:1788201592.310978:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.310985:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.310989:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.310995:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201592.311000:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 93 lru_type: 1 00010000:00010000:1.0:1788201592.311009:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 94 lru_type: 1 00000080:00200000:1.0:1788201592.311026:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.311035:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201592.311042:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.311059:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=oos2.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:1.0:1788201592.311065:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=oos2.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201592.311080:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: oos2.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201592.311421:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f215 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.311430:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f215 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.311442:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f215 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.311469:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416f800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727967232:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.311911:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.314646:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416f800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727967232:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.314678:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f215 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.314694:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f215 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.314701:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f215 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.314710:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f215 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.314720:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f215 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.314726:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1427ddc00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201592.314733:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f215 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.314741:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f215 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.314750:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f215 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.314758:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201592.314765:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f215 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.314773:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f215 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201592.314836:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14416f800 x1875064727967232/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201592.314855:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201592.314884:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201592.315730:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.315756:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.315771:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 94 lru_type: 1 00010000:00010000:1.0:1788201592.315787:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 94 lru_type: 1 00000080:00200000:1.0:1788201592.316000:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.316008:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.316013:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.316022:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:1.0:1788201592.316026:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 94 lru_type: 1 00010000:00010000:1.0:1788201592.316036:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 95 lru_type: 1 00000080:00200000:1.0:1788201592.316054:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.316063:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201592.316070:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.316090:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201592.316095:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=oos2.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14304b200, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:1.0:1788201592.316105:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=oos2.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:1.0:1788201592.316130:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: oos2.sh,[0x200000bd7:0x172:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201592.316207:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6f21c lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.316216:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6f21c lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201592.316231:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201592.316244:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14416f800 x1875064727967488/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201592.316254:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6f21c lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.316290:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416f800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727967488:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.316453:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.325062:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416f800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727967488:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.325635:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6f21c lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710972e9 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.325680:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6f21c lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x172:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710972e9 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.325691:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6f21c lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710972e9 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.325704:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6f21c lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710972e9 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.325719:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6f21c lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710972e9 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.325736:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6f21c lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710972e9 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.325745:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6f21c lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710972e9 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.325754:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6f21c lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710972e9 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201592.325769:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc14416f800 x1875064727967488/t8589937382(8589937382) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201592.325786:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14416f800 x1875064727967488/t8589937382(8589937382) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201592.325839:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6f21c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710972e9 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201592.325856:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6f21c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710972e9 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.325868:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/370 (0 0) 00000080:00200000:1.0:1788201592.325877:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201592.325895:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=oos2.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:1.0:1788201592.325933:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x172:0x0](ffff8bc1446ba1c8) 00000080:00200000:1.0:1788201592.326082:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x172:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201592.326360:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x172:0x0](ffff8bc1446ba1c8) 00000080:00010000:1.0:1788201592.326365:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x172:0x0](ffff8bc1446ba1c8) for lock 0xd138388016f6f21c 00000080:00010000:1.0:1788201592.326378:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x172:0x0](ffff8bc1446ba1c8) 00000080:00200008:1.0:1788201592.326408:0:24470:0:(file.c:1090:ll_file_open()) START file oos2.sh:[0x200000bd7:0x172:0x0](ffff8bc1446ba1c8), flags 100301 00000002:00100000:1.0:1788201592.326432:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14416f800 x1875064727967488/t8589937382(8589937382) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201592.326485:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f21c from it ffff8bc144cb5ba0 00010000:00010000:1.0:1788201592.326492:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6f21c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710972e9 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.326505:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6f21c lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710972e9 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201592.326540:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x172:0x0](ffff8bc1446ba1c8), inode mode 81a4 mask 40 00000080:00200008:1.0:1788201592.326575:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file oos2.sh:[0x200000bd7:0x172:0x0](ffff8bc1446ba1c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201592.326582:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x172:0x0](ffff8bc1446ba1c8),name=oos2.sh 00000002:00010000:1.0:1788201592.326602:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x172:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.326613:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6f21c lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710972e9 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.326625:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6f21c lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710972e9 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201592.326632:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.326637:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x172:0x0](ffff8bc1446ba1c8) 00000080:00010000:1.0:1788201592.326641:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x172:0x0](ffff8bc1446ba1c8) for lock 0xd138388016f6f21c 00000080:00010000:1.0:1788201592.326645:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f21c from it ffffadd1c7debcd8 00010000:00010000:1.0:1788201592.326648:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6f21c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710972e9 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.326656:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6f21c lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710972e9 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201592.326843:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x172:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201592.326855:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x172:0x0] 00000008:00010000:1.0:1788201592.326890:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201592.326894:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4eb0, osc lock ffff8bc145d09430, flags 0x400001002 00010000:00010000:1.0:1788201592.326953:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e6ecbdb1/0xd138388016f6f223 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.326970:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e6ecbdb1/0xd138388016f6f223 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201592.327023:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1788201592.330435:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e6ecbdb1/0xd138388016f6f223 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.330473:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e6ecbdb1/0xd138388016f6f223 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710972f7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.330488:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e6ecbdb1/0xd138388016f6f223 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710972f7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.330501:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e6ecbdb1/0xd138388016f6f223 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710972f7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201592.330515:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e6ecbdb1/0xd138388016f6f223 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710972f7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201592.330532:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201592.330543:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e6ecbdb1/0xd138388016f6f223 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710972f7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.330558:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e6ecbdb1/0xd138388016f6f223 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710972f7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.330567:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e6ecbdb1/0xd138388016f6f223 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710972f7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.330578:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e6ecbdb1/0xd138388016f6f223 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e21710972f7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201592.330602:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727967616:192.168.201.143@tcp:101:cp.0 00000080:00200000:1.0:1788201592.330654:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x172:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201592.330662:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e246f0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201592.330665:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e246f0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.330739:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4eb0 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.330744:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e246f0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201592.330747:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4eb0 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201592.330912:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x172:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1788201592.334688:0:24470:0:(file.c:2638:do_file_write_iter()) START file oos2.sh:[0x200000bd7:0x172:0x0], ppos: 0, count: 3006 00000080:00200000:0.0:1788201592.334726:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 3006 bytes 00000080:00200000:0.0:1788201592.334733:0:24470:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 3006 00000080:00200000:0.0:1788201592.334783:0:24470:0:(file.c:2090:ll_file_io_generic()) oos2.sh: write ppos: 0, bytes: 3006 00000080:00200000:0.0:1788201592.334816:0:24470:0:(file.c:1848:ll_io_set_mirror()) oos2.sh: desiginated mirror: 0 00000020:00200000:0.0:1788201592.334826:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000a874fd52[0x110, 1, [0x200000bd7:0x172:0x0] hash] 00000020:00200000:0.0:1788201592.334829:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 3006) 0 0 00000080:00200000:0.0:1788201592.334942:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x172:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201592.334961:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1788201592.334970:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 3006) 3006, 3006 00020000:00200000:0.0:1788201592.334976:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201592.335019:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:0.0:1788201592.335038:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1788201592.335046:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456f30, osc lock ffff8bc145d35300, flags 0x0 00010000:00010000:0.0:1788201592.335070:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/427 (0 4095) 00010000:00010000:0.0:1788201592.335213:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fd829a5f/0xd138388016f6f22a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ab:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.335227:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fd829a5f/0xd138388016f6f22a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ab:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.335241:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fd829a5f/0xd138388016f6f22a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ab:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201592.335276:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144158700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727967744:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201592.337157:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.341889:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:1.0:1788201592.343962:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201592.343972:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e6ecbdb1/0xd138388016f6f223 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710972f7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.343981:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3da00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201592.343989:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e6ecbdb1/0xd138388016f6f223 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e21710972f7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201592.344054:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x172:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201592.344069:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x172:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201592.344153:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e6ecbdb1/0xd138388016f6f223 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710972f7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.344167:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201592.344212:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e6ecbdb1/0xd138388016f6f223 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710972f7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.344221:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e6ecbdb1/0xd138388016f6f223 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710972f7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.344240:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201592.344242:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201592.344244:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201592.345961:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727967872:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201592.352852:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201592.352873:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144158700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727967744:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201592.352914:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fd829a5f/0xd138388016f6f22a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710972fe expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.352933:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fd829a5f/0xd138388016f6f22a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710972fe expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.352944:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fd829a5f/0xd138388016f6f22a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710972fe expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201592.353019:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743476736 00000100:00100000:3.0:1788201592.353029:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743476736 00000100:00100000:0.0:1788201592.353187:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 732 00000100:00100000:0.0:1788201592.353202:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14416f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743476736:12345-192.168.201.143@tcp:105: 00010000:00010000:0.0:1788201592.353215:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fd829a5f/0xd138388016f6f22a lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710972fe expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.353226:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fd829a5f/0xd138388016f6f22a lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710972fe expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.353236:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fd829a5f/0xd138388016f6f22a lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710972fe expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.353248:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fd829a5f/0xd138388016f6f22a lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710972fe expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.353258:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fd829a5f/0xd138388016f6f22a lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710972fe expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.353269:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fd829a5f/0xd138388016f6f22a lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e21710972fe expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.353309:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc143a49200) 00000100:00100000:0.0:1788201592.353387:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14416f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743476736:12345-192.168.201.143@tcp:105: Request processed in 188us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.353406:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 732 00000100:00100000:3.0:1788201592.356893:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727967872:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201592.370757:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201592.371019:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201592.371041:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201592.371055:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 98 lru_type: 1 00010000:00010000:0.0:1788201592.371071:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 98 lru_type: 1 00000080:00200000:0.0:1788201592.371078:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201592.371085:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201592.371088:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201592.371361:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:0.0:1788201592.371366:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 98 lru_type: 1 00010000:00010000:0.0:1788201592.371376:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 99 lru_type: 1 00000080:00200000:0.0:1788201592.371407:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201592.371416:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201592.371423:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201592.371443:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201592.371448:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=oos.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc152c97e00, open_flags 80c1, mode 81ed opened 0 00000080:00200000:0.0:1788201592.371456:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=oos.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:0.0:1788201592.371480:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: oos.sh,[0x200000bd7:0x173:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:0.0:1788201592.371545:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48c00/0xd138388016f6f23f lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.371553:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48c00/0xd138388016f6f23f lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1788201592.371768:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1788201592.371782:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14415aa00 x1875064727968640/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1788201592.373788:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48c00/0xd138388016f6f23f lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201592.373851:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727968640:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201592.374038:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201592.381521:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727968768:192.168.201.143@tcp:101:cp.0 00000080:00200000:3.0:1788201592.389682:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x173:0x0] updating i_size 0 i_blocks 1 00000020:00010000:3.0:1788201592.389690:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460054d0 (ffff8bc146919b48/0) at cl_lock_release():245 00000020:00010000:3.0:1788201592.389694:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460054d0 (ffff8bc146919b48/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201592.389699:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261dcb0 (ffff8bc146919488/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201592.389703:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460054d0 (ffff8bc146919b48/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201592.389706:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261dcb0 (ffff8bc146919b48/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201592.389750:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x173:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201592.390083:0:24470:0:(file.c:2638:do_file_write_iter()) START file oos.sh:[0x200000bd7:0x173:0x0], ppos: 0, count: 2192 00000080:00200000:1.0:1788201592.390105:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 2192 bytes 00000080:00200000:1.0:1788201592.390112:0:24470:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 2192 00000080:00200000:1.0:1788201592.390153:0:24470:0:(file.c:2090:ll_file_io_generic()) oos.sh: write ppos: 0, bytes: 2192 00000080:00200000:1.0:1788201592.390162:0:24470:0:(file.c:1848:ll_io_set_mirror()) oos.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201592.390169:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@0000000041abb8c9[0x110, 1, [0x200000bd7:0x173:0x0] hash] 00000020:00200000:1.0:1788201592.390181:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 2192) 0 0 00000080:00200000:1.0:1788201592.390186:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x173:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201592.390201:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1788201592.390211:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 2192) 2192, 2192 00020000:00200000:1.0:1788201592.390215:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201592.390252:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1788201592.390267:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201592.390274:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4eb0, osc lock ffff8bc145d09430, flags 0x0 00010000:00010000:1.0:1788201592.390294:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/428 (0 4095) 00010000:00010000:1.0:1788201592.390352:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.390367:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.390379:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.390420:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416ed80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727968896:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.390518:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.393411:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743476864 00000100:00100000:1.0:1788201592.393427:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743476864 00000100:00100000:1.0:1788201592.393539:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 733 00000100:00100000:1.0:1788201592.393553:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172759500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23411:x1875064743476864:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201592.393586:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001c580987/0xd138388016f6f246 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097352 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.394733:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201592.394748:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172759500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23411:x1875064743476864:12345-192.168.201.143@tcp:104: Request processed in 1195us (1593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201592.394760:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 733 00000100:00100000:0.0:1788201592.400284:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416ed80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727968896:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201592.400327:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.400345:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.400356:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201592.402601:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201592.402810:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743476992 00000100:00100000:3.0:1788201592.402824:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743476992 00000100:00100000:3.0:1788201592.402892:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 734 00000100:00100000:3.0:1788201592.402904:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14415b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21004:x1875064743476992:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201592.402925:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.402941:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.402951:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.402962:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.402972:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.402982:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.403017:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc149f3de00) 00000100:00100000:3.0:1788201592.403093:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14415b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21004:x1875064743476992:12345-192.168.201.143@tcp:105: Request processed in 192us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201592.403102:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 734 00010000:00010000:1.0:1788201592.403831:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.403848:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.403868:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201592.403884:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.403899:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.403908:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201592.403945:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) oos.sh: write [0, 2192) append 0 append lockpos 0 00000080:00200000:1.0:1788201592.403970:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 2192 bytes 00000080:00200000:1.0:1788201592.404049:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 2192, copied 2192 00000080:00200000:1.0:1788201592.404062:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000fd3aef35[3 000000008f13edac 2 1 000000008c1ba057 0 0 0] 00000080:00200000:1.0:1788201592.404066:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000bb319ee9 17ffffc0001001 3:0 ffff8bc148ec7c40 0 lru 00000080:00200000:1.0:1788201592.404074:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008d702853 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 00000000bc9fe6ea > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201592.404077:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000fd3aef35 00000080:00200000:1.0:1788201592.404078:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201592.404083:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 2192 prio 0 00000008:00010000:1.0:1788201592.404111:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000e5953ede ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201592.404134:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459f54f8, count 1, dirtied 1 00000080:00200000:1.0:1788201592.404140:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 2192 bytes, tot: 2192 00000080:00200000:1.0:1788201592.404246:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) oos.sh: write bytes 0, result: 2192 00000020:00010000:1.0:1788201592.404268:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c4b78 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201592.404272:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c4b78 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.404276:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4eb0 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201592.404283:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.404294:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201592.404315:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c4b78 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201592.404319:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4eb0 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201592.404329:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 2192 bytes 00000080:00200000:1.0:1788201592.404337:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1788201592.404373:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x173:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201592.404378:0:24470:0:(file.c:2238:ll_file_io_generic()) oos.sh: 2 io complete with rc: 0, result: 2192, restart: 0 00000080:00200000:1.0:1788201592.404386:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x173:0x0] updating i_size 2192 i_blocks 1 00000080:00200000:1.0:1788201592.404405:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 2192 00000080:00200008:1.0:1788201592.404460:0:24470:0:(file.c:479:ll_file_release()) START file oos.sh:[0x200000bd7:0x173:0x0](ffff8bc1459f5348), flags 100001 00000002:00100000:1.0:1788201592.404524:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc14415aa00 x1875064727968640/t8589937384(8589937384) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/664 e 0 to 0 dl 1788201608 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201592.404538:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201592.404545:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14416ed80 x1875064727969280/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201592.405063:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416ed80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727969280:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201592.405153:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.409775:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416ed80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727969280:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201592.409935:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc14415aa00 x1875064727968640/t8589937384(8589937384) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/664 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201592.410033:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.410059:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.410082:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 99 lru_type: 1 00010000:00010000:1.0:1788201592.410098:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 99 lru_type: 1 00000080:00200000:1.0:1788201592.410108:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.410115:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.410119:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.410127:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201592.410132:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 99 lru_type: 1 00010000:00010000:1.0:1788201592.410141:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 100 lru_type: 1 00000080:00200000:1.0:1788201592.410159:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.410168:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201592.410277:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.410284:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=oos.sh, flags=8 00000080:00200008:1.0:1788201592.410293:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file oos.sh:[0x200000bd7:0x173:0x0](ffff8bc1459f5348), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201592.410299:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x173:0x0](ffff8bc1459f5348),name=oos.sh 00000002:00010000:1.0:1788201592.410312:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x173:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.410322:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48c00/0xd138388016f6f23f lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x173:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097344 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201592.410333:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48c00/0xd138388016f6f23f lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x173:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097344 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201592.410340:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.410344:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x173:0x0](ffff8bc1459f5348) 00000080:00010000:1.0:1788201592.410346:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x173:0x0](ffff8bc1459f5348) for lock 0xd138388016f6f23f 00000080:00010000:1.0:1788201592.410352:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f23f from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201592.410355:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48c00/0xd138388016f6f23f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x173:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097344 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201592.410362:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48c00/0xd138388016f6f23f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x173:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097344 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201592.410435:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x173:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201592.410449:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x173:0x0] 00000008:00010000:1.0:1788201592.410483:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201592.410487:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4eb0, osc lock ffff8bc145d09430, flags 0x400001002 00010000:00010000:1.0:1788201592.410508:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.410521:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201592.410535:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201592.410539:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.410546:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201592.410562:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201592.410641:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x173:0x0] updating i_size 2192 i_blocks 1 00000020:00010000:1.0:1788201592.410647:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e246f0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201592.410651:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e246f0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.410654:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4eb0 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.410660:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e246f0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201592.410663:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4eb0 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201592.410770:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x173:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201592.410977:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.410987:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.410995:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 100 lru_type: 1 00010000:00010000:1.0:1788201592.411005:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 100 lru_type: 1 00000080:00200000:1.0:1788201592.411013:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.411017:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.411020:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.411024:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201592.411028:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 100 lru_type: 1 00010000:00010000:1.0:1788201592.411036:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 101 lru_type: 1 00000080:00200000:1.0:1788201592.411050:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.411055:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201592.411058:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.411074:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=ost_oos.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201592.411079:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=ost_oos.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201592.411089:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ost_oos.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201592.411147:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6f254 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.411156:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6f254 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.411168:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6f254 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.411210:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416ce00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727969408:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.411359:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.415278:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416ce00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727969408:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.415309:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6f254 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.415325:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6f254 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.415333:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6f254 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.415341:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6f254 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.415352:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6f254 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.415360:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3dc00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201592.415366:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6f254 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.415373:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6f254 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.415381:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6f254 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.415400:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201592.415408:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6f254 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.415415:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3dc00/0xd138388016f6f254 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201592.415439:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14416ce00 x1875064727969408/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201592.415456:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201592.415488:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201592.415739:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.415761:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.415772:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 101 lru_type: 1 00010000:00010000:1.0:1788201592.415826:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 101 lru_type: 1 00000080:00200000:1.0:1788201592.415835:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.415842:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.415846:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.415853:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201592.415857:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 101 lru_type: 1 00010000:00010000:1.0:1788201592.415868:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 102 lru_type: 1 00000080:00200000:1.0:1788201592.415886:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.415894:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201592.415901:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.415917:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=ost_oos.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:1.0:1788201592.415922:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=ost_oos.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201592.415935:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ost_oos.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201592.415984:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6f25b lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.415992:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6f25b lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.416004:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6f25b lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.416035:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416ce00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727969536:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.416123:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.424477:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416ce00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727969536:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.424512:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6f25b lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.424530:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6f25b lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.424538:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6f25b lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.424545:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6f25b lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.424556:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6f25b lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.424562:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3c000 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201592.424625:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6f25b lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.424634:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6f25b lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.424642:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6f25b lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.424650:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201592.424658:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6f25b lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.424726:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c000/0xd138388016f6f25b lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201592.424753:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14416ce00 x1875064727969536/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201592.424771:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201592.424874:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201592.425015:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.425034:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.425046:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 102 lru_type: 1 00010000:00010000:1.0:1788201592.425061:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 102 lru_type: 1 00000080:00200000:1.0:1788201592.425068:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.425074:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.425079:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.425085:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:1.0:1788201592.425089:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 102 lru_type: 1 00010000:00010000:1.0:1788201592.425098:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 103 lru_type: 1 00000080:00200000:1.0:1788201592.425117:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.425126:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201592.425133:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.425399:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201592.425407:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=ost_oos.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14304b200, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:1.0:1788201592.425417:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=ost_oos.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:1.0:1788201592.425443:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ost_oos.sh,[0x200000bd7:0x174:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201592.425506:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.425516:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201592.425530:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201592.425539:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14416ce00 x1875064727969792/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201592.425550:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.425645:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416ce00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727969792:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.426188:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.434656:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416ce00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727969792:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.434707:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109739f expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.434736:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x174:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109739f expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.434745:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109739f expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.434760:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109739f expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.434772:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109739f expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.434788:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109739f expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.434848:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109739f expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.434857:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109739f expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201592.434871:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc14416ce00 x1875064727969792/t8589937386(8589937386) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201592.434887:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14416ce00 x1875064727969792/t8589937386(8589937386) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201592.434904:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109739f expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201592.434919:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109739f expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.434932:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/372 (0 0) 00000080:00200000:1.0:1788201592.434941:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201592.434958:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=ost_oos.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:1.0:1788201592.435004:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x174:0x0](ffff8bc1446b9988) 00000080:00200000:1.0:1788201592.435511:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x174:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201592.435525:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x174:0x0](ffff8bc1446b9988) 00000080:00010000:1.0:1788201592.435529:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x174:0x0](ffff8bc1446b9988) for lock 0xd138388016f6f262 00000080:00010000:1.0:1788201592.435543:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x174:0x0](ffff8bc1446b9988) 00000080:00200008:1.0:1788201592.435561:0:24470:0:(file.c:1090:ll_file_open()) START file ost_oos.sh:[0x200000bd7:0x174:0x0](ffff8bc1446b9988), flags 100301 00000002:00100000:1.0:1788201592.435585:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14416ce00 x1875064727969792/t8589937386(8589937386) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201592.435638:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f262 from it ffff8bc144cb5ba0 00010000:00010000:1.0:1788201592.435644:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109739f expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.435655:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109739f expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201592.435883:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x174:0x0](ffff8bc1446b9988), inode mode 81a4 mask 40 00000080:00200008:1.0:1788201592.435915:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file ost_oos.sh:[0x200000bd7:0x174:0x0](ffff8bc1446b9988), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201592.435921:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x174:0x0](ffff8bc1446b9988),name=ost_oos.sh 00000002:00010000:1.0:1788201592.435942:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x174:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.435955:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109739f expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.435967:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109739f expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201592.435981:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.435986:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x174:0x0](ffff8bc1446b9988) 00000080:00010000:1.0:1788201592.435989:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x174:0x0](ffff8bc1446b9988) for lock 0xd138388016f6f262 00000080:00010000:1.0:1788201592.435994:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f262 from it ffffadd1c7debcd8 00010000:00010000:1.0:1788201592.435997:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109739f expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.436006:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109739f expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201592.436032:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x174:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201592.436041:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x174:0x0] 00000008:00010000:1.0:1788201592.436070:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201592.436073:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4630, osc lock ffff8bc145d09430, flags 0x400001002 00010000:00010000:1.0:1788201592.436513:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f269 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.436527:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f269 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201592.436608:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000020:00200000:1.0:1788201592.436688:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1788201592.437366:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727969920:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201592.442122:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f269 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.442167:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f269 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710973ad expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.442195:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f269 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710973ad expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.442209:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f269 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710973ad expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201592.442229:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f269 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710973ad expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201592.442243:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201592.442260:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f269 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710973ad expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.442270:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f269 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710973ad expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.442279:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f269 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710973ad expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.442290:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f269 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e21710973ad expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201592.442323:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727969920:192.168.201.143@tcp:101:cp.0 00000080:00200000:1.0:1788201592.442427:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x174:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201592.442435:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e246f0 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:1.0:1788201592.442438:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e246f0 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.442444:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4630 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.442449:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e246f0 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201592.442452:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4630 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201592.442499:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x174:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201592.442586:0:24470:0:(file.c:2638:do_file_write_iter()) START file ost_oos.sh:[0x200000bd7:0x174:0x0], ppos: 0, count: 938 00000080:00200000:1.0:1788201592.442607:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 938 bytes 00000080:00200000:1.0:1788201592.442615:0:24470:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 938 00000080:00200000:1.0:1788201592.442642:0:24470:0:(file.c:2090:ll_file_io_generic()) ost_oos.sh: write ppos: 0, bytes: 938 00000080:00200000:1.0:1788201592.442648:0:24470:0:(file.c:1848:ll_io_set_mirror()) ost_oos.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201592.442655:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@000000000b822dbc[0x110, 1, [0x200000bd7:0x174:0x0] hash] 00000020:00200000:1.0:1788201592.442658:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 938) 0 0 00000080:00200000:1.0:1788201592.442662:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x174:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201592.442689:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1788201592.442699:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 938) 938, 938 00020000:00200000:1.0:1788201592.442703:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201592.442736:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1788201592.442749:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201592.442755:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4630, osc lock ffff8bc145d09430, flags 0x0 00010000:00010000:1.0:1788201592.442774:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/428 (0 4095) 00010000:00010000:1.0:1788201592.442862:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.442872:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.442884:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.442909:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416c380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727970048:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201592.443594:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8180 going to sleep for 11 seconds 00000100:00100000:3.0:1788201592.447165:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201592.447810:0:20877:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788201592.447834:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743477120 00000100:00100000:1.0:1788201592.447845:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743477120 00000100:00100000:1.0:1788201592.447909:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 735 00000100:00100000:1.0:1788201592.447921:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17270e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21821:x1875064743477120:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201592.447947:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f269 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710973ad expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.448035:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201592.448043:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17270e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21821:x1875064743477120:12345-192.168.201.143@tcp:104: Request processed in 124us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201592.448051:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 735 00010000:00010000:3.0:1788201592.448348:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201592.448358:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f269 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710973ad expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.448380:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3c000 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201592.448395:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f269 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e21710973ad expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201592.448457:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x174:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201592.448471:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x174:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201592.448552:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f269 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710973ad expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.448560:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201592.448610:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f269 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710973ad expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.448619:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f269 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710973ad expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.448635:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201592.448637:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201592.448639:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201592.448649:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201592.448678:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727970176:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201592.457254:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201592.457382:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416c380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727970048:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201592.457437:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.457457:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.457468:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201592.458145:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743477248 00000100:00100000:3.0:1788201592.458156:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743477248 00000100:00100000:3.0:1788201592.458235:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 736 00000100:00100000:3.0:1788201592.458249:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14415b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23412:x1875064743477248:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201592.458267:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.458279:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.458290:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.458300:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.458310:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.458320:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.458345:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc149f3dc00) 00000100:00100000:3.0:1788201592.458437:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14415b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23412:x1875064743477248:12345-192.168.201.143@tcp:105: Request processed in 192us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201592.458445:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 736 00010000:00010000:0.0:1788201592.458675:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.458686:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.458703:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201592.458717:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.458737:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.458746:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201592.458779:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) ost_oos.sh: write [0, 938) append 0 append lockpos 0 00000080:00200000:0.0:1788201592.458846:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 938 bytes 00000080:00200000:0.0:1788201592.458917:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 938, copied 938 00000080:00200000:0.0:1788201592.458929:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004629e792[3 00000000b8b55647 2 1 000000008c1ba057 0 0 0] 00000080:00200000:0.0:1788201592.458933:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f097b555 17ffffc0001001 3:0 ffff8bc1727a69a0 0 lru 00000080:00200000:0.0:1788201592.458940:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000eb3be76a 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000a0243e1f > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201592.458942:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004629e792 00000080:00200000:0.0:1788201592.458944:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1788201592.458950:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 938 prio 0 00000008:00010000:0.0:1788201592.458974:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 000000003bb2c203 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201592.458996:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1446b9b38, count 1, dirtied 1 00000080:00200000:0.0:1788201592.459001:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 938 bytes, tot: 938 00000080:00200000:0.0:1788201592.459004:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) ost_oos.sh: write bytes 0, result: 938 00000020:00010000:0.0:1788201592.459024:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c4b78 (ffff8bc148e3b248/0) at cl_lock_release():245 00000020:00010000:0.0:1788201592.459028:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c4b78 (ffff8bc148e3b248/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201592.459031:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4630 (ffff8bc148e3bd88/1) at cl_lock_cancel():142 00010000:00010000:0.0:1788201592.459037:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.459053:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1788201592.459071:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c4b78 (ffff8bc148e3b248/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201592.459074:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4630 (ffff8bc148e3b248/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201592.459086:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 938 bytes 00000080:00200000:0.0:1788201592.459094:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1788201592.459132:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x174:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201592.459136:0:24470:0:(file.c:2238:ll_file_io_generic()) ost_oos.sh: 2 io complete with rc: 0, result: 938, restart: 0 00000080:00200000:0.0:1788201592.459145:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x174:0x0] updating i_size 938 i_blocks 1 00000080:00200000:0.0:1788201592.459152:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 938 00000080:00200008:0.0:1788201592.459216:0:24470:0:(file.c:479:ll_file_release()) START file ost_oos.sh:[0x200000bd7:0x174:0x0](ffff8bc1446b9988), flags 100001 00000002:00100000:0.0:1788201592.459290:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc14416ce00 x1875064727969792/t8589937386(8589937386) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201608 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1788201592.459304:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1788201592.459311:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144158380 x1875064727970432/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1788201592.459336:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144158380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727970432:192.168.201.143@tcp:35:cp.0 00000100:00100000:0.0:1788201592.459423:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201592.465600:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727970176:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201592.465976:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144158380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727970432:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201592.466013:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc14416ce00 x1875064727969792/t8589937386(8589937386) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201592.466110:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.466135:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.466160:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 103 lru_type: 1 00010000:00010000:1.0:1788201592.466246:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 103 lru_type: 1 00000080:00200000:1.0:1788201592.466257:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.466266:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.466270:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.466279:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201592.466284:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 103 lru_type: 1 00010000:00010000:1.0:1788201592.466294:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 104 lru_type: 1 00000080:00200000:1.0:1788201592.466313:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.466321:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201592.466328:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.466332:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=ost_oos.sh, flags=8 00000080:00200008:1.0:1788201592.466341:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file ost_oos.sh:[0x200000bd7:0x174:0x0](ffff8bc1446b9988), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201592.466347:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x174:0x0](ffff8bc1446b9988),name=ost_oos.sh 00000002:00010000:1.0:1788201592.466360:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x174:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.466369:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109739f expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201592.466378:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109739f expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201592.466384:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.466400:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x174:0x0](ffff8bc1446b9988) 00000080:00010000:1.0:1788201592.466403:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x174:0x0](ffff8bc1446b9988) for lock 0xd138388016f6f262 00000080:00010000:1.0:1788201592.466407:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f262 from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201592.466410:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109739f expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201592.466419:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109739f expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201592.466478:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x174:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201592.466491:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x174:0x0] 00000008:00010000:1.0:1788201592.466527:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201592.466533:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d49b0, osc lock ffff8bc145d08ab0, flags 0x400001002 00010000:00010000:1.0:1788201592.466554:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.466642:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201592.466658:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201592.466662:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.466745:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201592.466758:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201592.466769:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x174:0x0] updating i_size 938 i_blocks 1 00000020:00010000:1.0:1788201592.466774:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e25970 (ffff8bc148e3b128/0) at cl_lock_release():245 00000020:00010000:1.0:1788201592.466778:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e25970 (ffff8bc148e3b128/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.466781:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d49b0 (ffff8bc148e3be18/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.466786:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e25970 (ffff8bc148e3b128/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201592.466869:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d49b0 (ffff8bc148e3b128/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201592.466905:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x174:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201592.466976:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.466986:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.466994:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 104 lru_type: 1 00010000:00010000:1.0:1788201592.467004:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 104 lru_type: 1 00000080:00200000:1.0:1788201592.467013:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.467018:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.467020:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.467025:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201592.467029:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 104 lru_type: 1 00010000:00010000:1.0:1788201592.467037:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 105 lru_type: 1 00000080:00200000:1.0:1788201592.467046:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.467051:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201592.467055:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.467070:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=ost-pools.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201592.467075:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=ost-pools.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201592.467086:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ost-pools.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201592.467146:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d000/0xd138388016f6f277 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.467155:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d000/0xd138388016f6f277 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.467166:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d000/0xd138388016f6f277 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.467275:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416dc00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727970560:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.467471:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc153a8d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.472377:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416dc00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727970560:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.472421:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d000/0xd138388016f6f277 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.472439:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d000/0xd138388016f6f277 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.472447:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d000/0xd138388016f6f277 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.472456:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d000/0xd138388016f6f277 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.472468:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d000/0xd138388016f6f277 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.472476:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3d000 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201592.472482:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d000/0xd138388016f6f277 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.472491:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d000/0xd138388016f6f277 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.472499:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d000/0xd138388016f6f277 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.472507:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201592.472516:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d000/0xd138388016f6f277 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.472524:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d000/0xd138388016f6f277 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201592.472555:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14416dc00 x1875064727970560/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201592.472584:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201592.472616:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201592.472705:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.472724:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.472734:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 105 lru_type: 1 00010000:00010000:1.0:1788201592.472747:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 105 lru_type: 1 00000080:00200000:1.0:1788201592.472755:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.472760:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.472764:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.472771:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201592.472775:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 105 lru_type: 1 00010000:00010000:1.0:1788201592.472785:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 106 lru_type: 1 00000080:00200000:1.0:1788201592.472843:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.472852:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201592.472859:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.472876:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=ost-pools.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:1.0:1788201592.472881:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=ost-pools.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201592.472896:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ost-pools.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201592.472949:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f27e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.472957:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f27e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.472970:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f27e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.472996:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416dc00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727970688:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.473092:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc153a8d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201592.476749:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416dc00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727970688:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201592.476780:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f27e lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.476837:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f27e lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.476851:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f27e lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.476859:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f27e lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.476869:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f27e lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.476876:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3c800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201592.476882:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f27e lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.476890:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f27e lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.476898:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f27e lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.476907:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201592.476914:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f27e lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.476922:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f27e lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201592.476945:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14416dc00 x1875064727970688/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201592.476962:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201592.477003:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201592.477135:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201592.477156:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201592.477167:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 106 lru_type: 1 00010000:00010000:0.0:1788201592.477180:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 106 lru_type: 1 00000080:00200000:0.0:1788201592.477187:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201592.477192:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201592.477196:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201592.477203:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:0.0:1788201592.477207:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 106 lru_type: 1 00010000:00010000:0.0:1788201592.477217:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 107 lru_type: 1 00000080:00200000:0.0:1788201592.477234:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201592.477243:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201592.477249:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201592.477264:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201592.477270:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=ost-pools.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc152c96c00, open_flags 80c1, mode 81ed opened 0 00000080:00200000:0.0:1788201592.477290:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=ost-pools.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:0.0:1788201592.477314:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ost-pools.sh,[0x200000bd7:0x175:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:0.0:1788201592.477375:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49000/0xd138388016f6f285 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.477399:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49000/0xd138388016f6f285 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1788201592.477413:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1788201592.477421:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144159180 x1875064727970944/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1788201592.477430:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49000/0xd138388016f6f285 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201592.477456:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144159180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727970944:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201592.477620:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.490677:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144159180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727970944:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.490713:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49000/0xd138388016f6f285 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710973fa expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.490742:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49000/0xd138388016f6f285 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x175:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710973fa expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.490752:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49000/0xd138388016f6f285 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710973fa expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.490765:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49000/0xd138388016f6f285 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710973fa expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.490779:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49000/0xd138388016f6f285 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710973fa expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.490855:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49000/0xd138388016f6f285 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710973fa expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.490864:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49000/0xd138388016f6f285 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710973fa expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.490873:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49000/0xd138388016f6f285 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710973fa expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201592.490887:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc144159180 x1875064727970944/t8589937388(8589937388) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201592.490901:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc144159180 x1875064727970944/t8589937388(8589937388) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201592.490917:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49000/0xd138388016f6f285 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710973fa expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201592.490931:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49000/0xd138388016f6f285 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710973fa expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.490943:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/373 (0 0) 00000080:00200000:1.0:1788201592.490951:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201592.490970:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=ost-pools.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:1.0:1788201592.491005:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x175:0x0](ffff8bc1446bec08) 00000080:00200000:1.0:1788201592.491579:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x175:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201592.491593:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x175:0x0](ffff8bc1446bec08) 00000080:00010000:1.0:1788201592.491599:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x175:0x0](ffff8bc1446bec08) for lock 0xd138388016f6f285 00000080:00010000:1.0:1788201592.491612:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x175:0x0](ffff8bc1446bec08) 00000080:00200008:1.0:1788201592.491630:0:24470:0:(file.c:1090:ll_file_open()) START file ost-pools.sh:[0x200000bd7:0x175:0x0](ffff8bc1446bec08), flags 100301 00000002:00100000:1.0:1788201592.491655:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc144159180 x1875064727970944/t8589937388(8589937388) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201592.491718:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f285 from it ffff8bc146937360 00010000:00010000:1.0:1788201592.491724:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49000/0xd138388016f6f285 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710973fa expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.491735:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49000/0xd138388016f6f285 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710973fa expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201592.491764:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x175:0x0](ffff8bc1446bec08), inode mode 81ed mask 40 00000080:00200008:1.0:1788201592.491952:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file ost-pools.sh:[0x200000bd7:0x175:0x0](ffff8bc1446bec08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201592.491960:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x175:0x0](ffff8bc1446bec08),name=ost-pools.sh 00000002:00010000:1.0:1788201592.491983:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x175:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.491995:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49000/0xd138388016f6f285 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710973fa expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.492009:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49000/0xd138388016f6f285 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710973fa expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201592.492018:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.492024:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x175:0x0](ffff8bc1446bec08) 00000080:00010000:1.0:1788201592.492028:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x175:0x0](ffff8bc1446bec08) for lock 0xd138388016f6f285 00000080:00010000:1.0:1788201592.492032:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f285 from it ffffadd1c7debcd8 00010000:00010000:1.0:1788201592.492036:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49000/0xd138388016f6f285 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710973fa expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.492044:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49000/0xd138388016f6f285 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710973fa expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201592.492078:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x175:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201592.492089:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x175:0x0] 00000008:00010000:1.0:1788201592.492512:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201592.492517:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4db0, osc lock ffff8bc145d08ab0, flags 0x400001002 00010000:00010000:1.0:1788201592.492590:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000069322032/0xd138388016f6f28c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.492602:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000069322032/0xd138388016f6f28c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201592.492650:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:1.0:1788201592.505475:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x175:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201592.505484:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e25970 (ffff8bc148e3b128/0) at cl_lock_release():245 00000020:00010000:1.0:1788201592.505488:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e25970 (ffff8bc148e3b128/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.505493:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4db0 (ffff8bc148e3be18/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.505498:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e25970 (ffff8bc148e3b128/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201592.505502:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4db0 (ffff8bc148e3b128/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201592.505545:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x175:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201592.505676:0:24470:0:(file.c:2638:do_file_write_iter()) START file ost-pools.sh:[0x200000bd7:0x175:0x0], ppos: 0, count: 55540 00000080:00200000:1.0:1788201592.505706:0:24470:0:(file.c:2090:ll_file_io_generic()) ost-pools.sh: write ppos: 0, bytes: 55540 00000080:00200000:1.0:1788201592.505713:0:24470:0:(file.c:1848:ll_io_set_mirror()) ost-pools.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201592.505720:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000572aa4dc[0x110, 1, [0x200000bd7:0x175:0x0] hash] 00000020:00200000:1.0:1788201592.505723:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 55540) 0 0 00000080:00200000:1.0:1788201592.505728:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x175:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201592.505743:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 13] 00020000:00200000:1.0:1788201592.505753:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 55540) 55540, 55540 00020000:00200000:1.0:1788201592.505757:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201592.505812:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 13] 00000008:00010000:1.0:1788201592.505826:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201592.505831:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4db0, osc lock ffff8bc145d08ab0, flags 0x0 00010000:00010000:1.0:1788201592.505849:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/429 (0 57343) 00010000:00010000:1.0:1788201592.505895:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6f293 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.505906:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6f293 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->57343] (req 0->57343) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.505917:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6f293 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->57343] (req 0->57343) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.505943:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416f480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727971200:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.506054:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc153a8d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201592.512221:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201592.512553:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743477376 00000100:00100000:0.0:1788201592.512578:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743477376 00000100:00100000:0.0:1788201592.512652:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 737 00000100:00100000:0.0:1788201592.512739:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23413:x1875064743477376:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201592.512767:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000069322032/0xd138388016f6f28c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097408 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.512924:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201592.512931:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23413:x1875064743477376:12345-192.168.201.143@tcp:104: Request processed in 270us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.512939:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 737 00000100:00100000:3.0:1788201592.517949:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201592.518627:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416f480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727971200:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201592.518681:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6f293 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->57343] (req 0->57343) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e217109740f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.518704:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6f293 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->57343] (req 0->57343) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109740f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.518714:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6f293 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->57343] (req 0->57343) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109740f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.519154:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743477504 00000100:00100000:1.0:1788201592.519166:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743477504 00000100:00100000:1.0:1788201592.519249:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 738 00000100:00100000:1.0:1788201592.519262:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21003:x1875064743477504:12345-192.168.201.143@tcp:105: 00010000:00010000:1.0:1788201592.519888:0:20877:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6f293 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->57343] (req 0->57343) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109740f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.519909:0:20877:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6f293 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->57343] (req 0->57343) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109740f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.519921:0:20877:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6f293 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e217109740f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.519936:0:20877:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6f293 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e217109740f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.519947:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6f293 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e217109740f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.519959:0:20877:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6f293 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e217109740f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.519994:0:20877:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc149f3c600) 00000100:00100000:1.0:1788201592.520088:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21003:x1875064743477504:12345-192.168.201.143@tcp:105: Request processed in 826us (2153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201592.520099:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 738 00000100:00100000:0.0:1788201592.528136:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727971328:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201592.536331:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275bb80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727971712:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201592.536366:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491600/0xd138388016f6f29a lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.536397:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491600/0xd138388016f6f29a lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.536406:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491600/0xd138388016f6f29a lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.536414:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491600/0xd138388016f6f29a lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.536424:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491600/0xd138388016f6f29a lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.536431:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172491600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201592.536436:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491600/0xd138388016f6f29a lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.536448:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491600/0xd138388016f6f29a lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.536457:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491600/0xd138388016f6f29a lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.536464:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201592.536472:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491600/0xd138388016f6f29a lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.536479:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491600/0xd138388016f6f29a lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201592.536503:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc17275bb80 x1875064727971712/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201592.536522:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201592.536557:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201592.536653:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201592.536688:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201592.536699:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 109 lru_type: 1 00010000:00010000:0.0:1788201592.536713:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 109 lru_type: 1 00000080:00200000:0.0:1788201592.536720:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201592.536725:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201592.536729:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201592.536736:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201592.536739:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 109 lru_type: 1 00010000:00010000:0.0:1788201592.536747:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 110 lru_type: 1 00000080:00200000:0.0:1788201592.536765:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201592.536773:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201592.536780:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201592.536825:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=parallel-scale-cifs.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:0.0:1788201592.536829:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=parallel-scale-cifs.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201592.536841:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: parallel-scale-cifs.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201592.536892:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49a00/0xd138388016f6f2a1 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.536899:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49a00/0xd138388016f6f2a1 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.536910:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49a00/0xd138388016f6f2a1 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201592.536933:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415a300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727971840:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201592.537850:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201592.543257:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415a300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727971840:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201592.543363:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49a00/0xd138388016f6f2a1 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.543382:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49a00/0xd138388016f6f2a1 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.543400:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49a00/0xd138388016f6f2a1 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.543408:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49a00/0xd138388016f6f2a1 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.543419:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49a00/0xd138388016f6f2a1 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.543426:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc143a49a00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201592.543432:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49a00/0xd138388016f6f2a1 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.543440:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49a00/0xd138388016f6f2a1 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.543448:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49a00/0xd138388016f6f2a1 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.543455:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201592.543464:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49a00/0xd138388016f6f2a1 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.543471:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49a00/0xd138388016f6f2a1 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201592.543496:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14415a300 x1875064727971840/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201592.543514:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201592.543549:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201592.543913:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201592.543932:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201592.543945:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 110 lru_type: 1 00010000:00010000:0.0:1788201592.543958:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 110 lru_type: 1 00000080:00200000:0.0:1788201592.543965:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201592.543971:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201592.543975:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201592.543980:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:0.0:1788201592.543984:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 110 lru_type: 1 00010000:00010000:0.0:1788201592.543992:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 111 lru_type: 1 00000080:00200000:0.0:1788201592.544008:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201592.544016:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201592.544022:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201592.544034:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201592.544039:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=parallel-scale-cifs.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc152c96d80, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:0.0:1788201592.544048:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=parallel-scale-cifs.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:0.0:1788201592.544068:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: parallel-scale-cifs.sh,[0x200000bd7:0x176:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:0.0:1788201592.544140:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48200/0xd138388016f6f2a8 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.544153:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48200/0xd138388016f6f2a8 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1788201592.544167:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1788201592.544246:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14415a300 x1875064727972096/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1788201592.544257:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48200/0xd138388016f6f2a8 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201592.544346:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415a300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727972096:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201592.544524:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201592.550030:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415a300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727972096:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201592.550068:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48200/0xd138388016f6f2a8 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097455 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.550103:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48200/0xd138388016f6f2a8 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x176:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097455 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.550112:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48200/0xd138388016f6f2a8 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097455 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.550124:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48200/0xd138388016f6f2a8 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097455 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.550135:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48200/0xd138388016f6f2a8 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097455 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.550157:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48200/0xd138388016f6f2a8 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097455 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.550166:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48200/0xd138388016f6f2a8 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097455 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.550183:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48200/0xd138388016f6f2a8 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097455 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201592.550201:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc14415a300 x1875064727972096/t8589937390(8589937390) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201592.550218:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14415a300 x1875064727972096/t8589937390(8589937390) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201592.550234:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48200/0xd138388016f6f2a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097455 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1788201592.550251:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48200/0xd138388016f6f2a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097455 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.550264:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/374 (0 0) 00000080:00200000:0.0:1788201592.550272:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201592.550301:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=parallel-scale-cifs.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:0.0:1788201592.550346:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x176:0x0](ffff8bc1446800c8) 00000080:00200000:0.0:1788201592.550542:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x176:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1788201592.550554:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x176:0x0](ffff8bc1446800c8) 00000080:00010000:0.0:1788201592.550559:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x176:0x0](ffff8bc1446800c8) for lock 0xd138388016f6f2a8 00000080:00010000:0.0:1788201592.550573:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x176:0x0](ffff8bc1446800c8) 00000080:00200008:0.0:1788201592.550593:0:24470:0:(file.c:1090:ll_file_open()) START file parallel-scale-cifs.sh:[0x200000bd7:0x176:0x0](ffff8bc1446800c8), flags 100301 00000002:00100000:0.0:1788201592.550617:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14415a300 x1875064727972096/t8589937390(8589937390) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1788201592.550864:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f2a8 from it ffff8bc146937a80 00010000:00010000:0.0:1788201592.550871:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48200/0xd138388016f6f2a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097455 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.550881:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48200/0xd138388016f6f2a8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097455 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201592.550909:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x176:0x0](ffff8bc1446800c8), inode mode 81a4 mask 40 00000080:00200008:0.0:1788201592.550942:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file parallel-scale-cifs.sh:[0x200000bd7:0x176:0x0](ffff8bc1446800c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201592.550949:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x176:0x0](ffff8bc1446800c8),name=parallel-scale-cifs.sh 00000002:00010000:0.0:1788201592.550968:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x176:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201592.550979:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48200/0xd138388016f6f2a8 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097455 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.550991:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48200/0xd138388016f6f2a8 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097455 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201592.550999:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201592.551004:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x176:0x0](ffff8bc1446800c8) 00000080:00010000:0.0:1788201592.551008:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x176:0x0](ffff8bc1446800c8) for lock 0xd138388016f6f2a8 00000080:00010000:0.0:1788201592.551012:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f2a8 from it ffffadd1c7debcd8 00010000:00010000:0.0:1788201592.551015:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48200/0xd138388016f6f2a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097455 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.551023:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48200/0xd138388016f6f2a8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097455 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201592.551051:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x176:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201592.551061:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x176:0x0] 00000008:00010000:0.0:1788201592.551090:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201592.551094:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456e30, osc lock ffff8bc145d34d10, flags 0x400001002 00010000:00010000:0.0:1788201592.551150:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2af lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.551162:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2af lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201592.552830:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727972224:192.168.201.143@tcp:101:cp.0 00000020:00200000:0.0:1788201592.553199:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:0.0:1788201592.557364:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x176:0x0] updating i_size 0 i_blocks 1 00000020:00010000:0.0:1788201592.557371:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449db9d0 (ffff8bc1499c42d8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201592.557375:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449db9d0 (ffff8bc1499c42d8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201592.557380:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456e30 (ffff8bc1499c4248/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201592.557397:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449db9d0 (ffff8bc1499c42d8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201592.557400:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456e30 (ffff8bc1499c42d8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201592.557444:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x176:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1788201592.557519:0:24470:0:(file.c:2638:do_file_write_iter()) START file parallel-scale-cifs.sh:[0x200000bd7:0x176:0x0], ppos: 0, count: 6813 00000080:00200000:0.0:1788201592.557551:0:24470:0:(file.c:2090:ll_file_io_generic()) parallel-scale-cifs.sh: write ppos: 0, bytes: 6813 00000080:00200000:0.0:1788201592.557558:0:24470:0:(file.c:1848:ll_io_set_mirror()) parallel-scale-cifs.sh: desiginated mirror: 0 00000020:00200000:0.0:1788201592.557575:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@0000000099202a5a[0x110, 1, [0x200000bd7:0x176:0x0] hash] 00000020:00200000:0.0:1788201592.557578:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 6813) 0 0 00000080:00200000:0.0:1788201592.557582:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x176:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201592.557596:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 1] 00020000:00200000:0.0:1788201592.557605:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 6813) 6813, 6813 00020000:00200000:0.0:1788201592.557609:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201592.557642:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 1] 00000008:00010000:0.0:1788201592.557656:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1788201592.557673:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456e30, osc lock ffff8bc145d34d10, flags 0x0 00010000:00010000:0.0:1788201592.557692:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/429 (0 8191) 00010000:00010000:0.0:1788201592.557738:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f2b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.557749:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f2b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.557760:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f2b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201592.557784:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144158700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727972352:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201592.557916:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.562785:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201592.562923:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743477632 00000100:00100000:3.0:1788201592.562935:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743477632 00000100:00100000:3.0:1788201592.562997:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 739 00000100:00100000:3.0:1788201592.563009:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14416df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23415:x1875064743477632:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201592.563033:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097463 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.563134:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201592.563150:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14416df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23415:x1875064743477632:12345-192.168.201.143@tcp:104: Request processed in 136us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201592.563158:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 739 00000100:00100000:1.0:1788201592.563667:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17275bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727972480:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201592.567583:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201592.567724:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743477760 00000100:00100000:0.0:1788201592.567736:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743477760 00000100:00100000:0.0:1788201592.567829:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 740 00000100:00100000:0.0:1788201592.567840:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14416e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21004:x1875064743477760:12345-192.168.201.143@tcp:105: 00010000:00010000:0.0:1788201592.567856:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f2b6 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e217109746a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.567873:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f2b6 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109746a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.567883:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f2b6 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e217109746a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.567895:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f2b6 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e217109746a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.567963:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f2b6 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e217109746a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.568051:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f2b6 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e217109746a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.568084:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc143a49a00) 00000100:00100000:0.0:1788201592.568533:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14416e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21004:x1875064743477760:12345-192.168.201.143@tcp:105: Request processed in 331us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.568541:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 740 00000100:00100000:0.0:1788201592.571421:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727972480:192.168.201.143@tcp:103:ldlm_bl.0 00000080:00200000:0.0:1788201592.585936:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=parallel-scale-nfs.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:0.0:1788201592.585965:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: parallel-scale-nfs.sh,[0x200000bd7:0x177:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:0.0:1788201592.586032:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.586040:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1788201592.586055:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1788201592.586062:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144158a80 x1875064727973248/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1788201592.586078:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201592.586275:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144158a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727973248:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201592.586503:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201592.593326:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144158a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727973248:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201592.593365:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710974b0 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.593404:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x177:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710974b0 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.593415:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710974b0 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.593428:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710974b0 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.593441:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710974b0 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.593460:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710974b0 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.593469:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710974b0 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.593482:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710974b0 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201592.593497:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc144158a80 x1875064727973248/t8589937392(8589937392) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201592.593514:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc144158a80 x1875064727973248/t8589937392(8589937392) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201592.593531:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710974b0 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1788201592.593549:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710974b0 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.593564:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/375 (0 0) 00000080:00200000:0.0:1788201592.593573:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201592.593592:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=parallel-scale-nfs.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:0.0:1788201592.593638:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x177:0x0](ffff8bc144685b88) 00000080:00200000:0.0:1788201592.593874:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x177:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1788201592.593888:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x177:0x0](ffff8bc144685b88) 00000080:00010000:0.0:1788201592.593892:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x177:0x0](ffff8bc144685b88) for lock 0xd138388016f6f2cb 00000080:00010000:0.0:1788201592.593903:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x177:0x0](ffff8bc144685b88) 00000080:00200008:0.0:1788201592.593920:0:24470:0:(file.c:1090:ll_file_open()) START file parallel-scale-nfs.sh:[0x200000bd7:0x177:0x0](ffff8bc144685b88), flags 100301 00000002:00100000:0.0:1788201592.593946:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc144158a80 x1875064727973248/t8589937392(8589937392) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1788201592.593992:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f2cb from it ffff8bc146937720 00010000:00010000:0.0:1788201592.593999:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710974b0 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.594009:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710974b0 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201592.594035:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x177:0x0](ffff8bc144685b88), inode mode 81ed mask 40 00000080:00200008:0.0:1788201592.594068:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file parallel-scale-nfs.sh:[0x200000bd7:0x177:0x0](ffff8bc144685b88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201592.594075:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x177:0x0](ffff8bc144685b88),name=parallel-scale-nfs.sh 00000002:00010000:0.0:1788201592.594096:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x177:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201592.594107:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710974b0 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.594121:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710974b0 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201592.594128:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201592.594133:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x177:0x0](ffff8bc144685b88) 00000080:00010000:0.0:1788201592.594137:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x177:0x0](ffff8bc144685b88) for lock 0xd138388016f6f2cb 00000080:00010000:0.0:1788201592.594140:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f2cb from it ffffadd1c7debcd8 00010000:00010000:0.0:1788201592.594144:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710974b0 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.594152:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710974b0 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201592.594177:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x177:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201592.594187:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x177:0x0] 00000008:00010000:0.0:1788201592.594216:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201592.594220:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456a30, osc lock ffff8bc145d34130, flags 0x400001002 00010000:00010000:0.0:1788201592.594273:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2d2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.594284:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2d2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201592.594332:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1788201592.594347:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201592.594367:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727973376:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201592.601644:0:10055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2d2 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.601683:0:10055:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2d2 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710974be expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.601702:0:10055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2d2 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710974be expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.601718:0:10055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2d2 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710974be expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201592.601737:0:10055:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2d2 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710974be expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201592.601751:0:10055:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201592.601776:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2d2 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710974be expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.601784:0:10055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2d2 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710974be expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.601806:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2d2 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710974be expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.601816:0:10055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e21710974be expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201592.601853:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727973376:192.168.201.143@tcp:101:cp.0 00000080:00200000:3.0:1788201592.602693:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x177:0x0] updating i_size 0 i_blocks 1 00000020:00010000:3.0:1788201592.602703:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449db9d0 (ffff8bc1499c4ea8/0) at cl_lock_release():245 00000020:00010000:3.0:1788201592.602708:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449db9d0 (ffff8bc1499c4ea8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201592.602714:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456a30 (ffff8bc1499c41b8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201592.602720:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449db9d0 (ffff8bc1499c4ea8/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201592.602724:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456a30 (ffff8bc1499c4ea8/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201592.602772:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x177:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1788201592.602866:0:24470:0:(file.c:2638:do_file_write_iter()) START file parallel-scale-nfs.sh:[0x200000bd7:0x177:0x0], ppos: 0, count: 6213 00000080:00200000:3.0:1788201592.602902:0:24470:0:(file.c:2090:ll_file_io_generic()) parallel-scale-nfs.sh: write ppos: 0, bytes: 6213 00000080:00200000:3.0:1788201592.602909:0:24470:0:(file.c:1848:ll_io_set_mirror()) parallel-scale-nfs.sh: desiginated mirror: 0 00000020:00200000:3.0:1788201592.602917:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@0000000037f081a1[0x110, 1, [0x200000bd7:0x177:0x0] hash] 00000020:00200000:3.0:1788201592.602920:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 6213) 0 0 00000080:00200000:3.0:1788201592.602924:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x177:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201592.602937:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 1] 00020000:00200000:3.0:1788201592.602945:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 6213) 6213, 6213 00020000:00200000:3.0:1788201592.602950:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1788201592.602980:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 1] 00000008:00010000:3.0:1788201592.602995:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1788201592.603001:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149fec7b0, osc lock ffff8bc14691b560, flags 0x0 00010000:00010000:3.0:1788201592.603019:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/430 (0 8191) 00010000:00010000:3.0:1788201592.603067:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.603079:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.603103:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201592.603132:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727973504:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201592.603245:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.609718:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:0.0:1788201592.610607:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201592.610616:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2d2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710974be expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.610626:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc143a49600 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201592.610634:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e21710974be expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201592.610703:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x177:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201592.610720:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x177:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1788201592.610820:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710974be expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.610852:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201592.610882:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2d2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710974be expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.610892:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710974be expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.610911:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201592.610913:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201592.610915:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201592.610935:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727973632:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201592.619043:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727973504:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201592.619089:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.619108:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.619117:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.623443:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201592.624056:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743478016 00000100:00100000:0.0:1788201592.624071:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743478016 00000100:00100000:0.0:1788201592.624199:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 742 00000100:00100000:0.0:1788201592.624211:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14416f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21005:x1875064743478016:12345-192.168.201.143@tcp:105: 00010000:00010000:0.0:1788201592.624233:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.624250:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.624262:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.624275:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.624288:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.624301:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.624344:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1725a1e00) 00000100:00100000:0.0:1788201592.624444:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14416f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21005:x1875064743478016:12345-192.168.201.143@tcp:105: Request processed in 235us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.624453:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 742 00010000:00010000:1.0:1788201592.625031:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.625046:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.625071:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201592.625086:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.625100:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.625109:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201592.625142:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) parallel-scale-nfs.sh: write [0, 6213) append 0 append lockpos 0 00000080:00200000:1.0:1788201592.625162:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:1.0:1788201592.625231:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:1.0:1788201592.625245:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005b0fff80[3 00000000340e26d4 2 1 00000000a865c27d 0 0 0] 00000080:00200000:1.0:1788201592.625249:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006c4f9409 17ffffc0001001 3:0 ffff8bc1725a2b60 0 lru 00000080:00200000:1.0:1788201592.625257:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004165b0d2 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 00000000b28ae293 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201592.625259:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005b0fff80 00000080:00200000:1.0:1788201592.625261:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201592.625265:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 2117 bytes 00000080:00200000:1.0:1788201592.625306:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 2117, copied 2117 00000080:00200000:1.0:1788201592.625310:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d1ed2f4a[3 00000000340e26d4 2 1 00000000a865c27d 0 0 1] 00000080:00200000:1.0:1788201592.625313:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006800daed 17ffffc0001001 3:0 ffff8bc1725a2700 1 lru 00000080:00200000:1.0:1788201592.625319:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004da7681f 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 00000000b28ae293 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201592.625321:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d1ed2f4a 00000080:00200000:1.0:1788201592.625323:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:1.0:1788201592.625326:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 2, from 0, to 2117 prio 0 00000008:00010000:1.0:1788201592.625352:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000effc8163 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201592.625375:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc144685d38, count 2, dirtied 2 00000080:00200000:1.0:1788201592.625381:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 2 pages 6213 bytes, tot: 6213 00000080:00200000:1.0:1788201592.625396:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) parallel-scale-nfs.sh: write bytes 0, result: 6213 00000020:00010000:1.0:1788201592.625415:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460e66c8 (ffff8bc1460e9cf8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201592.625418:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460e66c8 (ffff8bc1460e9cf8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.625421:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149fec7b0 (ffff8bc1460e9ab8/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201592.625426:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.625437:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201592.625454:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460e66c8 (ffff8bc1460e9cf8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201592.625467:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149fec7b0 (ffff8bc1460e9cf8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201592.625476:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 6213 bytes 00000080:00200000:1.0:1788201592.625484:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 1] 00000080:00200000:1.0:1788201592.625685:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x177:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201592.625689:0:24470:0:(file.c:2238:ll_file_io_generic()) parallel-scale-nfs.sh: 2 io complete with rc: 0, result: 6213, restart: 0 00000080:00200000:1.0:1788201592.625698:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x177:0x0] updating i_size 6213 i_blocks 1 00000080:00200000:1.0:1788201592.625704:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 6213 00000080:00200008:1.0:1788201592.625757:0:24470:0:(file.c:479:ll_file_release()) START file parallel-scale-nfs.sh:[0x200000bd7:0x177:0x0](ffff8bc144685b88), flags 100001 00000002:00100000:1.0:1788201592.625914:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc144158a80 x1875064727973248/t8589937392(8589937392) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201608 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201592.625928:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201592.625936:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14416d500 x1875064727973888/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201592.625964:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416d500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727973888:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201592.626066:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc153a8d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201592.630538:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727973632:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201592.631171:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416d500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727973888:192.168.201.143@tcp:35:cp.0 00000002:00100000:3.0:1788201592.631210:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc144158a80 x1875064727973248/t8589937392(8589937392) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201592.631314:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201592.631340:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201592.631364:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 115 lru_type: 1 00010000:00010000:3.0:1788201592.631379:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 115 lru_type: 1 00000080:00200000:3.0:1788201592.631401:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201592.631410:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201592.631414:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201592.631427:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201592.631432:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 115 lru_type: 1 00010000:00010000:3.0:1788201592.631444:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 116 lru_type: 1 00000080:00200000:3.0:1788201592.631463:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201592.631472:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201592.631479:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201592.631482:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=parallel-scale-nfs.sh, flags=8 00000080:00200008:3.0:1788201592.631492:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file parallel-scale-nfs.sh:[0x200000bd7:0x177:0x0](ffff8bc144685b88), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201592.631497:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x177:0x0](ffff8bc144685b88),name=parallel-scale-nfs.sh 00000002:00010000:3.0:1788201592.631509:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x177:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201592.631530:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710974b0 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201592.631539:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710974b0 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201592.631546:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201592.631551:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x177:0x0](ffff8bc144685b88) 00000080:00010000:3.0:1788201592.631554:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x177:0x0](ffff8bc144685b88) for lock 0xd138388016f6f2cb 00000080:00010000:3.0:1788201592.631558:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f2cb from it ffffadd1c7debcb8 00010000:00010000:3.0:1788201592.631634:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710974b0 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201592.631644:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710974b0 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201592.631698:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x177:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201592.631709:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x177:0x0] 00000008:00010000:3.0:1788201592.631743:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201592.631747:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149feccb0, osc lock ffff8bc14691b430, flags 0x400001002 00010000:00010000:3.0:1788201592.631768:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.631780:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:3.0:1788201592.632089:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1788201592.632094:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.632108:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1788201592.632120:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1788201592.632130:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x177:0x0] updating i_size 6213 i_blocks 1 00000020:00010000:3.0:1788201592.632134:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc4000 (ffff8bc1460e9cf8/0) at cl_lock_release():245 00000020:00010000:3.0:1788201592.632137:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc4000 (ffff8bc1460e9cf8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201592.632140:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149feccb0 (ffff8bc1460e9ab8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201592.632145:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc4000 (ffff8bc1460e9cf8/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201592.632148:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149feccb0 (ffff8bc1460e9cf8/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201592.632181:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x177:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201592.632247:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201592.632256:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201592.632263:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 116 lru_type: 1 00010000:00010000:3.0:1788201592.632272:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 116 lru_type: 1 00000080:00200000:3.0:1788201592.632279:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201592.632284:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201592.632287:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201592.632292:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201592.632295:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 116 lru_type: 1 00010000:00010000:3.0:1788201592.632307:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 117 lru_type: 1 00000080:00200000:3.0:1788201592.632316:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201592.632322:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201592.632326:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201592.632341:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=parallel-scale-nfsv3.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:3.0:1788201592.632346:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=parallel-scale-nfsv3.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:3.0:1788201592.632357:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: parallel-scale-nfsv3.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201592.632424:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1800/0xd138388016f6f2e0 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.632432:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1800/0xd138388016f6f2e0 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.632444:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1800/0xd138388016f6f2e0 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201592.632476:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a3480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727974016:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201592.633573:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201592.636842:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a3480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727974016:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201592.636877:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1800/0xd138388016f6f2e0 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.636894:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1800/0xd138388016f6f2e0 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.636901:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1800/0xd138388016f6f2e0 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.636909:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1800/0xd138388016f6f2e0 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.636920:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1800/0xd138388016f6f2e0 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.636928:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1725a1800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201592.636934:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1800/0xd138388016f6f2e0 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.636942:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1800/0xd138388016f6f2e0 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.636950:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1800/0xd138388016f6f2e0 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.636957:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201592.636964:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1800/0xd138388016f6f2e0 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.636970:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1800/0xd138388016f6f2e0 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201592.636994:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a3480 x1875064727974016/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201592.637012:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201592.637042:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201592.637121:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201592.637140:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201592.637244:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 117 lru_type: 1 00010000:00010000:0.0:1788201592.637257:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 117 lru_type: 1 00000080:00200000:0.0:1788201592.637271:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201592.637278:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201592.637282:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201592.637289:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201592.637293:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 117 lru_type: 1 00010000:00010000:0.0:1788201592.637302:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 118 lru_type: 1 00000080:00200000:0.0:1788201592.637319:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201592.637327:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201592.637333:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201592.637348:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=parallel-scale-nfsv3.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:0.0:1788201592.637352:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=parallel-scale-nfsv3.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201592.637371:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: parallel-scale-nfsv3.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201592.637434:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f2e7 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.637442:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f2e7 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.637453:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f2e7 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201592.637725:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144158700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727974144:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201592.637873:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201592.640726:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144158700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727974144:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201592.640754:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f2e7 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.640768:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f2e7 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.640775:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f2e7 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.640782:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f2e7 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.640893:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f2e7 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.640901:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc143a49600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201592.640907:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f2e7 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.640915:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f2e7 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.640923:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f2e7 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.640931:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201592.640938:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f2e7 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.640946:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49600/0xd138388016f6f2e7 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201592.640974:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc144158700 x1875064727974144/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201592.640993:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201592.641023:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201592.641282:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201592.641301:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201592.641312:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 118 lru_type: 1 00010000:00010000:0.0:1788201592.641325:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 118 lru_type: 1 00000080:00200000:0.0:1788201592.641331:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201592.641337:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201592.641341:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201592.641347:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:0.0:1788201592.641351:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 118 lru_type: 1 00010000:00010000:0.0:1788201592.641360:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 119 lru_type: 1 00000080:00200000:0.0:1788201592.641377:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201592.641398:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201592.641406:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201592.641424:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201592.641430:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=parallel-scale-nfsv3.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc152c96900, open_flags 80c1, mode 81ed opened 0 00000080:00200000:0.0:1788201592.641439:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=parallel-scale-nfsv3.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:0.0:1788201592.641592:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: parallel-scale-nfsv3.sh,[0x200000bd7:0x178:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:0.0:1788201592.641657:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.641665:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1788201592.641679:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1788201592.641688:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144158700 x1875064727974400/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1788201592.641698:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201592.641721:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144158700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727974400:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201592.642006:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201592.648142:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144158700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727974400:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201592.648190:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109750b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.648221:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x178:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109750b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.648231:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109750b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.648248:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109750b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.648261:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109750b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.648348:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109750b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.648359:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109750b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.648366:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109750b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201592.648381:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc144158700 x1875064727974400/t8589937394(8589937394) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201592.648407:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc144158700 x1875064727974400/t8589937394(8589937394) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201592.648424:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109750b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1788201592.648438:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109750b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.648450:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/376 (0 0) 00000080:00200000:0.0:1788201592.648458:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201592.648475:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=parallel-scale-nfsv3.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:0.0:1788201592.648517:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x178:0x0](ffff8bc144686c08) 00000080:00200000:0.0:1788201592.648813:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x178:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1788201592.648827:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x178:0x0](ffff8bc144686c08) 00000080:00010000:0.0:1788201592.648831:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x178:0x0](ffff8bc144686c08) for lock 0xd138388016f6f2ee 00000080:00010000:0.0:1788201592.648843:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x178:0x0](ffff8bc144686c08) 00000080:00200008:0.0:1788201592.648862:0:24470:0:(file.c:1090:ll_file_open()) START file parallel-scale-nfsv3.sh:[0x200000bd7:0x178:0x0](ffff8bc144686c08), flags 100301 00000002:00100000:0.0:1788201592.648886:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc144158700 x1875064727974400/t8589937394(8589937394) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1788201592.648936:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f2ee from it ffff8bc146937420 00010000:00010000:0.0:1788201592.648941:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109750b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.648951:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109750b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201592.648977:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x178:0x0](ffff8bc144686c08), inode mode 81ed mask 40 00000080:00200008:0.0:1788201592.649012:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file parallel-scale-nfsv3.sh:[0x200000bd7:0x178:0x0](ffff8bc144686c08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201592.649018:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x178:0x0](ffff8bc144686c08),name=parallel-scale-nfsv3.sh 00000002:00010000:0.0:1788201592.649039:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x178:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201592.649050:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109750b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.649063:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109750b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201592.649076:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201592.649080:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x178:0x0](ffff8bc144686c08) 00000080:00010000:0.0:1788201592.649083:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x178:0x0](ffff8bc144686c08) for lock 0xd138388016f6f2ee 00000080:00010000:0.0:1788201592.649087:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f2ee from it ffffadd1c7debcd8 00010000:00010000:0.0:1788201592.649090:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109750b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.649097:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109750b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201592.649122:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x178:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201592.649133:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x178:0x0] 00000008:00010000:0.0:1788201592.649161:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201592.649165:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456130, osc lock ffff8bc145d34850, flags 0x400001002 00010000:00010000:0.0:1788201592.649218:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f2f5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.649230:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f2f5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201592.649472:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727974528:192.168.201.143@tcp:101:cp.0 00000020:00200000:0.0:1788201592.650862:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1788201592.653943:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f2f5 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.653979:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f2f5 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097519 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.654004:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f2f5 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097519 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.654019:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f2f5 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097519 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201592.654037:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f2f5 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097519 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201592.654051:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201592.654072:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f2f5 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097519 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.654082:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f2f5 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097519 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.654090:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f2f5 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097519 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.654108:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f2f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171097519 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201592.654134:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727974528:192.168.201.143@tcp:101:cp.0 00000080:00200000:0.0:1788201592.654548:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x178:0x0] updating i_size 0 i_blocks 1 00000020:00010000:0.0:1788201592.654556:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9970 (ffff8bc1499c47e8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201592.654560:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9970 (ffff8bc1499c47e8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201592.654574:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456130 (ffff8bc1499c4d88/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201592.654579:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9970 (ffff8bc1499c47e8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201592.654581:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456130 (ffff8bc1499c47e8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201592.654625:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x178:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1788201592.654857:0:24470:0:(file.c:2638:do_file_write_iter()) START file parallel-scale-nfsv3.sh:[0x200000bd7:0x178:0x0], ppos: 0, count: 269 00000080:00200000:0.0:1788201592.654877:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 269 bytes 00000080:00200000:0.0:1788201592.654883:0:24470:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 269 00000080:00200000:0.0:1788201592.654911:0:24470:0:(file.c:2090:ll_file_io_generic()) parallel-scale-nfsv3.sh: write ppos: 0, bytes: 269 00000080:00200000:0.0:1788201592.654918:0:24470:0:(file.c:1848:ll_io_set_mirror()) parallel-scale-nfsv3.sh: desiginated mirror: 0 00000020:00200000:0.0:1788201592.654925:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000f809663f[0x110, 1, [0x200000bd7:0x178:0x0] hash] 00000020:00200000:0.0:1788201592.654927:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 269) 0 0 00000080:00200000:0.0:1788201592.654932:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x178:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201592.654948:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1788201592.654956:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 269) 269, 269 00020000:00200000:0.0:1788201592.654961:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201592.654990:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:0.0:1788201592.655004:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1788201592.655011:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456130, osc lock ffff8bc145d34850, flags 0x0 00010000:00010000:0.0:1788201592.655028:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/430 (0 4095) 00010000:00010000:0.0:1788201592.655081:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.655505:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.655522:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201592.655553:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415b800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727974656:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201592.656016:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.659916:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743478144 00000100:00100000:1.0:1788201592.659928:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743478144 00000100:00100000:1.0:1788201592.659990:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 743 00000100:00100000:1.0:1788201592.660000:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23411:x1875064743478144:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201592.660022:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f2f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097519 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.660373:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201592.660381:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23411:x1875064743478144:12345-192.168.201.143@tcp:104: Request processed in 383us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201592.660399:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 743 00010000:00010000:3.0:1788201592.660460:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201592.660469:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f2f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097519 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.660480:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc143a48800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201592.660488:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f2f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171097519 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201592.660547:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x178:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201592.660570:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x178:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201592.660650:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f2f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097519 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.660658:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788201592.660823:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727974784:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201592.660933:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f2f5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097519 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.660944:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000baf8f4aa/0xd138388016f6f2f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097519 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.660963:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201592.660964:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201592.660967:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201592.665221:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415b800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727974656:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201592.665260:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.665407:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.665418:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201592.666471:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743478272 00000100:00100000:0.0:1788201592.666485:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743478272 00000100:00100000:0.0:1788201592.666601:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 744 00000100:00100000:0.0:1788201592.666613:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743478272:12345-192.168.201.143@tcp:105: 00010000:00010000:0.0:1788201592.666630:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.666643:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.666653:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.666675:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.666686:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.666697:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.666732:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc143a49600) 00000100:00100000:0.0:1788201592.666832:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743478272:12345-192.168.201.143@tcp:105: Request processed in 221us (2827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.666840:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 744 00010000:00010000:1.0:1788201592.667300:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.667314:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.667333:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201592.667346:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.667360:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.667369:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201592.667414:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) parallel-scale-nfsv3.sh: write [0, 269) append 0 append lockpos 0 00000080:00200000:1.0:1788201592.667442:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 269 bytes 00000080:00200000:1.0:1788201592.667510:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 269, copied 269 00000080:00200000:1.0:1788201592.667523:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000061449b04[3 00000000a34d700d 2 1 00000000947d3f8a 0 0 0] 00000080:00200000:1.0:1788201592.667527:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000032725064 17ffffc0001001 3:0 ffff8bc1725a27e0 0 lru 00000080:00200000:1.0:1788201592.667534:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000060d3c2d3 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 000000006eba026e > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201592.667537:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000061449b04 00000080:00200000:1.0:1788201592.667538:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201592.667543:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 269 prio 0 00000008:00010000:1.0:1788201592.667581:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 0000000028f6ddfc ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201592.667603:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc144686db8, count 1, dirtied 1 00000080:00200000:1.0:1788201592.667608:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 269 bytes, tot: 269 00000080:00200000:1.0:1788201592.667611:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) parallel-scale-nfsv3.sh: write bytes 0, result: 269 00000020:00010000:1.0:1788201592.667631:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc148fb13f8 (ffff8bc1499c47e8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201592.667635:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc148fb13f8 (ffff8bc1499c47e8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.667638:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456130 (ffff8bc1499c4d88/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201592.667644:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.667839:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201592.667861:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc148fb13f8 (ffff8bc1499c47e8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201592.667864:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456130 (ffff8bc1499c47e8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201592.667874:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 269 bytes 00000080:00200000:1.0:1788201592.667884:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1788201592.667917:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x178:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201592.667921:0:24470:0:(file.c:2238:ll_file_io_generic()) parallel-scale-nfsv3.sh: 2 io complete with rc: 0, result: 269, restart: 0 00000080:00200000:1.0:1788201592.667930:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x178:0x0] updating i_size 269 i_blocks 1 00000080:00200000:1.0:1788201592.667936:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 269 00000080:00200008:1.0:1788201592.667991:0:24470:0:(file.c:479:ll_file_release()) START file parallel-scale-nfsv3.sh:[0x200000bd7:0x178:0x0](ffff8bc144686c08), flags 100001 00000002:00100000:1.0:1788201592.668054:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc144158700 x1875064727974400/t8589937394(8589937394) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201608 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201592.668067:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201592.668073:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14416df80 x1875064727975040/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201592.668098:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416df80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727975040:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201592.668180:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc153a8d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.671499:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727974784:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201592.674104:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416df80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727975040:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201592.674152:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc144158700 x1875064727974400/t8589937394(8589937394) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201592.674262:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.674451:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.674478:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 119 lru_type: 1 00010000:00010000:1.0:1788201592.674498:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 119 lru_type: 1 00000080:00200000:1.0:1788201592.674507:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.674514:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.674519:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.674528:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201592.674533:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 119 lru_type: 1 00010000:00010000:1.0:1788201592.674543:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 120 lru_type: 1 00000080:00200000:1.0:1788201592.674572:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.674582:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201592.674590:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.674594:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=parallel-scale-nfsv3.sh, flags=8 00000080:00200008:1.0:1788201592.674603:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file parallel-scale-nfsv3.sh:[0x200000bd7:0x178:0x0](ffff8bc144686c08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201592.674609:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x178:0x0](ffff8bc144686c08),name=parallel-scale-nfsv3.sh 00000002:00010000:1.0:1788201592.674623:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x178:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.674633:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109750b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201592.674643:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109750b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201592.674650:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.674654:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x178:0x0](ffff8bc144686c08) 00000080:00010000:1.0:1788201592.674657:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x178:0x0](ffff8bc144686c08) for lock 0xd138388016f6f2ee 00000080:00010000:1.0:1788201592.674672:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f2ee from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201592.674677:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109750b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201592.674686:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109750b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201592.674742:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x178:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201592.674754:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x178:0x0] 00000008:00010000:1.0:1788201592.674786:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201592.674854:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d40b0, osc lock ffff8bc145d098f0, flags 0x400001002 00010000:00010000:1.0:1788201592.674876:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.674889:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201592.674905:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201592.674909:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.674922:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201592.674932:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201592.674943:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x178:0x0] updating i_size 269 i_blocks 1 00000020:00010000:1.0:1788201592.674947:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e25970 (ffff8bc148e3b2d8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201592.674950:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e25970 (ffff8bc148e3b2d8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.674953:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d40b0 (ffff8bc148e3b908/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.674957:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e25970 (ffff8bc148e3b2d8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201592.674960:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d40b0 (ffff8bc148e3b2d8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201592.674991:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x178:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201592.675055:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.675063:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.675070:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 120 lru_type: 1 00010000:00010000:1.0:1788201592.675078:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 120 lru_type: 1 00000080:00200000:1.0:1788201592.675085:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.675089:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.675103:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.675107:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201592.675111:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 120 lru_type: 1 00010000:00010000:1.0:1788201592.675124:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 121 lru_type: 1 00000080:00200000:1.0:1788201592.675134:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.675138:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201592.675142:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.675156:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=parallel-scale-nfsv4.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201592.675161:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=parallel-scale-nfsv4.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201592.675626:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: parallel-scale-nfsv4.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201592.675695:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f303 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.675703:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f303 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.675715:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f303 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.675745:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416e680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727975168:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.676037:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc153a8d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.680159:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416e680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727975168:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.680201:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f303 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.680218:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f303 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.680229:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f303 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.680236:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f303 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.680246:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f303 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.680253:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3cc00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201592.680259:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f303 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.680267:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f303 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.680284:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f303 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.680293:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201592.680301:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f303 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.680308:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f303 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201592.680331:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14416e680 x1875064727975168/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201592.680348:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201592.680378:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201592.680468:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.680488:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.680498:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 121 lru_type: 1 00010000:00010000:1.0:1788201592.680511:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 121 lru_type: 1 00000080:00200000:1.0:1788201592.680519:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.680524:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.680528:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.680535:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201592.680539:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 121 lru_type: 1 00010000:00010000:1.0:1788201592.680548:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 122 lru_type: 1 00000080:00200000:1.0:1788201592.680578:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.680588:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201592.680595:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.680612:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=parallel-scale-nfsv4.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:1.0:1788201592.680616:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=parallel-scale-nfsv4.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201592.680629:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: parallel-scale-nfsv4.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201592.680686:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c200/0xd138388016f6f30a lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.680693:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c200/0xd138388016f6f30a lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.680704:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c200/0xd138388016f6f30a lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.680727:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416e680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727975296:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.680865:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc153a8d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.685244:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416e680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727975296:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.685285:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c200/0xd138388016f6f30a lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.685302:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c200/0xd138388016f6f30a lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.685310:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c200/0xd138388016f6f30a lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.685317:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c200/0xd138388016f6f30a lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.685328:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c200/0xd138388016f6f30a lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.685335:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3c200 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201592.685341:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c200/0xd138388016f6f30a lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.685349:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c200/0xd138388016f6f30a lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.685357:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c200/0xd138388016f6f30a lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.685366:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201592.685374:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c200/0xd138388016f6f30a lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.685380:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c200/0xd138388016f6f30a lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201592.685415:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14416e680 x1875064727975296/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201592.685433:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201592.685465:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201592.685617:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.685635:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.685645:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 122 lru_type: 1 00010000:00010000:1.0:1788201592.685657:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 122 lru_type: 1 00000080:00200000:1.0:1788201592.685664:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.685669:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.685673:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.685678:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:1.0:1788201592.685682:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 122 lru_type: 1 00010000:00010000:1.0:1788201592.685690:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 123 lru_type: 1 00000080:00200000:1.0:1788201592.685709:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.685719:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201592.685726:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.685743:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201592.685748:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=parallel-scale-nfsv4.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14304b200, open_flags 80c1, mode 81ed opened 0 00000080:00200000:1.0:1788201592.685756:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=parallel-scale-nfsv4.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:1.0:1788201592.685778:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: parallel-scale-nfsv4.sh,[0x200000bd7:0x179:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201592.685902:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f311 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.685910:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f311 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201592.685924:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201592.685932:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14416e680 x1875064727975552/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201592.685942:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f311 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.685969:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416e680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727975552:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.686130:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc153a8d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.691631:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416e680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727975552:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.691674:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f311 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097566 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.691705:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f311 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x179:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097566 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.691714:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f311 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097566 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.691726:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f311 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097566 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.691738:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f311 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097566 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.691755:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f311 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097566 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.691764:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f311 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097566 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.691772:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f311 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097566 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201592.691785:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc14416e680 x1875064727975552/t8589937396(8589937396) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201592.691837:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14416e680 x1875064727975552/t8589937396(8589937396) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201592.691853:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f311 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097566 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201592.691867:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f311 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097566 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.691879:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/377 (0 0) 00000080:00200000:1.0:1788201592.691887:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201592.691903:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=parallel-scale-nfsv4.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:1.0:1788201592.691940:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x179:0x0](ffff8bc1446bdb88) 00000080:00200000:1.0:1788201592.692080:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x179:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201592.692101:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x179:0x0](ffff8bc1446bdb88) 00000080:00010000:1.0:1788201592.692105:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x179:0x0](ffff8bc1446bdb88) for lock 0xd138388016f6f311 00000080:00010000:1.0:1788201592.692117:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x179:0x0](ffff8bc1446bdb88) 00000080:00200008:1.0:1788201592.692134:0:24470:0:(file.c:1090:ll_file_open()) START file parallel-scale-nfsv4.sh:[0x200000bd7:0x179:0x0](ffff8bc1446bdb88), flags 100301 00000002:00100000:1.0:1788201592.692156:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14416e680 x1875064727975552/t8589937396(8589937396) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201592.692199:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f311 from it ffff8bc144cb50c0 00010000:00010000:1.0:1788201592.692204:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f311 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097566 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.692215:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f311 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097566 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201592.692241:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x179:0x0](ffff8bc1446bdb88), inode mode 81ed mask 40 00000080:00200008:1.0:1788201592.692275:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file parallel-scale-nfsv4.sh:[0x200000bd7:0x179:0x0](ffff8bc1446bdb88), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201592.692282:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x179:0x0](ffff8bc1446bdb88),name=parallel-scale-nfsv4.sh 00000002:00010000:1.0:1788201592.692303:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x179:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.692314:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f311 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097566 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.692327:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f311 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097566 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201592.692336:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.692341:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x179:0x0](ffff8bc1446bdb88) 00000080:00010000:1.0:1788201592.692344:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x179:0x0](ffff8bc1446bdb88) for lock 0xd138388016f6f311 00000080:00010000:1.0:1788201592.692348:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f311 from it ffffadd1c7debcd8 00010000:00010000:1.0:1788201592.692351:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f311 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097566 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.692358:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f311 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097566 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201592.692396:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x179:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201592.692407:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x179:0x0] 00000008:00010000:1.0:1788201592.692437:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201592.692441:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d42b0, osc lock ffff8bc145d098f0, flags 0x400001002 00010000:00010000:1.0:1788201592.692497:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f318 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.692509:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f318 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201592.692549:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1788201592.692786:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201592.692840:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727975680:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201592.697895:0:10055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f318 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.697936:0:10055:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f318 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097574 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.697952:0:10055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f318 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097574 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.697965:0:10055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f318 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097574 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201592.697982:0:10055:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f318 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097574 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201592.697995:0:10055:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201592.698003:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f318 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097574 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.698012:0:10055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f318 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097574 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.698020:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f318 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097574 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.698029:0:10055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f318 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171097574 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201592.698060:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727975680:192.168.201.143@tcp:101:cp.0 00000080:00200000:1.0:1788201592.698227:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x179:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201592.698236:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e25970 (ffff8bc148e3b2d8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201592.698239:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e25970 (ffff8bc148e3b2d8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.698245:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d42b0 (ffff8bc148e3b908/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.698250:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e25970 (ffff8bc148e3b2d8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201592.698253:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d42b0 (ffff8bc148e3b2d8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201592.698308:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x179:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201592.698377:0:24470:0:(file.c:2638:do_file_write_iter()) START file parallel-scale-nfsv4.sh:[0x200000bd7:0x179:0x0], ppos: 0, count: 234 00000080:00200000:1.0:1788201592.698405:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 234 bytes 00000080:00200000:1.0:1788201592.698411:0:24470:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 234 00000080:00200000:1.0:1788201592.698434:0:24470:0:(file.c:2090:ll_file_io_generic()) parallel-scale-nfsv4.sh: write ppos: 0, bytes: 234 00000080:00200000:1.0:1788201592.698440:0:24470:0:(file.c:1848:ll_io_set_mirror()) parallel-scale-nfsv4.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201592.698446:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000f46a9d98[0x110, 1, [0x200000bd7:0x179:0x0] hash] 00000020:00200000:1.0:1788201592.698448:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 234) 0 0 00000080:00200000:1.0:1788201592.698452:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x179:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201592.698466:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1788201592.698475:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 234) 234, 234 00020000:00200000:1.0:1788201592.698479:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201592.698511:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1788201592.698525:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201592.698530:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d42b0, osc lock ffff8bc145d098f0, flags 0x0 00010000:00010000:1.0:1788201592.698548:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/431 (0 4095) 00010000:00010000:1.0:1788201592.698608:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f31f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1af:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.698618:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f31f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1af:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.698629:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f31f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1af:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.698653:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416ca80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727975808:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.699157:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1450a6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.702562:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201592.702683:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743478400 00000100:00100000:3.0:1788201592.702697:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743478400 00000100:00100000:3.0:1788201592.702765:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 745 00000100:00100000:3.0:1788201592.702777:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14416dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21821:x1875064743478400:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201592.702841:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f318 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097574 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.702927:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201592.702934:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14416dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21821:x1875064743478400:12345-192.168.201.143@tcp:104: Request processed in 160us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201592.702940:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 745 00010000:00010000:3.0:1788201592.702963:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201592.702971:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f318 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097574 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.702980:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3c200 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201592.702986:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f318 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171097574 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201592.703045:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x179:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201592.703061:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x179:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201592.703138:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f318 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097574 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.703146:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201592.703186:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f318 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097574 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.703195:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f318 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097574 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.703212:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201592.703214:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201592.703216:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201592.703226:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201592.703243:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727975936:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201592.707850:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201592.708010:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743478528 00000100:00100000:3.0:1788201592.708025:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743478528 00000100:00100000:3.0:1788201592.708105:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 746 00000100:00100000:3.0:1788201592.708118:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14415b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21004:x1875064743478528:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201592.708141:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f31f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109757b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.708159:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f31f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109757b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.708381:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f31f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109757b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.708410:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f31f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e217109757b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.708421:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f31f lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e217109757b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.708432:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f31f lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e217109757b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.708457:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc149f3c000) 00000100:00100000:3.0:1788201592.708542:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14415b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21004:x1875064743478528:12345-192.168.201.143@tcp:105: Request processed in 427us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201592.708551:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 746 00000100:00100000:3.0:1788201592.714958:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727975936:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201592.737577:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727976832:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201592.742490:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f33b lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.742529:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f33b lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710975cf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.742547:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f33b lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710975cf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.742561:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f33b lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710975cf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201592.742580:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f33b lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710975cf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201592.742593:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201592.742615:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f33b lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710975cf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.742623:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f33b lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710975cf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.742632:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f33b lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710975cf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.742640:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f33b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e21710975cf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201592.742676:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727976832:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201592.747774:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201592.747890:0:20876:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788201592.747915:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743478656 00000100:00100000:0.0:1788201592.747926:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743478656 00000100:00100000:0.0:1788201592.747985:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 747 00000100:00100000:0.0:1788201592.747995:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14742ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23413:x1875064743478656:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201592.748019:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f33b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710975cf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.748636:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201592.748647:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14742ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23413:x1875064743478656:12345-192.168.201.143@tcp:104: Request processed in 651us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.748656:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 747 00010000:00010000:0.0:1788201592.748718:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201592.748727:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f33b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710975cf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.748737:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172491600 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201592.748745:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f33b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e21710975cf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201592.748826:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201592.748843:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1788201592.748918:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f33b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710975cf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.748925:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201592.748952:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f33b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710975cf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.748961:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f33b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710975cf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.748981:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201592.748983:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201592.748984:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201592.748993:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201592.749010:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727977088:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201592.755994:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743478784 00000100:00100000:3.0:1788201592.756006:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743478784 00000100:00100000:3.0:1788201592.756103:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 748 00000100:00100000:3.0:1788201592.756115:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21005:x1875064743478784:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201592.756135:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000bfd1eb34/0xd138388016f6f342 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710975d6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.756156:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000bfd1eb34/0xd138388016f6f342 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710975d6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.756175:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000bfd1eb34/0xd138388016f6f342 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710975d6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.756189:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000bfd1eb34/0xd138388016f6f342 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710975d6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.756200:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000bfd1eb34/0xd138388016f6f342 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710975d6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.756211:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000bfd1eb34/0xd138388016f6f342 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e21710975d6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.756240:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc172491c00) 00000100:00100000:3.0:1788201592.757205:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21005:x1875064743478784:12345-192.168.201.143@tcp:105: Request processed in 1090us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201592.757214:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 748 00000100:00100000:0.0:1788201592.765938:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727977088:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201592.769574:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f6a00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727977472:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.769609:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f349 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.769627:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f349 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.769634:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f349 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.769642:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f349 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.769652:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f349 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.769660:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172490800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201592.769665:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f349 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.769684:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f349 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.769692:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f349 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.769700:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201592.769708:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f349 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.769716:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f349 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201592.769742:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1725f6a00 x1875064727977472/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201592.769759:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201592.769835:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201592.769913:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.769933:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.769943:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 129 lru_type: 1 00010000:00010000:1.0:1788201592.769955:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 129 lru_type: 1 00000080:00200000:1.0:1788201592.769962:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.769968:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.769972:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.769977:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201592.769981:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 129 lru_type: 1 00010000:00010000:1.0:1788201592.769989:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 130 lru_type: 1 00000080:00200000:1.0:1788201592.770006:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.770014:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201592.770021:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.770036:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=performance-sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:1.0:1788201592.770040:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=performance-sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201592.770053:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: performance-sanity.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201592.770100:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f350 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.770107:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f350 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.770117:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f350 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.770141:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416c380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727977600:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.770238:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1450a6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.774484:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416c380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727977600:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.774516:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f350 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.774532:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f350 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.774540:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f350 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.774548:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f350 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.774568:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f350 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.774582:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3c800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201592.774587:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f350 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.774595:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f350 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.774603:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f350 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.774611:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201592.774619:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f350 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.774626:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3c800/0xd138388016f6f350 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201592.774650:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14416c380 x1875064727977600/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201592.774680:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201592.774711:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201592.774869:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.774887:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.774899:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 130 lru_type: 1 00010000:00010000:1.0:1788201592.774912:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 130 lru_type: 1 00000080:00200000:1.0:1788201592.774924:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.774930:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.774933:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.774940:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:1.0:1788201592.774944:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 130 lru_type: 1 00010000:00010000:1.0:1788201592.774953:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 131 lru_type: 1 00000080:00200000:1.0:1788201592.774970:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.774978:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201592.774984:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.775000:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201592.775007:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=performance-sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14304a000, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:1.0:1788201592.775016:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=performance-sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:1.0:1788201592.775040:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: performance-sanity.sh,[0x200000bd7:0x17b:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201592.775486:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.775495:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201592.775510:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201592.775518:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14416c380 x1875064727977856/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201592.775533:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.775569:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416c380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727977856:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.775729:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1450a6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.782903:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416c380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727977856:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.782941:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109761c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.782966:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109761c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.782974:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109761c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.782985:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109761c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.782996:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109761c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.783011:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109761c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.783019:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109761c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.783032:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109761c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201592.783046:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc14416c380 x1875064727977856/t8589937400(8589937400) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201592.783061:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14416c380 x1875064727977856/t8589937400(8589937400) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201592.783077:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109761c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201592.783105:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109761c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.783119:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/379 (0 0) 00000080:00200000:1.0:1788201592.783126:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201592.783143:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=performance-sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:1.0:1788201592.783192:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x17b:0x0](ffff8bc1446bcb08) 00000080:00200000:1.0:1788201592.783858:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x17b:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201592.783873:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x17b:0x0](ffff8bc1446bcb08) 00000080:00010000:1.0:1788201592.783876:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x17b:0x0](ffff8bc1446bcb08) for lock 0xd138388016f6f357 00000080:00010000:1.0:1788201592.783890:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x17b:0x0](ffff8bc1446bcb08) 00000080:00200008:1.0:1788201592.783909:0:24470:0:(file.c:1090:ll_file_open()) START file performance-sanity.sh:[0x200000bd7:0x17b:0x0](ffff8bc1446bcb08), flags 100301 00000002:00100000:1.0:1788201592.783935:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14416c380 x1875064727977856/t8589937400(8589937400) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201592.783986:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f357 from it ffff8bc144cb5000 00010000:00010000:1.0:1788201592.783993:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109761c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.784005:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109761c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201592.784030:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x17b:0x0](ffff8bc1446bcb08), inode mode 81a4 mask 40 00000080:00200008:1.0:1788201592.784062:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file performance-sanity.sh:[0x200000bd7:0x17b:0x0](ffff8bc1446bcb08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201592.784068:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x17b:0x0](ffff8bc1446bcb08),name=performance-sanity.sh 00000002:00010000:1.0:1788201592.784088:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x17b:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.784223:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109761c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.784236:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109761c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201592.784244:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.784249:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x17b:0x0](ffff8bc1446bcb08) 00000080:00010000:1.0:1788201592.784253:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x17b:0x0](ffff8bc1446bcb08) for lock 0xd138388016f6f357 00000080:00010000:1.0:1788201592.784257:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f357 from it ffffadd1c7debcd8 00010000:00010000:1.0:1788201592.784260:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109761c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.784268:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109761c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201592.784437:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17b:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201592.784446:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x17b:0x0] 00000008:00010000:1.0:1788201592.784474:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201592.784478:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4830, osc lock ffff8bc145d08e40, flags 0x400001002 00010000:00010000:1.0:1788201592.784530:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f35e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.784541:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f35e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201592.784573:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1788201592.785109:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727977984:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201592.790767:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f35e lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.790896:0:10054:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f35e lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109762a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.790915:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f35e lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109762a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.790929:0:10054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f35e lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109762a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201592.790949:0:10054:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f35e lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109762a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201592.790963:0:10054:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201592.791017:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f35e lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109762a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.791028:0:10054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f35e lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109762a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.791035:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f35e lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109762a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.791045:0:10054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f35e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e217109762a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201592.791072:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727977984:192.168.201.143@tcp:101:cp.0 00000080:00200000:1.0:1788201592.791428:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x17b:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201592.791437:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e246f0 (ffff8bc148e3b758/0) at cl_lock_release():245 00000020:00010000:1.0:1788201592.791441:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e246f0 (ffff8bc148e3b758/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.791445:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4830 (ffff8bc148e3bf38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.791450:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e246f0 (ffff8bc148e3b758/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201592.791453:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4830 (ffff8bc148e3b758/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201592.791496:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17b:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201592.791629:0:24470:0:(file.c:2638:do_file_write_iter()) START file performance-sanity.sh:[0x200000bd7:0x17b:0x0], ppos: 0, count: 3079 00000080:00200000:1.0:1788201592.791648:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 3079 bytes 00000080:00200000:1.0:1788201592.791654:0:24470:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 3079 00000080:00200000:1.0:1788201592.791754:0:24470:0:(file.c:2090:ll_file_io_generic()) performance-sanity.sh: write ppos: 0, bytes: 3079 00000080:00200000:1.0:1788201592.791761:0:24470:0:(file.c:1848:ll_io_set_mirror()) performance-sanity.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201592.791768:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@0000000004726381[0x110, 1, [0x200000bd7:0x17b:0x0] hash] 00000020:00200000:1.0:1788201592.791770:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 3079) 0 0 00000080:00200000:1.0:1788201592.791775:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17b:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201592.791895:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1788201592.791905:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 3079) 3079, 3079 00020000:00200000:1.0:1788201592.791909:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201592.791944:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1788201592.791957:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201592.791964:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4830, osc lock ffff8bc145d08e40, flags 0x0 00010000:00010000:1.0:1788201592.791984:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/432 (0 4095) 00010000:00010000:1.0:1788201592.792035:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.792046:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.792057:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.792085:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416fb80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727978112:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.792456:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201592.795860:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743478912 00000100:00100000:0.0:1788201592.795874:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743478912 00000100:00100000:0.0:1788201592.795982:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 749 00000100:00100000:0.0:1788201592.795993:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23415:x1875064743478912:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201592.796017:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f35e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109762a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.796155:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201592.796162:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23415:x1875064743478912:12345-192.168.201.143@tcp:104: Request processed in 171us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.796178:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 749 00010000:00010000:3.0:1788201592.796232:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201592.796241:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f35e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109762a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.796251:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3d400 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201592.796258:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f35e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e217109762a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201592.796329:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201592.796344:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201592.796431:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f35e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109762a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.796440:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201592.796470:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f35e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109762a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.796479:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f35e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109762a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.796498:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201592.796500:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201592.796502:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201592.796523:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727978240:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201592.800115:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201592.800234:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743479040 00000100:00100000:0.0:1788201592.800248:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743479040 00000100:00100000:0.0:1788201592.800315:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 750 00000100:00100000:0.0:1788201592.800326:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21003:x1875064743479040:12345-192.168.201.143@tcp:105: 00010000:00010000:0.0:1788201592.800350:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.800366:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.800375:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.800401:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.800413:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.800423:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.800452:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc149f3c800) 00000100:00100000:0.0:1788201592.800521:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21003:x1875064743479040:12345-192.168.201.143@tcp:105: Request processed in 197us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.800530:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 750 00000100:00100000:3.0:1788201592.803146:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727978240:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201592.803543:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416fb80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727978112:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.803639:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.803733:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201592.803749:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.803763:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.803771:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201592.803828:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) performance-sanity.sh: write [0, 3079) append 0 append lockpos 0 00000080:00200000:1.0:1788201592.803852:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 3079 bytes 00000080:00200000:1.0:1788201592.803925:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 3079, copied 3079 00000080:00200000:1.0:1788201592.803938:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c2877542[3 0000000092bc4f6e 2 1 000000008c1ba057 0 0 0] 00000080:00200000:1.0:1788201592.803942:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000cf1888cf 17ffffc0001001 3:0 ffff8bc1725a2620 0 lru 00000080:00200000:1.0:1788201592.803950:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007bd59df0 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 0000000026a3eafc > 3< 0 0 > 4< 0 0 8 0 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201592.803952:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c2877542 00000080:00200000:1.0:1788201592.803953:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201592.803959:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 3079 prio 0 00000008:00010000:1.0:1788201592.804052:0:17816:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000003ce7f60e ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:1.0:1788201592.804069:0:17816:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000003ce7f60e ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201592.804126:0:17816:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:1.0:1788201592.804419:0:17816:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc14416fb80 - object 0x280000400:417 offset 0<>5634 00000100:00100000:0.0:1788201592.804502:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727978368:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201592.806975:0:17816:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000354268d1 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:1.0:1788201592.807001:0:17816:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000354268d1 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201592.807058:0:17816:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:1.0:1788201592.807149:0:17816:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc14416d180 - object 0x280000400:418 offset 0<>1735 00000008:00010000:1.0:1788201592.807626:0:17816:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000298588cb ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:1.0:1788201592.807637:0:17816:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000298588cb ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201592.807744:0:17816:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:1.0:1788201592.807836:0:17816:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc14416f100 - object 0x280000400:419 offset 0<>38517 00000100:00100000:0.0:1788201592.807891:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727978624:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201592.808145:0:17816:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 0000000041ed5eb8 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096da9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:1.0:1788201592.808156:0:17816:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 0000000041ed5eb8 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096da9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201592.808187:0:17816:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096da9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:1.0:1788201592.808253:0:17816:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc14416dc00 - object 0x280000400:420 offset 0<>15476 00000008:00010000:3.0:1788201592.813968:0:10053:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000354268d1 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201592.813990:0:10053:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000354268d1 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201592.814006:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727978496:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201592.818307:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 000000009a8144be ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201592.818356:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1446bccb8, count 1, dirtied 1 00000080:00200000:1.0:1788201592.818367:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 3079 bytes, tot: 3079 00000080:00200000:1.0:1788201592.818373:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) performance-sanity.sh: write bytes 0, result: 3079 00000020:00010000:1.0:1788201592.818405:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c48a8 (ffff8bc148e3b758/0) at cl_lock_release():245 00000020:00010000:1.0:1788201592.818410:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c48a8 (ffff8bc148e3b758/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.818414:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4830 (ffff8bc148e3bf38/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201592.818423:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.818437:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201592.818458:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c48a8 (ffff8bc148e3b758/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201592.818462:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4830 (ffff8bc148e3b758/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201592.818473:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 3079 bytes 00000080:00200000:1.0:1788201592.818482:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1788201592.818504:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17b:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201592.818508:0:24470:0:(file.c:2238:ll_file_io_generic()) performance-sanity.sh: 2 io complete with rc: 0, result: 3079, restart: 0 00000080:00200000:1.0:1788201592.818523:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x17b:0x0] updating i_size 3079 i_blocks 1 00000080:00200000:1.0:1788201592.818529:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 3079 00000080:00200008:1.0:1788201592.818601:0:24470:0:(file.c:479:ll_file_release()) START file performance-sanity.sh:[0x200000bd7:0x17b:0x0](ffff8bc1446bcb08), flags 100001 00000002:00100000:1.0:1788201592.818699:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc14416c380 x1875064727977856/t8589937400(8589937400) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201608 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201592.818712:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201592.818719:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14416ca80 x1875064727979008/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201592.818748:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416ca80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727979008:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201592.818884:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43540 going to sleep for 11 seconds 00000008:00010000:1.0:1788201592.821774:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000298588cb ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201592.821865:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000298588cb ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201592.821900:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727978624:192.168.201.143@tcp:4:cp.0 00000008:00010000:0.0:1788201592.822133:0:10052:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000003ce7f60e ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201592.822153:0:10052:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000003ce7f60e ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:0.0:1788201592.822174:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727978368:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201592.824574:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416ca80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727979008:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201592.824623:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc14416c380 x1875064727977856/t8589937400(8589937400) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201592.824728:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.824752:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.824777:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 131 lru_type: 1 00010000:00010000:1.0:1788201592.824855:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 131 lru_type: 1 00000080:00200000:1.0:1788201592.824865:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.824873:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.824876:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.824885:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201592.824890:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 131 lru_type: 1 00010000:00010000:1.0:1788201592.824899:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 132 lru_type: 1 00000080:00200000:1.0:1788201592.824918:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.824926:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201592.824933:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.824937:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=performance-sanity.sh, flags=8 00000080:00200008:1.0:1788201592.824945:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file performance-sanity.sh:[0x200000bd7:0x17b:0x0](ffff8bc1446bcb08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201592.824950:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x17b:0x0](ffff8bc1446bcb08),name=performance-sanity.sh 00000002:00010000:1.0:1788201592.824963:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x17b:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.824972:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109761c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201592.824979:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109761c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201592.824986:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.824989:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x17b:0x0](ffff8bc1446bcb08) 00000080:00010000:1.0:1788201592.824992:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x17b:0x0](ffff8bc1446bcb08) for lock 0xd138388016f6f357 00000080:00010000:1.0:1788201592.824996:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f357 from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201592.825000:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109761c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201592.825007:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109761c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201592.825062:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17b:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201592.825074:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x17b:0x0] 00000008:00010000:1.0:1788201592.825107:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201592.825112:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4830, osc lock ffff8bc145d08e40, flags 0x400001002 00010000:00010000:1.0:1788201592.825132:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.825145:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201592.825160:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201592.825165:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.825174:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201592.825186:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201592.825195:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x17b:0x0] updating i_size 3079 i_blocks 1 00000020:00010000:1.0:1788201592.825199:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e246f0 (ffff8bc148e3b758/0) at cl_lock_release():245 00000020:00010000:1.0:1788201592.825203:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e246f0 (ffff8bc148e3b758/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.825206:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4830 (ffff8bc148e3bf38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.825210:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e246f0 (ffff8bc148e3b758/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201592.825213:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4830 (ffff8bc148e3b758/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201592.825241:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17b:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201592.825675:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.825687:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.825694:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 132 lru_type: 1 00010000:00010000:1.0:1788201592.825704:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 132 lru_type: 1 00000080:00200000:1.0:1788201592.825710:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.825714:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.825716:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.825720:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201592.825723:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 132 lru_type: 1 00010000:00010000:1.0:1788201592.825731:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 133 lru_type: 1 00000080:00200000:1.0:1788201592.825740:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.825743:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201592.825747:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.825760:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=pjdfstest.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201592.825764:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=pjdfstest.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201592.825773:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: pjdfstest.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201592.825850:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f36c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.825858:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f36c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.825869:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f36c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.825894:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416f480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727979136:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.825991:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.829900:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416f480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727979136:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.829935:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f36c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.829953:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f36c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.829961:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f36c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.829969:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f36c lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.829978:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f36c lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.829986:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3d400 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201592.829991:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f36c lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.830000:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f36c lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.830008:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f36c lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.830016:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201592.830023:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f36c lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.830029:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f36c lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201592.830056:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14416f480 x1875064727979136/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201592.830075:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201592.830107:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201592.830200:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.830219:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.830230:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 133 lru_type: 1 00010000:00010000:1.0:1788201592.830245:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 133 lru_type: 1 00000080:00200000:1.0:1788201592.830252:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.830258:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.830262:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.830268:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201592.830474:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 133 lru_type: 1 00010000:00010000:1.0:1788201592.830486:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 134 lru_type: 1 00000080:00200000:1.0:1788201592.830504:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.830513:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000100:00100000:1.0:1788201592.835493:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f4700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727979264:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.835523:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f373 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.835541:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f373 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.835548:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f373 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.835569:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f373 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.835581:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f373 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.835590:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172490800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201592.835595:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f373 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.835604:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f373 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.835612:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f373 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.835620:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201592.835627:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f373 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.835634:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f373 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201592.835670:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1725f4700 x1875064727979264/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201592.835690:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201592.835722:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201592.835909:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.835929:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.835941:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 134 lru_type: 1 00010000:00010000:1.0:1788201592.835956:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 134 lru_type: 1 00000080:00200000:1.0:1788201592.835964:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.835970:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.835974:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.835981:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:1.0:1788201592.835985:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 134 lru_type: 1 00010000:00010000:1.0:1788201592.835995:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 135 lru_type: 1 00000080:00200000:1.0:1788201592.836012:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.836021:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201592.836027:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.836046:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201592.836051:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=pjdfstest.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14304a000, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:1.0:1788201592.836060:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=pjdfstest.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:1.0:1788201592.836084:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: pjdfstest.sh,[0x200000bd7:0x17c:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201592.836159:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.836167:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201592.836181:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201592.836189:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14416f480 x1875064727979520/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201592.836199:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.836226:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14416f480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727979520:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.836431:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.844891:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14416f480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727979520:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.844928:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097677 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.844956:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x17c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097677 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.844964:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x17c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097677 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.844976:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x17c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097677 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.844991:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x17c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097677 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.845006:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x17c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097677 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.845016:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x17c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097677 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.845024:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x17c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097677 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201592.845037:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc14416f480 x1875064727979520/t8589937402(8589937402) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201592.845051:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14416f480 x1875064727979520/t8589937402(8589937402) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201592.845066:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x17c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097677 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201592.845079:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x17c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097677 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.845103:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/380 (0 0) 00000080:00200000:1.0:1788201592.845112:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201592.845128:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=pjdfstest.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:1.0:1788201592.845178:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x17c:0x0](ffff8bc1446baa08) 00000080:00200000:1.0:1788201592.845431:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x17c:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201592.845441:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x17c:0x0](ffff8bc1446baa08) 00000080:00010000:1.0:1788201592.845443:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x17c:0x0](ffff8bc1446baa08) for lock 0xd138388016f6f37a 00000080:00010000:1.0:1788201592.845456:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x17c:0x0](ffff8bc1446baa08) 00000080:00200008:1.0:1788201592.845474:0:24470:0:(file.c:1090:ll_file_open()) START file pjdfstest.sh:[0x200000bd7:0x17c:0x0](ffff8bc1446baa08), flags 100301 00000002:00100000:1.0:1788201592.845496:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14416f480 x1875064727979520/t8589937402(8589937402) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201592.845547:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f37a from it ffff8bc1466cd6c0 00010000:00010000:1.0:1788201592.845553:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x17c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097677 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.845628:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x17c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097677 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201592.845656:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x17c:0x0](ffff8bc1446baa08), inode mode 81a4 mask 40 00000080:00200008:1.0:1788201592.845760:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file pjdfstest.sh:[0x200000bd7:0x17c:0x0](ffff8bc1446baa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201592.845767:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x17c:0x0](ffff8bc1446baa08),name=pjdfstest.sh 00000002:00010000:1.0:1788201592.845817:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x17c:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.845829:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x17c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097677 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.845842:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x17c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097677 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201592.845850:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.845855:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x17c:0x0](ffff8bc1446baa08) 00000080:00010000:1.0:1788201592.845860:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x17c:0x0](ffff8bc1446baa08) for lock 0xd138388016f6f37a 00000080:00010000:1.0:1788201592.845864:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f37a from it ffffadd1c7debcd8 00010000:00010000:1.0:1788201592.845867:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x17c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097677 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.845875:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x17c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097677 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201592.845904:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17c:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201592.845915:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x17c:0x0] 00000008:00010000:1.0:1788201592.845945:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201592.845950:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d42b0, osc lock ffff8bc145d08e40, flags 0x400001002 00010000:00010000:1.0:1788201592.846010:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f381 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.846022:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f381 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201592.846068:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1788201592.846263:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201592.846298:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727979648:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201592.850082:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f381 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.850235:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f381 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097685 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.850254:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f381 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097685 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.850269:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f381 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097685 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201592.850397:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f381 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097685 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201592.850410:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201592.850428:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f381 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097685 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.850437:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f381 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097685 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.850445:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f381 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097685 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.850454:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f381 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171097685 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201592.850482:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727979648:192.168.201.143@tcp:101:cp.0 00000080:00200000:1.0:1788201592.850840:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x17c:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201592.850848:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e246f0 (ffff8bc148e3b758/0) at cl_lock_release():245 00000020:00010000:1.0:1788201592.850852:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e246f0 (ffff8bc148e3b758/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.850857:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d42b0 (ffff8bc148e3bf38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.850863:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e246f0 (ffff8bc148e3b758/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201592.850866:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d42b0 (ffff8bc148e3b758/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201592.850911:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17c:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201592.850984:0:24470:0:(file.c:2638:do_file_write_iter()) START file pjdfstest.sh:[0x200000bd7:0x17c:0x0], ppos: 0, count: 4150 00000080:00200000:1.0:1788201592.851018:0:24470:0:(file.c:2090:ll_file_io_generic()) pjdfstest.sh: write ppos: 0, bytes: 4150 00000080:00200000:1.0:1788201592.851026:0:24470:0:(file.c:1848:ll_io_set_mirror()) pjdfstest.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201592.851035:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000447e24f7[0x110, 1, [0x200000bd7:0x17c:0x0] hash] 00000020:00200000:1.0:1788201592.851037:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4150) 0 0 00000080:00200000:1.0:1788201592.851042:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17c:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201592.851056:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 1] 00020000:00200000:1.0:1788201592.851065:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4150) 4150, 4150 00020000:00200000:1.0:1788201592.851069:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201592.851406:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 1] 00000008:00010000:1.0:1788201592.851421:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201592.851427:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d42b0, osc lock ffff8bc145d08e40, flags 0x0 00010000:00010000:1.0:1788201592.851445:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/432 (0 8191) 00010000:00010000:1.0:1788201592.851499:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f388 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.851511:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f388 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b0:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.851522:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f388 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b0:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.851548:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146029c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727979776:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.852355:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201592.855723:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743479168 00000100:00100000:0.0:1788201592.855736:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743479168 00000100:00100000:0.0:1788201592.855873:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 751 00000100:00100000:0.0:1788201592.855887:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23408:x1875064743479168:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201592.855913:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f381 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097685 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.856022:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201592.856030:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23408:x1875064743479168:12345-192.168.201.143@tcp:104: Request processed in 146us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.856041:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 751 00010000:00010000:1.0:1788201592.856119:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201592.856129:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f381 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097685 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.856139:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3d400 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201592.856146:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f381 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171097685 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201592.856232:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201592.856250:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201592.857072:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f381 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097685 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.857086:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201592.857136:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f381 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097685 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.857147:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f381 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097685 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.857174:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201592.857177:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201592.857179:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201592.862988:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743479296 00000100:00100000:3.0:1788201592.863001:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743479296 00000100:00100000:3.0:1788201592.863062:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 752 00000100:00100000:3.0:1788201592.863073:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21004:x1875064743479296:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201592.863093:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f388 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109768c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.863108:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f388 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109768c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.863119:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f388 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e217109768c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.863139:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f388 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e217109768c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.863149:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f388 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e217109768c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.863159:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f388 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e217109768c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.863196:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc149f3c200) 00000100:00100000:3.0:1788201592.863277:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21004:x1875064743479296:12345-192.168.201.143@tcp:105: Request processed in 199us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201592.863285:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 752 00000100:00100000:1.0:1788201592.869890:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f5880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727980160:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201592.869935:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc14416f480 x1875064727979520/t8589937402(8589937402) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201592.870029:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.870053:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.870076:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 135 lru_type: 1 00010000:00010000:1.0:1788201592.870093:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 135 lru_type: 1 00000080:00200000:1.0:1788201592.870104:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.870111:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.870115:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.870124:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201592.870128:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 135 lru_type: 1 00010000:00010000:1.0:1788201592.870139:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 136 lru_type: 1 00000080:00200000:1.0:1788201592.870158:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.870165:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201592.870184:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.870189:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=pjdfstest.sh, flags=8 00000080:00200008:1.0:1788201592.870198:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file pjdfstest.sh:[0x200000bd7:0x17c:0x0](ffff8bc1446baa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201592.870204:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x17c:0x0](ffff8bc1446baa08),name=pjdfstest.sh 00000002:00010000:1.0:1788201592.870217:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x17c:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.870225:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x17c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097677 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201592.870233:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x17c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097677 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201592.870240:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.870244:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x17c:0x0](ffff8bc1446baa08) 00000080:00010000:1.0:1788201592.870246:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x17c:0x0](ffff8bc1446baa08) for lock 0xd138388016f6f37a 00000080:00010000:1.0:1788201592.870251:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f37a from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201592.870254:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x17c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097677 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201592.870263:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x17c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097677 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201592.870327:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17c:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201592.870338:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x17c:0x0] 00000008:00010000:1.0:1788201592.870371:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201592.870374:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4db0, osc lock ffff8bc145d08000, flags 0x400001002 00010000:00010000:1.0:1788201592.870405:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f388 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109768c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.870417:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f388 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109768c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201592.870431:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201592.870435:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f388 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109768c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.870444:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f388 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109768c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201592.870455:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201592.870465:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x17c:0x0] updating i_size 4150 i_blocks 1 00000020:00010000:1.0:1788201592.870469:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e272e0 (ffff8bc148e3bea8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201592.870472:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e272e0 (ffff8bc148e3bea8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.870475:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4db0 (ffff8bc148e3b1b8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.870480:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e272e0 (ffff8bc148e3bea8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201592.870483:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4db0 (ffff8bc148e3bea8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201592.870519:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17c:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201592.870581:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.870591:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.870598:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 136 lru_type: 1 00010000:00010000:1.0:1788201592.870608:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 136 lru_type: 1 00000080:00200000:1.0:1788201592.870614:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.870619:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.870622:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.870626:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201592.870629:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 136 lru_type: 1 00010000:00010000:1.0:1788201592.870638:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 137 lru_type: 1 00000080:00200000:1.0:1788201592.870648:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.870652:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201592.870656:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.870670:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=racer.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201592.870675:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=racer.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201592.870686:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: racer.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201592.870739:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f38f lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.870748:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f38f lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.870760:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f38f lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.870786:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146029500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727980288:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.870957:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.877623:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146029500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727980288:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.877656:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f38f lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.877684:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f38f lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.877692:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f38f lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.877700:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f38f lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.877711:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f38f lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.877718:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3d400 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201592.877724:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f38f lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.877737:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f38f lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.877746:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f38f lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.877753:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201592.877761:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f38f lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.877767:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f38f lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201592.877848:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc146029500 x1875064727980288/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201592.877868:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201592.877899:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201592.877983:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.878004:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.878015:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 137 lru_type: 1 00010000:00010000:1.0:1788201592.878028:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 137 lru_type: 1 00000080:00200000:1.0:1788201592.878036:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.878042:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.878046:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.878053:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201592.878057:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 137 lru_type: 1 00010000:00010000:1.0:1788201592.878067:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 138 lru_type: 1 00000080:00200000:1.0:1788201592.878086:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.878095:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201592.878102:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.878119:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=racer.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:1.0:1788201592.878122:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=racer.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201592.878136:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: racer.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201592.878190:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d000/0xd138388016f6f396 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.878197:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d000/0xd138388016f6f396 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.878209:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d000/0xd138388016f6f396 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.878237:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146029500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727980416:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.878456:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.892981:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f6d80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727980672:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.893018:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490c00/0xd138388016f6f39d lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710976d2 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.893058:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490c00/0xd138388016f6f39d lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710976d2 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.893068:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490c00/0xd138388016f6f39d lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710976d2 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.893081:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490c00/0xd138388016f6f39d lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710976d2 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.893346:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490c00/0xd138388016f6f39d lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710976d2 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.893365:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490c00/0xd138388016f6f39d lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710976d2 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.893374:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490c00/0xd138388016f6f39d lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710976d2 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.893391:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490c00/0xd138388016f6f39d lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710976d2 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201592.893406:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1725f6d80 x1875064727980672/t8589937404(8589937404) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201592.893421:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725f6d80 x1875064727980672/t8589937404(8589937404) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201592.893437:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490c00/0xd138388016f6f39d lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710976d2 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201592.893452:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490c00/0xd138388016f6f39d lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710976d2 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.893463:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/381 (0 0) 00000080:00200000:1.0:1788201592.893472:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201592.893489:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=racer.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:1.0:1788201592.893525:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x17d:0x0](ffff8bc1446bd348) 00000080:00200000:1.0:1788201592.894536:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x17d:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201592.894631:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x17d:0x0](ffff8bc1446bd348) 00000080:00010000:1.0:1788201592.894636:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x17d:0x0](ffff8bc1446bd348) for lock 0xd138388016f6f39d 00000080:00010000:1.0:1788201592.894653:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x17d:0x0](ffff8bc1446bd348) 00000080:00200008:1.0:1788201592.894746:0:24470:0:(file.c:1090:ll_file_open()) START file racer.sh:[0x200000bd7:0x17d:0x0](ffff8bc1446bd348), flags 100301 00000002:00100000:1.0:1788201592.894779:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725f6d80 x1875064727980672/t8589937404(8589937404) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201592.894850:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f39d from it ffff8bc1507dbf00 00010000:00010000:1.0:1788201592.894858:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490c00/0xd138388016f6f39d lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710976d2 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.894871:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490c00/0xd138388016f6f39d lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710976d2 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201592.894898:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x17d:0x0](ffff8bc1446bd348), inode mode 81ed mask 40 00000080:00200008:1.0:1788201592.894932:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file racer.sh:[0x200000bd7:0x17d:0x0](ffff8bc1446bd348), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201592.894939:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x17d:0x0](ffff8bc1446bd348),name=racer.sh 00000002:00010000:1.0:1788201592.894963:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x17d:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.894978:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490c00/0xd138388016f6f39d lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710976d2 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.894992:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490c00/0xd138388016f6f39d lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710976d2 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201592.895000:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.895005:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x17d:0x0](ffff8bc1446bd348) 00000080:00010000:1.0:1788201592.895009:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x17d:0x0](ffff8bc1446bd348) for lock 0xd138388016f6f39d 00000080:00010000:1.0:1788201592.895013:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f39d from it ffffadd1c7debcd8 00010000:00010000:1.0:1788201592.895016:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490c00/0xd138388016f6f39d lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710976d2 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.895023:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490c00/0xd138388016f6f39d lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710976d2 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201592.895050:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17d:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201592.895060:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x17d:0x0] 00000008:00010000:1.0:1788201592.895237:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201592.895242:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4630, osc lock ffff8bc145d08000, flags 0x400001002 00010000:00010000:1.0:1788201592.895415:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f3a4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.895427:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f3a4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201592.895533:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727980800:192.168.201.143@tcp:101:cp.0 00000020:00200000:1.0:1788201592.896823:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1788201592.900755:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f3a4 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.900789:0:10054:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f3a4 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710976e0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.900890:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f3a4 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710976e0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.900906:0:10054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f3a4 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710976e0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201592.900924:0:10054:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f3a4 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710976e0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201592.900937:0:10054:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201592.900995:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f3a4 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710976e0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.901005:0:10054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f3a4 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710976e0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.901012:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f3a4 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710976e0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.901022:0:10054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f3a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e21710976e0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201592.901046:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727980800:192.168.201.143@tcp:101:cp.0 00000080:00200000:1.0:1788201592.901239:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x17d:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201592.901246:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e272e0 (ffff8bc148e3bea8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201592.901249:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e272e0 (ffff8bc148e3bea8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.901254:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4630 (ffff8bc148e3b1b8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.901259:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e272e0 (ffff8bc148e3bea8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201592.901261:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4630 (ffff8bc148e3bea8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201592.901372:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17d:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201592.901457:0:24470:0:(file.c:2638:do_file_write_iter()) START file racer.sh:[0x200000bd7:0x17d:0x0], ppos: 0, count: 7187 00000080:00200000:1.0:1788201592.901493:0:24470:0:(file.c:2090:ll_file_io_generic()) racer.sh: write ppos: 0, bytes: 7187 00000080:00200000:1.0:1788201592.901500:0:24470:0:(file.c:1848:ll_io_set_mirror()) racer.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201592.901505:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@000000005e134025[0x110, 1, [0x200000bd7:0x17d:0x0] hash] 00000020:00200000:1.0:1788201592.901508:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 7187) 0 0 00000080:00200000:1.0:1788201592.901512:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17d:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201592.901525:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 1] 00020000:00200000:1.0:1788201592.901533:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 7187) 7187, 7187 00020000:00200000:1.0:1788201592.901536:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201592.901637:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 1] 00000008:00010000:1.0:1788201592.901652:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201592.901720:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4630, osc lock ffff8bc145d08000, flags 0x0 00010000:00010000:1.0:1788201592.901739:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/433 (0 8191) 00010000:00010000:1.0:1788201592.901787:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000069322032/0xd138388016f6f3ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.901824:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000069322032/0xd138388016f6f3ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.901835:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000069322032/0xd138388016f6f3ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.901861:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727980928:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.902031:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d436c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201592.909130:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201592.909234:0:20876:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788201592.909258:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743479424 00000100:00100000:0.0:1788201592.909281:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743479424 00000100:00100000:0.0:1788201592.909361:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 753 00000100:00100000:0.0:1788201592.909372:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172702850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23411:x1875064743479424:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201592.909408:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f3a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710976e0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.913400:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201592.913427:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172702850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23411:x1875064743479424:12345-192.168.201.143@tcp:104: Request processed in 4047us (4303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.913441:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 753 00010000:00010000:0.0:1788201592.913510:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201592.913520:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f3a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710976e0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.913536:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3d400 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201592.913546:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f3a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e21710976e0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201592.913629:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201592.913644:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1788201592.913902:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f3a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710976e0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.913912:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201592.913943:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f3a4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710976e0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.913953:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f3a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710976e0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.913970:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201592.913972:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201592.913974:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201592.913983:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201592.914000:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727981056:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201592.923240:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743479552 00000100:00100000:1.0:1788201592.923254:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743479552 00000100:00100000:1.0:1788201592.923458:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 754 00000100:00100000:1.0:1788201592.923472:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21005:x1875064743479552:12345-192.168.201.143@tcp:105: 00010000:00010000:1.0:1788201592.923494:0:20877:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000069322032/0xd138388016f6f3ab lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710976e7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.923510:0:20877:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000069322032/0xd138388016f6f3ab lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710976e7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.923521:0:20877:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000069322032/0xd138388016f6f3ab lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710976e7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.923533:0:20877:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000069322032/0xd138388016f6f3ab lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710976e7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.923544:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000069322032/0xd138388016f6f3ab lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710976e7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.923566:0:20877:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000069322032/0xd138388016f6f3ab lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e21710976e7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.923644:0:20877:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc149f3d000) 00000100:00100000:1.0:1788201592.923884:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21005:x1875064743479552:12345-192.168.201.143@tcp:105: Request processed in 414us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201592.923893:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 754 00000100:00100000:3.0:1788201592.926761:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727981056:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201592.931143:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f6300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727981312:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201592.931201:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1725f6d80 x1875064727980672/t8589937404(8589937404) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201592.931304:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.931330:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.931355:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 139 lru_type: 1 00010000:00010000:1.0:1788201592.931373:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 139 lru_type: 1 00000080:00200000:1.0:1788201592.931393:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.931400:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.931404:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.931414:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201592.931419:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 139 lru_type: 1 00010000:00010000:1.0:1788201592.931429:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 140 lru_type: 1 00000080:00200000:1.0:1788201592.931447:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.931455:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201592.931462:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.931466:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=racer.sh, flags=8 00000080:00200008:1.0:1788201592.931476:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file racer.sh:[0x200000bd7:0x17d:0x0](ffff8bc1446bd348), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201592.931482:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x17d:0x0](ffff8bc1446bd348),name=racer.sh 00000002:00010000:1.0:1788201592.931495:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x17d:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.931506:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490c00/0xd138388016f6f39d lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710976d2 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201592.931515:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490c00/0xd138388016f6f39d lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710976d2 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201592.931522:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.931526:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x17d:0x0](ffff8bc1446bd348) 00000080:00010000:1.0:1788201592.931528:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x17d:0x0](ffff8bc1446bd348) for lock 0xd138388016f6f39d 00000080:00010000:1.0:1788201592.931532:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f39d from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201592.931536:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490c00/0xd138388016f6f39d lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710976d2 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201592.931544:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490c00/0xd138388016f6f39d lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710976d2 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201592.931612:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17d:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201592.931624:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x17d:0x0] 00000008:00010000:1.0:1788201592.931903:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201592.931907:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4030, osc lock ffff8bc145d08720, flags 0x400001002 00010000:00010000:1.0:1788201592.931928:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000069322032/0xd138388016f6f3ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710976e7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.931943:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000069322032/0xd138388016f6f3ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710976e7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201592.931958:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201592.931963:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000069322032/0xd138388016f6f3ab lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710976e7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201592.931974:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000069322032/0xd138388016f6f3ab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710976e7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201592.931986:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201592.931998:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x17d:0x0] updating i_size 7187 i_blocks 1 00000020:00010000:1.0:1788201592.932003:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e244a0 (ffff8bc148e3bc68/0) at cl_lock_release():245 00000020:00010000:1.0:1788201592.932006:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e244a0 (ffff8bc148e3bc68/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.932009:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4030 (ffff8bc148e3b7e8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201592.932013:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e244a0 (ffff8bc148e3bc68/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201592.932016:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4030 (ffff8bc148e3bc68/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201592.932050:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17d:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201592.932118:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201592.932127:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201592.932134:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 140 lru_type: 1 00010000:00010000:1.0:1788201592.932143:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 140 lru_type: 1 00000080:00200000:1.0:1788201592.932151:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201592.932156:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201592.932159:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201592.932163:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201592.932167:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 140 lru_type: 1 00010000:00010000:1.0:1788201592.932179:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 141 lru_type: 1 00000080:00200000:1.0:1788201592.932189:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.932193:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201592.932196:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201592.932211:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=recovery-double-scale.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201592.932217:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=recovery-double-scale.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201592.932227:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: recovery-double-scale.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201592.932450:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f3b2 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.932459:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f3b2 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.932472:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f3b2 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.932500:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146028e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727981440:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201592.932972:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201592.939886:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146028e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727981440:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201592.939920:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f3b2 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.939936:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f3b2 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.939949:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f3b2 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.939957:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f3b2 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.939966:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f3b2 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.939974:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1427ddc00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201592.939979:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f3b2 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.939987:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f3b2 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.939995:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f3b2 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.940003:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201592.940012:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f3b2 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.940019:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f3b2 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201592.940042:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc146028e00 x1875064727981440/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 600/584 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201592.940060:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201592.940237:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201592.940402:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201592.940423:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201592.940436:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 141 lru_type: 1 00010000:00010000:0.0:1788201592.940449:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 141 lru_type: 1 00000080:00200000:0.0:1788201592.940463:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201592.940470:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201592.940474:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201592.940482:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201592.940486:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 141 lru_type: 1 00010000:00010000:0.0:1788201592.940496:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 142 lru_type: 1 00000080:00200000:0.0:1788201592.940516:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201592.940526:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201592.940533:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201592.940550:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=recovery-double-scale.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:0.0:1788201592.940554:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=recovery-double-scale.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201592.940640:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: recovery-double-scale.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201592.940766:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6f3b9 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.940775:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6f3b9 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.940786:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48800/0xd138388016f6f3b9 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201592.940900:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415b480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727981568:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201592.941066:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201592.953007:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f7480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727981824:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201592.953041:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f3c0 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109772d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.953067:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f3c0 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109772d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.953076:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f3c0 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109772d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.953088:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f3c0 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109772d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.953111:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f3c0 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109772d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.953128:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f3c0 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109772d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.953137:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f3c0 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109772d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.953146:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f3c0 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109772d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201592.953169:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1725f7480 x1875064727981824/t8589937406(8589937406) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 672/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201592.953185:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725f7480 x1875064727981824/t8589937406(8589937406) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 672/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201592.953202:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109772d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1788201592.953217:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109772d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.953230:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/382 (0 0) 00000080:00200000:0.0:1788201592.953238:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201592.953255:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=recovery-double-scale.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:0.0:1788201592.953304:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x17e:0x0](ffff8bc144682a08) 00000080:00200000:0.0:1788201592.953487:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x17e:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1788201592.953499:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x17e:0x0](ffff8bc144682a08) 00000080:00010000:0.0:1788201592.953503:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x17e:0x0](ffff8bc144682a08) for lock 0xd138388016f6f3c0 00000080:00010000:0.0:1788201592.953515:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x17e:0x0](ffff8bc144682a08) 00000080:00200008:0.0:1788201592.953534:0:24470:0:(file.c:1090:ll_file_open()) START file recovery-double-scale.sh:[0x200000bd7:0x17e:0x0](ffff8bc144682a08), flags 100301 00000002:00100000:0.0:1788201592.953571:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725f7480 x1875064727981824/t8589937406(8589937406) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 600/664 e 0 to 0 dl 1788201608 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1788201592.953627:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f3c0 from it ffff8bc1507db840 00010000:00010000:0.0:1788201592.953632:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109772d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.953642:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f3c0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109772d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201592.953916:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x17e:0x0](ffff8bc144682a08), inode mode 81a4 mask 40 00000080:00200008:0.0:1788201592.953952:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file recovery-double-scale.sh:[0x200000bd7:0x17e:0x0](ffff8bc144682a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201592.953960:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x17e:0x0](ffff8bc144682a08),name=recovery-double-scale.sh 00000002:00010000:0.0:1788201592.953983:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x17e:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201592.953995:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f3c0 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109772d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.954008:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f3c0 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109772d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201592.954016:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201592.954021:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x17e:0x0](ffff8bc144682a08) 00000080:00010000:0.0:1788201592.954024:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x17e:0x0](ffff8bc144682a08) for lock 0xd138388016f6f3c0 00000080:00010000:0.0:1788201592.954028:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f3c0 from it ffffadd1c7debcd8 00010000:00010000:0.0:1788201592.954031:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109772d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201592.954039:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f3c0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109772d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201592.954067:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17e:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201592.954076:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x17e:0x0] 00000008:00010000:0.0:1788201592.954103:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201592.954107:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456030, osc lock ffff8bc145d35560, flags 0x400001002 00010000:00010000:0.0:1788201592.954159:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6f3c7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.954170:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6f3c7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201592.954256:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727981952:192.168.201.143@tcp:101:cp.0 00000020:00200000:0.0:1788201592.954411:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201592.958943:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6f3c7 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.958981:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6f3c7 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109773b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.958999:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6f3c7 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109773b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.959014:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6f3c7 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109773b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201592.959032:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6f3c7 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109773b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201592.959045:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1788201592.959058:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6f3c7 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109773b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.959068:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6f3c7 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109773b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.959076:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6f3c7 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109773b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.959107:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6f3c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e217109773b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201592.959132:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727981952:192.168.201.143@tcp:101:cp.0 00000080:00200000:3.0:1788201592.959967:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x17e:0x0] updating i_size 0 i_blocks 1 00000020:00010000:3.0:1788201592.959976:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449db530 (ffff8bc1499c4c68/0) at cl_lock_release():245 00000020:00010000:3.0:1788201592.959981:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449db530 (ffff8bc1499c4c68/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201592.959986:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456030 (ffff8bc1499c4638/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201592.959991:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449db530 (ffff8bc1499c4c68/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201592.959994:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456030 (ffff8bc1499c4c68/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201592.960035:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17e:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1788201592.960123:0:24470:0:(file.c:2638:do_file_write_iter()) START file recovery-double-scale.sh:[0x200000bd7:0x17e:0x0], ppos: 0, count: 8441 00000080:00200000:3.0:1788201592.960171:0:24470:0:(file.c:2090:ll_file_io_generic()) recovery-double-scale.sh: write ppos: 0, bytes: 8441 00000080:00200000:3.0:1788201592.960180:0:24470:0:(file.c:1848:ll_io_set_mirror()) recovery-double-scale.sh: desiginated mirror: 0 00000020:00200000:3.0:1788201592.960187:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@000000004bf9a5bf[0x110, 1, [0x200000bd7:0x17e:0x0] hash] 00000020:00200000:3.0:1788201592.960190:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 8441) 0 0 00000080:00200000:3.0:1788201592.960194:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17e:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201592.960208:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 2] 00020000:00200000:3.0:1788201592.960217:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 8441) 8441, 8441 00020000:00200000:3.0:1788201592.960222:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1788201592.960256:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 2] 00000008:00010000:3.0:1788201592.960464:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1788201592.960472:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149feccb0, osc lock ffff8bc14691b430, flags 0x0 00010000:00010000:3.0:1788201592.960493:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/433 (0 12287) 00010000:00010000:3.0:1788201592.960553:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.960564:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.960577:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201592.960611:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727982080:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201592.960905:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201592.964510:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743479680 00000100:00100000:3.0:1788201592.964523:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743479680 00000100:00100000:3.0:1788201592.964602:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 755 00000100:00100000:3.0:1788201592.964613:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21821:x1875064743479680:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201592.964636:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6f3c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109773b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.964747:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201592.964756:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21821:x1875064743479680:12345-192.168.201.143@tcp:104: Request processed in 144us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201592.964764:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 755 00010000:00010000:3.0:1788201592.964822:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201592.964830:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6f3c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109773b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.964841:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc143a48a00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201592.964847:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6f3c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e217109773b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201592.964910:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201592.964927:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201592.965010:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6f3c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109773b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.965019:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201592.965052:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6f3c7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109773b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.965061:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000135d9a5d/0xd138388016f6f3c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109773b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201592.965081:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201592.965083:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201592.965084:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201592.965426:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201592.965450:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727982208:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201592.970120:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743479808 00000100:00100000:1.0:1788201592.970134:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743479808 00000100:00100000:1.0:1788201592.970213:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 756 00000100:00100000:1.0:1788201592.970225:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21003:x1875064743479808:12345-192.168.201.143@tcp:105: 00010000:00010000:1.0:1788201592.970246:0:20877:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097742 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.970262:0:20877:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097742 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.970283:0:20877:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097742 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.970296:0:20877:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097742 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.970306:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097742 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.970323:0:20877:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171097742 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201592.970348:0:20877:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1725a1400) 00000100:00100000:1.0:1788201592.970433:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21003:x1875064743479808:12345-192.168.201.143@tcp:105: Request processed in 210us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201592.970442:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 756 00000100:00100000:3.0:1788201592.970932:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727982080:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201592.970957:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097742 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.970980:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097742 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201592.970995:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171097742 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.971011:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097742 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.971022:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097742 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201592.971052:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) recovery-double-scale.sh: write [0, 8441) append 0 append lockpos 0 00000080:00200000:3.0:1788201592.971074:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:3.0:1788201592.971134:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:3.0:1788201592.971146:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004d813b44[3 00000000fa292e87 2 1 0000000066f23e14 0 0 0] 00000080:00200000:3.0:1788201592.971150:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000dc5ca64f 17ffffc0001001 3:0 ffff8bc1460728c0 0 lru 00000080:00200000:3.0:1788201592.971159:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000660a4835 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000e14f883c > 3< 0 0 > 4< 0 0 8 0 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201592.971161:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004d813b44 00000080:00200000:3.0:1788201592.971163:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201592.971166:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:3.0:1788201592.971189:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:3.0:1788201592.971194:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000cc4abf65[3 00000000fa292e87 2 1 0000000066f23e14 0 0 1] 00000080:00200000:3.0:1788201592.971197:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000316e5b57 17ffffc0001001 3:0 ffff8bc146072e00 1 lru 00000080:00200000:3.0:1788201592.971203:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000071af18af 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 00000000e14f883c > 3< 0 0 > 4< 0 0 8 0 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201592.971206:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000cc4abf65 00000080:00200000:3.0:1788201592.971208:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:3.0:1788201592.971209:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 249 bytes 00000080:00200000:3.0:1788201592.971231:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 249, copied 249 00000080:00200000:3.0:1788201592.971235:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000051ee453f[3 00000000fa292e87 2 1 0000000066f23e14 0 0 2] 00000080:00200000:3.0:1788201592.971239:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b393b927 17ffffc0001001 3:0 ffff8bc146072ee0 2 lru 00000080:00200000:3.0:1788201592.971245:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000082bce887 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000000ce25486 00000000e14f883c > 3< 0 0 > 4< 0 0 8 0 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201592.971247:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000051ee453f 00000080:00200000:3.0:1788201592.971248:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:3.0:1788201592.971252:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 3, from 0, to 249 prio 0 00000008:00010000:3.0:1788201592.974267:0:9520:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000436963de ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:3.0:1788201592.974549:0:9520:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000436963de ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201592.974750:0:9520:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 1 00000008:00100000:3.0:1788201592.975067:0:9520:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1724a1500 - object 0x240000400:416 offset 0<>903 00000008:00010000:3.0:1788201592.975120:0:9520:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000004c75ab65 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:3.0:1788201592.975131:0:9520:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000004c75ab65 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201592.975262:0:9520:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:3.0:1788201592.975535:0:9520:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1724a2300 - object 0x240000400:417 offset 0<>394763 00000008:00010000:3.0:1788201592.975551:0:9520:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000390cd994 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096c98 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:3.0:1788201592.975573:0:9520:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000390cd994 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096c98 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201592.975603:0:9520:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096c98 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:3.0:1788201592.975682:0:9520:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1724a3800 - object 0x240000400:418 offset 0<>9974 00000008:00010000:3.0:1788201592.975706:0:9520:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000005de6e866 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096d4e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:3.0:1788201592.975715:0:9520:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000005de6e866 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096d4e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201592.975749:0:9520:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096d4e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:3.0:1788201592.975824:0:9520:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1724a0e00 - object 0x240000400:419 offset 0<>39343 00000008:00010000:3.0:1788201592.975837:0:9520:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000ba6985c4 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000083541a8b/0xd138388016f6f040 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096e04 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:3.0:1788201592.975846:0:9520:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000ba6985c4 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000083541a8b/0xd138388016f6f040 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096e04 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201592.975868:0:9520:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000083541a8b/0xd138388016f6f040 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096e04 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:3.0:1788201592.975894:0:9520:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1724a2d80 - object 0x240000400:420 offset 0<>674 00000008:00010000:3.0:1788201592.975905:0:9520:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000c88bdffc ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096eba expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:3.0:1788201592.975914:0:9520:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000c88bdffc ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096eba expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201592.975935:0:9520:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096eba expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:3.0:1788201592.975964:0:9520:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1724a1180 - object 0x240000400:421 offset 0<>2659 00000008:00010000:3.0:1788201592.975975:0:9520:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000c5f1d161 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:3.0:1788201592.975984:0:9520:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000c5f1d161 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201592.976011:0:9520:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:3.0:1788201592.976052:0:9520:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1724a0380 - object 0x240000400:422 offset 0<>28245 00000008:00010000:3.0:1788201592.976062:0:9520:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000163f5c32 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b477b91d/0xd138388016f6f112 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097026 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:3.0:1788201592.976071:0:9520:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000163f5c32 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b477b91d/0xd138388016f6f112 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097026 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201592.976092:0:9520:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b477b91d/0xd138388016f6f112 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097026 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:3.0:1788201592.976120:0:9520:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1724a1c00 - object 0x240000400:423 offset 0<>1754 00000008:00010000:3.0:1788201592.976130:0:9520:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000003e326483 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ec3e6631/0xd138388016f6f158 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710970dc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:3.0:1788201592.976139:0:9520:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000003e326483 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ec3e6631/0xd138388016f6f158 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710970dc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201592.976161:0:9520:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ec3e6631/0xd138388016f6f158 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710970dc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:3.0:1788201592.976187:0:9520:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1724a3100 - object 0x240000400:424 offset 0<>1613 00000100:00100000:0.0:1788201592.976499:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727982336:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201592.976646:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727982464:192.168.201.143@tcp:4:cp.0 00000100:00100000:0.0:1788201592.977283:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727982848:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201592.977356:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727982976:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201592.977423:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727982720:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201592.977455:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727983232:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201592.977479:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788201592.977485:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727982592:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201592.977509:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727983104:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201592.979743:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727982208:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201592.980848:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727983360:192.168.201.143@tcp:4:cp.0 00000008:00010000:0.0:1788201592.985967:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000436963de ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 1 00000008:00010000:0.0:1788201592.986032:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000436963de ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 1 00000100:00100000:0.0:1788201592.986068:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727982336:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201592.986278:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 0000000014c5a66b ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097742 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201592.986312:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc144682bb8, count 3, dirtied 3 00000080:00200000:3.0:1788201592.986320:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 3 pages 8441 bytes, tot: 8441 00000080:00200000:3.0:1788201592.986325:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) recovery-double-scale.sh: write bytes 0, result: 8441 00000020:00010000:3.0:1788201592.986344:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460e6b78 (ffff8bc1460e9cf8/0) at cl_lock_release():245 00000020:00010000:3.0:1788201592.986348:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460e6b78 (ffff8bc1460e9cf8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201592.986352:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149feccb0 (ffff8bc1460e9ab8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1788201592.986361:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097742 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.986375:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097742 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1788201592.986405:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460e6b78 (ffff8bc1460e9cf8/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201592.986408:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149feccb0 (ffff8bc1460e9cf8/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201592.986417:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 8441 bytes 00000080:00200000:3.0:1788201592.986425:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 2] 00000080:00200000:3.0:1788201592.986453:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17e:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201592.986457:0:24470:0:(file.c:2238:ll_file_io_generic()) recovery-double-scale.sh: 2 io complete with rc: 0, result: 8441, restart: 0 00000080:00200000:3.0:1788201592.986472:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x17e:0x0] updating i_size 8441 i_blocks 1 00000080:00200000:3.0:1788201592.986478:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 8441 00000080:00200008:3.0:1788201592.986535:0:24470:0:(file.c:479:ll_file_release()) START file recovery-double-scale.sh:[0x200000bd7:0x17e:0x0](ffff8bc144682a08), flags 100001 00000002:00100000:3.0:1788201592.986604:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1725f7480 x1875064727981824/t8589937406(8589937406) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 600/664 e 0 to 0 dl 1788201608 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1788201592.986618:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1788201592.986624:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a0a80 x1875064727983616/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1788201592.986648:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a0a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727983616:192.168.201.143@tcp:35:cp.0 00000100:00100000:3.0:1788201592.986750:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201592.999062:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a0a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727983616:192.168.201.143@tcp:35:cp.0 00000002:00100000:3.0:1788201592.999110:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1725f7480 x1875064727981824/t8589937406(8589937406) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 600/664 e 0 to 0 dl 1788201608 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201592.999214:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201592.999239:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201592.999264:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 143 lru_type: 1 00010000:00010000:3.0:1788201592.999358:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 143 lru_type: 1 00000080:00200000:3.0:1788201592.999368:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201592.999375:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201592.999390:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201592.999400:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201592.999404:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 143 lru_type: 1 00010000:00010000:3.0:1788201592.999414:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 144 lru_type: 1 00000080:00200000:3.0:1788201592.999434:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201592.999442:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201592.999448:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201592.999452:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=recovery-double-scale.sh, flags=8 00000080:00200008:3.0:1788201592.999461:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file recovery-double-scale.sh:[0x200000bd7:0x17e:0x0](ffff8bc144682a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201592.999467:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x17e:0x0](ffff8bc144682a08),name=recovery-double-scale.sh 00000002:00010000:3.0:1788201592.999480:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x17e:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201592.999489:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f3c0 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109772d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201592.999498:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f3c0 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109772d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201592.999506:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201592.999510:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x17e:0x0](ffff8bc144682a08) 00000080:00010000:3.0:1788201592.999513:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x17e:0x0](ffff8bc144682a08) for lock 0xd138388016f6f3c0 00000080:00010000:3.0:1788201592.999517:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f3c0 from it ffffadd1c7debcb8 00010000:00010000:3.0:1788201592.999520:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109772d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201592.999528:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f3c0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109772d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201592.999644:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17e:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201592.999729:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x17e:0x0] 00000008:00010000:3.0:1788201592.999768:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201592.999772:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149fec730, osc lock ffff8bc14691b430, flags 0x400001002 00010000:00010000:3.0:1788201593.000164:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097742 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:1.0:1788201593.026911:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000ba6985c4 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000083541a8b/0xd138388016f6f040 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096e04 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201593.026964:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000ba6985c4 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000083541a8b/0xd138388016f6f040 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096e04 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201593.027002:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727982848:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201593.027117:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000003e326483 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ec3e6631/0xd138388016f6f158 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710970dc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201593.027132:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000003e326483 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ec3e6631/0xd138388016f6f158 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710970dc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201593.027147:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727983360:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201593.034570:0:10053:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000005de6e866 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096d4e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201593.034631:0:10053:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000005de6e866 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096d4e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201593.034679:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727982720:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201593.040639:0:10053:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000c5f1d161 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201593.040701:0:10053:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000c5f1d161 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201593.040737:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727983104:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201593.050701:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727984256:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201593.078983:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201593.079192:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743480064 00000100:00100000:1.0:1788201593.079205:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743480064 00000100:00100000:1.0:1788201593.079287:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 757 00000100:00100000:1.0:1788201593.079300:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21822:x1875064743480064:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201593.079324:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f3ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097796 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.079525:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201593.079533:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21822:x1875064743480064:12345-192.168.201.143@tcp:104: Request processed in 236us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201593.079542:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 757 00010000:00010000:0.0:1788201593.079685:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201593.079695:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f3ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097796 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.079706:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172473800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201593.079714:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f3ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171097796 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201593.079778:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201593.079837:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1788201593.079914:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f3ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097796 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.079924:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201593.079951:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f3ea lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097796 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.079963:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f3ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097796 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.079984:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201593.079986:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201593.079988:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201593.079998:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201593.080015:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727984512:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201593.084193:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201593.092207:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727984512:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201593.098941:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f5c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727984768:192.168.201.143@tcp:35:cp.0 00000002:00100000:3.0:1788201593.098992:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1725f6680 x1875064727984128/t8589937408(8589937408) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201593.099094:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201593.099118:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201593.099142:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 147 lru_type: 1 00010000:00010000:3.0:1788201593.099160:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 147 lru_type: 1 00000080:00200000:3.0:1788201593.099170:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201593.099178:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201593.099183:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201593.099192:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201593.099197:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 147 lru_type: 1 00010000:00010000:3.0:1788201593.099206:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 148 lru_type: 1 00000080:00200000:3.0:1788201593.099226:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201593.099234:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201593.099241:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201593.099245:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=recovery-mds-scale.sh, flags=8 00000080:00200008:3.0:1788201593.099254:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file recovery-mds-scale.sh:[0x200000bd7:0x17f:0x0](ffff8bc1459f3248), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201593.099260:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x17f:0x0](ffff8bc1459f3248),name=recovery-mds-scale.sh 00000002:00010000:3.0:1788201593.099353:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x17f:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201593.099364:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472a00/0xd138388016f6f3e3 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097788 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201593.099374:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472a00/0xd138388016f6f3e3 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097788 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201593.099393:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201593.099399:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x17f:0x0](ffff8bc1459f3248) 00000080:00010000:3.0:1788201593.099402:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x17f:0x0](ffff8bc1459f3248) for lock 0xd138388016f6f3e3 00000080:00010000:3.0:1788201593.099406:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f3e3 from it ffffadd1c7debcb8 00010000:00010000:3.0:1788201593.099410:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472a00/0xd138388016f6f3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097788 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201593.099419:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472a00/0xd138388016f6f3e3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097788 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201593.099479:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17f:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201593.099490:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x17f:0x0] 00000008:00010000:3.0:1788201593.099528:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201593.099533:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149feccb0, osc lock ffff8bc14691aab0, flags 0x400001002 00010000:00010000:3.0:1788201593.099552:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000943c2caa/0xd138388016f6f3f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109779d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201593.099566:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000943c2caa/0xd138388016f6f3f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109779d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:3.0:1788201593.099580:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1788201593.099584:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000943c2caa/0xd138388016f6f3f1 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109779d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201593.099593:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000943c2caa/0xd138388016f6f3f1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109779d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1788201593.099606:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1788201593.099616:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x17f:0x0] updating i_size 1790 i_blocks 1 00000020:00010000:3.0:1788201593.099621:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc6500 (ffff8bc1460e9a28/0) at cl_lock_release():245 00000020:00010000:3.0:1788201593.099625:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc6500 (ffff8bc1460e9a28/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201593.099628:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149feccb0 (ffff8bc1460e9878/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201593.099633:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc6500 (ffff8bc1460e9a28/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201593.099636:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149feccb0 (ffff8bc1460e9a28/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201593.099944:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17f:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:3.0:1788201593.111858:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f7100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727985024:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201593.111894:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473a00/0xd138388016f6f3ff lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.111915:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473a00/0xd138388016f6f3ff lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.111925:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473a00/0xd138388016f6f3ff lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.111934:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473a00/0xd138388016f6f3ff lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.111947:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473a00/0xd138388016f6f3ff lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.111956:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172473a00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201593.111963:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473a00/0xd138388016f6f3ff lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.111973:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473a00/0xd138388016f6f3ff lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.111983:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473a00/0xd138388016f6f3ff lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.111993:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201593.112003:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473a00/0xd138388016f6f3ff lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.112012:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473a00/0xd138388016f6f3ff lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201593.112040:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1725f7100 x1875064727985024/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201593.112061:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201593.112109:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:3.0:1788201593.112264:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201593.112294:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201593.112306:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 150 lru_type: 1 00010000:00010000:3.0:1788201593.112321:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 150 lru_type: 1 00000080:00200000:3.0:1788201593.112329:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201593.112336:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201593.112341:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201593.112348:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:3.0:1788201593.112352:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 150 lru_type: 1 00010000:00010000:3.0:1788201593.112361:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 151 lru_type: 1 00000080:00200000:3.0:1788201593.112393:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201593.112402:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201593.112409:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201593.112424:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:3.0:1788201593.112430:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=recovery-oss-scale.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc146421500, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:3.0:1788201593.112439:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=recovery-oss-scale.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:3.0:1788201593.112463:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: recovery-oss-scale.sh,[0x200000bd7:0x180:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:3.0:1788201593.112526:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1800/0xd138388016f6f406 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.112538:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1800/0xd138388016f6f406 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1788201593.112551:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1788201593.112561:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a0000 x1875064727985280/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1788201593.112572:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1800/0xd138388016f6f406 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201593.112598:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a0000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727985280:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201593.113778:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201593.136836:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a0000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727985280:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201593.136878:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1800/0xd138388016f6f406 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710977e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201593.139500:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727985408:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201593.143762:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000609140ca/0xd138388016f6f40d lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.143831:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000609140ca/0xd138388016f6f40d lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710977f1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.143850:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000609140ca/0xd138388016f6f40d lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710977f1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.143865:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000609140ca/0xd138388016f6f40d lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710977f1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201593.143886:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000609140ca/0xd138388016f6f40d lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710977f1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201593.143899:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201593.143981:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000609140ca/0xd138388016f6f40d lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710977f1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.143993:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000609140ca/0xd138388016f6f40d lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710977f1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.144002:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000609140ca/0xd138388016f6f40d lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710977f1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.144013:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000609140ca/0xd138388016f6f40d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e21710977f1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201593.144040:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727985408:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201593.148126:0:20877:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201593.148148:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743480448 00000100:00100000:3.0:1788201593.148221:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743480448 00000100:00100000:3.0:1788201593.148329:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 759 00000100:00100000:3.0:1788201593.148342:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172702450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23408:x1875064743480448:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201593.148365:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000609140ca/0xd138388016f6f40d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710977f1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201593.148472:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201593.148480:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172702450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23408:x1875064743480448:12345-192.168.201.143@tcp:104: Request processed in 141us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201593.148492:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 759 00010000:00010000:0.0:1788201593.148588:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201593.148598:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000609140ca/0xd138388016f6f40d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710977f1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.148609:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172472000 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201593.148616:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000609140ca/0xd138388016f6f40d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e21710977f1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201593.148698:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x180:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201593.148713:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x180:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1788201593.148788:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000609140ca/0xd138388016f6f40d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710977f1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.148833:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201593.148865:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000609140ca/0xd138388016f6f40d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710977f1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.148875:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000609140ca/0xd138388016f6f40d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710977f1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.148895:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201593.148897:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201593.148899:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201593.148909:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201593.148927:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727985664:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201593.153588:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201593.154294:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743480576 00000100:00100000:3.0:1788201593.154304:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743480576 00000100:00100000:3.0:1788201593.154362:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 760 00000100:00100000:3.0:1788201593.154373:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc146029f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21005:x1875064743480576:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201593.154406:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f40fa3a5/0xd138388016f6f414 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710977f8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.154417:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f40fa3a5/0xd138388016f6f414 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710977f8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.154428:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f40fa3a5/0xd138388016f6f414 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710977f8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.154438:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f40fa3a5/0xd138388016f6f414 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710977f8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.154448:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f40fa3a5/0xd138388016f6f414 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710977f8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.154461:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f40fa3a5/0xd138388016f6f414 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e21710977f8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.154495:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc172472400) 00000100:00100000:3.0:1788201593.154576:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc146029f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21005:x1875064743480576:12345-192.168.201.143@tcp:105: Request processed in 204us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201593.154587:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 760 00010000:00010000:1.0:1788201593.155300:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f40fa3a5/0xd138388016f6f414 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710977f8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.155315:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f40fa3a5/0xd138388016f6f414 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710977f8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.155334:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f40fa3a5/0xd138388016f6f414 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710977f8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201593.155349:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f40fa3a5/0xd138388016f6f414 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e21710977f8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.155364:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f40fa3a5/0xd138388016f6f414 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710977f8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.155374:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f40fa3a5/0xd138388016f6f414 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710977f8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201593.155426:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) recovery-oss-scale.sh: write [0, 1694) append 0 append lockpos 0 00000080:00200000:1.0:1788201593.155447:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 1694 bytes 00000080:00200000:1.0:1788201593.155518:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 1694, copied 1694 00000080:00200000:1.0:1788201593.155532:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005676bc17[3 00000000c59ec988 2 1 0000000087f2c2d4 0 0 0] 00000080:00200000:1.0:1788201593.155536:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009dd25f21 17ffffc0001001 3:0 ffff8bc1725a2ee0 0 lru 00000080:00200000:1.0:1788201593.155544:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003bfa00c6 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000ccc6d8cb > 3< 0 0 > 4< 0 0 8 28966912 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.155546:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005676bc17 00000080:00200000:1.0:1788201593.155548:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201593.155553:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 1694 prio 0 00000008:00010000:1.0:1788201593.155589:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000ba6985c4 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f40fa3a5/0xd138388016f6f414 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710977f8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201593.155619:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459f2bb8, count 1, dirtied 1 00000080:00200000:1.0:1788201593.155625:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 1694 bytes, tot: 1694 00000080:00200000:1.0:1788201593.155628:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) recovery-oss-scale.sh: write bytes 0, result: 1694 00000020:00010000:1.0:1788201593.155646:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1498447b8 (ffff8bc146919638/0) at cl_lock_release():245 00000020:00010000:1.0:1788201593.155650:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1498447b8 (ffff8bc146919638/0) at cl_lock_cancel():142 00010000:00010000:3.0:1788201593.156016:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00010000:1.0:1788201593.156350:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d8b0 (ffff8bc146919998/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201593.156361:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f40fa3a5/0xd138388016f6f414 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710977f8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.156374:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f40fa3a5/0xd138388016f6f414 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710977f8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201593.156402:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1498447b8 (ffff8bc146919638/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201593.156405:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d8b0 (ffff8bc146919638/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201593.156416:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 1694 bytes 00000080:00200000:1.0:1788201593.156425:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1788201593.156463:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x180:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201593.156467:0:24470:0:(file.c:2238:ll_file_io_generic()) recovery-oss-scale.sh: 2 io complete with rc: 0, result: 1694, restart: 0 00000080:00200000:1.0:1788201593.156521:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x180:0x0] updating i_size 1694 i_blocks 1 00000080:00200000:1.0:1788201593.156527:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 1694 00000080:00200008:1.0:1788201593.156598:0:24470:0:(file.c:479:ll_file_release()) START file recovery-oss-scale.sh:[0x200000bd7:0x180:0x0](ffff8bc1459f2a08), flags 100001 00000002:00100000:1.0:1788201593.157633:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1724a0000 x1875064727985280/t8589937410(8589937410) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201609 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201593.157651:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201593.157667:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14602bb80 x1875064727985920/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201593.157702:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602bb80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727985920:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201593.157832:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201593.164448:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727985664:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201593.169265:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f4000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727986048:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201593.169296:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f41b lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.169313:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f41b lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.169321:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f41b lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.169329:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f41b lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.169339:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f41b lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.169346:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172473200 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201593.169351:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f41b lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.169359:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f41b lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.169366:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f41b lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.169386:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201593.169395:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f41b lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.169402:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f41b lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201593.169424:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1725f4000 x1875064727986048/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 600/584 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201593.169441:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201593.169470:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201593.169547:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201593.169631:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.169644:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 153 lru_type: 1 00010000:00010000:1.0:1788201593.169722:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 153 lru_type: 1 00000080:00200000:1.0:1788201593.169731:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.169738:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201593.169742:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201593.169748:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201593.169752:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 153 lru_type: 1 00010000:00010000:1.0:1788201593.169760:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 154 lru_type: 1 00000080:00200000:1.0:1788201593.169778:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.169788:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201593.170032:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.170057:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=recovery-random-scale.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:1.0:1788201593.170062:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=recovery-random-scale.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201593.170076:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: recovery-random-scale.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201593.170135:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f422 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.170143:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f422 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.170154:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f422 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.170188:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146028700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727986176:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201593.170341:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201593.175633:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146028700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727986176:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201593.175729:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f422 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.175748:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f422 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.175756:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f422 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.175764:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f422 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.175774:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f422 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.175781:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bc400 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201593.175786:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f422 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.175903:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f422 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.175913:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f422 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.175920:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201593.175928:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f422 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.175935:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f422 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201593.175957:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc146028700 x1875064727986176/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 600/584 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201593.175976:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201593.176010:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201593.176259:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201593.176279:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.176291:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 154 lru_type: 1 00010000:00010000:1.0:1788201593.176304:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 154 lru_type: 1 00000080:00200000:1.0:1788201593.176316:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.176322:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201593.176326:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201593.176333:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:1.0:1788201593.176336:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 154 lru_type: 1 00010000:00010000:1.0:1788201593.176345:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 155 lru_type: 1 00000080:00200000:1.0:1788201593.176362:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.176369:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201593.176387:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.176403:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201593.176408:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=recovery-random-scale.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14304a000, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:1.0:1788201593.176417:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=recovery-random-scale.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:1.0:1788201593.176442:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: recovery-random-scale.sh,[0x200000bd7:0x181:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201593.176509:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.176516:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201593.176530:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201593.176538:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146028700 x1875064727986432/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 672/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201593.176620:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.177992:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146028700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727986432:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201593.178189:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201593.183503:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146028700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727986432:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201593.183539:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109783e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.183580:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x181:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109783e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.183589:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109783e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.183602:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109783e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.183613:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109783e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.183630:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109783e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.183638:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109783e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.183651:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109783e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201593.183776:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc146028700 x1875064727986432/t8589937412(8589937412) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 672/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201593.183827:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc146028700 x1875064727986432/t8589937412(8589937412) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 672/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201593.183845:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109783e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201593.183861:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109783e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.183873:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/385 (0 0) 00000080:00200000:1.0:1788201593.183882:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201593.183899:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=recovery-random-scale.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:1.0:1788201593.183936:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x181:0x0](ffff8bc1446be3c8) 00000080:00200000:1.0:1788201593.184087:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x181:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201593.184098:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x181:0x0](ffff8bc1446be3c8) 00000080:00010000:1.0:1788201593.184102:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x181:0x0](ffff8bc1446be3c8) for lock 0xd138388016f6f429 00000080:00010000:1.0:1788201593.184114:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x181:0x0](ffff8bc1446be3c8) 00000080:00200008:1.0:1788201593.184132:0:24470:0:(file.c:1090:ll_file_open()) START file recovery-random-scale.sh:[0x200000bd7:0x181:0x0](ffff8bc1446be3c8), flags 100301 00000002:00100000:1.0:1788201593.184154:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc146028700 x1875064727986432/t8589937412(8589937412) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 600/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201593.184212:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f429 from it ffff8bc1466cdc00 00010000:00010000:1.0:1788201593.184217:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109783e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.184228:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109783e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201593.184255:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x181:0x0](ffff8bc1446be3c8), inode mode 81a4 mask 40 00000080:00200008:1.0:1788201593.184288:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file recovery-random-scale.sh:[0x200000bd7:0x181:0x0](ffff8bc1446be3c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201593.184296:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x181:0x0](ffff8bc1446be3c8),name=recovery-random-scale.sh 00000002:00010000:1.0:1788201593.184317:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x181:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.184327:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109783e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.184341:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109783e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201593.184348:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.184354:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x181:0x0](ffff8bc1446be3c8) 00000080:00010000:1.0:1788201593.184357:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x181:0x0](ffff8bc1446be3c8) for lock 0xd138388016f6f429 00000080:00010000:1.0:1788201593.184361:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f429 from it ffffadd1c7debcd8 00010000:00010000:1.0:1788201593.184364:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109783e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.184373:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109783e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201593.184417:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x181:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201593.184427:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x181:0x0] 00000008:00010000:1.0:1788201593.184457:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201593.184461:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d41b0, osc lock ffff8bc145d08720, flags 0x400001002 00010000:00010000:1.0:1788201593.184517:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f430 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.184528:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f430 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201593.185202:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146029880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727986560:192.168.201.143@tcp:101:cp.0 00000020:00200000:1.0:1788201593.185570:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1788201593.188635:0:10055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f430 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.188750:0:10055:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f430 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109784c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.188772:0:10055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f430 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109784c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.188863:0:10055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f430 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109784c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201593.188884:0:10055:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f430 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109784c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201593.188897:0:10055:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201593.188959:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f430 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109784c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.188970:0:10055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f430 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109784c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.188978:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f430 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109784c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.188987:0:10055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f430 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e217109784c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201593.189013:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146029880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727986560:192.168.201.143@tcp:101:cp.0 00000080:00200000:1.0:1788201593.189243:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x181:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201593.189251:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e244a0 (ffff8bc148e3bc68/0) at cl_lock_release():245 00000020:00010000:1.0:1788201593.189254:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e244a0 (ffff8bc148e3bc68/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.189260:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d41b0 (ffff8bc148e3b7e8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.189265:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e244a0 (ffff8bc148e3bc68/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201593.189268:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d41b0 (ffff8bc148e3bc68/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201593.189315:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x181:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201593.189405:0:24470:0:(file.c:2638:do_file_write_iter()) START file recovery-random-scale.sh:[0x200000bd7:0x181:0x0], ppos: 0, count: 6430 00000080:00200000:1.0:1788201593.189440:0:24470:0:(file.c:2090:ll_file_io_generic()) recovery-random-scale.sh: write ppos: 0, bytes: 6430 00000080:00200000:1.0:1788201593.189447:0:24470:0:(file.c:1848:ll_io_set_mirror()) recovery-random-scale.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201593.189453:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000aee05459[0x110, 1, [0x200000bd7:0x181:0x0] hash] 00000020:00200000:1.0:1788201593.189456:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 6430) 0 0 00000080:00200000:1.0:1788201593.189460:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x181:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201593.189475:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 1] 00020000:00200000:1.0:1788201593.189483:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 6430) 6430, 6430 00020000:00200000:1.0:1788201593.189487:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201593.189520:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 1] 00000008:00010000:1.0:1788201593.189535:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201593.189541:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d41b0, osc lock ffff8bc145d08720, flags 0x0 00010000:00010000:1.0:1788201593.189629:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/435 (0 8191) 00010000:00010000:1.0:1788201593.189750:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.189761:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.189773:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.189882:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146028380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727986688:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201593.190054:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d439c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201593.192966:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201593.193087:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743480704 00000100:00100000:1.0:1788201593.193108:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743480704 00000100:00100000:1.0:1788201593.193186:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 761 00000100:00100000:1.0:1788201593.193198:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23411:x1875064743480704:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201593.193223:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f430 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109784c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.193823:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201593.193832:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23411:x1875064743480704:12345-192.168.201.143@tcp:104: Request processed in 637us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201593.193841:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 761 00010000:00010000:0.0:1788201593.193969:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201593.193980:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f430 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109784c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.193993:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14a778a00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201593.194000:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f430 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e217109784c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201593.194060:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x181:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201593.194075:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x181:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1788201593.194166:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f430 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109784c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.194176:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201593.194209:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f430 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109784c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.194219:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f430 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109784c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.194235:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201593.194237:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201593.194238:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201593.194247:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201593.194264:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727986816:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201593.196736:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146028380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727986688:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201593.196777:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097853 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.196822:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097853 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.196833:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097853 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201593.200343:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:3.0:1788201593.203305:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097853 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.203332:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097853 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.203356:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097853 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201593.203382:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171097853 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.203398:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097853 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.203406:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097853 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201593.203994:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727986816:192.168.201.143@tcp:103:ldlm_bl.0 00000080:00200000:0.0:1788201593.204181:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) recovery-random-scale.sh: write [0, 6430) append 0 append lockpos 0 00000080:00200000:0.0:1788201593.204207:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:0.0:1788201593.204268:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:0.0:1788201593.204283:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d4eea360[3 00000000cd567d25 2 1 000000008c769856 0 0 0] 00000080:00200000:0.0:1788201593.204287:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000065532268 17ffffc0001001 3:0 ffff8bc1727a60e0 0 lru 00000080:00200000:0.0:1788201593.204295:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000086b5cb5b 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201593.204298:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d4eea360 00000080:00200000:0.0:1788201593.204299:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1788201593.204302:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 2334 bytes 00000080:00200000:0.0:1788201593.204343:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 2334, copied 2334 00000080:00200000:0.0:1788201593.204348:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000884d874f[3 00000000cd567d25 2 1 000000008c769856 0 0 1] 00000080:00200000:0.0:1788201593.204351:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e0261a5b 17ffffc0001001 3:0 ffff8bc1727a61c0 1 lru 00000080:00200000:0.0:1788201593.204356:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d4e3fe7e 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 0000000098f35ebd > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201593.204358:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000884d874f 00000080:00200000:0.0:1788201593.204359:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:0.0:1788201593.204363:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 2, from 0, to 2334 prio 0 00000008:00010000:0.0:1788201593.204400:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000908bab3b ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097853 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201593.204427:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1446be578, count 2, dirtied 2 00000080:00200000:0.0:1788201593.204433:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 2 pages 6430 bytes, tot: 6430 00000080:00200000:0.0:1788201593.204436:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) recovery-random-scale.sh: write bytes 0, result: 6430 00000020:00010000:0.0:1788201593.204457:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c4998 (ffff8bc148e3bc68/0) at cl_lock_release():245 00000020:00010000:0.0:1788201593.204462:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c4998 (ffff8bc148e3bc68/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201593.204466:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d41b0 (ffff8bc148e3b7e8/1) at cl_lock_cancel():142 00010000:00010000:0.0:1788201593.204473:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097853 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.204485:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097853 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1788201593.204511:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c4998 (ffff8bc148e3bc68/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201593.204515:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d41b0 (ffff8bc148e3bc68/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201593.204525:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 6430 bytes 00000080:00200000:0.0:1788201593.204534:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 1] 00000080:00200000:0.0:1788201593.204760:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x181:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201593.204766:0:24470:0:(file.c:2238:ll_file_io_generic()) recovery-random-scale.sh: 2 io complete with rc: 0, result: 6430, restart: 0 00000080:00200000:0.0:1788201593.204775:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x181:0x0] updating i_size 6430 i_blocks 1 00000080:00200000:0.0:1788201593.204782:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 6430 00000080:00200008:0.0:1788201593.204876:0:24470:0:(file.c:479:ll_file_release()) START file recovery-random-scale.sh:[0x200000bd7:0x181:0x0](ffff8bc1446be3c8), flags 100001 00000002:00100000:0.0:1788201593.204959:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc146028700 x1875064727986432/t8589937412(8589937412) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 600/664 e 0 to 0 dl 1788201609 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1788201593.204973:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1788201593.204979:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14415b480 x1875064727987072/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1788201593.205005:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415b480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727987072:192.168.201.143@tcp:35:cp.0 00000100:00100000:0.0:1788201593.205111:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201593.208876:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415b480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727987072:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201593.208924:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc146028700 x1875064727986432/t8589937412(8589937412) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 600/664 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201593.209015:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201593.209038:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.209062:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 155 lru_type: 1 00010000:00010000:1.0:1788201593.209079:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 155 lru_type: 1 00000080:00200000:1.0:1788201593.209089:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.209096:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201593.209100:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201593.209110:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201593.209114:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 155 lru_type: 1 00010000:00010000:1.0:1788201593.209125:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 156 lru_type: 1 00000080:00200000:1.0:1788201593.209144:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.209152:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201593.209159:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.209163:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=recovery-random-scale.sh, flags=8 00000080:00200008:1.0:1788201593.209240:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file recovery-random-scale.sh:[0x200000bd7:0x181:0x0](ffff8bc1446be3c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201593.209247:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x181:0x0](ffff8bc1446be3c8),name=recovery-random-scale.sh 00000002:00010000:1.0:1788201593.209260:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x181:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.209269:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109783e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201593.209278:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109783e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201593.209286:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.209290:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x181:0x0](ffff8bc1446be3c8) 00000080:00010000:1.0:1788201593.209293:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x181:0x0](ffff8bc1446be3c8) for lock 0xd138388016f6f429 00000080:00010000:1.0:1788201593.209296:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f429 from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201593.209300:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109783e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201593.209308:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109783e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201593.209369:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x181:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201593.209396:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x181:0x0] 00000008:00010000:1.0:1788201593.209433:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201593.209438:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4fb0, osc lock ffff8bc145d085f0, flags 0x400001002 00010000:00010000:1.0:1788201593.209459:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097853 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.209472:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097853 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201593.209486:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201593.209490:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097853 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.209497:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097853 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201593.209508:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201593.209518:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x181:0x0] updating i_size 6430 i_blocks 1 00000020:00010000:1.0:1788201593.209521:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e27530 (ffff8bc148e3b638/0) at cl_lock_release():245 00000020:00010000:1.0:1788201593.209525:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e27530 (ffff8bc148e3b638/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.209528:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4fb0 (ffff8bc148e3b6c8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.209532:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e27530 (ffff8bc148e3b638/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201593.209535:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4fb0 (ffff8bc148e3b638/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201593.209640:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x181:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201593.209785:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201593.209954:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.209965:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 156 lru_type: 1 00010000:00010000:1.0:1788201593.209977:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 156 lru_type: 1 00000080:00200000:1.0:1788201593.209985:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.209990:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201593.209993:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201593.209998:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201593.210002:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 156 lru_type: 1 00010000:00010000:1.0:1788201593.210009:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 157 lru_type: 1 00000080:00200000:1.0:1788201593.210020:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.210024:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201593.210028:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.210044:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=recovery-scale-lib.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201593.210048:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=recovery-scale-lib.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201593.210059:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: recovery-scale-lib.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201593.210111:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f43e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.210118:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f43e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.210129:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f43e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.210169:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146028000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727987200:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201593.210280:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d439c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201593.213462:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146028000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727987200:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201593.213492:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f43e lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.213510:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f43e lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.213517:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f43e lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.213525:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f43e lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.213534:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f43e lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.213542:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14a778c00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201593.213547:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f43e lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.213567:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f43e lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.213575:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f43e lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.213582:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201593.213589:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f43e lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.213596:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f43e lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201593.213627:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc146028000 x1875064727987200/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201593.213645:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201593.213824:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201593.213902:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201593.213921:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.213932:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 157 lru_type: 1 00010000:00010000:1.0:1788201593.213945:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 157 lru_type: 1 00000080:00200000:1.0:1788201593.213953:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.213959:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201593.213963:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201593.213969:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201593.213973:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 157 lru_type: 1 00010000:00010000:1.0:1788201593.213981:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 158 lru_type: 1 00000080:00200000:1.0:1788201593.214000:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.214010:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201593.214016:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.214034:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=recovery-scale-lib.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:1.0:1788201593.214039:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=recovery-scale-lib.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201593.214052:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: recovery-scale-lib.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201593.214112:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f445 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.214120:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f445 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.214132:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f445 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.214253:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146028000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727987328:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201593.214409:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d439c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201593.218368:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146028000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727987328:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201593.218409:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f445 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.218426:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f445 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.218433:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f445 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.218442:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f445 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.218452:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f445 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.218459:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14a778400 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201593.218465:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f445 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.218472:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f445 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.218480:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f445 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.218487:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201593.218493:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f445 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.218500:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f445 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201593.218524:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc146028000 x1875064727987328/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201593.218542:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201593.218645:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201593.218895:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201593.218914:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.218926:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 158 lru_type: 1 00010000:00010000:1.0:1788201593.218938:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 158 lru_type: 1 00000080:00200000:1.0:1788201593.218945:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.218950:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201593.218955:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201593.218961:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:1.0:1788201593.218964:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 158 lru_type: 1 00010000:00010000:1.0:1788201593.218972:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 159 lru_type: 1 00000080:00200000:1.0:1788201593.218988:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.218997:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201593.219004:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.219020:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201593.219026:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=recovery-scale-lib.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14304a000, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:1.0:1788201593.219034:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=recovery-scale-lib.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:1.0:1788201593.219056:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: recovery-scale-lib.sh,[0x200000bd7:0x182:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201593.219245:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.219254:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201593.219269:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201593.219277:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146028000 x1875064727987584/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201593.219286:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.219311:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146028000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727987584:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201593.219572:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d439c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201593.224459:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146028000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727987584:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201593.224494:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097899 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.224524:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x182:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097899 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.224533:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097899 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.224546:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097899 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.224563:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097899 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.224581:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097899 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.224590:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097899 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.224598:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097899 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201593.224611:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc146028000 x1875064727987584/t8589937414(8589937414) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201593.224626:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc146028000 x1875064727987584/t8589937414(8589937414) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201593.224643:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097899 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201593.224672:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097899 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.224685:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/386 (0 0) 00000080:00200000:1.0:1788201593.224694:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201593.224713:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=recovery-scale-lib.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:1.0:1788201593.224749:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x182:0x0](ffff8bc1446bba88) 00000080:00200000:1.0:1788201593.224933:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x182:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201593.224943:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x182:0x0](ffff8bc1446bba88) 00000080:00010000:1.0:1788201593.224947:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x182:0x0](ffff8bc1446bba88) for lock 0xd138388016f6f44c 00000080:00010000:1.0:1788201593.224959:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x182:0x0](ffff8bc1446bba88) 00000080:00200008:1.0:1788201593.224977:0:24470:0:(file.c:1090:ll_file_open()) START file recovery-scale-lib.sh:[0x200000bd7:0x182:0x0](ffff8bc1446bba88), flags 100301 00000002:00100000:1.0:1788201593.224999:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc146028000 x1875064727987584/t8589937414(8589937414) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201593.225050:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f44c from it ffff8bc1466cd7e0 00010000:00010000:1.0:1788201593.225055:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097899 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.225064:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097899 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201593.226493:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x182:0x0](ffff8bc1446bba88), inode mode 81a4 mask 40 00000080:00200008:0.0:1788201593.226883:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file recovery-scale-lib.sh:[0x200000bd7:0x182:0x0](ffff8bc1446bba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201593.226893:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x182:0x0](ffff8bc1446bba88),name=recovery-scale-lib.sh 00000002:00010000:0.0:1788201593.226928:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x182:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201593.226951:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097899 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.226968:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097899 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201593.226983:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201593.226992:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x182:0x0](ffff8bc1446bba88) 00000080:00010000:0.0:1788201593.226996:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x182:0x0](ffff8bc1446bba88) for lock 0xd138388016f6f44c 00000080:00010000:0.0:1788201593.227004:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f44c from it ffffadd1c7debcd8 00010000:00010000:0.0:1788201593.227009:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097899 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.227018:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097899 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201593.227083:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x182:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201593.227107:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x182:0x0] 00000008:00010000:0.0:1788201593.227141:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201593.227145:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456330, osc lock ffff8bc145d35430, flags 0x400001002 00010000:00010000:0.0:1788201593.227419:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f453 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.227432:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f453 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201593.227480:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1788201593.227584:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201593.227610:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727987712:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201593.231635:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f453 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.231748:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f453 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710978a7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.231767:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f453 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710978a7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.231782:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f453 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710978a7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201593.231826:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f453 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710978a7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201593.231839:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1788201593.231902:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f453 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710978a7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.231912:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f453 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710978a7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.231926:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f453 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710978a7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.231936:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f453 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e21710978a7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201593.231963:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727987712:192.168.201.143@tcp:101:cp.0 00000080:00200000:0.0:1788201593.232044:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x182:0x0] updating i_size 0 i_blocks 1 00000020:00010000:0.0:1788201593.232052:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449dabf0 (ffff8bc1499c4908/0) at cl_lock_release():245 00000020:00010000:0.0:1788201593.232055:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449dabf0 (ffff8bc1499c4908/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201593.232061:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456330 (ffff8bc1499c4b48/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201593.232065:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449dabf0 (ffff8bc1499c4908/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201593.232068:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456330 (ffff8bc1499c4908/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201593.232244:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x182:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1788201593.232321:0:24470:0:(file.c:2638:do_file_write_iter()) START file recovery-scale-lib.sh:[0x200000bd7:0x182:0x0], ppos: 0, count: 6234 00000080:00200000:0.0:1788201593.232354:0:24470:0:(file.c:2090:ll_file_io_generic()) recovery-scale-lib.sh: write ppos: 0, bytes: 6234 00000080:00200000:0.0:1788201593.232361:0:24470:0:(file.c:1848:ll_io_set_mirror()) recovery-scale-lib.sh: desiginated mirror: 0 00000020:00200000:0.0:1788201593.232368:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@000000005d2b9691[0x110, 1, [0x200000bd7:0x182:0x0] hash] 00000020:00200000:0.0:1788201593.232371:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 6234) 0 0 00000080:00200000:0.0:1788201593.232387:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x182:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201593.232403:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 1] 00020000:00200000:0.0:1788201593.232411:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 6234) 6234, 6234 00020000:00200000:0.0:1788201593.232415:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201593.232448:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 1] 00000008:00010000:0.0:1788201593.232462:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1788201593.232468:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456330, osc lock ffff8bc145d35430, flags 0x0 00010000:00010000:0.0:1788201593.232488:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/435 (0 8191) 00010000:00010000:0.0:1788201593.232539:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.232623:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.232637:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201593.232740:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415b800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727987840:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201593.233002:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5840 going to sleep for 11 seconds 00000100:00100000:3.0:1788201593.238531:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743480960 00000100:00100000:3.0:1788201593.238543:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743480960 00000100:00100000:3.0:1788201593.238759:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 763 00000100:00100000:3.0:1788201593.238772:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21821:x1875064743480960:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201593.238812:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f453 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710978a7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201593.238909:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201593.238916:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21821:x1875064743480960:12345-192.168.201.143@tcp:104: Request processed in 148us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201593.238924:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 763 00010000:00010000:0.0:1788201593.240367:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201593.240394:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f453 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710978a7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.240410:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3d400 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201593.240420:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f453 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e21710978a7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201593.240498:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x182:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201593.240514:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x182:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1788201593.240610:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f453 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710978a7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.240619:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201593.240675:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f453 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710978a7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.240685:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006fb50418/0xd138388016f6f453 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710978a7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.240705:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201593.240707:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201593.240709:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201593.240721:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201593.240745:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17275bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727987968:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201593.245947:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743481088 00000100:00100000:3.0:1788201593.245960:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743481088 00000100:00100000:3.0:1788201593.246028:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 764 00000100:00100000:3.0:1788201593.246041:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21004:x1875064743481088:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201593.246062:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.246080:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.246100:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.246114:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.246125:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.246143:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.246318:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1727c9c00) 00000100:00100000:3.0:1788201593.246410:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21004:x1875064743481088:12345-192.168.201.143@tcp:105: Request processed in 372us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201593.246418:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 764 00000100:00100000:0.0:1788201593.248470:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415b800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727987840:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201593.248508:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.248534:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201593.248567:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.248581:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.248591:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201593.248626:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) recovery-scale-lib.sh: write [0, 6234) append 0 append lockpos 0 00000080:00200000:0.0:1788201593.248649:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:0.0:1788201593.248725:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:0.0:1788201593.248739:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ed8aca00[3 000000008df50774 2 1 00000000e663ddc8 0 0 0] 00000080:00200000:0.0:1788201593.248742:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000bbe4a2ad 17ffffc0001001 3:0 ffff8bc1727a6380 0 lru 00000080:00200000:0.0:1788201593.248751:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007f180b28 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000b7ac1888 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201593.248753:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ed8aca00 00000080:00200000:0.0:1788201593.248755:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1788201593.248759:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 2138 bytes 00000080:00200000:0.0:1788201593.248819:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 2138, copied 2138 00000080:00200000:0.0:1788201593.248825:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000027eed382[3 000000008df50774 2 1 00000000e663ddc8 0 0 1] 00000080:00200000:0.0:1788201593.248827:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f821271b 17ffffc0001001 3:0 ffff8bc1727a6d20 1 lru 00000080:00200000:0.0:1788201593.248833:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f6635851 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 00000000b7ac1888 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201593.248835:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000027eed382 00000080:00200000:0.0:1788201593.248837:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:0.0:1788201593.248841:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 2, from 0, to 2138 prio 0 00000008:00010000:0.0:1788201593.248872:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000bf7e2717 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201593.248902:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1446bbc38, count 2, dirtied 2 00000080:00200000:0.0:1788201593.248909:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 2 pages 6234 bytes, tot: 6234 00000080:00200000:0.0:1788201593.248912:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) recovery-scale-lib.sh: write bytes 0, result: 6234 00000020:00010000:0.0:1788201593.248932:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc148fb1b78 (ffff8bc1499c4908/0) at cl_lock_release():245 00000020:00010000:0.0:1788201593.248936:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc148fb1b78 (ffff8bc1499c4908/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201593.248940:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456330 (ffff8bc1499c4b48/1) at cl_lock_cancel():142 00010000:00010000:0.0:1788201593.248945:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.248956:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1788201593.248975:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc148fb1b78 (ffff8bc1499c4908/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201593.248978:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456330 (ffff8bc1499c4908/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201593.248986:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 6234 bytes 00000080:00200000:0.0:1788201593.248995:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 1] 00000080:00200000:0.0:1788201593.249028:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x182:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201593.249033:0:24470:0:(file.c:2238:ll_file_io_generic()) recovery-scale-lib.sh: 2 io complete with rc: 0, result: 6234, restart: 0 00000080:00200000:0.0:1788201593.249041:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x182:0x0] updating i_size 6234 i_blocks 1 00000080:00200000:0.0:1788201593.249047:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 6234 00000080:00200008:0.0:1788201593.249106:0:24470:0:(file.c:479:ll_file_release()) START file recovery-scale-lib.sh:[0x200000bd7:0x182:0x0](ffff8bc1446bba88), flags 100001 00000002:00100000:0.0:1788201593.249190:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc146028000 x1875064727987584/t8589937414(8589937414) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201609 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1788201593.249203:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1788201593.249210:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14415b800 x1875064727988224/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1788201593.249239:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14415b800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727988224:192.168.201.143@tcp:35:cp.0 00000100:00100000:0.0:1788201593.249343:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201593.253663:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17275bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727987968:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201593.256332:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14415b800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727988224:192.168.201.143@tcp:35:cp.0 00000002:00100000:0.0:1788201593.256387:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc146028000 x1875064727987584/t8589937414(8589937414) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201593.256481:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201593.256504:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201593.256528:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 159 lru_type: 1 00010000:00010000:0.0:1788201593.256544:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 159 lru_type: 1 00000080:00200000:0.0:1788201593.256724:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201593.256733:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201593.256737:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201593.256748:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201593.256752:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 159 lru_type: 1 00010000:00010000:0.0:1788201593.256763:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 160 lru_type: 1 00000080:00200000:0.0:1788201593.256781:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201593.256987:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201593.256997:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201593.257003:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=recovery-scale-lib.sh, flags=8 00000080:00200008:0.0:1788201593.257013:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file recovery-scale-lib.sh:[0x200000bd7:0x182:0x0](ffff8bc1446bba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201593.257021:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x182:0x0](ffff8bc1446bba88),name=recovery-scale-lib.sh 00000002:00010000:0.0:1788201593.257038:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x182:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201593.257049:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097899 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201593.257058:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097899 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201593.257065:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201593.257069:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x182:0x0](ffff8bc1446bba88) 00000080:00010000:0.0:1788201593.257072:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x182:0x0](ffff8bc1446bba88) for lock 0xd138388016f6f44c 00000080:00010000:0.0:1788201593.257077:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f44c from it ffffadd1c7debcb8 00010000:00010000:0.0:1788201593.257080:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097899 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201593.257088:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097899 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201593.257155:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x182:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201593.257173:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x182:0x0] 00000008:00010000:0.0:1788201593.257208:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201593.257213:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456330, osc lock ffff8bc145d35430, flags 0x400001002 00010000:00010000:0.0:1788201593.257234:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.257253:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:0.0:1788201593.257268:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1788201593.257273:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.257281:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1788201593.257293:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1788201593.257304:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x182:0x0] updating i_size 6234 i_blocks 1 00000020:00010000:0.0:1788201593.257309:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449dabf0 (ffff8bc1499c4908/0) at cl_lock_release():245 00000020:00010000:0.0:1788201593.257312:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449dabf0 (ffff8bc1499c4908/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201593.257316:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456330 (ffff8bc1499c4b48/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201593.257320:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449dabf0 (ffff8bc1499c4908/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201593.257322:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456330 (ffff8bc1499c4908/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201593.257351:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x182:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201593.257429:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201593.257437:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201593.257446:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 160 lru_type: 1 00010000:00010000:0.0:1788201593.257455:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 160 lru_type: 1 00000080:00200000:0.0:1788201593.257467:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201593.257471:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201593.257474:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201593.257478:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201593.257481:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 160 lru_type: 1 00010000:00010000:0.0:1788201593.257490:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 161 lru_type: 1 00000080:00200000:0.0:1788201593.257499:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201593.257504:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201593.257508:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201593.257526:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=recovery-small.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:0.0:1788201593.257531:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=recovery-small.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201593.257543:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: recovery-small.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201593.257625:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f461 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.257634:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f461 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.257648:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f461 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201593.257981:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727988352:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201593.258117:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201593.263048:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727988352:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201593.263077:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f461 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.263106:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f461 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.263113:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f461 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.263120:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f461 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.263131:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f461 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.263138:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3d400 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201593.263152:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f461 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.263168:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f461 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.263176:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f461 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.263185:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201593.263193:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f461 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.263199:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d400/0xd138388016f6f461 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201593.263226:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1725b1180 x1875064727988352/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201593.263245:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201593.263282:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201593.263365:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201593.263416:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201593.263427:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 161 lru_type: 1 00010000:00010000:0.0:1788201593.263440:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 161 lru_type: 1 00000080:00200000:0.0:1788201593.263447:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201593.263454:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201593.263458:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201593.263465:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201593.263469:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 161 lru_type: 1 00010000:00010000:0.0:1788201593.263478:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 162 lru_type: 1 00000080:00200000:0.0:1788201593.263496:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201593.263505:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201593.263511:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201593.263528:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=recovery-small.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:0.0:1788201593.263534:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=recovery-small.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201593.263547:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: recovery-small.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201593.263822:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f468 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.263966:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f468 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.263980:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f468 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201593.264006:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727988480:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201593.264122:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201593.269640:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727988480:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201593.269682:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f468 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.269697:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f468 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.269705:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f468 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.269713:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f468 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.269722:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f468 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.269730:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc146085a00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201593.269736:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f468 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.269743:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f468 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.269752:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f468 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.269759:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201593.269767:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f468 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.269774:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f468 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201593.269836:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1725b1180 x1875064727988480/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201593.269858:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201593.269891:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201593.270020:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201593.270038:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201593.270049:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 162 lru_type: 1 00010000:00010000:0.0:1788201593.270063:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 162 lru_type: 1 00000080:00200000:0.0:1788201593.270071:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201593.270077:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201593.270081:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201593.270088:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:0.0:1788201593.270106:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 162 lru_type: 1 00010000:00010000:0.0:1788201593.270115:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 163 lru_type: 1 00000080:00200000:0.0:1788201593.270133:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201593.270151:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201593.270166:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201593.270185:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201593.270191:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=recovery-small.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc152c96780, open_flags 80c1, mode 81ed opened 0 00000080:00200000:0.0:1788201593.270201:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=recovery-small.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:0.0:1788201593.270224:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: recovery-small.sh,[0x200000bd7:0x183:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:0.0:1788201593.270287:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.270295:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1788201593.270310:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1788201593.270317:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725b1180 x1875064727988736/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1788201593.270328:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201593.270353:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725b1180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727988736:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201593.270543:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201593.283282:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725b1180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727988736:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201593.283321:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710978f4 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.283348:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x183:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710978f4 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.283357:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710978f4 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.283370:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710978f4 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.283396:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710978f4 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.283414:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710978f4 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.283425:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710978f4 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.283432:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710978f4 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201593.283444:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1725b1180 x1875064727988736/t8589937416(8589937416) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201593.283461:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725b1180 x1875064727988736/t8589937416(8589937416) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201593.283479:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710978f4 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1788201593.283493:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710978f4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.283505:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/387 (0 0) 00000080:00200000:0.0:1788201593.283514:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201593.283531:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=recovery-small.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:0.0:1788201593.283570:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x183:0x0](ffff8bc144687448) 00000080:00200000:0.0:1788201593.283729:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x183:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1788201593.283740:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x183:0x0](ffff8bc144687448) 00000080:00010000:0.0:1788201593.283743:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x183:0x0](ffff8bc144687448) for lock 0xd138388016f6f46f 00000080:00010000:0.0:1788201593.283755:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x183:0x0](ffff8bc144687448) 00000080:00200008:0.0:1788201593.283773:0:24470:0:(file.c:1090:ll_file_open()) START file recovery-small.sh:[0x200000bd7:0x183:0x0](ffff8bc144687448), flags 100301 00000002:00100000:0.0:1788201593.283821:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725b1180 x1875064727988736/t8589937416(8589937416) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1788201593.283874:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f46f from it ffff8bc146937360 00010000:00010000:0.0:1788201593.283879:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710978f4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.283889:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710978f4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201593.283921:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x183:0x0](ffff8bc144687448), inode mode 81ed mask 40 00000080:00200008:0.0:1788201593.283954:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file recovery-small.sh:[0x200000bd7:0x183:0x0](ffff8bc144687448), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201593.283961:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x183:0x0](ffff8bc144687448),name=recovery-small.sh 00000002:00010000:0.0:1788201593.283982:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x183:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201593.283994:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710978f4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.284007:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710978f4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201593.284015:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201593.284020:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x183:0x0](ffff8bc144687448) 00000080:00010000:0.0:1788201593.284023:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x183:0x0](ffff8bc144687448) for lock 0xd138388016f6f46f 00000080:00010000:0.0:1788201593.284027:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f46f from it ffffadd1c7debcd8 00010000:00010000:0.0:1788201593.284030:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710978f4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.284038:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710978f4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201593.284067:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x183:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201593.284077:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x183:0x0] 00000008:00010000:1.0:1788201593.284407:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201593.284412:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456430, osc lock ffff8bc145d085f0, flags 0x400001002 00010000:00010000:1.0:1788201593.284471:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fc1d640d/0xd138388016f6f476 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.284483:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fc1d640d/0xd138388016f6f476 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201593.284530:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:1.0:1788201593.287577:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x183:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201593.287586:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449dabf0 (ffff8bc1499c4908/0) at cl_lock_release():245 00000020:00010000:1.0:1788201593.287590:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449dabf0 (ffff8bc1499c4908/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.287596:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456430 (ffff8bc1499c4b48/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.287601:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449dabf0 (ffff8bc1499c4908/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201593.287604:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456430 (ffff8bc1499c4908/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201593.287646:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x183:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201593.287867:0:24470:0:(file.c:2638:do_file_write_iter()) START file recovery-small.sh:[0x200000bd7:0x183:0x0], ppos: 0, count: 111139 00000080:00200000:1.0:1788201593.287904:0:24470:0:(file.c:2090:ll_file_io_generic()) recovery-small.sh: write ppos: 0, bytes: 111139 00000080:00200000:1.0:1788201593.287912:0:24470:0:(file.c:1848:ll_io_set_mirror()) recovery-small.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201593.287919:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000478f96f0[0x110, 1, [0x200000bd7:0x183:0x0] hash] 00000020:00200000:1.0:1788201593.287921:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 111139) 0 0 00000080:00200000:1.0:1788201593.287926:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x183:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201593.287940:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 27] 00020000:00200000:1.0:1788201593.287949:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 111139) 111139, 111139 00020000:00200000:1.0:1788201593.287953:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201593.287990:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 27] 00000008:00010000:1.0:1788201593.288005:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201593.288011:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d46b0, osc lock ffff8bc145d085f0, flags 0x0 00010000:00010000:1.0:1788201593.288027:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/436 (0 114687) 00010000:00010000:1.0:1788201593.288074:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.288085:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->114687] (req 0->114687) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.288097:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->114687] (req 0->114687) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.288122:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602b480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727988992:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201593.288209:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201593.298403:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201593.298519:0:21781:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788201593.298557:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743481216 00000100:00100000:0.0:1788201593.298571:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743481216 00000100:00100000:0.0:1788201593.298643:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 765 00000100:00100000:0.0:1788201593.298666:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17257fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23391:x1875064743481216:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201593.298690:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fc1d640d/0xd138388016f6f476 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097902 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.298825:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201593.298834:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17257fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23391:x1875064743481216:12345-192.168.201.143@tcp:104: Request processed in 180us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201593.298841:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 765 00000100:00100000:1.0:1788201593.301982:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602b480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727988992:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201593.302024:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->114687] (req 0->114687) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097909 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.302041:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->114687] (req 0->114687) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097909 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.302051:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->114687] (req 0->114687) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097909 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201593.302148:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727989120:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201593.313712:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201593.316472:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727989120:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201593.316781:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097909 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.316840:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097909 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.316863:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097909 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201593.316878:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171097909 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.316893:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097909 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.316901:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097909 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201593.316930:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) recovery-small.sh: write [0, 111139) append 0 append lockpos 0 00000080:00200000:1.0:1788201593.316952:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.317007:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:1.0:1788201593.317019:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004cae5195[3 00000000e907c76c 2 1 000000000235009b 0 0 0] 00000080:00200000:1.0:1788201593.317024:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009d3e9448 17ffffc0001001 3:0 ffff8bc1725a2e00 0 lru 00000080:00200000:1.0:1788201593.317032:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000028add7e7 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.317034:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004cae5195 00000080:00200000:1.0:1788201593.317035:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201593.317039:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.317061:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:1.0:1788201593.317065:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004b746764[3 00000000e907c76c 2 1 000000000235009b 0 0 1] 00000080:00200000:1.0:1788201593.317068:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a7d44451 17ffffc0001001 3:0 ffff8bc1725a2540 1 lru 00000080:00200000:1.0:1788201593.317074:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000002517e1e7 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.317076:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004b746764 00000080:00200000:1.0:1788201593.317077:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:1.0:1788201593.317079:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.317104:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:1.0:1788201593.317108:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001d578361[3 00000000e907c76c 2 1 000000000235009b 0 0 2] 00000080:00200000:1.0:1788201593.317111:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000849bc96 17ffffc0001001 3:0 ffff8bc1725a2a80 2 lru 00000080:00200000:1.0:1788201593.317117:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009e0cbf63 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.317119:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001d578361 00000080:00200000:1.0:1788201593.317120:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:1.0:1788201593.317122:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.317137:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:1.0:1788201593.317141:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005a960f50[3 00000000e907c76c 2 1 000000000235009b 0 0 3] 00000080:00200000:1.0:1788201593.317144:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000320c7a6a 17ffffc0001001 3:0 ffff8bc1725a2c40 3 lru 00000080:00200000:1.0:1788201593.317149:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e21e4d20 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.317151:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005a960f50 00000080:00200000:1.0:1788201593.317152:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:1.0:1788201593.317164:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.317191:0:24470:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:1.0:1788201593.317195:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002d8c34f2[3 00000000e907c76c 2 1 000000000235009b 0 0 4] 00000080:00200000:1.0:1788201593.317199:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006bab2997 17ffffc0001021 2:0 ffff8bc1725a29a0 4 lru 00000080:00200000:1.0:1788201593.317204:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a3683f56 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.317206:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002d8c34f2 00000080:00200000:1.0:1788201593.317208:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:1.0:1788201593.317210:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.317222:0:24470:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:1.0:1788201593.317225:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000034583451[3 00000000e907c76c 2 1 000000000235009b 0 0 5] 00000080:00200000:1.0:1788201593.317228:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000653b3f7d 17ffffc0001001 3:0 ffff8bc1725a20e0 5 lru 00000080:00200000:1.0:1788201593.317234:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e9b06d05 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.317236:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000034583451 00000080:00200000:1.0:1788201593.317237:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:1.0:1788201593.317238:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.317249:0:24470:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:1.0:1788201593.317252:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008aa94276[3 00000000e907c76c 2 1 000000000235009b 0 0 6] 00000080:00200000:1.0:1788201593.317255:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ceed7403 17ffffc0001001 3:0 ffff8bc1725a21c0 6 lru 00000080:00200000:1.0:1788201593.317260:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009427713d 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.317262:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008aa94276 00000080:00200000:1.0:1788201593.317263:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:1.0:1788201593.317264:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.317278:0:24470:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:1.0:1788201593.317282:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c18d23e4[3 00000000e907c76c 2 1 000000000235009b 0 0 7] 00000080:00200000:1.0:1788201593.317284:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000602c4a05 17ffffc0001001 3:0 ffff8bc1725a2380 7 lru 00000080:00200000:1.0:1788201593.317289:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000047854820 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.317291:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c18d23e4 00000080:00200000:1.0:1788201593.317292:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:1.0:1788201593.317294:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.317307:0:24470:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:1.0:1788201593.317311:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000005ade95f[3 00000000e907c76c 2 1 000000000235009b 0 0 8] 00000080:00200000:1.0:1788201593.317314:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002a503011 17ffffc0001001 3:0 ffff8bc1725a28c0 8 lru 00000080:00200000:1.0:1788201593.317319:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001f72ded2 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.317322:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000005ade95f 00000080:00200000:1.0:1788201593.317323:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:1.0:1788201593.317324:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.317341:0:24470:0:(rw26.c:898:ll_write_end()) pos 36864, len 4096, copied 4096 00000080:00200000:1.0:1788201593.317345:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ff2cd2eb[3 00000000e907c76c 2 1 000000000235009b 0 0 9] 00000080:00200000:1.0:1788201593.317348:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004cb3359e 17ffffc0001001 3:0 ffff8bc1725a2000 9 lru 00000080:00200000:1.0:1788201593.317354:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009a07cf70 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.317356:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ff2cd2eb 00000080:00200000:1.0:1788201593.317357:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:1.0:1788201593.317359:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 10 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.317388:0:24470:0:(rw26.c:898:ll_write_end()) pos 40960, len 4096, copied 4096 00000080:00200000:1.0:1788201593.317393:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008033684f[3 00000000e907c76c 2 1 000000000235009b 0 0 10] 00000080:00200000:1.0:1788201593.317396:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000bc21ac5a 17ffffc0001001 3:0 ffff8bc1725a2d20 10 lru 00000080:00200000:1.0:1788201593.317402:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000042c61d64 10: 1< 0 - - > 2< 40960 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.317404:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008033684f 00000080:00200000:1.0:1788201593.317405:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 11. 00000080:00200000:1.0:1788201593.317407:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 11 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.317420:0:24470:0:(rw26.c:898:ll_write_end()) pos 45056, len 4096, copied 4096 00000080:00200000:1.0:1788201593.317424:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000051489d52[3 00000000e907c76c 2 1 000000000235009b 0 0 11] 00000080:00200000:1.0:1788201593.317427:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000199e7b2a 17ffffc0001001 3:0 ffff8bc1725a2460 11 lru 00000080:00200000:1.0:1788201593.317433:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001fff9e0c 11: 1< 0 - - > 2< 45056 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.317435:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000051489d52 00000080:00200000:1.0:1788201593.317436:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 12. 00000080:00200000:1.0:1788201593.317438:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 12 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.317449:0:24470:0:(rw26.c:898:ll_write_end()) pos 49152, len 4096, copied 4096 00000080:00200000:1.0:1788201593.317453:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000fbe91cd1[3 00000000e907c76c 2 1 000000000235009b 0 0 12] 00000080:00200000:1.0:1788201593.317455:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000b30edbd 17ffffc0001001 3:0 ffff8bc1725a22a0 12 lru 00000080:00200000:1.0:1788201593.317460:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b3d45b01 12: 1< 0 - - > 2< 49152 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.317462:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000fbe91cd1 00000080:00200000:1.0:1788201593.317463:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 13. 00000080:00200000:1.0:1788201593.317465:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 13 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.317481:0:24470:0:(rw26.c:898:ll_write_end()) pos 53248, len 4096, copied 4096 00000080:00200000:1.0:1788201593.317485:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003a8dbc79[3 00000000e907c76c 2 1 000000000235009b 0 0 13] 00000080:00200000:1.0:1788201593.317488:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c19bf12b 17ffffc0001001 3:0 ffff8bc1468cd1c0 13 lru 00000080:00200000:1.0:1788201593.317493:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d47f7d7c 13: 1< 0 - - > 2< 53248 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.317495:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003a8dbc79 00000080:00200000:1.0:1788201593.317497:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 14. 00000080:00200000:1.0:1788201593.317499:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 14 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.317514:0:24470:0:(rw26.c:898:ll_write_end()) pos 57344, len 4096, copied 4096 00000080:00200000:1.0:1788201593.317519:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008364a9e4[3 00000000e907c76c 2 1 000000000235009b 0 0 14] 00000080:00200000:1.0:1788201593.317522:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007a4aec1c 17ffffc0001001 3:0 ffff8bc1468cd9a0 14 lru 00000080:00200000:1.0:1788201593.317528:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007dde7e78 14: 1< 0 - - > 2< 57344 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.317530:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008364a9e4 00000080:00200000:1.0:1788201593.317531:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 15. 00000080:00200000:1.0:1788201593.317533:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 15 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.317544:0:24470:0:(rw26.c:898:ll_write_end()) pos 61440, len 4096, copied 4096 00000080:00200000:1.0:1788201593.317548:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001e7a87fa[3 00000000e907c76c 2 1 000000000235009b 0 0 15] 00000080:00200000:1.0:1788201593.318079:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b9fcd084 17ffffc0001001 3:0 ffff8bc1468cda80 15 lru 00000080:00200000:1.0:1788201593.318085:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a9a84ba4 15: 1< 0 - - > 2< 61440 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.318088:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001e7a87fa 00000080:00200000:1.0:1788201593.318089:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 16. 00000080:00200000:1.0:1788201593.318102:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 16 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.318124:0:24470:0:(rw26.c:898:ll_write_end()) pos 65536, len 4096, copied 4096 00000080:00200000:1.0:1788201593.318129:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000dd177f97[3 00000000e907c76c 2 1 000000000235009b 0 0 16] 00000080:00200000:1.0:1788201593.318132:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e1e9bce6 17ffffc0001001 3:0 ffff8bc1468cdb60 16 lru 00000080:00200000:1.0:1788201593.318138:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d68808c1 16: 1< 0 - - > 2< 65536 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.318140:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000dd177f97 00000080:00200000:1.0:1788201593.318141:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 17. 00000080:00200000:1.0:1788201593.318143:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 17 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.319346:0:24470:0:(rw26.c:898:ll_write_end()) pos 69632, len 4096, copied 4096 00000080:00200000:1.0:1788201593.319358:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005f4eaf20[3 00000000e907c76c 2 1 000000000235009b 0 0 17] 00000080:00200000:1.0:1788201593.319361:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000039ca7425 17ffffc0001001 3:0 ffff8bc1468cd700 17 lru 00000080:00200000:1.0:1788201593.319368:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009c6b700d 17: 1< 0 - - > 2< 69632 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.319370:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005f4eaf20 00000080:00200000:1.0:1788201593.319384:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 18. 00000080:00200000:1.0:1788201593.319387:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 18 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.319415:0:24470:0:(rw26.c:898:ll_write_end()) pos 73728, len 4096, copied 4096 00000080:00200000:1.0:1788201593.319420:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002da717c8[3 00000000e907c76c 2 1 000000000235009b 0 0 18] 00000080:00200000:1.0:1788201593.319423:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000edfbe056 17ffffc0001001 3:0 ffff8bc1468cd7e0 18 lru 00000080:00200000:1.0:1788201593.319430:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008b6ad4a8 18: 1< 0 - - > 2< 73728 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.319433:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002da717c8 00000080:00200000:1.0:1788201593.319434:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 19. 00000080:00200000:1.0:1788201593.319436:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 19 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.319460:0:24470:0:(rw26.c:898:ll_write_end()) pos 77824, len 4096, copied 4096 00000080:00200000:1.0:1788201593.319465:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003661d3ac[3 00000000e907c76c 2 1 000000000235009b 0 0 19] 00000080:00200000:1.0:1788201593.319467:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000004fac017 17ffffc0001021 2:0 ffff8bc1468cd620 19 lru 00000080:00200000:1.0:1788201593.319473:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001d188b2d 19: 1< 0 - - > 2< 77824 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.319475:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003661d3ac 00000080:00200000:1.0:1788201593.319476:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 20. 00000080:00200000:1.0:1788201593.319478:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 20 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.319495:0:24470:0:(rw26.c:898:ll_write_end()) pos 81920, len 4096, copied 4096 00000080:00200000:1.0:1788201593.319499:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000bbcd03b5[3 00000000e907c76c 2 1 000000000235009b 0 0 20] 00000080:00200000:1.0:1788201593.319502:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007fd3a140 17ffffc0001001 3:0 ffff8bc1468cdee0 20 lru 00000080:00200000:1.0:1788201593.319508:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ed73c48e 20: 1< 0 - - > 2< 81920 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.319510:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000bbcd03b5 00000080:00200000:1.0:1788201593.319511:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 21. 00000080:00200000:1.0:1788201593.319513:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 21 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.319528:0:24470:0:(rw26.c:898:ll_write_end()) pos 86016, len 4096, copied 4096 00000080:00200000:1.0:1788201593.319533:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006d8ff450[3 00000000e907c76c 2 1 000000000235009b 0 0 21] 00000080:00200000:1.0:1788201593.319535:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001406cf7d 17ffffc0001001 3:0 ffff8bc1468cde00 21 lru 00000080:00200000:1.0:1788201593.319541:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006066cf07 21: 1< 0 - - > 2< 86016 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.319544:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006d8ff450 00000080:00200000:1.0:1788201593.319545:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 22. 00000080:00200000:1.0:1788201593.319547:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 22 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.319782:0:24470:0:(rw26.c:898:ll_write_end()) pos 90112, len 4096, copied 4096 00000080:00200000:1.0:1788201593.319787:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d0348577[3 00000000e907c76c 2 1 000000000235009b 0 0 22] 00000080:00200000:1.0:1788201593.320326:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000fd2b2c95 17ffffc0001001 3:0 ffff8bc1468cd8c0 22 lru 00000080:00200000:1.0:1788201593.320332:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005de590fc 22: 1< 0 - - > 2< 90112 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.320335:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d0348577 00000080:00200000:1.0:1788201593.320336:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 23. 00000080:00200000:1.0:1788201593.320359:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 23 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.320391:0:24470:0:(rw26.c:898:ll_write_end()) pos 94208, len 4096, copied 4096 00000080:00200000:1.0:1788201593.320396:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b65e9392[3 00000000e907c76c 2 1 000000000235009b 0 0 23] 00000080:00200000:1.0:1788201593.320399:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000358abb35 17ffffc0001001 3:0 ffff8bc1468cd540 23 lru 00000080:00200000:1.0:1788201593.320404:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000fc947a22 23: 1< 0 - - > 2< 94208 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.320406:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b65e9392 00000080:00200000:1.0:1788201593.320407:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 24. 00000080:00200000:1.0:1788201593.320409:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 24 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.320428:0:24470:0:(rw26.c:898:ll_write_end()) pos 98304, len 4096, copied 4096 00000080:00200000:1.0:1788201593.320432:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000bf0d967e[3 00000000e907c76c 2 1 000000000235009b 0 0 24] 00000080:00200000:1.0:1788201593.320435:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000fa5b7015 17ffffc0001001 3:0 ffff8bc1468cdc40 24 lru 00000080:00200000:1.0:1788201593.320440:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001c49c36a 24: 1< 0 - - > 2< 98304 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.320442:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000bf0d967e 00000080:00200000:1.0:1788201593.320444:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 25. 00000080:00200000:1.0:1788201593.320446:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 25 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.320461:0:24470:0:(rw26.c:898:ll_write_end()) pos 102400, len 4096, copied 4096 00000080:00200000:1.0:1788201593.320466:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000011d5f5be[3 00000000e907c76c 2 1 000000000235009b 0 0 25] 00000080:00200000:1.0:1788201593.320468:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008707f4c9 17ffffc0001001 3:0 ffff8bc1468cd380 25 lru 00000080:00200000:1.0:1788201593.320473:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ac00f312 25: 1< 0 - - > 2< 102400 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.320475:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000011d5f5be 00000080:00200000:1.0:1788201593.320476:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 26. 00000080:00200000:1.0:1788201593.320478:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 26 of 0 to 4096 bytes 00000080:00200000:1.0:1788201593.320492:0:24470:0:(rw26.c:898:ll_write_end()) pos 106496, len 4096, copied 4096 00000080:00200000:1.0:1788201593.320497:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f92b7d54[3 00000000e907c76c 2 1 000000000235009b 0 0 26] 00000080:00200000:1.0:1788201593.320500:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000016c05d5c 17ffffc0001001 3:0 ffff8bc1468cd000 26 lru 00000080:00200000:1.0:1788201593.320505:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ff2062e1 26: 1< 0 - - > 2< 106496 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.320508:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f92b7d54 00000080:00200000:1.0:1788201593.320509:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 27. 00000080:00200000:1.0:1788201593.320511:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 27 of 0 to 547 bytes 00000080:00200000:1.0:1788201593.320537:0:24470:0:(rw26.c:898:ll_write_end()) pos 110592, len 547, copied 547 00000080:00200000:1.0:1788201593.320542:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000026b41ced[3 00000000e907c76c 2 1 000000000235009b 0 0 27] 00000080:00200000:1.0:1788201593.320544:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f3c690fa 17ffffc0001001 3:0 ffff8bc1468cdd20 27 lru 00000080:00200000:1.0:1788201593.321536:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000077b1f19f 27: 1< 0 - - > 2< 110592 0 0 0x0 0x0 | 000000008930e75a 0000000009b8307e > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.321543:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000026b41ced 00000080:00200000:1.0:1788201593.321545:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 28. 00000080:00200000:1.0:1788201593.321563:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 28, from 0, to 547 prio 0 00000008:00010000:1.0:1788201593.321606:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 000000000feb0963 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097909 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201593.321661:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1446875f8, count 15, dirtied 15 00000080:00200000:1.0:1788201593.321682:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1446875f8, count 13, dirtied 13 00000080:00200000:1.0:1788201593.321686:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 28 pages 111139 bytes, tot: 111139 00000080:00200000:1.0:1788201593.321691:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) recovery-small.sh: write bytes 0, result: 111139 00000020:00010000:1.0:1788201593.321713:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c4998 (ffff8bc148e3b638/0) at cl_lock_release():245 00000020:00010000:1.0:1788201593.321717:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c4998 (ffff8bc148e3b638/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.321721:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d46b0 (ffff8bc148e3b6c8/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201593.321732:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097909 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.321748:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097909 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201593.321772:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c4998 (ffff8bc148e3b638/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201593.321775:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d46b0 (ffff8bc148e3b638/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201593.321787:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 111139 bytes 00000080:00200000:1.0:1788201593.321814:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 27] 00000080:00200000:1.0:1788201593.321861:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x183:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201593.321866:0:24470:0:(file.c:2238:ll_file_io_generic()) recovery-small.sh: 2 io complete with rc: 0, result: 111139, restart: 0 00000080:00200000:1.0:1788201593.321878:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x183:0x0] updating i_size 111139 i_blocks 1 00000080:00200000:1.0:1788201593.321884:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 111139 00000080:00200008:1.0:1788201593.321946:0:24470:0:(file.c:479:ll_file_release()) START file recovery-small.sh:[0x200000bd7:0x183:0x0](ffff8bc144687448), flags 100001 00000002:00100000:1.0:1788201593.322028:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1725b1180 x1875064727988736/t8589937416(8589937416) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201609 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201593.322043:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201593.322049:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14602b480 x1875064727989376/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201593.322079:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602b480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727989376:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201593.322244:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201593.334697:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602b480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727989376:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201593.334744:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1725b1180 x1875064727988736/t8589937416(8589937416) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201593.334882:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201593.334907:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.334931:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 163 lru_type: 1 00010000:00010000:1.0:1788201593.334948:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 163 lru_type: 1 00000080:00200000:1.0:1788201593.334958:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.334965:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201593.334969:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201593.334979:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201593.334984:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 163 lru_type: 1 00010000:00010000:1.0:1788201593.334994:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 164 lru_type: 1 00000080:00200000:1.0:1788201593.335014:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.335021:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201593.335027:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.335031:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=recovery-small.sh, flags=8 00000080:00200008:1.0:1788201593.335040:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file recovery-small.sh:[0x200000bd7:0x183:0x0](ffff8bc144687448), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201593.335046:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x183:0x0](ffff8bc144687448),name=recovery-small.sh 00000002:00010000:1.0:1788201593.335060:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x183:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.335069:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710978f4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201593.335077:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710978f4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201593.335084:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.335088:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x183:0x0](ffff8bc144687448) 00000080:00010000:1.0:1788201593.335091:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x183:0x0](ffff8bc144687448) for lock 0xd138388016f6f46f 00000080:00010000:1.0:1788201593.335094:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f46f from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201593.335098:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710978f4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201593.335105:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710978f4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201593.335176:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x183:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201593.335188:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x183:0x0] 00000008:00010000:1.0:1788201593.335222:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201593.335227:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d46b0, osc lock ffff8bc145d085f0, flags 0x400001002 00010000:00010000:1.0:1788201593.335247:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097909 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.335260:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097909 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201593.335275:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201593.335280:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097909 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.335288:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097909 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201593.335300:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201593.335310:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x183:0x0] updating i_size 111139 i_blocks 1 00000020:00010000:1.0:1788201593.335315:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e27530 (ffff8bc148e3b638/0) at cl_lock_release():245 00000020:00010000:1.0:1788201593.335318:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e27530 (ffff8bc148e3b638/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.335321:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d46b0 (ffff8bc148e3b6c8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.335326:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e27530 (ffff8bc148e3b638/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201593.335329:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d46b0 (ffff8bc148e3b638/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201593.335363:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x183:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201593.335437:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201593.335445:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.335453:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 164 lru_type: 1 00010000:00010000:1.0:1788201593.335461:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 164 lru_type: 1 00000080:00200000:1.0:1788201593.335469:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.335474:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201593.335477:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201593.335480:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201593.335484:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 164 lru_type: 1 00010000:00010000:1.0:1788201593.335492:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 165 lru_type: 1 00000080:00200000:1.0:1788201593.335501:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.335506:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201593.335509:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.335523:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=replay-dual.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201593.335528:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=replay-dual.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201593.335538:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: replay-dual.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201593.335592:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f484 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.335601:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f484 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.335613:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f484 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.335637:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602b800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727989504:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201593.335770:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201593.348753:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602b800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727989504:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201593.348784:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f484 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.348831:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f484 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.348840:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f484 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.348849:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f484 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.348860:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f484 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.348867:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14a778200 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201593.348873:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f484 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.348880:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f484 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.348889:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f484 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.348897:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201593.348906:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f484 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.348914:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f484 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201593.348941:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14602b800 x1875064727989504/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201593.348960:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201593.348988:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201593.349063:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201593.349081:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.349093:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 165 lru_type: 1 00010000:00010000:1.0:1788201593.349107:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 165 lru_type: 1 00000080:00200000:1.0:1788201593.349115:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.349121:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201593.349125:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201593.349131:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201593.349135:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 165 lru_type: 1 00010000:00010000:1.0:1788201593.349145:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 166 lru_type: 1 00000080:00200000:1.0:1788201593.349226:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.349236:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201593.349242:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.349258:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=replay-dual.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:1.0:1788201593.349262:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=replay-dual.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201593.349277:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: replay-dual.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201593.349327:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779c00/0xd138388016f6f48b lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.349335:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779c00/0xd138388016f6f48b lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.349345:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779c00/0xd138388016f6f48b lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.349381:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602b800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727989632:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201593.349511:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201593.359325:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602b800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727989632:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201593.359360:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779c00/0xd138388016f6f48b lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.359386:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779c00/0xd138388016f6f48b lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.359395:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779c00/0xd138388016f6f48b lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.359403:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779c00/0xd138388016f6f48b lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.359414:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779c00/0xd138388016f6f48b lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.359421:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14a779c00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201593.359427:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779c00/0xd138388016f6f48b lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.359435:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779c00/0xd138388016f6f48b lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.359444:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779c00/0xd138388016f6f48b lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.359451:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201593.359458:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779c00/0xd138388016f6f48b lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.359465:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779c00/0xd138388016f6f48b lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201593.359491:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14602b800 x1875064727989632/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201593.359509:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201593.359540:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201593.359697:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201593.359715:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.359726:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 166 lru_type: 1 00010000:00010000:1.0:1788201593.359740:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 166 lru_type: 1 00000080:00200000:1.0:1788201593.359747:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.359753:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201593.359757:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201593.359763:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:1.0:1788201593.359768:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 166 lru_type: 1 00010000:00010000:1.0:1788201593.359776:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 167 lru_type: 1 00000080:00200000:1.0:1788201593.359895:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.359907:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201593.359944:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.359958:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201593.359963:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=replay-dual.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14304a300, open_flags 80c1, mode 81ed opened 0 00000080:00200000:1.0:1788201593.359972:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=replay-dual.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:1.0:1788201593.359996:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: replay-dual.sh,[0x200000bd7:0x184:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201593.360061:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f492 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.360069:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f492 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201593.360083:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201593.360773:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14602b800 x1875064727989888/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201593.360785:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f492 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.370873:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602b800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727989888:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201593.370909:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f492 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109794f expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.370937:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f492 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109794f expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.370947:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f492 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109794f expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.370960:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f492 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109794f expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.370972:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f492 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109794f expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.370988:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f492 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109794f expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.370998:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f492 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109794f expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.371006:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f492 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109794f expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201593.371019:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc14602b800 x1875064727989888/t8589937418(8589937418) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201593.371036:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14602b800 x1875064727989888/t8589937418(8589937418) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201593.371053:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f492 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109794f expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201593.371068:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f492 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109794f expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.371081:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/388 (0 0) 00000080:00200000:1.0:1788201593.371102:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201593.371120:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=replay-dual.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:1.0:1788201593.371158:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x184:0x0](ffff8bc1446b9148) 00000080:00200000:1.0:1788201593.371321:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x184:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201593.371333:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x184:0x0](ffff8bc1446b9148) 00000080:00010000:1.0:1788201593.371337:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x184:0x0](ffff8bc1446b9148) for lock 0xd138388016f6f492 00000080:00010000:1.0:1788201593.371349:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x184:0x0](ffff8bc1446b9148) 00000080:00200008:1.0:1788201593.371368:0:24470:0:(file.c:1090:ll_file_open()) START file replay-dual.sh:[0x200000bd7:0x184:0x0](ffff8bc1446b9148), flags 100301 00000002:00100000:1.0:1788201593.371407:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14602b800 x1875064727989888/t8589937418(8589937418) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201593.371460:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f492 from it ffff8bc1466cdd20 00010000:00010000:1.0:1788201593.371466:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f492 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109794f expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.371476:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f492 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109794f expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201593.371506:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x184:0x0](ffff8bc1446b9148), inode mode 81ed mask 40 00000080:00200008:1.0:1788201593.371543:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file replay-dual.sh:[0x200000bd7:0x184:0x0](ffff8bc1446b9148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201593.371552:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x184:0x0](ffff8bc1446b9148),name=replay-dual.sh 00000002:00010000:1.0:1788201593.371578:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x184:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.371589:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f492 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109794f expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.371603:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f492 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109794f expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201593.371611:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.371617:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x184:0x0](ffff8bc1446b9148) 00000080:00010000:1.0:1788201593.371621:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x184:0x0](ffff8bc1446b9148) for lock 0xd138388016f6f492 00000080:00010000:1.0:1788201593.371625:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f492 from it ffffadd1c7debcd8 00010000:00010000:1.0:1788201593.371629:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f492 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109794f expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.371637:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f492 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109794f expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:0.0:1788201593.374011:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727990016:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201593.383466:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f499 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.383509:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f499 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109795d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.383530:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f499 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109795d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.383561:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f499 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109795d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201593.383584:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f499 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109795d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201593.383602:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201593.383625:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f499 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109795d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.383636:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f499 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109795d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.383645:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f499 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109795d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.383665:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f499 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e217109795d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201593.383693:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727990016:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201593.388387:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201593.388518:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743481472 00000100:00100000:1.0:1788201593.388532:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743481472 00000100:00100000:1.0:1788201593.388617:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 767 00000100:00100000:1.0:1788201593.388631:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23415:x1875064743481472:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201593.388666:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f499 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109795d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.388785:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201593.388829:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23415:x1875064743481472:12345-192.168.201.143@tcp:104: Request processed in 201us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201593.388838:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 767 00010000:00010000:0.0:1788201593.389993:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201593.390005:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f499 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109795d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.390019:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172473a00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201593.390027:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f499 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e217109795d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201593.390097:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x184:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201593.390111:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x184:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1788201593.390206:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f499 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109795d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.390214:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201593.390268:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f499 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109795d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.390278:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f499 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109795d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.390300:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201593.390302:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201593.390303:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201593.390403:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201593.390428:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727990272:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201593.394587:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201593.394685:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743481600 00000100:00100000:0.0:1788201593.394696:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743481600 00000100:00100000:0.0:1788201593.394770:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 768 00000100:00100000:0.0:1788201593.394784:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1726cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743481600:12345-192.168.201.143@tcp:105: 00010000:00010000:0.0:1788201593.394831:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000003039f059/0xd138388016f6f4a0 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->36863] (req 0->36863) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097964 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.394846:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000003039f059/0xd138388016f6f4a0 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->36863] (req 0->36863) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097964 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.394856:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000003039f059/0xd138388016f6f4a0 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097964 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.394873:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000003039f059/0xd138388016f6f4a0 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097964 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.394884:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000003039f059/0xd138388016f6f4a0 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097964 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.394895:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000003039f059/0xd138388016f6f4a0 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171097964 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.394932:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc172472600) 00000100:00100000:0.0:1788201593.395016:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1726cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743481600:12345-192.168.201.143@tcp:105: Request processed in 234us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201593.395024:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 768 00000100:00100000:3.0:1788201593.404818:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727990272:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201593.434855:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472000/0xd138388016f6f4b5 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x185:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710979aa expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.434871:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472000/0xd138388016f6f4b5 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710979aa expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.434887:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472000/0xd138388016f6f4b5 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710979aa expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.434902:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472000/0xd138388016f6f4b5 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710979aa expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.434921:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472000/0xd138388016f6f4b5 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710979aa expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.434930:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472000/0xd138388016f6f4b5 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710979aa expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.434939:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472000/0xd138388016f6f4b5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710979aa expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201593.434954:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1725f6a00 x1875064727991040/t8589937420(8589937420) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1788201593.434971:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725f6a00 x1875064727991040/t8589937420(8589937420) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1788201593.434989:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472000/0xd138388016f6f4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710979aa expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1788201593.435006:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472000/0xd138388016f6f4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710979aa expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.435019:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/389 (0 0) 00000080:00200000:2.0:1788201593.435029:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1788201593.435047:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=replay-ost-single.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:2.0:1788201593.435088:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x185:0x0](ffff8bc1459f0908) 00000080:00200000:2.0:1788201593.435265:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x185:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1788201593.435277:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x185:0x0](ffff8bc1459f0908) 00000080:00010000:2.0:1788201593.435280:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x185:0x0](ffff8bc1459f0908) for lock 0xd138388016f6f4b5 00000080:00010000:2.0:1788201593.435294:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x185:0x0](ffff8bc1459f0908) 00000080:00200008:2.0:1788201593.435318:0:24470:0:(file.c:1090:ll_file_open()) START file replay-ost-single.sh:[0x200000bd7:0x185:0x0](ffff8bc1459f0908), flags 100301 00000002:00100000:2.0:1788201593.435342:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725f6a00 x1875064727991040/t8589937420(8589937420) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1788201593.435413:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f4b5 from it ffff8bc1507dbf60 00010000:00010000:2.0:1788201593.435419:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472000/0xd138388016f6f4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710979aa expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.435431:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472000/0xd138388016f6f4b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710979aa expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201593.435465:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x185:0x0](ffff8bc1459f0908), inode mode 81ed mask 40 00000080:00200008:2.0:1788201593.435520:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file replay-ost-single.sh:[0x200000bd7:0x185:0x0](ffff8bc1459f0908), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1788201593.435528:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x185:0x0](ffff8bc1459f0908),name=replay-ost-single.sh 00000002:00010000:2.0:1788201593.435875:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x185:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201593.435890:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472000/0xd138388016f6f4b5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710979aa expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201593.435911:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472000/0xd138388016f6f4b5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710979aa expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201593.435919:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201593.435926:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x185:0x0](ffff8bc1459f0908) 00000080:00010000:2.0:1788201593.435929:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x185:0x0](ffff8bc1459f0908) for lock 0xd138388016f6f4b5 00000080:00010000:2.0:1788201593.435934:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f4b5 from it ffffadd1c7debcd8 00010000:00010000:2.0:1788201593.435937:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472000/0xd138388016f6f4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710979aa expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201593.435945:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472000/0xd138388016f6f4b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710979aa expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1788201593.435977:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x185:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201593.435989:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x185:0x0] 00000008:00010000:2.0:1788201593.436019:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201593.436024:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d730, osc lock ffff8bc151fc0d10, flags 0x400001002 00010000:00010000:2.0:1788201593.436083:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006006808a/0xd138388016f6f4bc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.436095:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006006808a/0xd138388016f6f4bc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.436206:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727991168:192.168.201.143@tcp:101:cp.0 00000020:00200000:2.0:1788201593.436473:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1788201593.445267:0:10055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006006808a/0xd138388016f6f4bc lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.445308:0:10055:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006006808a/0xd138388016f6f4bc lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710979b8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.445328:0:10055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006006808a/0xd138388016f6f4bc lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710979b8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.445345:0:10055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006006808a/0xd138388016f6f4bc lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710979b8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201593.445366:0:10055:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006006808a/0xd138388016f6f4bc lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710979b8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201593.445393:0:10055:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201593.445413:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006006808a/0xd138388016f6f4bc lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710979b8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.445423:0:10055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006006808a/0xd138388016f6f4bc lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710979b8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.445431:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006006808a/0xd138388016f6f4bc lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710979b8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.445441:0:10055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006006808a/0xd138388016f6f4bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e21710979b8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201593.445470:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727991168:192.168.201.143@tcp:101:cp.0 00000080:00200000:2.0:1788201593.445591:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x185:0x0] updating i_size 0 i_blocks 1 00000020:00010000:2.0:1788201593.445598:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460046f0 (ffff8bc146919ab8/0) at cl_lock_release():245 00000020:00010000:2.0:1788201593.445602:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460046f0 (ffff8bc146919ab8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201593.445608:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d730 (ffff8bc146919c68/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201593.445613:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460046f0 (ffff8bc146919ab8/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201593.445616:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d730 (ffff8bc146919ab8/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201593.445674:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x185:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1788201593.445754:0:24470:0:(file.c:2638:do_file_write_iter()) START file replay-ost-single.sh:[0x200000bd7:0x185:0x0], ppos: 0, count: 13879 00000080:00200000:2.0:1788201593.445786:0:24470:0:(file.c:2090:ll_file_io_generic()) replay-ost-single.sh: write ppos: 0, bytes: 13879 00000080:00200000:2.0:1788201593.445843:0:24470:0:(file.c:1848:ll_io_set_mirror()) replay-ost-single.sh: desiginated mirror: 0 00000020:00200000:2.0:1788201593.445851:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000bcbfef74[0x110, 1, [0x200000bd7:0x185:0x0] hash] 00000020:00200000:2.0:1788201593.445854:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 13879) 0 0 00000080:00200000:2.0:1788201593.445859:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x185:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201593.445874:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 3] 00020000:00200000:2.0:1788201593.445883:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 13879) 13879, 13879 00020000:00200000:2.0:1788201593.445887:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201593.445926:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 3] 00000008:00010000:2.0:1788201593.445941:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1788201593.445947:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d730, osc lock ffff8bc151fc0d10, flags 0x0 00010000:00010000:2.0:1788201593.445966:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/437 (0 16383) 00010000:00010000:2.0:1788201593.446013:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.446023:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.446035:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201593.446067:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f7b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727991296:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201593.446177:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc148293600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201593.450334:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201593.450532:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743481728 00000100:00100000:2.0:1788201593.450642:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743481728 00000100:00100000:2.0:1788201593.450730:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 769 00000100:00100000:2.0:1788201593.450745:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1474d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23408:x1875064743481728:12345-192.168.201.143@tcp:104: 00010000:00010000:2.0:1788201593.450770:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006006808a/0xd138388016f6f4bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710979b8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201593.452018:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201593.452034:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1474d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23408:x1875064743481728:12345-192.168.201.143@tcp:104: Request processed in 1289us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201593.452044:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 769 00010000:00010000:3.0:1788201593.452882:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201593.452896:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006006808a/0xd138388016f6f4bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710979b8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201593.452911:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172473200 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201593.452920:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006006808a/0xd138388016f6f4bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e21710979b8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201593.453108:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x185:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201593.453123:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x185:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00000100:00100000:0.0:1788201593.454999:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f7b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727991296:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201593.455042:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.455061:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.455071:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.455778:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006006808a/0xd138388016f6f4bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710979b8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201593.455821:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788201593.455896:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727991424:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201593.456043:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006006808a/0xd138388016f6f4bc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710979b8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201593.456054:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006006808a/0xd138388016f6f4bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710979b8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201593.456079:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201593.456082:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201593.456084:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201593.458908:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201593.459020:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743481856 00000100:00100000:2.0:1788201593.459032:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743481856 00000100:00100000:2.0:1788201593.459105:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 770 00000100:00100000:2.0:1788201593.459117:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1474d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21004:x1875064743481856:12345-192.168.201.143@tcp:105: 00010000:00010000:2.0:1788201593.459141:0:20877:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.459167:0:20877:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.459178:0:20877:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.459191:0:20877:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.459203:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.459214:0:20877:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.459242:0:20877:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc172473a00) 00000100:00100000:2.0:1788201593.459318:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1474d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21004:x1875064743481856:12345-192.168.201.143@tcp:105: Request processed in 204us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201593.459327:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 770 00010000:00010000:0.0:1788201593.459644:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.459668:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.459687:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201593.459701:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.459715:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.459724:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201593.459765:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) replay-ost-single.sh: write [0, 13879) append 0 append lockpos 0 00000080:00200000:0.0:1788201593.459789:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:0.0:1788201593.459879:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:0.0:1788201593.459892:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004d42b1d7[3 000000001b26a759 2 1 000000002c23fcb5 0 0 0] 00000080:00200000:0.0:1788201593.459896:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000057d6aa11 17ffffc0001001 3:0 ffff8bc1727a6000 0 lru 00000080:00200000:0.0:1788201593.459905:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e282b26c 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 00000000ed7f71cb > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201593.459909:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004d42b1d7 00000080:00200000:0.0:1788201593.459910:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1788201593.459914:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:0.0:1788201593.459945:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:0.0:1788201593.459950:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000858138e4[3 000000001b26a759 2 1 000000002c23fcb5 0 0 1] 00000080:00200000:0.0:1788201593.459953:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000000fc0bb2 17ffffc0001001 3:0 ffff8bc1726e5ee0 1 lru 00000080:00200000:0.0:1788201593.459958:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000015bdb4ee 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 00000000ed7f71cb > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201593.459960:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000858138e4 00000080:00200000:0.0:1788201593.459962:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:0.0:1788201593.459963:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:0.0:1788201593.459981:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:0.0:1788201593.459986:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000dbe197d4[3 000000001b26a759 2 1 000000002c23fcb5 0 0 2] 00000080:00200000:0.0:1788201593.459988:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000514ca401 17ffffc0001001 3:0 ffff8bc1726e5620 2 lru 00000080:00200000:0.0:1788201593.459993:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000cb0f47cb 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000008930e75a 00000000ed7f71cb > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201593.459996:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000dbe197d4 00000080:00200000:0.0:1788201593.459997:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:0.0:1788201593.459998:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 1591 bytes 00000080:00200000:0.0:1788201593.460024:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 1591, copied 1591 00000080:00200000:0.0:1788201593.460029:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006faa780d[3 000000001b26a759 2 1 000000002c23fcb5 0 0 3] 00000080:00200000:0.0:1788201593.460032:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e5dae40e 17ffffc0001001 3:0 ffff8bc1726e57e0 3 lru 00000080:00200000:0.0:1788201593.460038:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d8b506bc 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000008930e75a 00000000ed7f71cb > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201593.460041:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006faa780d 00000080:00200000:0.0:1788201593.460042:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:0.0:1788201593.460046:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 4, from 0, to 1591 prio 0 00000008:00010000:0.0:1788201593.460074:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 000000007e517272 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201593.460100:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459f0ab8, count 4, dirtied 4 00000080:00200000:0.0:1788201593.460106:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 4 pages 13879 bytes, tot: 13879 00000080:00200000:0.0:1788201593.460109:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) replay-ost-single.sh: write bytes 0, result: 13879 00000020:00010000:0.0:1788201593.460128:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc149844f38 (ffff8bc146919ab8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201593.460133:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149844f38 (ffff8bc146919ab8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201593.460136:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d730 (ffff8bc146919c68/1) at cl_lock_cancel():142 00010000:00010000:0.0:1788201593.460142:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.460155:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1788201593.460177:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149844f38 (ffff8bc146919ab8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201593.460180:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d730 (ffff8bc146919ab8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201593.460189:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 13879 bytes 00000080:00200000:0.0:1788201593.460197:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 3] 00000080:00200000:0.0:1788201593.460239:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x185:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201593.460244:0:24470:0:(file.c:2238:ll_file_io_generic()) replay-ost-single.sh: 2 io complete with rc: 0, result: 13879, restart: 0 00000080:00200000:0.0:1788201593.460253:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x185:0x0] updating i_size 13879 i_blocks 1 00000080:00200000:0.0:1788201593.460260:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 13879 00000080:00200008:0.0:1788201593.460317:0:24470:0:(file.c:479:ll_file_release()) START file replay-ost-single.sh:[0x200000bd7:0x185:0x0](ffff8bc1459f0908), flags 100001 00000002:00100000:0.0:1788201593.460390:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1725f6a00 x1875064727991040/t8589937420(8589937420) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201609 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1788201593.460403:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1788201593.460409:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1474d4a80 x1875064727991680/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1788201593.460436:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d4a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727991680:192.168.201.143@tcp:35:cp.0 00000100:00100000:0.0:1788201593.460495:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201593.465609:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d4a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727991680:192.168.201.143@tcp:35:cp.0 00000002:00100000:2.0:1788201593.465671:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1725f6a00 x1875064727991040/t8589937420(8589937420) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201593.465775:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201593.465967:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201593.465991:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 171 lru_type: 1 00010000:00010000:2.0:1788201593.466008:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 171 lru_type: 1 00000080:00200000:2.0:1788201593.466016:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201593.466023:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201593.466027:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201593.466036:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201593.466040:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 171 lru_type: 1 00010000:00010000:2.0:1788201593.466050:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 172 lru_type: 1 00000080:00200000:2.0:1788201593.466070:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201593.466079:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201593.466085:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201593.466137:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=replay-ost-single.sh, flags=8 00000080:00200008:2.0:1788201593.466146:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file replay-ost-single.sh:[0x200000bd7:0x185:0x0](ffff8bc1459f0908), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1788201593.466205:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x185:0x0](ffff8bc1459f0908),name=replay-ost-single.sh 00000002:00010000:2.0:1788201593.466222:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x185:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201593.466232:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472000/0xd138388016f6f4b5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710979aa expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201593.466242:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472000/0xd138388016f6f4b5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710979aa expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1788201593.466248:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201593.466252:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x185:0x0](ffff8bc1459f0908) 00000080:00010000:2.0:1788201593.466255:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x185:0x0](ffff8bc1459f0908) for lock 0xd138388016f6f4b5 00000080:00010000:2.0:1788201593.466259:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f4b5 from it ffffadd1c7debcb8 00010000:00010000:2.0:1788201593.466262:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472000/0xd138388016f6f4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710979aa expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201593.466270:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472000/0xd138388016f6f4b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710979aa expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201593.466323:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x185:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201593.466333:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x185:0x0] 00000008:00010000:2.0:1788201593.466365:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201593.466381:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d2b0, osc lock ffff8bc151fc0130, flags 0x400001002 00010000:00010000:2.0:1788201593.466403:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201593.466416:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:2.0:1788201593.466430:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1788201593.466434:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201593.466447:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1788201593.466458:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1788201593.466470:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x185:0x0] updating i_size 13879 i_blocks 1 00000020:00010000:2.0:1788201593.466475:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc146005970 (ffff8bc146919638/0) at cl_lock_release():245 00000020:00010000:2.0:1788201593.466479:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146005970 (ffff8bc146919638/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201593.466481:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d2b0 (ffff8bc146919998/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201593.466486:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146005970 (ffff8bc146919638/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201593.466488:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d2b0 (ffff8bc146919638/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201593.466522:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x185:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:1.0:1788201593.466888:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727991424:192.168.201.143@tcp:103:ldlm_bl.0 00000080:00200000:2.0:1788201593.466980:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201593.466992:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201593.467004:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 172 lru_type: 1 00010000:00010000:2.0:1788201593.467013:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 172 lru_type: 1 00000080:00200000:2.0:1788201593.467019:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201593.467024:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201593.467027:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201593.467030:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201593.467033:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 172 lru_type: 1 00010000:00010000:2.0:1788201593.467046:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 173 lru_type: 1 00000080:00200000:2.0:1788201593.467056:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201593.467061:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201593.467065:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201593.467079:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=replay-single-lmv.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:2.0:1788201593.467084:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=replay-single-lmv.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201593.467252:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: replay-single-lmv.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201593.467306:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f4ca lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.467315:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f4ca lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.467327:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f4ca lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201593.467351:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f4700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727991808:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201593.467520:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc14301b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201593.474730:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f4700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727991808:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201593.474761:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f4ca lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.474778:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f4ca lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.474786:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f4ca lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.474813:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f4ca lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.474823:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f4ca lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.474831:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172472200 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201593.474836:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f4ca lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.474845:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f4ca lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.474853:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f4ca lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.474861:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201593.474869:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f4ca lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.474880:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f4ca lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201593.474906:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1725f4700 x1875064727991808/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201593.474924:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201593.474954:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:3.0:1788201593.475035:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201593.475055:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201593.475065:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 173 lru_type: 1 00010000:00010000:3.0:1788201593.475078:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 173 lru_type: 1 00000080:00200000:3.0:1788201593.475085:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201593.475151:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201593.475226:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201593.475234:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201593.475238:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 173 lru_type: 1 00010000:00010000:3.0:1788201593.475247:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 174 lru_type: 1 00000080:00200000:3.0:1788201593.475265:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201593.475275:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201593.475282:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201593.475299:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=replay-single-lmv.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:3.0:1788201593.475303:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=replay-single-lmv.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:3.0:1788201593.475318:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: replay-single-lmv.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201593.475385:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1a00/0xd138388016f6f4d1 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.475393:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1a00/0xd138388016f6f4d1 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.475405:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1a00/0xd138388016f6f4d1 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201593.475434:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727991936:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201593.475545:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201593.479402:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727991936:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201593.479433:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1a00/0xd138388016f6f4d1 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.479450:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1a00/0xd138388016f6f4d1 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.479457:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1a00/0xd138388016f6f4d1 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.479465:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1a00/0xd138388016f6f4d1 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.479475:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1a00/0xd138388016f6f4d1 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.479487:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1725a1a00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201593.479492:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1a00/0xd138388016f6f4d1 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.479500:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1a00/0xd138388016f6f4d1 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.479509:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1a00/0xd138388016f6f4d1 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.479516:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201593.479524:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1a00/0xd138388016f6f4d1 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.479531:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1a00/0xd138388016f6f4d1 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201593.479612:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1726ce680 x1875064727991936/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201593.479633:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201593.479728:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:3.0:1788201593.479961:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201593.479980:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201593.479991:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 174 lru_type: 1 00010000:00010000:3.0:1788201593.480005:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 174 lru_type: 1 00000080:00200000:3.0:1788201593.480017:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201593.480023:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201593.480026:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201593.480032:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:3.0:1788201593.480036:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 174 lru_type: 1 00010000:00010000:3.0:1788201593.480044:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 175 lru_type: 1 00000080:00200000:3.0:1788201593.480060:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201593.480068:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201593.480074:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201593.480088:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:3.0:1788201593.480239:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=replay-single-lmv.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc146420900, open_flags 80c1, mode 81ed opened 0 00000080:00200000:3.0:1788201593.480249:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=replay-single-lmv.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:3.0:1788201593.480271:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: replay-single-lmv.sh,[0x200000bd7:0x186:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:3.0:1788201593.480328:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.480335:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1788201593.480348:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1788201593.480356:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1726ce680 x1875064727992192/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1788201593.480384:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201593.480408:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727992192:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201593.480685:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201593.484943:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727992192:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201593.484978:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097a05 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.485004:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097a05 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.485014:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097a05 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.485027:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097a05 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.485040:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097a05 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.485057:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097a05 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.485066:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097a05 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.485079:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097a05 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201593.485110:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1726ce680 x1875064727992192/t8589937422(8589937422) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1788201593.485125:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1726ce680 x1875064727992192/t8589937422(8589937422) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201593.485139:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097a05 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1788201593.485161:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097a05 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.485173:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/390 (0 0) 00000080:00200000:3.0:1788201593.485181:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1788201593.485197:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=replay-single-lmv.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:3.0:1788201593.485238:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x186:0x0](ffff8bc1459d42c8) 00000080:00200000:3.0:1788201593.485408:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x186:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1788201593.485420:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x186:0x0](ffff8bc1459d42c8) 00000080:00010000:3.0:1788201593.485424:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x186:0x0](ffff8bc1459d42c8) for lock 0xd138388016f6f4d8 00000080:00010000:3.0:1788201593.485436:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x186:0x0](ffff8bc1459d42c8) 00000080:00200008:3.0:1788201593.485453:0:24470:0:(file.c:1090:ll_file_open()) START file replay-single-lmv.sh:[0x200000bd7:0x186:0x0](ffff8bc1459d42c8), flags 100301 00000002:00100000:3.0:1788201593.485476:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1726ce680 x1875064727992192/t8589937422(8589937422) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1788201593.485529:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f4d8 from it ffff8bc148c9b060 00010000:00010000:3.0:1788201593.485535:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097a05 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.485556:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097a05 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201593.485587:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x186:0x0](ffff8bc1459d42c8), inode mode 81ed mask 40 00000080:00200008:3.0:1788201593.485623:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file replay-single-lmv.sh:[0x200000bd7:0x186:0x0](ffff8bc1459d42c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201593.485630:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x186:0x0](ffff8bc1459d42c8),name=replay-single-lmv.sh 00000002:00010000:3.0:1788201593.485981:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x186:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201593.485996:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097a05 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201593.486010:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097a05 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201593.486018:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201593.486024:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x186:0x0](ffff8bc1459d42c8) 00000080:00010000:3.0:1788201593.486027:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x186:0x0](ffff8bc1459d42c8) for lock 0xd138388016f6f4d8 00000080:00010000:3.0:1788201593.486032:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f4d8 from it ffffadd1c7debcd8 00010000:00010000:3.0:1788201593.486036:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097a05 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201593.486043:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097a05 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201593.486073:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x186:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201593.486083:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x186:0x0] 00000008:00010000:3.0:1788201593.486113:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201593.486117:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149feca30, osc lock ffff8bc14691aab0, flags 0x400001002 00010000:00010000:3.0:1788201593.486182:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f4df lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.486194:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f4df lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201593.486298:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727992320:192.168.201.143@tcp:101:cp.0 00000020:00200000:3.0:1788201593.486463:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:2.0:1788201593.499456:0:10053:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8bc143fc0000: committing for last_committed 8589935323 gen 1 00010000:00010000:2.0:1788201593.499594:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f4df lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.499623:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f4df lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097a13 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.499657:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f4df lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097a13 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.499674:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f4df lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097a13 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1788201593.499693:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f4df lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097a13 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1788201593.499705:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:2.0:1788201593.499725:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f4df lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097a13 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.499734:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f4df lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097a13 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.499741:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f4df lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097a13 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.499750:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f4df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171097a13 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1788201593.499774:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727992320:192.168.201.143@tcp:101:cp.0 00000080:00200000:3.0:1788201593.500023:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x186:0x0] updating i_size 0 i_blocks 1 00000020:00010000:3.0:1788201593.500031:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc6500 (ffff8bc1460e9a28/0) at cl_lock_release():245 00000020:00010000:3.0:1788201593.500035:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc6500 (ffff8bc1460e9a28/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201593.500040:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149feca30 (ffff8bc1460e9878/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201593.500045:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc6500 (ffff8bc1460e9a28/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201593.500048:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149feca30 (ffff8bc1460e9a28/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201593.500091:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x186:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1788201593.500173:0:24470:0:(file.c:2638:do_file_write_iter()) START file replay-single-lmv.sh:[0x200000bd7:0x186:0x0], ppos: 0, count: 2129 00000080:00200000:3.0:1788201593.500190:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 2129 bytes 00000080:00200000:3.0:1788201593.500197:0:24470:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 2129 00000080:00200000:3.0:1788201593.500222:0:24470:0:(file.c:2090:ll_file_io_generic()) replay-single-lmv.sh: write ppos: 0, bytes: 2129 00000080:00200000:3.0:1788201593.500229:0:24470:0:(file.c:1848:ll_io_set_mirror()) replay-single-lmv.sh: desiginated mirror: 0 00000020:00200000:3.0:1788201593.500235:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@000000001e6327e2[0x110, 1, [0x200000bd7:0x186:0x0] hash] 00000020:00200000:3.0:1788201593.500237:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 2129) 0 0 00000080:00200000:3.0:1788201593.500241:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x186:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201593.500255:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1788201593.500264:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 2129) 2129, 2129 00020000:00200000:3.0:1788201593.500268:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1788201593.500299:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1788201593.500314:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1788201593.500320:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149feca30, osc lock ffff8bc14691aab0, flags 0x0 00010000:00010000:3.0:1788201593.500338:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/437 (0 4095) 00010000:00010000:3.0:1788201593.500398:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.500410:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.500421:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201593.500443:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727992448:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201593.500536:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc840 going to sleep for 11 seconds 00000100:00100000:3.0:1788201593.502753:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201593.503221:0:20876:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788201593.503247:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743481984 00000100:00100000:2.0:1788201593.503258:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743481984 00000100:00100000:2.0:1788201593.503319:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 771 00000100:00100000:2.0:1788201593.503330:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172703450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23411:x1875064743481984:12345-192.168.201.143@tcp:104: 00010000:00010000:2.0:1788201593.503353:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f4df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097a13 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201593.503441:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201593.503448:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172703450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23411:x1875064743481984:12345-192.168.201.143@tcp:104: Request processed in 120us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201593.503457:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 771 00010000:00010000:3.0:1788201593.505326:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201593.505341:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f4df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097a13 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201593.505358:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1725a0c00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201593.505366:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f4df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171097a13 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201593.505447:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x186:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201593.505463:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x186:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201593.505570:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f4df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097a13 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201593.505579:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201593.505620:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f4df lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097a13 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201593.505630:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f4df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097a13 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201593.505860:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727992576:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201593.507973:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201593.507982:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201593.507985:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201593.508062:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727992448:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201593.508109:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.508127:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.508137:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201593.508537:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201593.508769:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743482112 00000100:00100000:1.0:1788201593.508778:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743482112 00000100:00100000:1.0:1788201593.508863:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 772 00000100:00100000:1.0:1788201593.508875:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1474d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21005:x1875064743482112:12345-192.168.201.143@tcp:105: 00010000:00010000:1.0:1788201593.508890:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.508900:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.508909:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.508920:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.508931:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.508948:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.508973:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1725a1a00) 00000100:00100000:1.0:1788201593.509044:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1474d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21005:x1875064743482112:12345-192.168.201.143@tcp:105: Request processed in 171us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201593.509052:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 772 00010000:00010000:3.0:1788201593.510886:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.510908:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.510931:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201593.510952:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.510965:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.510974:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201593.511012:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) replay-single-lmv.sh: write [0, 2129) append 0 append lockpos 0 00000080:00200000:3.0:1788201593.511040:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 2129 bytes 00000080:00200000:3.0:1788201593.512239:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 2129, copied 2129 00000080:00200000:3.0:1788201593.512260:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f1326198[3 000000009302d36b 2 1 00000000aedd57cb 0 0 0] 00000080:00200000:3.0:1788201593.512264:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000000c21981 17ffffc0001001 3:0 ffff8bc146072620 0 lru 00000080:00200000:3.0:1788201593.512272:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000de020a88 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 000000009a229d98 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.512275:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f1326198 00000080:00200000:3.0:1788201593.512276:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201593.512283:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 2129 prio 0 00000008:00010000:3.0:1788201593.512310:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000dc1150d4 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201593.512336:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d4478, count 1, dirtied 1 00000080:00200000:3.0:1788201593.512342:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 2129 bytes, tot: 2129 00000080:00200000:3.0:1788201593.512345:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) replay-single-lmv.sh: write bytes 0, result: 2129 00000020:00010000:3.0:1788201593.512365:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460e64e8 (ffff8bc1460e9a28/0) at cl_lock_release():245 00000020:00010000:3.0:1788201593.512380:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460e64e8 (ffff8bc1460e9a28/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201593.512384:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149feca30 (ffff8bc1460e9878/1) at cl_lock_cancel():142 00010000:00010000:3.0:1788201593.512391:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.512402:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1788201593.512424:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460e64e8 (ffff8bc1460e9a28/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201593.512428:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149feca30 (ffff8bc1460e9a28/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201593.512436:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 2129 bytes 00000080:00200000:3.0:1788201593.512445:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1788201593.512485:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x186:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201593.512489:0:24470:0:(file.c:2238:ll_file_io_generic()) replay-single-lmv.sh: 2 io complete with rc: 0, result: 2129, restart: 0 00000080:00200000:3.0:1788201593.512497:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x186:0x0] updating i_size 2129 i_blocks 1 00000080:00200000:3.0:1788201593.512503:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 2129 00000080:00200008:3.0:1788201593.512571:0:24470:0:(file.c:479:ll_file_release()) START file replay-single-lmv.sh:[0x200000bd7:0x186:0x0](ffff8bc1459d42c8), flags 100001 00000002:00100000:3.0:1788201593.512642:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1726ce680 x1875064727992192/t8589937422(8589937422) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201609 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1788201593.512666:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1788201593.512673:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1726cfb80 x1875064727992832/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1788201593.512702:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727992832:192.168.201.143@tcp:35:cp.0 00000100:00100000:3.0:1788201593.513102:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc840 going to sleep for 11 seconds 00000100:00100000:3.0:1788201593.515944:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727992576:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201593.516233:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727992832:192.168.201.143@tcp:35:cp.0 00000002:00100000:3.0:1788201593.516267:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1726ce680 x1875064727992192/t8589937422(8589937422) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201593.516359:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201593.516392:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201593.516416:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 175 lru_type: 1 00010000:00010000:3.0:1788201593.516433:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 175 lru_type: 1 00000080:00200000:3.0:1788201593.516443:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201593.516449:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201593.516454:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201593.516465:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201593.516470:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 175 lru_type: 1 00010000:00010000:3.0:1788201593.516480:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 176 lru_type: 1 00000080:00200000:3.0:1788201593.516500:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201593.516508:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201593.516514:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201593.516518:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=replay-single-lmv.sh, flags=8 00000080:00200008:3.0:1788201593.516528:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file replay-single-lmv.sh:[0x200000bd7:0x186:0x0](ffff8bc1459d42c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201593.516533:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x186:0x0](ffff8bc1459d42c8),name=replay-single-lmv.sh 00000002:00010000:3.0:1788201593.516781:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x186:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201593.516996:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097a05 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201593.517008:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097a05 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201593.517016:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201593.517022:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x186:0x0](ffff8bc1459d42c8) 00000080:00010000:3.0:1788201593.517024:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x186:0x0](ffff8bc1459d42c8) for lock 0xd138388016f6f4d8 00000080:00010000:3.0:1788201593.517029:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f4d8 from it ffffadd1c7debcb8 00010000:00010000:3.0:1788201593.517032:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097a05 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201593.517041:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097a05 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201593.517095:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x186:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201593.517106:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x186:0x0] 00000008:00010000:3.0:1788201593.517142:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201593.517147:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149feca30, osc lock ffff8bc14691aab0, flags 0x400001002 00010000:00010000:3.0:1788201593.517240:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201593.517253:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:3.0:1788201593.517267:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1788201593.517271:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201593.517285:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1788201593.517297:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1788201593.517307:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x186:0x0] updating i_size 2129 i_blocks 1 00000020:00010000:3.0:1788201593.517312:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc6500 (ffff8bc1460e9a28/0) at cl_lock_release():245 00000020:00010000:3.0:1788201593.517315:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc6500 (ffff8bc1460e9a28/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201593.517318:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149feca30 (ffff8bc1460e9878/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201593.517323:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc6500 (ffff8bc1460e9a28/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201593.517326:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149feca30 (ffff8bc1460e9a28/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201593.517361:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x186:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201593.517445:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201593.517454:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201593.517462:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 176 lru_type: 1 00010000:00010000:3.0:1788201593.517471:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 176 lru_type: 1 00000080:00200000:3.0:1788201593.517478:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201593.517483:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201593.517486:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201593.517490:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201593.517494:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 176 lru_type: 1 00010000:00010000:3.0:1788201593.517508:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 177 lru_type: 1 00000080:00200000:3.0:1788201593.517517:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201593.517522:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201593.517526:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201593.517540:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=replay-single.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:3.0:1788201593.517545:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=replay-single.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:3.0:1788201593.517629:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: replay-single.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201593.517755:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f4ed lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.517764:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f4ed lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.517775:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f4ed lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201593.517969:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727992960:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201593.518116:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc840 going to sleep for 11 seconds 00000100:00100000:3.0:1788201593.521980:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727992960:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201593.522007:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f4ed lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.522023:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f4ed lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.522035:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f4ed lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.522043:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f4ed lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.522053:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f4ed lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.522060:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1725a1000 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201593.522065:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f4ed lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.522072:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f4ed lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.522080:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f4ed lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.522088:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201593.522146:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f4ed lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.522211:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f4ed lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201593.522236:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1726cdf80 x1875064727992960/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201593.522254:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201593.522284:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:3.0:1788201593.522361:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201593.522388:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201593.522401:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 177 lru_type: 1 00010000:00010000:3.0:1788201593.522414:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 177 lru_type: 1 00000080:00200000:3.0:1788201593.522421:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201593.522427:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201593.522431:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201593.522436:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201593.522440:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 177 lru_type: 1 00010000:00010000:3.0:1788201593.522449:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 178 lru_type: 1 00000080:00200000:3.0:1788201593.522467:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201593.522476:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201593.522482:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201593.522498:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=replay-single.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:3.0:1788201593.522502:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=replay-single.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:3.0:1788201593.522514:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: replay-single.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201593.522634:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f4f4 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.522643:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f4f4 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.522727:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f4f4 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201593.522755:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727993088:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201593.523101:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201593.535903:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727993088:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201593.535933:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f4f4 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.535950:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f4f4 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.535957:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f4f4 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.535963:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f4f4 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.535974:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f4f4 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.535985:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1725a0c00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:2.0:1788201593.535990:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f4f4 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.535998:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f4f4 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.536006:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f4f4 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.536014:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201593.536021:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f4f4 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.536028:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0c00/0xd138388016f6f4f4 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201593.536053:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1726cdf80 x1875064727993088/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201593.536070:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1788201593.536102:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201593.536253:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201593.536272:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201593.536283:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 178 lru_type: 1 00010000:00010000:2.0:1788201593.536296:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 178 lru_type: 1 00000080:00200000:2.0:1788201593.536309:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201593.536315:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201593.536319:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201593.536326:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:2.0:1788201593.536330:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 178 lru_type: 1 00010000:00010000:2.0:1788201593.536340:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 179 lru_type: 1 00000080:00200000:2.0:1788201593.536357:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201593.536378:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201593.536386:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201593.536401:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1788201593.536406:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=replay-single.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14c594180, open_flags 80c1, mode 81ed opened 0 00000080:00200000:2.0:1788201593.536414:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=replay-single.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:2.0:1788201593.536439:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: replay-single.sh,[0x200000bd7:0x187:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:2.0:1788201593.536500:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.536509:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1788201593.536523:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1788201593.536530:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725f7100 x1875064727993344/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1788201593.536556:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201593.536586:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f7100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727993344:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201593.536965:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1539faa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201593.544388:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f7100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727993344:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201593.544429:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097a60 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.544458:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x187:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097a60 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.544468:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097a60 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.544480:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097a60 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.544493:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097a60 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.544511:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097a60 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.544519:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097a60 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.544533:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097a60 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201593.544557:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1725f7100 x1875064727993344/t8589937424(8589937424) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1788201593.544574:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725f7100 x1875064727993344/t8589937424(8589937424) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1788201593.544591:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097a60 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1788201593.544605:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097a60 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.544616:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/391 (0 0) 00000080:00200000:2.0:1788201593.544624:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1788201593.544641:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=replay-single.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:2.0:1788201593.544687:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x187:0x0](ffff8bc1459f5b88) 00000080:00200000:2.0:1788201593.544870:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x187:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1788201593.544881:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x187:0x0](ffff8bc1459f5b88) 00000080:00010000:2.0:1788201593.544898:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x187:0x0](ffff8bc1459f5b88) for lock 0xd138388016f6f4fb 00000080:00010000:2.0:1788201593.544912:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x187:0x0](ffff8bc1459f5b88) 00000080:00200008:2.0:1788201593.544928:0:24470:0:(file.c:1090:ll_file_open()) START file replay-single.sh:[0x200000bd7:0x187:0x0](ffff8bc1459f5b88), flags 100301 00000002:00100000:2.0:1788201593.544951:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1725f7100 x1875064727993344/t8589937424(8589937424) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1788201593.545002:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f4fb from it ffff8bc1507db540 00010000:00010000:2.0:1788201593.545008:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097a60 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.545017:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097a60 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201593.545042:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x187:0x0](ffff8bc1459f5b88), inode mode 81ed mask 40 00000080:00200008:2.0:1788201593.545074:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file replay-single.sh:[0x200000bd7:0x187:0x0](ffff8bc1459f5b88), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1788201593.545080:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x187:0x0](ffff8bc1459f5b88),name=replay-single.sh 00000002:00010000:2.0:1788201593.545115:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x187:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201593.545125:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097a60 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201593.545137:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097a60 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201593.545145:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201593.545151:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x187:0x0](ffff8bc1459f5b88) 00000080:00010000:2.0:1788201593.545154:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x187:0x0](ffff8bc1459f5b88) for lock 0xd138388016f6f4fb 00000080:00010000:2.0:1788201593.545158:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f4fb from it ffffadd1c7debcd8 00010000:00010000:2.0:1788201593.545162:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097a60 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201593.545169:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097a60 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1788201593.545197:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x187:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201593.545207:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x187:0x0] 00000008:00010000:2.0:1788201593.545239:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201593.545247:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d830, osc lock ffff8bc151fc0130, flags 0x400001002 00010000:00010000:2.0:1788201593.545298:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f502 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.545309:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f502 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1788201593.545348:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1788201593.546276:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201593.546304:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727993472:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201593.556914:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f502 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.556952:0:10054:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f502 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097a6e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.556969:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f502 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097a6e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.556984:0:10054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f502 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097a6e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201593.557002:0:10054:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f502 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097a6e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201593.557016:0:10054:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201593.557098:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f502 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097a6e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.557115:0:10054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f502 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097a6e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.557123:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f502 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097a6e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.557132:0:10054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f502 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171097a6e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201593.557301:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727993472:192.168.201.143@tcp:101:cp.0 00000080:00200000:2.0:1788201593.564984:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x187:0x0] updating i_size 0 i_blocks 1 00000020:00010000:2.0:1788201593.565001:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc146005970 (ffff8bc146919638/0) at cl_lock_release():245 00000020:00010000:2.0:1788201593.565008:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146005970 (ffff8bc146919638/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201593.565015:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d830 (ffff8bc146919998/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201593.565022:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146005970 (ffff8bc146919638/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201593.565025:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d830 (ffff8bc146919638/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201593.565075:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x187:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1788201593.565259:0:24470:0:(file.c:2638:do_file_write_iter()) START file replay-single.sh:[0x200000bd7:0x187:0x0], ppos: 0, count: 158554 00000080:00200000:2.0:1788201593.565300:0:24470:0:(file.c:2090:ll_file_io_generic()) replay-single.sh: write ppos: 0, bytes: 158554 00000080:00200000:2.0:1788201593.565308:0:24470:0:(file.c:1848:ll_io_set_mirror()) replay-single.sh: desiginated mirror: 0 00000020:00200000:2.0:1788201593.565316:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@0000000015e99aa0[0x110, 1, [0x200000bd7:0x187:0x0] hash] 00000020:00200000:2.0:1788201593.565319:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 158554) 0 0 00000080:00200000:2.0:1788201593.565323:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x187:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201593.565336:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 38] 00020000:00200000:2.0:1788201593.565346:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 158554) 158554, 158554 00020000:00200000:2.0:1788201593.565350:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201593.565398:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 38] 00000008:00010000:2.0:1788201593.565414:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1788201593.565422:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d830, osc lock ffff8bc151fc0130, flags 0x0 00010000:00010000:2.0:1788201593.565447:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/438 (0 159743) 00010000:00010000:2.0:1788201593.565518:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.565531:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.565544:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201593.566354:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f5f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727993600:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201593.566636:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1539203c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201593.590712:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201593.590938:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743482240 00000100:00100000:1.0:1788201593.590952:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743482240 00000100:00100000:1.0:1788201593.591025:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 773 00000100:00100000:1.0:1788201593.591037:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1474d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21821:x1875064743482240:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201593.591061:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f502 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097a6e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.591177:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201593.591185:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1474d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21821:x1875064743482240:12345-192.168.201.143@tcp:104: Request processed in 151us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201593.591193:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 773 00010000:00010000:3.0:1788201593.591997:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201593.592012:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f502 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097a6e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201593.592026:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172472e00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201593.592034:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f502 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171097a6e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201593.592102:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x187:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201593.592117:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x187:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201593.592267:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f502 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097a6e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201593.592283:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788201593.592361:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727993728:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201593.592575:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f502 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097a6e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201593.592585:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f502 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097a6e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201593.592607:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201593.592609:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201593.592611:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201593.607897:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201593.608129:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743482368 00000100:00100000:1.0:1788201593.608153:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743482368 00000100:00100000:1.0:1788201593.608253:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 774 00000100:00100000:1.0:1788201593.608266:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1474d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21003:x1875064743482368:12345-192.168.201.143@tcp:105: 00010000:00010000:1.0:1788201593.608287:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.608306:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.608317:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.608330:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.608342:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.608354:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.608390:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc172473c00) 00000100:00100000:1.0:1788201593.608468:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1474d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21003:x1875064743482368:12345-192.168.201.143@tcp:105: Request processed in 204us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201593.608477:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 774 00000100:00100000:3.0:1788201593.610480:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f5f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727993600:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201593.610516:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.610545:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201593.610561:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.610576:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.610584:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201593.610619:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) replay-single.sh: write [0, 158554) append 0 append lockpos 0 00000080:00200000:3.0:1788201593.610643:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.610721:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:3.0:1788201593.610749:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007e4594f2[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 0] 00000080:00200000:3.0:1788201593.610753:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000075e3c314 17ffffc0001001 3:0 ffff8bc1460727e0 0 lru 00000080:00200000:3.0:1788201593.610760:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c20fd83e 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.610763:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007e4594f2 00000080:00200000:3.0:1788201593.610764:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201593.610769:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.610819:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:3.0:1788201593.610825:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000cf8939bb[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 1] 00000080:00200000:3.0:1788201593.610828:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000003d7c759 17ffffc0001001 3:0 ffff8bc146072b60 1 lru 00000080:00200000:3.0:1788201593.610834:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000098b9fac6 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.610837:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000cf8939bb 00000080:00200000:3.0:1788201593.610838:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:3.0:1788201593.610840:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.610860:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:3.0:1788201593.610864:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000647f8d49[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 2] 00000080:00200000:3.0:1788201593.610867:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000800f3fdf 17ffffc0001001 3:0 ffff8bc146072700 2 lru 00000080:00200000:3.0:1788201593.610872:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000711ae6b2 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.610874:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000647f8d49 00000080:00200000:3.0:1788201593.610875:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:3.0:1788201593.610877:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.610906:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:3.0:1788201593.610912:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006730d8be[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 3] 00000080:00200000:3.0:1788201593.610915:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ace41171 17ffffc0001001 3:0 ffff8bc150a08620 3 lru 00000080:00200000:3.0:1788201593.610920:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008c531a5d 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.610923:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006730d8be 00000080:00200000:3.0:1788201593.610925:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:3.0:1788201593.610926:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.610943:0:24470:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:3.0:1788201593.610947:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000189bba26[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 4] 00000080:00200000:3.0:1788201593.610950:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000fb536b93 17ffffc0001001 3:0 ffff8bc150a08ee0 4 lru 00000080:00200000:3.0:1788201593.610955:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005d569fa7 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.610957:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000189bba26 00000080:00200000:3.0:1788201593.610958:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:3.0:1788201593.610960:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.610976:0:24470:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:3.0:1788201593.610981:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c773c67d[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 5] 00000080:00200000:3.0:1788201593.610983:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005e317d6d 17ffffc0001001 3:0 ffff8bc150a08e00 5 lru 00000080:00200000:3.0:1788201593.610988:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007b10a105 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.610990:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c773c67d 00000080:00200000:3.0:1788201593.610991:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:3.0:1788201593.610993:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.611011:0:24470:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:3.0:1788201593.611014:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000956bd46f[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 6] 00000080:00200000:3.0:1788201593.611017:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e4fa2ff1 17ffffc0001001 3:0 ffff8bc150a088c0 6 lru 00000080:00200000:3.0:1788201593.611021:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c0d9a839 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.611024:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000956bd46f 00000080:00200000:3.0:1788201593.611025:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:3.0:1788201593.611027:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.611042:0:24470:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:3.0:1788201593.611046:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000050e6ed55[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 7] 00000080:00200000:3.0:1788201593.611049:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f1a96d02 17ffffc0001001 3:0 ffff8bc150a08540 7 lru 00000080:00200000:3.0:1788201593.611054:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000071363e17 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.611056:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000050e6ed55 00000080:00200000:3.0:1788201593.611057:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:3.0:1788201593.611059:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.611074:0:24470:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:3.0:1788201593.611089:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001594d963[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 8] 00000080:00200000:3.0:1788201593.611093:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007f4c3259 17ffffc0001001 3:0 ffff8bc150a08a80 8 lru 00000080:00200000:3.0:1788201593.611099:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f3811e6a 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.611101:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001594d963 00000080:00200000:3.0:1788201593.611103:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:3.0:1788201593.611105:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.611122:0:24470:0:(rw26.c:898:ll_write_end()) pos 36864, len 4096, copied 4096 00000080:00200000:3.0:1788201593.611127:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002c9bc2b2[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 9] 00000080:00200000:3.0:1788201593.611130:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000cb799afe 17ffffc0001001 3:0 ffff8bc150a08c40 9 lru 00000080:00200000:3.0:1788201593.611134:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006ba59ed9 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.611136:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002c9bc2b2 00000080:00200000:3.0:1788201593.611138:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:3.0:1788201593.611140:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 10 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.611609:0:24470:0:(rw26.c:898:ll_write_end()) pos 40960, len 4096, copied 4096 00000080:00200000:3.0:1788201593.611615:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000967b5816[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 10] 00000080:00200000:3.0:1788201593.611618:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f7404bea 17ffffc0001021 2:0 ffff8bc150a089a0 10 lru 00000080:00200000:3.0:1788201593.611624:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e4e9155f 10: 1< 0 - - > 2< 40960 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.611626:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000967b5816 00000080:00200000:3.0:1788201593.611627:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 11. 00000080:00200000:3.0:1788201593.611630:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 11 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.611646:0:24470:0:(rw26.c:898:ll_write_end()) pos 45056, len 4096, copied 4096 00000080:00200000:3.0:1788201593.611651:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e527b894[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 11] 00000080:00200000:3.0:1788201593.611653:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000976199b3 17ffffc0001001 3:0 ffff8bc150a080e0 11 lru 00000080:00200000:3.0:1788201593.611658:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000ef74e62 11: 1< 0 - - > 2< 45056 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.611660:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e527b894 00000080:00200000:3.0:1788201593.611661:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 12. 00000080:00200000:3.0:1788201593.611663:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 12 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.611679:0:24470:0:(rw26.c:898:ll_write_end()) pos 49152, len 4096, copied 4096 00000080:00200000:3.0:1788201593.611684:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000919b252c[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 12] 00000080:00200000:3.0:1788201593.611687:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005b7a40ae 17ffffc0001001 3:0 ffff8bc150a081c0 12 lru 00000080:00200000:3.0:1788201593.611692:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000038493909 12: 1< 0 - - > 2< 49152 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.611695:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000919b252c 00000080:00200000:3.0:1788201593.611696:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 13. 00000080:00200000:3.0:1788201593.611699:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 13 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.611717:0:24470:0:(rw26.c:898:ll_write_end()) pos 53248, len 4096, copied 4096 00000080:00200000:3.0:1788201593.611721:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a3f9160b[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 13] 00000080:00200000:3.0:1788201593.611724:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f87ddb39 17ffffc0001001 3:0 ffff8bc150a08380 13 lru 00000080:00200000:3.0:1788201593.612056:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005929ae2c 13: 1< 0 - - > 2< 53248 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.612060:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a3f9160b 00000080:00200000:3.0:1788201593.612061:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 14. 00000080:00200000:3.0:1788201593.612064:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 14 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.612094:0:24470:0:(rw26.c:898:ll_write_end()) pos 57344, len 4096, copied 4096 00000080:00200000:3.0:1788201593.612100:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000dc656805[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 14] 00000080:00200000:3.0:1788201593.612103:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000756a0be4 17ffffc0001001 3:0 ffff8bc150a08000 14 lru 00000080:00200000:3.0:1788201593.612108:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000027bf3584 14: 1< 0 - - > 2< 57344 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.612111:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000dc656805 00000080:00200000:3.0:1788201593.612112:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 15. 00000080:00200000:3.0:1788201593.612115:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 15 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.612132:0:24470:0:(rw26.c:898:ll_write_end()) pos 61440, len 4096, copied 4096 00000080:00200000:3.0:1788201593.612137:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f5b68657[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 15] 00000080:00200000:3.0:1788201593.612139:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000425816b6 17ffffc0001001 3:0 ffff8bc150a08d20 15 lru 00000080:00200000:3.0:1788201593.612439:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004dd77a79 15: 1< 0 - - > 2< 61440 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.612442:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f5b68657 00000080:00200000:3.0:1788201593.612444:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 16. 00000080:00200000:3.0:1788201593.612447:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 16 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.612467:0:24470:0:(rw26.c:898:ll_write_end()) pos 65536, len 4096, copied 4096 00000080:00200000:3.0:1788201593.612472:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009f5e0c84[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 16] 00000080:00200000:3.0:1788201593.612474:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000aee002e0 17ffffc0001001 3:0 ffff8bc150a08460 16 lru 00000080:00200000:3.0:1788201593.612479:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c0ae5bb0 16: 1< 0 - - > 2< 65536 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.612481:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009f5e0c84 00000080:00200000:3.0:1788201593.612483:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 17. 00000080:00200000:3.0:1788201593.612485:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 17 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.612499:0:24470:0:(rw26.c:898:ll_write_end()) pos 69632, len 4096, copied 4096 00000080:00200000:3.0:1788201593.612503:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000431248b[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 17] 00000080:00200000:3.0:1788201593.612506:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000082d81038 17ffffc0001001 3:0 ffff8bc150a082a0 17 lru 00000080:00200000:3.0:1788201593.612513:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004fed18e6 17: 1< 0 - - > 2< 69632 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.612515:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000431248b 00000080:00200000:3.0:1788201593.612516:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 18. 00000080:00200000:3.0:1788201593.612519:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 18 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.612539:0:24470:0:(rw26.c:898:ll_write_end()) pos 73728, len 4096, copied 4096 00000080:00200000:3.0:1788201593.612543:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000014a1d5e8[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 18] 00000080:00200000:3.0:1788201593.612546:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001c07bab7 17ffffc0001001 3:0 ffff8bc150a08b60 18 lru 00000080:00200000:3.0:1788201593.612552:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000b658201 18: 1< 0 - - > 2< 73728 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.612554:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000014a1d5e8 00000080:00200000:3.0:1788201593.612555:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 19. 00000080:00200000:3.0:1788201593.612558:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 19 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.612575:0:24470:0:(rw26.c:898:ll_write_end()) pos 77824, len 4096, copied 4096 00000080:00200000:3.0:1788201593.612580:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000085b5a02e[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 19] 00000080:00200000:3.0:1788201593.612582:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005c0f4130 17ffffc0001001 3:0 ffff8bc150a08700 19 lru 00000080:00200000:3.0:1788201593.612588:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000041a2be4e 19: 1< 0 - - > 2< 77824 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.612590:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000085b5a02e 00000080:00200000:3.0:1788201593.612591:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 20. 00000080:00200000:3.0:1788201593.612593:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 20 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.612614:0:24470:0:(rw26.c:898:ll_write_end()) pos 81920, len 4096, copied 4096 00000080:00200000:3.0:1788201593.612618:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000092f12d5c[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 20] 00000080:00200000:3.0:1788201593.612620:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000692f8bd6 17ffffc0001001 3:0 ffff8bc150a087e0 20 lru 00000080:00200000:3.0:1788201593.612625:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000086162612 20: 1< 0 - - > 2< 81920 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.612628:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000092f12d5c 00000080:00200000:3.0:1788201593.612629:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 21. 00000080:00200000:3.0:1788201593.612631:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 21 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.612659:0:24470:0:(rw26.c:898:ll_write_end()) pos 86016, len 4096, copied 4096 00000080:00200000:3.0:1788201593.612664:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001716b856[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 21] 00000080:00200000:3.0:1788201593.612667:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a8904ff4 17ffffc0001001 3:0 ffff8bc147418380 21 lru 00000080:00200000:3.0:1788201593.612673:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c4e291f4 21: 1< 0 - - > 2< 86016 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.612675:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001716b856 00000080:00200000:3.0:1788201593.612676:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 22. 00000080:00200000:3.0:1788201593.612679:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 22 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.612696:0:24470:0:(rw26.c:898:ll_write_end()) pos 90112, len 4096, copied 4096 00000080:00200000:3.0:1788201593.612700:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006d2f5a28[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 22] 00000080:00200000:3.0:1788201593.612703:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006db082d3 17ffffc0001001 3:0 ffff8bc147418000 22 lru 00000080:00200000:3.0:1788201593.612708:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000061eb8243 22: 1< 0 - - > 2< 90112 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.612710:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006d2f5a28 00000080:00200000:3.0:1788201593.612711:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 23. 00000080:00200000:3.0:1788201593.612713:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 23 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.615568:0:24470:0:(rw26.c:898:ll_write_end()) pos 94208, len 4096, copied 4096 00000080:00200000:3.0:1788201593.615604:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006ced1a28[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 23] 00000080:00200000:3.0:1788201593.615608:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009fc44c1f 17ffffc0001001 3:0 ffff8bc147418d20 23 lru 00000080:00200000:3.0:1788201593.615619:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000018b6c897 23: 1< 0 - - > 2< 94208 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.615622:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006ced1a28 00000080:00200000:3.0:1788201593.615623:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 24. 00000080:00200000:3.0:1788201593.615630:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 24 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.615712:0:24470:0:(rw26.c:898:ll_write_end()) pos 98304, len 4096, copied 4096 00000080:00200000:3.0:1788201593.615718:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009837ac42[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 24] 00000080:00200000:3.0:1788201593.615721:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004c1a5c5b 17ffffc0001001 3:0 ffff8bc1474180e0 24 lru 00000080:00200000:3.0:1788201593.615726:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000000f0f7e2 24: 1< 0 - - > 2< 98304 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.615728:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009837ac42 00000080:00200000:3.0:1788201593.615742:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 25. 00000080:00200000:3.0:1788201593.615745:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 25 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.615778:0:24470:0:(rw26.c:898:ll_write_end()) pos 102400, len 4096, copied 4096 00000080:00200000:3.0:1788201593.615783:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f65f25a3[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 25] 00000080:00200000:3.0:1788201593.615786:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006357b4e0 17ffffc0001021 2:0 ffff8bc147418460 25 lru 00000080:00200000:3.0:1788201593.615813:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d8a2ec70 25: 1< 0 - - > 2< 102400 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.615817:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f65f25a3 00000080:00200000:3.0:1788201593.615818:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 26. 00000080:00200000:3.0:1788201593.615821:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 26 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.615840:0:24470:0:(rw26.c:898:ll_write_end()) pos 106496, len 4096, copied 4096 00000080:00200000:3.0:1788201593.615844:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009a34ddec[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 26] 00000080:00200000:3.0:1788201593.615847:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c0c46daa 17ffffc0001001 3:0 ffff8bc1474182a0 26 lru 00000080:00200000:3.0:1788201593.615853:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c7741ec4 26: 1< 0 - - > 2< 106496 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.615855:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009a34ddec 00000080:00200000:3.0:1788201593.615857:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 27. 00000080:00200000:3.0:1788201593.615859:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 27 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.615879:0:24470:0:(rw26.c:898:ll_write_end()) pos 110592, len 4096, copied 4096 00000080:00200000:3.0:1788201593.615883:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e7e1b172[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 27] 00000080:00200000:3.0:1788201593.615886:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000cc4496ba 17ffffc0001001 3:0 ffff8bc147418b60 27 lru 00000080:00200000:3.0:1788201593.615891:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000476eb4cf 27: 1< 0 - - > 2< 110592 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.615892:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e7e1b172 00000080:00200000:3.0:1788201593.615893:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 28. 00000080:00200000:3.0:1788201593.615895:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 28 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.615910:0:24470:0:(rw26.c:898:ll_write_end()) pos 114688, len 4096, copied 4096 00000080:00200000:3.0:1788201593.615914:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000033d49d74[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 28] 00000080:00200000:3.0:1788201593.615917:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000035dc2193 17ffffc0001001 3:0 ffff8bc147418700 28 lru 00000080:00200000:3.0:1788201593.615922:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005ad40686 28: 1< 0 - - > 2< 114688 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.615924:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000033d49d74 00000080:00200000:3.0:1788201593.615925:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 29. 00000080:00200000:3.0:1788201593.615927:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 29 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.615943:0:24470:0:(rw26.c:898:ll_write_end()) pos 118784, len 4096, copied 4096 00000080:00200000:3.0:1788201593.615947:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000044665f3a[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 29] 00000080:00200000:3.0:1788201593.615950:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009af0e07d 17ffffc0001001 3:0 ffff8bc1474187e0 29 lru 00000080:00200000:3.0:1788201593.615955:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000550c1566 29: 1< 0 - - > 2< 118784 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.615957:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000044665f3a 00000080:00200000:3.0:1788201593.615959:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 30. 00000080:00200000:3.0:1788201593.615961:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 30 of 0 to 4096 bytes 00000080:00200000:3.0:1788201593.615978:0:24470:0:(rw26.c:898:ll_write_end()) pos 122880, len 4096, copied 4096 00000080:00200000:3.0:1788201593.615983:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000afa04f4a[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 30] 00000080:00200000:3.0:1788201593.615985:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000052d4dcfa 17ffffc0001001 3:0 ffff8bc147418620 30 lru 00000080:00200000:3.0:1788201593.615990:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e9a30b4a 30: 1< 0 - - > 2< 122880 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201593.615993:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000afa04f4a 00000080:00200000:3.0:1788201593.617557:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 31. 00000080:00200000:0.0:1788201593.617893:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 31 of 0 to 4096 bytes 00000080:00200000:0.0:1788201593.617960:0:24470:0:(rw26.c:898:ll_write_end()) pos 126976, len 4096, copied 4096 00000080:00200000:0.0:1788201593.617970:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d6c2d7d7[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 31] 00000080:00200000:0.0:1788201593.617974:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a48cab5f 17ffffc0001021 2:0 ffff8bc1726e5700 31 lru 00000080:00200000:0.0:1788201593.617983:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003d8c73c4 31: 1< 0 - - > 2< 126976 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201593.617986:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d6c2d7d7 00000080:00200000:0.0:1788201593.617987:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 32. 00000080:00200000:0.0:1788201593.617989:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 32 of 0 to 4096 bytes 00000080:00200000:0.0:1788201593.618008:0:24470:0:(rw26.c:898:ll_write_end()) pos 131072, len 4096, copied 4096 00000080:00200000:0.0:1788201593.618013:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f7c0d0d5[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 32] 00000080:00200000:0.0:1788201593.618015:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000076c050ec 17ffffc0001001 3:0 ffff8bc1726e5b60 32 lru 00000080:00200000:0.0:1788201593.618021:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a95f4e8b 32: 1< 0 - - > 2< 131072 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201593.618023:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f7c0d0d5 00000080:00200000:0.0:1788201593.618024:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 33. 00000080:00200000:0.0:1788201593.618027:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 33 of 0 to 4096 bytes 00000080:00200000:0.0:1788201593.618043:0:24470:0:(rw26.c:898:ll_write_end()) pos 135168, len 4096, copied 4096 00000080:00200000:0.0:1788201593.618048:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009af90a35[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 33] 00000080:00200000:0.0:1788201593.618051:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000245acf4a 17ffffc0001001 3:0 ffff8bc1726e52a0 33 lru 00000080:00200000:0.0:1788201593.618056:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d60e1019 33: 1< 0 - - > 2< 135168 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201593.618059:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009af90a35 00000080:00200000:0.0:1788201593.618060:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 34. 00000080:00200000:0.0:1788201593.618062:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 34 of 0 to 4096 bytes 00000080:00200000:0.0:1788201593.618077:0:24470:0:(rw26.c:898:ll_write_end()) pos 139264, len 4096, copied 4096 00000080:00200000:0.0:1788201593.618081:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000eaef60c0[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 34] 00000080:00200000:0.0:1788201593.618084:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001d1caf79 17ffffc0001001 3:0 ffff8bc1726e5460 34 lru 00000080:00200000:0.0:1788201593.618102:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000037465824 34: 1< 0 - - > 2< 139264 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201593.618105:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000eaef60c0 00000080:00200000:0.0:1788201593.618106:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 35. 00000080:00200000:0.0:1788201593.618108:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 35 of 0 to 4096 bytes 00000080:00200000:0.0:1788201593.618126:0:24470:0:(rw26.c:898:ll_write_end()) pos 143360, len 4096, copied 4096 00000080:00200000:0.0:1788201593.618131:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000528ab69[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 35] 00000080:00200000:0.0:1788201593.618134:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ba648df0 17ffffc0001001 3:0 ffff8bc1726e5d20 35 lru 00000080:00200000:0.0:1788201593.618140:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d0c6d411 35: 1< 0 - - > 2< 143360 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201593.618142:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000528ab69 00000080:00200000:0.0:1788201593.618143:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 36. 00000080:00200000:0.0:1788201593.618145:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 36 of 0 to 4096 bytes 00000080:00200000:0.0:1788201593.618162:0:24470:0:(rw26.c:898:ll_write_end()) pos 147456, len 4096, copied 4096 00000080:00200000:0.0:1788201593.618166:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000295f606[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 36] 00000080:00200000:0.0:1788201593.618169:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f0a78a3f 17ffffc0001001 3:0 ffff8bc1726e5000 36 lru 00000080:00200000:0.0:1788201593.618175:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005c46c655 36: 1< 0 - - > 2< 147456 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201593.618177:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000295f606 00000080:00200000:0.0:1788201593.618178:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 37. 00000080:00200000:0.0:1788201593.618180:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 37 of 0 to 4096 bytes 00000080:00200000:0.0:1788201593.618196:0:24470:0:(rw26.c:898:ll_write_end()) pos 151552, len 4096, copied 4096 00000080:00200000:0.0:1788201593.618200:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000095827115[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 37] 00000080:00200000:0.0:1788201593.618203:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000067c15ef3 17ffffc0001001 3:0 ffff8bc1726e5380 37 lru 00000080:00200000:0.0:1788201593.618209:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000461f1a90 37: 1< 0 - - > 2< 151552 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201593.618212:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000095827115 00000080:00200000:0.0:1788201593.618213:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 38. 00000080:00200000:0.0:1788201593.618215:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 38 of 0 to 2906 bytes 00000080:00200000:0.0:1788201593.618240:0:24470:0:(rw26.c:898:ll_write_end()) pos 155648, len 2906, copied 2906 00000080:00200000:0.0:1788201593.618245:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000948037b6[3 000000003bc5ff99 2 1 0000000046fd08ea 0 0 38] 00000080:00200000:0.0:1788201593.618247:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008215f7c7 17ffffc0001001 3:0 ffff8bc1726e51c0 38 lru 00000080:00200000:0.0:1788201593.618252:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008af11358 38: 1< 0 - - > 2< 155648 0 0 0x0 0x0 | 000000008930e75a 000000009c2869e2 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201593.618255:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000948037b6 00000080:00200000:0.0:1788201593.618256:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 39. 00000080:00200000:0.0:1788201593.618261:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 39, from 0, to 2906 prio 0 00000008:00010000:0.0:1788201593.618301:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000953f8997 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201593.618342:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459f5d38, count 15, dirtied 15 00000080:00200000:0.0:1788201593.618361:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459f5d38, count 15, dirtied 15 00000080:00200000:0.0:1788201593.618384:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459f5d38, count 9, dirtied 9 00000080:00200000:0.0:1788201593.618389:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 39 pages 158554 bytes, tot: 158554 00000080:00200000:0.0:1788201593.618394:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) replay-single.sh: write bytes 0, result: 158554 00000020:00010000:0.0:1788201593.618416:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc149844128 (ffff8bc146919638/0) at cl_lock_release():245 00000020:00010000:0.0:1788201593.618420:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149844128 (ffff8bc146919638/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201593.618423:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d830 (ffff8bc146919998/1) at cl_lock_cancel():142 00010000:00010000:0.0:1788201593.618432:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.618446:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1788201593.618471:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149844128 (ffff8bc146919638/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201593.618474:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d830 (ffff8bc146919638/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201593.618484:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 158554 bytes 00000080:00200000:0.0:1788201593.618492:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 38] 00000080:00200000:0.0:1788201593.618528:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x187:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201593.618532:0:24470:0:(file.c:2238:ll_file_io_generic()) replay-single.sh: 2 io complete with rc: 0, result: 158554, restart: 0 00000080:00200000:0.0:1788201593.618540:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x187:0x0] updating i_size 158554 i_blocks 1 00000080:00200000:0.0:1788201593.618546:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 158554 00000080:00200008:0.0:1788201593.618603:0:24470:0:(file.c:479:ll_file_release()) START file replay-single.sh:[0x200000bd7:0x187:0x0](ffff8bc1459f5b88), flags 100001 00000002:00100000:0.0:1788201593.618837:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1725f7100 x1875064727993344/t8589937424(8589937424) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201609 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1788201593.618850:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1788201593.618858:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1474d7100 x1875064727993984/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1788201593.618888:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d7100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727993984:192.168.201.143@tcp:35:cp.0 00000100:00100000:0.0:1788201593.619033:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201593.620746:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727993728:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201593.624220:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d7100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727993984:192.168.201.143@tcp:35:cp.0 00000002:00100000:0.0:1788201593.624437:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1725f7100 x1875064727993344/t8589937424(8589937424) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201593.624533:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201593.624568:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201593.624592:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 179 lru_type: 1 00010000:00010000:0.0:1788201593.624607:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 179 lru_type: 1 00000080:00200000:0.0:1788201593.624614:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201593.624619:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201593.624622:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201593.624630:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201593.624633:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 179 lru_type: 1 00010000:00010000:0.0:1788201593.624641:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 180 lru_type: 1 00000080:00200000:0.0:1788201593.624657:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201593.624665:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201593.624671:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201593.624675:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=replay-single.sh, flags=8 00000080:00200008:0.0:1788201593.624683:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file replay-single.sh:[0x200000bd7:0x187:0x0](ffff8bc1459f5b88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201593.624689:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x187:0x0](ffff8bc1459f5b88),name=replay-single.sh 00000002:00010000:0.0:1788201593.624702:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x187:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201593.624711:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097a60 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201593.624718:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097a60 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201593.624722:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201593.624725:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x187:0x0](ffff8bc1459f5b88) 00000080:00010000:0.0:1788201593.624727:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x187:0x0](ffff8bc1459f5b88) for lock 0xd138388016f6f4fb 00000080:00010000:0.0:1788201593.624730:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f4fb from it ffffadd1c7debcb8 00010000:00010000:0.0:1788201593.624732:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097a60 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201593.624738:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097a60 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201593.624784:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x187:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201593.625025:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x187:0x0] 00000008:00010000:0.0:1788201593.625074:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201593.625078:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456fb0, osc lock ffff8bc145d35430, flags 0x400001002 00010000:00010000:0.0:1788201593.625099:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.625111:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:0.0:1788201593.625132:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1788201593.625137:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.625162:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1788201593.625174:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1788201593.625185:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x187:0x0] updating i_size 158554 i_blocks 1 00000020:00010000:0.0:1788201593.625189:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9030 (ffff8bc1499c46c8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201593.625192:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9030 (ffff8bc1499c46c8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201593.625195:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456fb0 (ffff8bc1499c4518/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201593.625199:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9030 (ffff8bc1499c46c8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201593.625201:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456fb0 (ffff8bc1499c46c8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201593.625224:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x187:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201593.625436:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201593.625447:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201593.625455:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 180 lru_type: 1 00010000:00010000:0.0:1788201593.625464:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 180 lru_type: 1 00000080:00200000:0.0:1788201593.625472:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201593.625477:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201593.625480:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201593.625484:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201593.625488:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 180 lru_type: 1 00010000:00010000:0.0:1788201593.625496:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 181 lru_type: 1 00000080:00200000:0.0:1788201593.625505:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201593.625511:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201593.625515:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201593.625530:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=replay-vbr.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:0.0:1788201593.625535:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=replay-vbr.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201593.625546:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: replay-vbr.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201593.625607:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f510 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.625616:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f510 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.625629:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f510 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201593.625672:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d6d80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727994112:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201593.625771:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201593.632330:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d6d80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727994112:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201593.632363:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f510 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.632393:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f510 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.632401:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f510 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.632410:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f510 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.632420:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f510 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.632425:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc146085000 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201593.632430:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f510 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.632435:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f510 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.632441:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f510 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.632446:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201593.632452:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f510 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.632456:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f510 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201593.632475:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1474d6d80 x1875064727994112/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201593.632489:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201593.632517:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201593.632592:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201593.632613:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201593.632622:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 181 lru_type: 1 00010000:00010000:0.0:1788201593.632633:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 181 lru_type: 1 00000080:00200000:0.0:1788201593.632638:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201593.632651:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201593.632655:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201593.632659:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201593.632663:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 181 lru_type: 1 00010000:00010000:0.0:1788201593.632669:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 182 lru_type: 1 00000080:00200000:0.0:1788201593.632681:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201593.632688:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201593.632693:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201593.632706:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=replay-vbr.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:0.0:1788201593.632709:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=replay-vbr.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201593.632718:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: replay-vbr.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201593.632763:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f517 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.632771:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f517 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.632783:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f517 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201593.632852:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d6d80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727994240:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201593.633091:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201593.644666:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d6d80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727994240:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201593.644698:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f517 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.644718:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f517 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.644724:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f517 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.644731:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f517 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.644742:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f517 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.644749:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc146085e00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201593.644754:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f517 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.644761:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f517 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.644770:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f517 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.644780:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201593.644788:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f517 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.644824:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f517 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201593.644848:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1474d6d80 x1875064727994240/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201593.644868:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201593.644902:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201593.645049:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201593.645068:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201593.645089:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 182 lru_type: 1 00010000:00010000:0.0:1788201593.645104:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 182 lru_type: 1 00000080:00200000:0.0:1788201593.645111:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201593.645118:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201593.645122:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201593.645128:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:0.0:1788201593.645133:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 182 lru_type: 1 00010000:00010000:0.0:1788201593.645143:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 183 lru_type: 1 00000080:00200000:0.0:1788201593.645162:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201593.645171:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201593.645177:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201593.645194:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201593.645200:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=replay-vbr.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc152c97500, open_flags 80c1, mode 81ed opened 0 00000080:00200000:0.0:1788201593.645208:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=replay-vbr.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:0.0:1788201593.645232:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: replay-vbr.sh,[0x200000bd7:0x188:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:0.0:1788201593.645293:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.645300:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1788201593.645314:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1788201593.645321:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1474d6d80 x1875064727994496/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1788201593.645331:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201593.645357:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d6d80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727994496:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201593.645559:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201593.649395:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d6d80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727994496:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201593.649432:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097abb expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.649461:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x188:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097abb expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.649470:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097abb expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.649482:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097abb expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.649493:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097abb expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.649511:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097abb expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.649520:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097abb expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.649528:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097abb expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201593.649541:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1474d6d80 x1875064727994496/t8589937426(8589937426) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201593.649567:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1474d6d80 x1875064727994496/t8589937426(8589937426) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201593.649581:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097abb expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1788201593.649595:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097abb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.649607:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/392 (0 0) 00000080:00200000:0.0:1788201593.649615:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201593.649632:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=replay-vbr.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:0.0:1788201593.649685:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x188:0x0](ffff8bc144681148) 00000080:00200000:0.0:1788201593.649870:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x188:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1788201593.649882:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x188:0x0](ffff8bc144681148) 00000080:00010000:0.0:1788201593.649886:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x188:0x0](ffff8bc144681148) for lock 0xd138388016f6f51e 00000080:00010000:0.0:1788201593.649898:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x188:0x0](ffff8bc144681148) 00000080:00200008:0.0:1788201593.649917:0:24470:0:(file.c:1090:ll_file_open()) START file replay-vbr.sh:[0x200000bd7:0x188:0x0](ffff8bc144681148), flags 100301 00000002:00100000:0.0:1788201593.649939:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1474d6d80 x1875064727994496/t8589937426(8589937426) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1788201593.649989:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f51e from it ffff8bc1469370c0 00010000:00010000:0.0:1788201593.649994:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097abb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.650005:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097abb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201593.650035:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x188:0x0](ffff8bc144681148), inode mode 81ed mask 40 00000080:00200008:0.0:1788201593.650068:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file replay-vbr.sh:[0x200000bd7:0x188:0x0](ffff8bc144681148), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201593.650075:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x188:0x0](ffff8bc144681148),name=replay-vbr.sh 00000002:00010000:0.0:1788201593.650097:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x188:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201593.650109:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097abb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.650127:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097abb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201593.650135:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201593.650139:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x188:0x0](ffff8bc144681148) 00000080:00010000:0.0:1788201593.650143:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x188:0x0](ffff8bc144681148) for lock 0xd138388016f6f51e 00000080:00010000:0.0:1788201593.650147:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f51e from it ffffadd1c7debcd8 00010000:00010000:0.0:1788201593.650150:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097abb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.650158:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097abb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201593.650184:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x188:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201593.650195:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x188:0x0] 00000008:00010000:0.0:1788201593.650223:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201593.650228:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1724560b0, osc lock ffff8bc145d35430, flags 0x400001002 00010000:00010000:0.0:1788201593.650281:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f525 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.650291:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f525 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201593.650330:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1788201593.650347:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201593.650381:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727994624:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201593.672293:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f525 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.672330:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f525 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097ac9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.672350:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f525 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097ac9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.672382:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f525 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097ac9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201593.672404:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f525 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097ac9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201593.672417:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201593.672442:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f525 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097ac9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.672452:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f525 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097ac9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.672460:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f525 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097ac9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.672475:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f525 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171097ac9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201593.672502:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727994624:192.168.201.143@tcp:101:cp.0 00000080:00200000:2.0:1788201593.672675:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x188:0x0] updating i_size 0 i_blocks 1 00000020:00010000:2.0:1788201593.672682:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9030 (ffff8bc1499c46c8/0) at cl_lock_release():245 00000020:00010000:2.0:1788201593.672686:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9030 (ffff8bc1499c46c8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201593.672692:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1724560b0 (ffff8bc1499c4518/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201593.672697:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9030 (ffff8bc1499c46c8/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201593.672700:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1724560b0 (ffff8bc1499c46c8/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201593.672743:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x188:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1788201593.672885:0:24470:0:(file.c:2638:do_file_write_iter()) START file replay-vbr.sh:[0x200000bd7:0x188:0x0], ppos: 0, count: 37842 00000080:00200000:2.0:1788201593.672927:0:24470:0:(file.c:2090:ll_file_io_generic()) replay-vbr.sh: write ppos: 0, bytes: 37842 00000080:00200000:2.0:1788201593.672936:0:24470:0:(file.c:1848:ll_io_set_mirror()) replay-vbr.sh: desiginated mirror: 0 00000020:00200000:2.0:1788201593.672943:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000e5d25016[0x110, 1, [0x200000bd7:0x188:0x0] hash] 00000020:00200000:2.0:1788201593.672945:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 37842) 0 0 00000080:00200000:2.0:1788201593.672950:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x188:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201593.672964:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 9] 00020000:00200000:2.0:1788201593.672972:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 37842) 37842, 37842 00020000:00200000:2.0:1788201593.672976:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201593.673010:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 9] 00000008:00010000:2.0:1788201593.673027:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1788201593.673034:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261dc30, osc lock ffff8bc151fc0850, flags 0x0 00010000:00010000:2.0:1788201593.673052:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/438 (0 40959) 00010000:00010000:2.0:1788201593.673101:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.673111:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.673123:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201593.673150:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f7b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727994752:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201593.673296:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc153920e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201593.675948:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201593.676053:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743482496 00000100:00100000:0.0:1788201593.676065:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743482496 00000100:00100000:0.0:1788201593.676148:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 775 00000100:00100000:0.0:1788201593.676169:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14602a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23131:x1875064743482496:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201593.676192:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f525 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097ac9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.676289:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201593.676296:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14602a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23131:x1875064743482496:12345-192.168.201.143@tcp:104: Request processed in 131us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201593.676304:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 775 00010000:00010000:2.0:1788201593.676523:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201593.676538:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f525 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097ac9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201593.676557:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc146085400 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:2.0:1788201593.676565:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f525 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171097ac9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201593.676637:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x188:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201593.677095:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x188:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:2.0:1788201593.677241:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f525 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097ac9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201593.677252:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788201593.677315:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727994880:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201593.678189:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f525 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097ac9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201593.678211:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f525 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097ac9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201593.678233:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201593.678236:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201593.678238:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201593.684899:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201593.685331:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f7b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727994752:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201593.685388:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.685408:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.685418:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201593.685877:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743482624 00000100:00100000:0.0:1788201593.685890:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743482624 00000100:00100000:0.0:1788201593.685972:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 776 00000100:00100000:0.0:1788201593.685986:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc146029f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21004:x1875064743482624:12345-192.168.201.143@tcp:105: 00010000:00010000:0.0:1788201593.686012:0:20877:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.686023:0:20877:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.686038:0:20877:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.686050:0:20877:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.686061:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.686071:0:20877:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.686098:0:20877:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc172472800) 00000100:00100000:0.0:1788201593.686177:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc146029f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21004:x1875064743482624:12345-192.168.201.143@tcp:105: Request processed in 193us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201593.686186:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 776 00010000:00010000:2.0:1788201593.686942:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.686957:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.686977:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1788201593.686998:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.687029:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.687038:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1788201593.687074:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) replay-vbr.sh: write [0, 37842) append 0 append lockpos 0 00000080:00200000:2.0:1788201593.687096:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:2.0:1788201593.687159:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:2.0:1788201593.687172:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000095b71d36[3 00000000fa33430e 2 1 000000003b69914e 0 0 0] 00000080:00200000:2.0:1788201593.687177:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004ecb670f 17ffffc0001001 3:0 ffff8bc146c50460 0 lru 00000080:00200000:2.0:1788201593.687185:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000012d59d55 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 000000005b8d2936 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201593.687187:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000095b71d36 00000080:00200000:2.0:1788201593.687189:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1788201593.687193:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:2.0:1788201593.687220:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:2.0:1788201593.687225:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b2d43ded[3 00000000fa33430e 2 1 000000003b69914e 0 0 1] 00000080:00200000:2.0:1788201593.687228:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000006805f2d 17ffffc0001001 3:0 ffff8bc146c50d20 1 lru 00000080:00200000:2.0:1788201593.687235:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000002433f04d 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 000000005b8d2936 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201593.687237:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b2d43ded 00000080:00200000:2.0:1788201593.687239:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:2.0:1788201593.687241:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:2.0:1788201593.687258:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:2.0:1788201593.687263:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000dfb0704[3 00000000fa33430e 2 1 000000003b69914e 0 0 2] 00000080:00200000:2.0:1788201593.687266:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000baba1254 17ffffc0001001 3:0 ffff8bc146c50000 2 lru 00000080:00200000:2.0:1788201593.687272:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000172f8878 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000000ce25486 000000005b8d2936 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201593.687274:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000dfb0704 00000080:00200000:2.0:1788201593.687276:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:2.0:1788201593.687278:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:2.0:1788201593.687296:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:2.0:1788201593.687300:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000aea38469[3 00000000fa33430e 2 1 000000003b69914e 0 0 3] 00000080:00200000:2.0:1788201593.687304:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ca9cef49 17ffffc0001001 3:0 ffff8bc146c50380 3 lru 00000080:00200000:2.0:1788201593.687310:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000061176e94 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000000ce25486 000000005b8d2936 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201593.687313:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000aea38469 00000080:00200000:2.0:1788201593.687315:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:2.0:1788201593.687317:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:2.0:1788201593.687343:0:24470:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:2.0:1788201593.687348:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b01f9ba6[3 00000000fa33430e 2 1 000000003b69914e 0 0 4] 00000080:00200000:2.0:1788201593.687350:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009acd586e 17ffffc0001021 2:0 ffff8bc146c501c0 4 lru 00000080:00200000:2.0:1788201593.687355:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b271fb2b 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000000ce25486 000000005b8d2936 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201593.687357:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b01f9ba6 00000080:00200000:2.0:1788201593.687358:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:2.0:1788201593.687360:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:2.0:1788201593.687395:0:24470:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:2.0:1788201593.687400:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005c6cce63[3 00000000fa33430e 2 1 000000003b69914e 0 0 5] 00000080:00200000:2.0:1788201593.687403:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000397e3e7d 17ffffc0001001 3:0 ffff8bc146c500e0 5 lru 00000080:00200000:2.0:1788201593.687409:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003c3bdc5b 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000000ce25486 000000005b8d2936 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201593.687411:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005c6cce63 00000080:00200000:2.0:1788201593.687412:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:2.0:1788201593.687414:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:2.0:1788201593.687432:0:24470:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:2.0:1788201593.687437:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000086c2102b[3 00000000fa33430e 2 1 000000003b69914e 0 0 6] 00000080:00200000:2.0:1788201593.687440:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ea6d266a 17ffffc0001001 3:0 ffff8bc146c509a0 6 lru 00000080:00200000:2.0:1788201593.687445:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009200733c 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000000ce25486 000000005b8d2936 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201593.687448:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000086c2102b 00000080:00200000:2.0:1788201593.687449:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:2.0:1788201593.687451:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:2.0:1788201593.687467:0:24470:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:2.0:1788201593.687472:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d12960cb[3 00000000fa33430e 2 1 000000003b69914e 0 0 7] 00000080:00200000:2.0:1788201593.687474:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006b7e65a1 17ffffc0001001 3:0 ffff8bc146c50c40 7 lru 00000080:00200000:2.0:1788201593.687479:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f825f803 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000000ce25486 000000005b8d2936 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201593.687482:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d12960cb 00000080:00200000:2.0:1788201593.687483:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:2.0:1788201593.687484:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:2.0:1788201593.687503:0:24470:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:2.0:1788201593.687507:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000964670e[3 00000000fa33430e 2 1 000000003b69914e 0 0 8] 00000080:00200000:2.0:1788201593.687510:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000be6b74b8 17ffffc0001001 3:0 ffff8bc1506b3e00 8 lru 00000080:00200000:2.0:1788201593.687515:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005c7ac1cf 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000000ce25486 000000005b8d2936 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201593.687517:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000964670e 00000080:00200000:2.0:1788201593.687518:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:2.0:1788201593.687520:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 978 bytes 00000080:00200000:2.0:1788201593.687545:0:24470:0:(rw26.c:898:ll_write_end()) pos 36864, len 978, copied 978 00000080:00200000:2.0:1788201593.687856:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ad7c38e5[3 00000000fa33430e 2 1 000000003b69914e 0 0 9] 00000080:00200000:2.0:1788201593.687863:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006243580a 17ffffc0001001 3:0 ffff8bc1506b3ee0 9 lru 00000080:00200000:2.0:1788201593.687868:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a59ab763 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000000ce25486 000000005b8d2936 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201593.687871:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ad7c38e5 00000080:00200000:2.0:1788201593.687872:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:2.0:1788201593.687876:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 10, from 0, to 978 prio 0 00000008:00010000:2.0:1788201593.687906:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000163f5c32 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1788201593.687937:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1446812f8, count 10, dirtied 10 00000080:00200000:2.0:1788201593.687943:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 10 pages 37842 bytes, tot: 37842 00000080:00200000:2.0:1788201593.687946:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) replay-vbr.sh: write bytes 0, result: 37842 00000020:00010000:2.0:1788201593.687965:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc149844128 (ffff8bc146919b48/0) at cl_lock_release():245 00000020:00010000:2.0:1788201593.687968:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149844128 (ffff8bc146919b48/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201593.687971:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261dc30 (ffff8bc146919488/1) at cl_lock_cancel():142 00010000:00010000:2.0:1788201593.687978:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.687988:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1788201593.688133:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149844128 (ffff8bc146919b48/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201593.688137:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261dc30 (ffff8bc146919b48/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201593.688148:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 37842 bytes 00000080:00200000:2.0:1788201593.688156:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 9] 00000080:00200000:2.0:1788201593.688197:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x188:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201593.688201:0:24470:0:(file.c:2238:ll_file_io_generic()) replay-vbr.sh: 2 io complete with rc: 0, result: 37842, restart: 0 00000080:00200000:2.0:1788201593.688212:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x188:0x0] updating i_size 37842 i_blocks 1 00000080:00200000:2.0:1788201593.688217:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 37842 00000080:00200008:2.0:1788201593.688272:0:24470:0:(file.c:479:ll_file_release()) START file replay-vbr.sh:[0x200000bd7:0x188:0x0](ffff8bc144681148), flags 100001 00000002:00100000:2.0:1788201593.688339:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1474d6d80 x1875064727994496/t8589937426(8589937426) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201609 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1788201593.688353:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1788201593.688360:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725f7b80 x1875064727995136/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1788201593.688403:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f7b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727995136:192.168.201.143@tcp:35:cp.0 00000100:00100000:2.0:1788201593.688777:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc153920e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201593.696630:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f7b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727995136:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201593.696691:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1474d6d80 x1875064727994496/t8589937426(8589937426) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201593.696865:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201593.696894:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.696919:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 183 lru_type: 1 00010000:00010000:1.0:1788201593.696938:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 183 lru_type: 1 00000080:00200000:1.0:1788201593.696947:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.696953:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201593.696958:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201593.696966:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201593.696971:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 183 lru_type: 1 00010000:00010000:1.0:1788201593.696982:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 184 lru_type: 1 00000080:00200000:1.0:1788201593.697001:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.697010:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201593.697017:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.697021:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=replay-vbr.sh, flags=8 00000080:00200008:1.0:1788201593.697030:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file replay-vbr.sh:[0x200000bd7:0x188:0x0](ffff8bc144681148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201593.697036:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x188:0x0](ffff8bc144681148),name=replay-vbr.sh 00000002:00010000:1.0:1788201593.697050:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x188:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.697059:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097abb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201593.697070:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097abb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201593.697077:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.697082:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x188:0x0](ffff8bc144681148) 00000080:00010000:1.0:1788201593.697084:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x188:0x0](ffff8bc144681148) for lock 0xd138388016f6f51e 00000080:00010000:1.0:1788201593.697089:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f51e from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201593.697092:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097abb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201593.697101:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097abb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201593.697162:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x188:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201593.697174:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x188:0x0] 00000008:00010000:1.0:1788201593.697215:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201593.697220:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4b30, osc lock ffff8bc145d085f0, flags 0x400001002 00010000:00010000:1.0:1788201593.697240:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.697254:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201593.697270:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201593.697275:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.697288:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201593.697300:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201593.697312:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x188:0x0] updating i_size 37842 i_blocks 1 00000020:00010000:1.0:1788201593.697316:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e27530 (ffff8bc148e3b638/0) at cl_lock_release():245 00000020:00010000:1.0:1788201593.697320:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e27530 (ffff8bc148e3b638/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.697323:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4b30 (ffff8bc148e3b6c8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.697327:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e27530 (ffff8bc148e3b638/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201593.697330:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4b30 (ffff8bc148e3b638/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201593.697383:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x188:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201593.697455:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201593.697463:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.697470:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 184 lru_type: 1 00010000:00010000:1.0:1788201593.697479:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 184 lru_type: 1 00000080:00200000:1.0:1788201593.697485:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.697489:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201593.697491:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201593.697495:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201593.697498:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 184 lru_type: 1 00010000:00010000:1.0:1788201593.697509:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 185 lru_type: 1 00000080:00200000:1.0:1788201593.697518:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.697523:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201593.697526:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.697541:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=rpc.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201593.697546:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=rpc.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201593.697555:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: rpc.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201593.697615:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6f533 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.697624:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6f533 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.697635:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6f533 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.697662:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727995264:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201593.697781:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201593.699634:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727994880:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788201593.708390:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727995264:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201593.708422:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6f533 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.708445:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6f533 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.708453:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6f533 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.708460:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6f533 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.708471:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6f533 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.708479:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14a778000 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:2.0:1788201593.708484:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6f533 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.708493:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6f533 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.708501:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6f533 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.708509:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201593.708518:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6f533 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.708524:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778000/0xd138388016f6f533 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201593.708559:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14602b100 x1875064727995264/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201593.708581:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1788201593.708615:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201593.708711:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201593.708731:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201593.708741:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 185 lru_type: 1 00010000:00010000:2.0:1788201593.708754:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 185 lru_type: 1 00000080:00200000:2.0:1788201593.708762:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201593.708768:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201593.708772:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201593.708778:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201593.708782:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 185 lru_type: 1 00010000:00010000:2.0:1788201593.708830:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 186 lru_type: 1 00000080:00200000:2.0:1788201593.708849:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201593.708857:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201593.708864:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201593.708880:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=rpc.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:2.0:1788201593.708885:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=rpc.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201593.708898:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: rpc.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201593.708952:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f53a lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.708961:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f53a lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.708972:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f53a lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201593.709001:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f5500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727995392:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201593.709113:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc153920e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201593.728012:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f5500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727995392:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201593.728045:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f53a lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.728062:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f53a lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.728075:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f53a lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.728083:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f53a lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.728094:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f53a lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.728102:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172473600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201593.728108:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f53a lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.728115:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f53a lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.728124:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f53a lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.728132:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201593.728140:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f53a lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.728157:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f53a lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201593.728185:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1725f5500 x1875064727995392/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201593.728202:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201593.728237:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201593.728392:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201593.728410:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.728421:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 186 lru_type: 1 00010000:00010000:1.0:1788201593.728434:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 186 lru_type: 1 00000080:00200000:1.0:1788201593.728441:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.728447:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201593.728451:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201593.728457:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:1.0:1788201593.728462:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 186 lru_type: 1 00010000:00010000:1.0:1788201593.728470:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 187 lru_type: 1 00000080:00200000:1.0:1788201593.728487:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.728496:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201593.728502:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.728518:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201593.728524:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=rpc.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14304a600, open_flags 80c1, mode 81ed opened 0 00000080:00200000:1.0:1788201593.728532:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=rpc.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:1.0:1788201593.728565:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: rpc.sh,[0x200000bd7:0x189:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201593.728629:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.728641:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201593.728666:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201593.728673:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146028380 x1875064727995648/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201593.728683:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.728708:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146028380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727995648:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201593.729038:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d436c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201593.755462:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146028380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727995648:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201593.755503:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097b16 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.755532:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x189:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097b16 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.755552:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097b16 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.755566:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097b16 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.755580:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097b16 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.755604:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097b16 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.755614:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097b16 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.755621:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097b16 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201593.755636:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc146028380 x1875064727995648/t8589937428(8589937428) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201593.755664:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc146028380 x1875064727995648/t8589937428(8589937428) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201593.755681:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097b16 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201593.755696:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097b16 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.755708:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/393 (0 0) 00000080:00200000:1.0:1788201593.755717:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201593.755734:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=rpc.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:1.0:1788201593.755778:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x189:0x0](ffff8bc14592b248) 00000080:00200000:1.0:1788201593.756002:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x189:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201593.756013:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x189:0x0](ffff8bc14592b248) 00000080:00010000:1.0:1788201593.756017:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x189:0x0](ffff8bc14592b248) for lock 0xd138388016f6f541 00000080:00010000:1.0:1788201593.756031:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x189:0x0](ffff8bc14592b248) 00000080:00200008:1.0:1788201593.756054:0:24470:0:(file.c:1090:ll_file_open()) START file rpc.sh:[0x200000bd7:0x189:0x0](ffff8bc14592b248), flags 100301 00000002:00100000:1.0:1788201593.756077:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc146028380 x1875064727995648/t8589937428(8589937428) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201593.756133:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f541 from it ffff8bc1466cd420 00010000:00010000:1.0:1788201593.756138:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097b16 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.756150:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097b16 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201593.756180:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x189:0x0](ffff8bc14592b248), inode mode 81ed mask 40 00000080:00200008:1.0:1788201593.756216:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file rpc.sh:[0x200000bd7:0x189:0x0](ffff8bc14592b248), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201593.756223:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x189:0x0](ffff8bc14592b248),name=rpc.sh 00000002:00010000:1.0:1788201593.756245:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x189:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.756255:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097b16 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.756268:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097b16 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201593.756275:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.756280:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x189:0x0](ffff8bc14592b248) 00000080:00010000:1.0:1788201593.756283:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x189:0x0](ffff8bc14592b248) for lock 0xd138388016f6f541 00000080:00010000:1.0:1788201593.756287:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f541 from it ffffadd1c7debcd8 00010000:00010000:1.0:1788201593.756289:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097b16 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.756301:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097b16 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201593.756327:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x189:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201593.756336:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x189:0x0] 00000008:00010000:1.0:1788201593.756377:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201593.756382:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d47b0, osc lock ffff8bc145d085f0, flags 0x400001002 00010000:00010000:1.0:1788201593.756437:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f548 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.756449:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f548 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201593.756500:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1788201593.756616:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146029880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727995776:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201593.763469:0:10055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f548 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.763510:0:10055:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f548 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097b24 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.763528:0:10055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f548 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097b24 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.763557:0:10055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f548 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097b24 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201593.763578:0:10055:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f548 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097b24 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201593.763592:0:10055:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201593.763614:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f548 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097b24 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.763625:0:10055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f548 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097b24 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.763634:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f548 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097b24 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.763653:0:10055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f548 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171097b24 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201593.763681:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146029880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727995776:192.168.201.143@tcp:101:cp.0 00000080:00200000:1.0:1788201593.764987:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x189:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201593.765013:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e27530 (ffff8bc148e3b638/0) at cl_lock_release():245 00000020:00010000:1.0:1788201593.765019:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e27530 (ffff8bc148e3b638/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.765025:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d47b0 (ffff8bc148e3b6c8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.765032:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e27530 (ffff8bc148e3b638/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201593.765035:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d47b0 (ffff8bc148e3b638/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201593.765084:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x189:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201593.765176:0:24470:0:(file.c:2638:do_file_write_iter()) START file rpc.sh:[0x200000bd7:0x189:0x0], ppos: 0, count: 423 00000080:00200000:1.0:1788201593.765193:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 423 bytes 00000080:00200000:1.0:1788201593.765199:0:24470:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 423 00000080:00200000:1.0:1788201593.765230:0:24470:0:(file.c:2090:ll_file_io_generic()) rpc.sh: write ppos: 0, bytes: 423 00000080:00200000:1.0:1788201593.765237:0:24470:0:(file.c:1848:ll_io_set_mirror()) rpc.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201593.765244:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@000000004117a52c[0x110, 1, [0x200000bd7:0x189:0x0] hash] 00000020:00200000:1.0:1788201593.765248:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 423) 0 0 00000080:00200000:1.0:1788201593.765251:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x189:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201593.765331:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1788201593.765340:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 423) 423, 423 00020000:00200000:1.0:1788201593.765344:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201593.765389:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1788201593.765406:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201593.765412:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d47b0, osc lock ffff8bc145d085f0, flags 0x0 00010000:00010000:1.0:1788201593.765437:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/439 (0 4095) 00010000:00010000:1.0:1788201593.765504:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.765518:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.765533:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.765639:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146029180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727995904:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201593.765896:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201593.769164:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201593.769520:0:20876:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788201593.769553:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743482752 00000100:00100000:1.0:1788201593.769565:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743482752 00000100:00100000:1.0:1788201593.769699:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 777 00000100:00100000:1.0:1788201593.769711:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1726ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23415:x1875064743482752:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201593.769732:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f548 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097b24 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.769863:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201593.769871:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1726ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23415:x1875064743482752:12345-192.168.201.143@tcp:104: Request processed in 163us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201593.769879:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 777 00010000:00010000:3.0:1788201593.770710:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201593.770721:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f548 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097b24 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201593.770734:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14a778000 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201593.770742:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f548 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171097b24 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201593.770831:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x189:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201593.770846:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x189:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201593.770930:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f548 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097b24 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201593.770938:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201593.770985:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f548 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097b24 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201593.770994:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f548 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097b24 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201593.771012:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201593.771014:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201593.771016:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201593.771025:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201593.771046:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727996032:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788201593.774590:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146029180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727995904:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201593.774634:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.774661:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.774671:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201593.777505:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201593.778203:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743482880 00000100:00100000:0.0:1788201593.778218:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743482880 00000100:00100000:0.0:1788201593.778471:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 778 00000100:00100000:0.0:1788201593.778485:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21005:x1875064743482880:12345-192.168.201.143@tcp:105: 00010000:00010000:0.0:1788201593.778505:0:20877:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.778521:0:20877:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.778531:0:20877:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.778555:0:20877:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.778566:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.778579:0:20877:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.778614:0:20877:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc14a779c00) 00000100:00100000:0.0:1788201593.778831:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21005:x1875064743482880:12345-192.168.201.143@tcp:105: Request processed in 348us (1341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201593.778840:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 778 00010000:00010000:2.0:1788201593.779947:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.779967:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.779991:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1788201593.780024:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.780039:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.780049:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1788201593.780088:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) rpc.sh: write [0, 423) append 0 append lockpos 0 00000080:00200000:2.0:1788201593.780112:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 423 bytes 00000080:00200000:2.0:1788201593.780196:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 423, copied 423 00000080:00200000:2.0:1788201593.780210:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a59edefa[3 000000000b00d744 2 1 000000000235009b 0 0 0] 00000080:00200000:2.0:1788201593.780213:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008ca556f0 17ffffc0001001 3:0 ffff8bc1506b3620 0 lru 00000080:00200000:2.0:1788201593.780221:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b014317e 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 000000002dcecbba > 3< 0 0 > 4< 0 0 8 1703936 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201593.780223:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a59edefa 00000080:00200000:2.0:1788201593.780225:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1788201593.780231:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 423 prio 0 00000008:00010000:2.0:1788201593.780457:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 000000009a71e902 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1788201593.780483:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc14592b3f8, count 1, dirtied 1 00000080:00200000:2.0:1788201593.780489:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 423 bytes, tot: 423 00000080:00200000:2.0:1788201593.780493:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) rpc.sh: write bytes 0, result: 423 00000020:00010000:2.0:1788201593.780513:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c4998 (ffff8bc148e3b638/0) at cl_lock_release():245 00000020:00010000:2.0:1788201593.780518:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c4998 (ffff8bc148e3b638/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201593.780522:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d47b0 (ffff8bc148e3b6c8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1788201593.780527:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.780538:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1788201593.780557:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c4998 (ffff8bc148e3b638/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201593.780560:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d47b0 (ffff8bc148e3b638/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201593.780571:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 423 bytes 00000080:00200000:2.0:1788201593.780581:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1788201593.780619:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x189:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201593.780624:0:24470:0:(file.c:2238:ll_file_io_generic()) rpc.sh: 2 io complete with rc: 0, result: 423, restart: 0 00000080:00200000:2.0:1788201593.780633:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x189:0x0] updating i_size 423 i_blocks 1 00000080:00200000:2.0:1788201593.780639:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 423 00000080:00200008:2.0:1788201593.780772:0:24470:0:(file.c:479:ll_file_release()) START file rpc.sh:[0x200000bd7:0x189:0x0](ffff8bc14592b248), flags 100001 00000002:00100000:2.0:1788201593.780881:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc146028380 x1875064727995648/t8589937428(8589937428) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/664 e 0 to 0 dl 1788201609 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1788201593.780896:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1788201593.780903:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725f4e00 x1875064727996288/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1788201593.780934:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f4e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727996288:192.168.201.143@tcp:35:cp.0 00000100:00100000:2.0:1788201593.781614:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1539203c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201593.790061:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f4e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727996288:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201593.790117:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc146028380 x1875064727995648/t8589937428(8589937428) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/664 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201593.790215:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201593.790241:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.790427:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 187 lru_type: 1 00010000:00010000:1.0:1788201593.790446:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 187 lru_type: 1 00000080:00200000:1.0:1788201593.790456:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.790465:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201593.790468:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201593.790478:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201593.790483:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 187 lru_type: 1 00010000:00010000:1.0:1788201593.790493:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 188 lru_type: 1 00000080:00200000:1.0:1788201593.790512:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.790521:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201593.790527:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.790531:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=rpc.sh, flags=8 00000080:00200008:1.0:1788201593.790540:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file rpc.sh:[0x200000bd7:0x189:0x0](ffff8bc14592b248), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201593.790546:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x189:0x0](ffff8bc14592b248),name=rpc.sh 00000002:00010000:1.0:1788201593.790559:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x189:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.790569:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097b16 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201593.790578:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097b16 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201593.790584:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.790588:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x189:0x0](ffff8bc14592b248) 00000080:00010000:1.0:1788201593.790591:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x189:0x0](ffff8bc14592b248) for lock 0xd138388016f6f541 00000080:00010000:1.0:1788201593.790596:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f541 from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201593.790599:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097b16 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201593.790608:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097b16 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201593.790751:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x189:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201593.790763:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x189:0x0] 00000008:00010000:1.0:1788201593.790859:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201593.790864:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4a30, osc lock ffff8bc145d08f70, flags 0x400001002 00010000:00010000:1.0:1788201593.790885:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.790899:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201593.790914:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201593.790919:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.790928:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201593.790940:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201593.790951:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x189:0x0] updating i_size 423 i_blocks 1 00000020:00010000:1.0:1788201593.790956:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e262b0 (ffff8bc148e3b518/0) at cl_lock_release():245 00000020:00010000:1.0:1788201593.790960:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e262b0 (ffff8bc148e3b518/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.790963:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4a30 (ffff8bc148e3bab8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.790967:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e262b0 (ffff8bc148e3b518/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201593.790970:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4a30 (ffff8bc148e3b518/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201593.791013:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x189:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201593.791086:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201593.791109:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.791117:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 188 lru_type: 1 00010000:00010000:1.0:1788201593.791126:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 188 lru_type: 1 00000080:00200000:1.0:1788201593.791134:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.791139:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201593.791142:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201593.791147:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201593.791150:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 188 lru_type: 1 00010000:00010000:1.0:1788201593.791159:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 189 lru_type: 1 00000080:00200000:1.0:1788201593.791168:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.791173:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201593.791177:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.791191:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=run_dbench.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201593.791196:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run_dbench.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201593.791207:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run_dbench.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00000100:00100000:3.0:1788201593.793435:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727996032:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201593.793841:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f556 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.793856:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f556 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.793875:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f556 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.793929:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602a300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727996416:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201593.794054:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201593.799339:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602a300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727996416:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201593.799404:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f556 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.799422:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f556 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.799429:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f556 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.799436:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f556 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.799446:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f556 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.799454:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14a778400 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201593.799459:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f556 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.799467:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f556 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.799475:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f556 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.799483:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201593.799490:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f556 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.799497:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f556 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201593.799520:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14602a300 x1875064727996416/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201593.799538:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201593.799581:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201593.799908:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201593.799930:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.799942:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 189 lru_type: 1 00010000:00010000:1.0:1788201593.799955:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 189 lru_type: 1 00000080:00200000:1.0:1788201593.799961:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.799967:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201593.799971:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201593.799976:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201593.799980:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 189 lru_type: 1 00010000:00010000:1.0:1788201593.799989:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 190 lru_type: 1 00000080:00200000:1.0:1788201593.800009:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.800018:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201593.800023:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.800039:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=run_dbench.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:1.0:1788201593.800043:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run_dbench.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201593.800057:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run_dbench.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201593.800106:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f55d lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.800114:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f55d lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.800127:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f55d lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.800152:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602a300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727996544:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201593.800247:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201593.807066:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602a300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727996544:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201593.807111:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f55d lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.807128:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f55d lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.807136:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f55d lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.807145:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f55d lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.807164:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f55d lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.807173:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14a778a00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201593.807178:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f55d lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.807186:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f55d lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.807194:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f55d lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.807203:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201593.807211:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f55d lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.807217:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f55d lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201593.807238:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14602a300 x1875064727996544/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201593.807263:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201593.807294:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201593.807435:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201593.807454:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.807465:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 190 lru_type: 1 00010000:00010000:1.0:1788201593.807478:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 190 lru_type: 1 00000080:00200000:1.0:1788201593.807485:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.807490:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201593.807494:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201593.807502:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:1.0:1788201593.807506:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 190 lru_type: 1 00010000:00010000:1.0:1788201593.807514:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 191 lru_type: 1 00000080:00200000:1.0:1788201593.807531:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.807539:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201593.807557:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.807572:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201593.807577:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=run_dbench.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14304a600, open_flags 80c1, mode 81ed opened 0 00000080:00200000:1.0:1788201593.807586:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run_dbench.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:1.0:1788201593.807610:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run_dbench.sh,[0x200000bd7:0x18a:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201593.808152:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.808163:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201593.808179:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201593.808188:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14602a300 x1875064727996800/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201593.808198:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.808226:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602a300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727996800:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201593.808736:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201593.817730:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602a300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727996800:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201593.817770:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097b71 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.817835:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097b71 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.817846:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097b71 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.817859:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097b71 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.817872:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097b71 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.817889:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097b71 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.817897:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097b71 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.817906:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097b71 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201593.817919:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc14602a300 x1875064727996800/t8589937430(8589937430) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201593.817934:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14602a300 x1875064727996800/t8589937430(8589937430) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201593.817949:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097b71 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201593.817963:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097b71 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.817976:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/394 (0 0) 00000080:00200000:1.0:1788201593.817984:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201593.818014:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=run_dbench.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:1.0:1788201593.818055:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x18a:0x0](ffff8bc145928908) 00000080:00200000:1.0:1788201593.818220:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x18a:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201593.818230:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x18a:0x0](ffff8bc145928908) 00000080:00010000:1.0:1788201593.818233:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x18a:0x0](ffff8bc145928908) for lock 0xd138388016f6f564 00000080:00010000:1.0:1788201593.818245:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x18a:0x0](ffff8bc145928908) 00000080:00200008:1.0:1788201593.818645:0:24470:0:(file.c:1090:ll_file_open()) START file run_dbench.sh:[0x200000bd7:0x18a:0x0](ffff8bc145928908), flags 100301 00000002:00100000:1.0:1788201593.818673:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14602a300 x1875064727996800/t8589937430(8589937430) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201593.818725:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f564 from it ffff8bc1466cdba0 00010000:00010000:1.0:1788201593.818731:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097b71 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.818742:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097b71 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201593.818769:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x18a:0x0](ffff8bc145928908), inode mode 81ed mask 40 00000080:00200008:1.0:1788201593.818895:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file run_dbench.sh:[0x200000bd7:0x18a:0x0](ffff8bc145928908), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201593.818903:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x18a:0x0](ffff8bc145928908),name=run_dbench.sh 00000002:00010000:1.0:1788201593.818925:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x18a:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.818936:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097b71 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.818953:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097b71 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201593.818961:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.818966:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x18a:0x0](ffff8bc145928908) 00000080:00010000:1.0:1788201593.818969:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x18a:0x0](ffff8bc145928908) for lock 0xd138388016f6f564 00000080:00010000:1.0:1788201593.818973:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f564 from it ffffadd1c7debcd8 00010000:00010000:1.0:1788201593.818977:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097b71 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.818984:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097b71 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201593.819221:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201593.819232:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x18a:0x0] 00000008:00010000:1.0:1788201593.819449:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201593.819454:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d43b0, osc lock ffff8bc145d08f70, flags 0x400001002 00010000:00010000:1.0:1788201593.819512:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f56b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.819523:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f56b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201593.819597:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000020:00200000:1.0:1788201593.819732:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:2.0:1788201593.822376:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727996928:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201593.826163:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f56b lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.826208:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f56b lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097b7f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.826226:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f56b lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097b7f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.826242:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f56b lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097b7f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1788201593.826473:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f56b lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097b7f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1788201593.826489:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:2.0:1788201593.826509:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f56b lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097b7f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.826520:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f56b lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097b7f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.826528:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f56b lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097b7f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.826546:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f56b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171097b7f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1788201593.826578:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064727996928:192.168.201.143@tcp:101:cp.0 00000080:00200000:1.0:1788201593.826842:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x18a:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201593.826850:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e262b0 (ffff8bc148e3b518/0) at cl_lock_release():245 00000020:00010000:1.0:1788201593.826854:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e262b0 (ffff8bc148e3b518/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.826860:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d43b0 (ffff8bc148e3bab8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.826865:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e262b0 (ffff8bc148e3b518/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201593.826868:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d43b0 (ffff8bc148e3b518/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201593.826912:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18a:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201593.826984:0:24470:0:(file.c:2638:do_file_write_iter()) START file run_dbench.sh:[0x200000bd7:0x18a:0x0], ppos: 0, count: 1342 00000080:00200000:1.0:1788201593.827002:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 1342 bytes 00000080:00200000:1.0:1788201593.827007:0:24470:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 1342 00000080:00200000:1.0:1788201593.827033:0:24470:0:(file.c:2090:ll_file_io_generic()) run_dbench.sh: write ppos: 0, bytes: 1342 00000080:00200000:1.0:1788201593.827040:0:24470:0:(file.c:1848:ll_io_set_mirror()) run_dbench.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201593.827046:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000e2d5faea[0x110, 1, [0x200000bd7:0x18a:0x0] hash] 00000020:00200000:1.0:1788201593.827049:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 1342) 0 0 00000080:00200000:1.0:1788201593.827053:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201593.827066:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1788201593.827075:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 1342) 1342, 1342 00020000:00200000:1.0:1788201593.827079:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201593.827111:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1788201593.827125:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201593.827132:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d43b0, osc lock ffff8bc145d08f70, flags 0x0 00010000:00010000:1.0:1788201593.827160:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/439 (0 4095) 00010000:00010000:1.0:1788201593.827206:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.827216:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.827228:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.827252:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146028e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727997056:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201593.827501:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201593.833933:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201593.834199:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743483008 00000100:00100000:0.0:1788201593.834214:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743483008 00000100:00100000:0.0:1788201593.834294:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 779 00000100:00100000:0.0:1788201593.834305:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1726ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23408:x1875064743483008:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201593.834334:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f56b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097b7f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.834453:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201593.834460:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1726ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23408:x1875064743483008:12345-192.168.201.143@tcp:104: Request processed in 158us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201593.834468:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 779 00010000:00010000:3.0:1788201593.834663:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201593.834672:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f56b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097b7f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201593.834688:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14a778a00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201593.834695:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f56b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171097b7f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201593.834756:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201593.834771:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201593.834898:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f56b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097b7f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201593.834907:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201593.834935:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f56b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097b7f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201593.834942:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000006f06a732/0xd138388016f6f56b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097b7f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201593.834961:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201593.834963:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201593.834965:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201593.835147:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201593.835169:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727997184:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201593.842197:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201593.843318:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146028e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727997056:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201593.843357:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.843386:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.843396:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201593.843631:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743483136 00000100:00100000:3.0:1788201593.843653:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743483136 00000100:00100000:3.0:1788201593.843727:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 780 00000100:00100000:3.0:1788201593.843738:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1474d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743483136:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201593.843752:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.843763:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.843772:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.843783:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.843823:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.843835:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.843858:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc14a778000) 00000100:00100000:3.0:1788201593.843946:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1474d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743483136:12345-192.168.201.143@tcp:105: Request processed in 209us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201593.843954:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 780 00010000:00010000:1.0:1788201593.844648:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.844663:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.844682:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201593.844697:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.844709:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.844717:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201593.844754:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) run_dbench.sh: write [0, 1342) append 0 append lockpos 0 00000080:00200000:1.0:1788201593.844777:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 1342 bytes 00000080:00200000:1.0:1788201593.844884:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 1342, copied 1342 00000080:00200000:1.0:1788201593.844897:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d0e26910[3 00000000f502b47a 2 1 000000000c9b1601 0 0 0] 00000080:00200000:1.0:1788201593.844901:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000063af0ffe 17ffffc0001001 3:0 ffff8bc1468cd460 0 lru 00000080:00200000:1.0:1788201593.844910:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003292f56d 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000f549e6dd > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.844913:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d0e26910 00000080:00200000:1.0:1788201593.844915:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201593.844921:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 1342 prio 0 00000008:00010000:1.0:1788201593.844947:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000e6b9159f ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201593.844970:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145928ab8, count 1, dirtied 1 00000080:00200000:1.0:1788201593.844975:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 1342 bytes, tot: 1342 00000080:00200000:1.0:1788201593.844978:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) run_dbench.sh: write bytes 0, result: 1342 00000020:00010000:1.0:1788201593.844996:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c4a88 (ffff8bc148e3b518/0) at cl_lock_release():245 00000020:00010000:1.0:1788201593.845010:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c4a88 (ffff8bc148e3b518/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.845014:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d43b0 (ffff8bc148e3bab8/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201593.845020:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.845030:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201593.845047:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c4a88 (ffff8bc148e3b518/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201593.845050:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d43b0 (ffff8bc148e3b518/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201593.845060:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 1342 bytes 00000080:00200000:1.0:1788201593.845068:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1788201593.845103:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201593.845107:0:24470:0:(file.c:2238:ll_file_io_generic()) run_dbench.sh: 2 io complete with rc: 0, result: 1342, restart: 0 00000080:00200000:1.0:1788201593.845116:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x18a:0x0] updating i_size 1342 i_blocks 1 00000080:00200000:1.0:1788201593.845122:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 1342 00000080:00200008:1.0:1788201593.845181:0:24470:0:(file.c:479:ll_file_release()) START file run_dbench.sh:[0x200000bd7:0x18a:0x0](ffff8bc145928908), flags 100001 00000002:00100000:1.0:1788201593.845237:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc14602a300 x1875064727996800/t8589937430(8589937430) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201609 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201593.845250:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201593.845265:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146028e00 x1875064727997440/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201593.845289:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146028e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727997440:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201593.845380:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201593.849077:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727997184:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201593.852106:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146028e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727997440:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201593.852153:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc14602a300 x1875064727996800/t8589937430(8589937430) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201593.852242:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201593.852280:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.852304:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 191 lru_type: 1 00010000:00010000:1.0:1788201593.852322:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 191 lru_type: 1 00000080:00200000:1.0:1788201593.852332:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.852339:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201593.852343:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201593.852354:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201593.852359:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 191 lru_type: 1 00010000:00010000:1.0:1788201593.852381:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 192 lru_type: 1 00000080:00200000:1.0:1788201593.852400:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.852409:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201593.852416:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.852421:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=run_dbench.sh, flags=8 00000080:00200008:1.0:1788201593.852430:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file run_dbench.sh:[0x200000bd7:0x18a:0x0](ffff8bc145928908), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201593.852436:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x18a:0x0](ffff8bc145928908),name=run_dbench.sh 00000002:00010000:1.0:1788201593.852449:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x18a:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.852458:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097b71 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201593.852467:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097b71 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201593.852475:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.852479:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x18a:0x0](ffff8bc145928908) 00000080:00010000:1.0:1788201593.852481:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x18a:0x0](ffff8bc145928908) for lock 0xd138388016f6f564 00000080:00010000:1.0:1788201593.852485:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f564 from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201593.852488:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097b71 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201593.852497:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097b71 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201593.852567:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201593.852578:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x18a:0x0] 00000008:00010000:1.0:1788201593.852610:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201593.852614:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d43b0, osc lock ffff8bc145d08f70, flags 0x400001002 00010000:00010000:1.0:1788201593.852633:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.852939:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201593.852954:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201593.852958:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.852967:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201593.852979:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201593.852989:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x18a:0x0] updating i_size 1342 i_blocks 1 00000020:00010000:1.0:1788201593.852993:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e262b0 (ffff8bc148e3b518/0) at cl_lock_release():245 00000020:00010000:1.0:1788201593.852997:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e262b0 (ffff8bc148e3b518/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.853043:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d43b0 (ffff8bc148e3bab8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.853048:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e262b0 (ffff8bc148e3b518/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201593.853051:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d43b0 (ffff8bc148e3b518/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201593.853083:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18a:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201593.853147:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201593.853158:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.853167:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 192 lru_type: 1 00010000:00010000:1.0:1788201593.853176:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 192 lru_type: 1 00000080:00200000:1.0:1788201593.853183:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.853187:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201593.853189:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201593.853193:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201593.853196:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 192 lru_type: 1 00010000:00010000:1.0:1788201593.853202:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 193 lru_type: 1 00000080:00200000:1.0:1788201593.853210:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.853214:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201593.853218:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.853232:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=run_dd.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201593.853236:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run_dd.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201593.853247:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run_dd.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201593.853764:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f579 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.853777:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f579 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.853822:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f579 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.853856:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727997568:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201593.854028:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201593.859782:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727997568:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201593.859891:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f579 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.859908:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f579 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.859915:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f579 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.859923:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f579 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.859933:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f579 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.859941:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14a778a00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201593.859946:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f579 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.859953:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f579 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.859961:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f579 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.859971:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201593.859978:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f579 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.859985:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f579 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201593.860010:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14602ad80 x1875064727997568/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201593.860028:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201593.860058:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201593.861404:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201593.861436:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.861456:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 193 lru_type: 1 00010000:00010000:1.0:1788201593.861473:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 193 lru_type: 1 00000080:00200000:1.0:1788201593.861481:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.861489:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201593.861493:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201593.861501:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201593.861505:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 193 lru_type: 1 00010000:00010000:1.0:1788201593.861514:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 194 lru_type: 1 00000080:00200000:1.0:1788201593.861534:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.861964:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201593.861974:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.861997:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=run_dd.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:1.0:1788201593.862002:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run_dd.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201593.862019:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run_dd.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201593.862412:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f580 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.862424:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f580 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.862439:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f580 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.862475:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727997696:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201593.863055:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201593.867241:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727997696:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201593.867281:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f580 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.867301:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f580 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.867309:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f580 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.867318:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f580 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.867330:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f580 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.867337:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bc400 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201593.867342:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f580 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.867350:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f580 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.867359:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f580 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.867376:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201593.867384:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f580 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.867391:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc400/0xd138388016f6f580 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201593.867415:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14602ad80 x1875064727997696/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201593.867433:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201593.867469:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201593.867624:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201593.867653:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.867665:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 194 lru_type: 1 00010000:00010000:1.0:1788201593.867683:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 194 lru_type: 1 00000080:00200000:1.0:1788201593.867689:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.867695:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201593.867698:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201593.867704:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:1.0:1788201593.867709:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 194 lru_type: 1 00010000:00010000:1.0:1788201593.867717:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 195 lru_type: 1 00000080:00200000:1.0:1788201593.867735:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.867743:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201593.867749:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.867765:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201593.867771:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=run_dd.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14304a600, open_flags 80c1, mode 81ed opened 0 00000080:00200000:1.0:1788201593.867780:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run_dd.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:1.0:1788201593.867847:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run_dd.sh,[0x200000bd7:0x18b:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201593.867934:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.867942:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201593.867955:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201593.867963:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14602ad80 x1875064727997952/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201593.867973:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.867999:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727997952:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201593.868153:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201593.875840:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727997952:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201593.875889:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097bcc expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.875916:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097bcc expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.875926:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097bcc expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.875940:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097bcc expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.875953:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097bcc expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.875971:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097bcc expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.875980:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097bcc expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.875990:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097bcc expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201593.876005:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc14602ad80 x1875064727997952/t8589937432(8589937432) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201593.876021:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14602ad80 x1875064727997952/t8589937432(8589937432) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201593.876037:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097bcc expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201593.876052:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097bcc expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.876064:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/395 (0 0) 00000080:00200000:1.0:1788201593.876073:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201593.876103:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=run_dd.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:1.0:1788201593.876143:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x18b:0x0](ffff8bc14592ec08) 00000080:00200000:1.0:1788201593.876292:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x18b:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201593.876302:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x18b:0x0](ffff8bc14592ec08) 00000080:00010000:1.0:1788201593.876306:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x18b:0x0](ffff8bc14592ec08) for lock 0xd138388016f6f587 00000080:00010000:1.0:1788201593.876318:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x18b:0x0](ffff8bc14592ec08) 00000080:00200008:1.0:1788201593.876337:0:24470:0:(file.c:1090:ll_file_open()) START file run_dd.sh:[0x200000bd7:0x18b:0x0](ffff8bc14592ec08), flags 100301 00000002:00100000:1.0:1788201593.876361:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14602ad80 x1875064727997952/t8589937432(8589937432) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201593.876427:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f587 from it ffff8bc1466cdcc0 00010000:00010000:1.0:1788201593.876433:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097bcc expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.876443:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097bcc expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201593.876472:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x18b:0x0](ffff8bc14592ec08), inode mode 81ed mask 40 00000080:00200008:1.0:1788201593.876504:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file run_dd.sh:[0x200000bd7:0x18b:0x0](ffff8bc14592ec08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201593.876512:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x18b:0x0](ffff8bc14592ec08),name=run_dd.sh 00000002:00010000:1.0:1788201593.876533:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x18b:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.876557:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097bcc expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.876572:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097bcc expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201593.876581:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.876587:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x18b:0x0](ffff8bc14592ec08) 00000080:00010000:1.0:1788201593.876590:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x18b:0x0](ffff8bc14592ec08) for lock 0xd138388016f6f587 00000080:00010000:1.0:1788201593.876595:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f587 from it ffffadd1c7debcd8 00010000:00010000:1.0:1788201593.876598:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097bcc expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.876606:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097bcc expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201593.876633:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18b:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201593.876912:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x18b:0x0] 00000008:00010000:1.0:1788201593.876947:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201593.876952:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4bb0, osc lock ffff8bc145d08f70, flags 0x400001002 00010000:00010000:1.0:1788201593.877009:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f58e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.877021:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f58e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201593.877111:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:00200000:1.0:1788201593.877160:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1788201593.882079:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727998080:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201593.889956:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f58e lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.889994:0:10054:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f58e lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097bda expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.890013:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f58e lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097bda expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.890026:0:10054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f58e lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097bda expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1788201593.890046:0:10054:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f58e lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097bda expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1788201593.890060:0:10054:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:2.0:1788201593.890118:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f58e lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097bda expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.890128:0:10054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f58e lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097bda expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.890142:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f58e lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097bda expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.890163:0:10054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f58e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171097bda expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1788201593.890192:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727998080:192.168.201.143@tcp:101:cp.0 00000080:00200000:1.0:1788201593.890397:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x18b:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201593.890404:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e262b0 (ffff8bc148e3b518/0) at cl_lock_release():245 00000020:00010000:1.0:1788201593.890408:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e262b0 (ffff8bc148e3b518/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.890414:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4bb0 (ffff8bc148e3bab8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.890420:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e262b0 (ffff8bc148e3b518/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201593.890423:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4bb0 (ffff8bc148e3b518/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201593.890467:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18b:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201593.890613:0:24470:0:(file.c:2638:do_file_write_iter()) START file run_dd.sh:[0x200000bd7:0x18b:0x0], ppos: 0, count: 1659 00000080:00200000:1.0:1788201593.890633:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 1659 bytes 00000080:00200000:1.0:1788201593.890639:0:24470:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 1659 00000080:00200000:1.0:1788201593.890740:0:24470:0:(file.c:2090:ll_file_io_generic()) run_dd.sh: write ppos: 0, bytes: 1659 00000080:00200000:1.0:1788201593.890747:0:24470:0:(file.c:1848:ll_io_set_mirror()) run_dd.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201593.890753:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@000000007bf0fa70[0x110, 1, [0x200000bd7:0x18b:0x0] hash] 00000020:00200000:1.0:1788201593.890756:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 1659) 0 0 00000080:00200000:1.0:1788201593.890761:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18b:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201593.890775:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1788201593.890784:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 1659) 1659, 1659 00020000:00200000:1.0:1788201593.890788:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201593.890911:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1788201593.890927:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201593.890933:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4bb0, osc lock ffff8bc145d08f70, flags 0x0 00010000:00010000:1.0:1788201593.890952:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/440 (0 4095) 00010000:00010000:1.0:1788201593.890999:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.891010:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.891022:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.891047:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146029500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727998208:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201593.891276:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201593.894612:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201593.894785:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743483264 00000100:00100000:1.0:1788201593.894867:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743483264 00000100:00100000:1.0:1788201593.894985:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 781 00000100:00100000:1.0:1788201593.894998:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1474d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23411:x1875064743483264:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201593.895022:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f58e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097bda expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.896054:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201593.896070:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1474d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23411:x1875064743483264:12345-192.168.201.143@tcp:104: Request processed in 1072us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201593.896081:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 781 00010000:00010000:2.0:1788201593.897374:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201593.897388:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f58e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097bda expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201593.897405:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17261e200 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:2.0:1788201593.897415:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f58e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171097bda expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201593.897490:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201593.897507:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00000100:00100000:3.0:1788201593.897927:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146029500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727998208:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201593.897960:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.897972:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.897981:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.899387:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f58e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097bda expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201593.899406:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201593.899442:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f58e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097bda expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201593.899459:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f58e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097bda expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201593.899478:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201593.899481:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201593.899484:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201593.899498:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201593.899523:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727998336:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201593.906902:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201593.907013:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743483392 00000100:00100000:1.0:1788201593.907028:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743483392 00000100:00100000:1.0:1788201593.907100:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 782 00000100:00100000:1.0:1788201593.907112:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1474d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21004:x1875064743483392:12345-192.168.201.143@tcp:105: 00010000:00010000:1.0:1788201593.907134:0:20877:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.907159:0:20877:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.907170:0:20877:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.907184:0:20877:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.907196:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.907207:0:20877:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.907401:0:20877:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc17261ea00) 00000100:00100000:1.0:1788201593.907494:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1474d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21004:x1875064743483392:12345-192.168.201.143@tcp:105: Request processed in 383us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201593.907502:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 782 00000100:00100000:2.0:1788201593.910519:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727998336:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201593.910905:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.910923:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.910944:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201593.910958:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.910978:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.910986:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201593.911015:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) run_dd.sh: write [0, 1659) append 0 append lockpos 0 00000080:00200000:0.0:1788201593.911037:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 1659 bytes 00000080:00200000:0.0:1788201593.911105:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 1659, copied 1659 00000080:00200000:0.0:1788201593.911118:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000361a313d[3 000000007e2f9553 2 1 000000000c9b1601 0 0 0] 00000080:00200000:0.0:1788201593.911122:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007bd49aea 17ffffc0001001 3:0 ffff8bc1726e50e0 0 lru 00000080:00200000:0.0:1788201593.911131:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000030d106d5 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 00000000959e246c > 3< 0 0 > 4< 0 0 8 0 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201593.911133:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000361a313d 00000080:00200000:0.0:1788201593.911134:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1788201593.911140:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 1659 prio 0 00000008:00010000:0.0:1788201593.911352:0:13591:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000efb6ca0b ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6f063 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096e5f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201593.911382:0:13591:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000efb6ca0b ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6f063 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096e5f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201593.911446:0:13591:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6f063 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096e5f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201593.911638:0:13591:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1474d7480 - object 0x280000400:421 offset 0<>9198 00000100:00100000:2.0:1788201593.911771:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727998464:192.168.201.143@tcp:4:cp.0 00000008:00010000:0.0:1788201593.912248:0:13591:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000000ce1d5f3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096f15 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201593.912332:0:13591:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000000ce1d5f3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096f15 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201593.912382:0:13591:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096f15 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201593.912433:0:13591:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1474d5180 - object 0x280000400:422 offset 0<>4207 00000100:00100000:1.0:1788201593.912488:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727998592:192.168.201.143@tcp:4:cp.0 00000008:00010000:0.0:1788201593.912844:0:13591:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000781b57b3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000009a4e707/0xd138388016f6f0ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096fcb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201593.912857:0:13591:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000781b57b3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000009a4e707/0xd138388016f6f0ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096fcb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201593.912886:0:13591:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000009a4e707/0xd138388016f6f0ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096fcb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201593.912922:0:13591:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1474d6a00 - object 0x280000400:423 offset 0<>704 00000100:00100000:3.0:1788201593.913467:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727998720:192.168.201.143@tcp:4:cp.0 00000008:00010000:0.0:1788201593.918069:0:13591:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000d04bdfba ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003f09d801/0xd138388016f6f135 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097081 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201593.918104:0:13591:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000d04bdfba ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003f09d801/0xd138388016f6f135 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097081 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201593.918195:0:13591:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003f09d801/0xd138388016f6f135 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097081 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201593.918336:0:13591:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1474d5500 - object 0x280000400:424 offset 0<>4915 00000100:00100000:3.0:1788201593.918416:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000008:00010000:0.0:1788201593.918649:0:13591:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000c7de8db8 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009b0557ef/0xd138388016f6f17b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097137 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201593.918660:0:13591:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000c7de8db8 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009b0557ef/0xd138388016f6f17b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097137 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201593.918691:0:13591:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009b0557ef/0xd138388016f6f17b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097137 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201593.918769:0:13591:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1474d6300 - object 0x280000400:425 offset 0<>16105 00000100:00100000:3.0:1788201593.918954:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727998976:192.168.201.143@tcp:4:cp.0 00000100:00100000:3.0:1788201593.919125:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727998848:192.168.201.143@tcp:4:cp.0 00000008:00010000:0.0:1788201593.920614:0:13591:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 0000000099228d5c ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002dba747d/0xd138388016f6f1c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710971ed expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201593.920637:0:13591:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 0000000099228d5c ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002dba747d/0xd138388016f6f1c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710971ed expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201593.920708:0:13591:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002dba747d/0xd138388016f6f1c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710971ed expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201593.920819:0:13591:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1474d6680 - object 0x280000400:426 offset 0<>2858 00000008:00010000:0.0:1788201593.920865:0:13591:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000003886946a ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710972a3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201593.920874:0:13591:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000003886946a ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710972a3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000100:00100000:0.0:1788201593.920901:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201593.920922:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727999104:192.168.201.143@tcp:4:cp.0 00010000:00010000:0.0:1788201593.921713:0:13591:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710972a3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201593.921783:0:13591:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1474d4700 - object 0x280000400:427 offset 0<>4218 00000008:00010000:0.0:1788201593.921825:0:13591:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000e5953ede ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201593.921837:0:13591:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000e5953ede ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000100:00100000:0.0:1788201593.921858:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727999232:192.168.201.143@tcp:4:cp.0 00010000:00010000:0.0:1788201593.921937:0:13591:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201593.921971:0:13591:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1474d4e00 - object 0x280000400:428 offset 0<>2192 00000008:00010000:0.0:1788201593.921997:0:13591:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000b2e36bf7 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6f293 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109740f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201593.922008:0:13591:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000b2e36bf7 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6f293 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109740f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201593.922049:0:13591:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6f293 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109740f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201593.922116:0:13591:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1474d4380 - object 0x280000400:429 offset 0<>55540 00000100:00100000:3.0:1788201593.922444:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727999488:192.168.201.143@tcp:4:cp.0 00000100:00100000:3.0:1788201593.922524:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201593.922531:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727999360:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201593.924344:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000000ce1d5f3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096f15 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201593.924419:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000000ce1d5f3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096f15 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201593.924460:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064727998592:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201593.925141:0:10053:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000efb6ca0b ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6f063 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096e5f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201593.925232:0:10053:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000efb6ca0b ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6f063 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096e5f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201593.925328:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727998464:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201593.928082:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 000000000d6673c0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1788201593.928138:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc14592edb8, count 1, dirtied 1 00000080:00200000:2.0:1788201593.928156:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 1659 bytes, tot: 1659 00000080:00200000:2.0:1788201593.928163:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) run_dd.sh: write bytes 0, result: 1659 00000020:00010000:2.0:1788201593.928190:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c4a88 (ffff8bc148e3b518/0) at cl_lock_release():245 00000020:00010000:2.0:1788201593.928194:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c4a88 (ffff8bc148e3b518/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201593.928198:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4bb0 (ffff8bc148e3bab8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1788201593.928208:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.928223:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1788201593.928396:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c4a88 (ffff8bc148e3b518/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201593.928401:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4bb0 (ffff8bc148e3b518/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201593.928418:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 1659 bytes 00000080:00200000:2.0:1788201593.928428:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1788201593.928469:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18b:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201593.928474:0:24470:0:(file.c:2238:ll_file_io_generic()) run_dd.sh: 2 io complete with rc: 0, result: 1659, restart: 0 00000080:00200000:2.0:1788201593.928490:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x18b:0x0] updating i_size 1659 i_blocks 1 00000080:00200000:2.0:1788201593.928499:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 1659 00000080:00200008:2.0:1788201593.928586:0:24470:0:(file.c:479:ll_file_release()) START file run_dd.sh:[0x200000bd7:0x18b:0x0](ffff8bc14592ec08), flags 100001 00000002:00100000:2.0:1788201593.928685:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc14602ad80 x1875064727997952/t8589937432(8589937432) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201609 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1788201593.928701:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1788201593.928708:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725f5500 x1875064727999744/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1788201593.928741:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f5500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727999744:192.168.201.143@tcp:35:cp.0 00000100:00100000:2.0:1788201593.928895:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc153920e40 going to sleep for 11 seconds 00000008:00010000:0.0:1788201593.943834:0:10055:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000781b57b3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000009a4e707/0xd138388016f6f0ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096fcb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201593.943886:0:10055:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000781b57b3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000009a4e707/0xd138388016f6f0ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096fcb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:0.0:1788201593.943921:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727998720:192.168.201.143@tcp:4:cp.0 00000100:00100000:2.0:1788201593.944908:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f5500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727999744:192.168.201.143@tcp:35:cp.0 00000002:00100000:2.0:1788201593.944942:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc14602ad80 x1875064727997952/t8589937432(8589937432) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201593.945029:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201593.945051:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201593.945074:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 195 lru_type: 1 00010000:00010000:2.0:1788201593.945097:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 195 lru_type: 1 00000080:00200000:2.0:1788201593.945106:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201593.945113:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201593.945118:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201593.945127:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201593.945132:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 195 lru_type: 1 00010000:00010000:2.0:1788201593.945142:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 196 lru_type: 1 00000080:00200000:2.0:1788201593.945175:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201593.945183:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201593.945190:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201593.945194:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=run_dd.sh, flags=8 00000080:00200008:2.0:1788201593.945202:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file run_dd.sh:[0x200000bd7:0x18b:0x0](ffff8bc14592ec08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1788201593.945208:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x18b:0x0](ffff8bc14592ec08),name=run_dd.sh 00000002:00010000:2.0:1788201593.945220:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x18b:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201593.945229:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097bcc expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201593.945239:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097bcc expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1788201593.945246:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201593.945261:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x18b:0x0](ffff8bc14592ec08) 00000080:00010000:2.0:1788201593.945264:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x18b:0x0](ffff8bc14592ec08) for lock 0xd138388016f6f587 00000080:00010000:2.0:1788201593.945269:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f587 from it ffffadd1c7debcb8 00010000:00010000:2.0:1788201593.945273:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097bcc expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201593.945281:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097bcc expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201593.945324:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18b:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201593.945334:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x18b:0x0] 00000008:00010000:2.0:1788201593.945378:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201593.945383:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261dc30, osc lock ffff8bc151fc0850, flags 0x400001002 00010000:00010000:2.0:1788201593.945402:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201593.945414:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:2.0:1788201593.945428:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1788201593.945433:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201593.945453:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1788201593.945464:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1788201593.945474:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x18b:0x0] updating i_size 1659 i_blocks 1 00000020:00010000:2.0:1788201593.945480:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc146005bc0 (ffff8bc146919b48/0) at cl_lock_release():245 00000020:00010000:2.0:1788201593.945483:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146005bc0 (ffff8bc146919b48/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201593.945487:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261dc30 (ffff8bc146919488/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201593.945491:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146005bc0 (ffff8bc146919b48/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201593.945494:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261dc30 (ffff8bc146919b48/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201593.945523:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18b:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201593.946058:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201593.946072:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201593.946083:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 196 lru_type: 1 00010000:00010000:2.0:1788201593.946093:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 196 lru_type: 1 00000080:00200000:2.0:1788201593.946100:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201593.946106:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201593.946109:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201593.946114:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201593.946117:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 196 lru_type: 1 00010000:00010000:2.0:1788201593.946125:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 197 lru_type: 1 00000080:00200000:2.0:1788201593.946135:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201593.946140:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201593.946202:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201593.946221:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=run_IOR.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:2.0:1788201593.946227:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run_IOR.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201593.946238:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run_IOR.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201593.948919:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f59c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.948942:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f59c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.948957:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f59c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201593.948999:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f5f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727999872:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201593.949138:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc153920e40 going to sleep for 11 seconds 00000008:00010000:0.0:1788201593.949378:0:10055:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000003886946a ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710972a3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201593.949420:0:10055:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000003886946a ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710972a3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:0.0:1788201593.949466:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727999232:192.168.201.143@tcp:4:cp.0 00000008:00010000:0.0:1788201593.949496:0:10055:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 0000000099228d5c ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002dba747d/0xd138388016f6f1c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710971ed expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201593.949509:0:10055:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 0000000099228d5c ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002dba747d/0xd138388016f6f1c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710971ed expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:0.0:1788201593.949523:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064727999104:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201593.957582:0:10053:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000c7de8db8 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009b0557ef/0xd138388016f6f17b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097137 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201593.957711:0:10053:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000c7de8db8 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009b0557ef/0xd138388016f6f17b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097137 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201593.957753:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727998976:192.168.201.143@tcp:4:cp.0 00000100:00100000:3.0:1788201593.958771:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f5f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064727999872:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201593.958829:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f59c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.958843:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f59c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.958851:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f59c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.958859:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f59c lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.958869:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f59c lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.958876:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172472e00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201593.958880:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f59c lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.958887:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f59c lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.958896:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f59c lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.958904:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201593.958913:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f59c lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.958920:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f59c lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201593.958944:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1725f5f80 x1875064727999872/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201593.958965:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201593.958998:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:3.0:1788201593.959080:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201593.959114:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201593.959126:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 197 lru_type: 1 00010000:00010000:3.0:1788201593.959139:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 197 lru_type: 1 00000080:00200000:3.0:1788201593.959155:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201593.959161:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201593.959165:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201593.959171:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201593.959175:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 197 lru_type: 1 00010000:00010000:3.0:1788201593.959188:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 198 lru_type: 1 00000080:00200000:3.0:1788201593.959204:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201593.959213:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201593.959220:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201593.959234:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=run_IOR.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:3.0:1788201593.959239:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run_IOR.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:3.0:1788201593.959263:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run_IOR.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201593.959312:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f5a3 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.959321:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f5a3 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.959332:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f5a3 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201593.959358:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728000000:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201593.959476:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201593.963487:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728000000:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201593.963517:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f5a3 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.963532:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f5a3 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201593.963555:0:10053:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000d04bdfba ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003f09d801/0xd138388016f6f135 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097081 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201593.963607:0:10053:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000d04bdfba ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003f09d801/0xd138388016f6f135 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097081 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201593.963612:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f5a3 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.963619:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f5a3 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.963630:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f5a3 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201593.963636:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727998848:192.168.201.143@tcp:4:cp.0 00000008:00010000:0.0:1788201593.963671:0:10053:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000e5953ede ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201593.963686:0:10053:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000e5953ede ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:0.0:1788201593.963699:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727999360:192.168.201.143@tcp:4:cp.0 00010000:00010000:3.0:1788201593.963704:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1725a1600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201593.963711:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f5a3 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.963719:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f5a3 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201593.963727:0:10053:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000b2e36bf7 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6f293 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109740f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201593.963727:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f5a3 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.963737:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201593.963744:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f5a3 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201593.963751:0:10053:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000b2e36bf7 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6f293 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109740f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201593.963753:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f5a3 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201593.963763:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064727999488:192.168.201.143@tcp:4:cp.0 00000002:00100000:3.0:1788201593.963778:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1726cd500 x1875064728000000/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201593.963819:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201593.963847:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:3.0:1788201593.963975:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201593.963993:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201593.964005:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 198 lru_type: 1 00010000:00010000:3.0:1788201593.964019:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 198 lru_type: 1 00000080:00200000:3.0:1788201593.964026:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201593.964032:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201593.964036:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201593.964042:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:3.0:1788201593.964047:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 198 lru_type: 1 00010000:00010000:3.0:1788201593.964056:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 199 lru_type: 1 00000080:00200000:3.0:1788201593.964075:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201593.964085:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201593.964404:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201593.964419:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201593.964423:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=run_IOR.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc146420900, open_flags 80c1, mode 81ed opened 0 00000080:00200000:0.0:1788201593.964429:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run_IOR.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:0.0:1788201593.964450:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run_IOR.sh,[0x200000bd7:0x18c:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:0.0:1788201593.964505:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.964511:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1788201593.964521:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1788201593.964526:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1474d4000 x1875064728000256/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1788201593.964533:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201593.964555:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d4000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728000256:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201593.964716:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201593.967469:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d4000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728000256:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201593.967504:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097c27 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.967531:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097c27 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.967541:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097c27 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.967553:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097c27 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.967565:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097c27 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.967583:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097c27 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.967591:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097c27 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.967600:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097c27 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201593.967613:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1474d4000 x1875064728000256/t8589937434(8589937434) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201593.967628:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1474d4000 x1875064728000256/t8589937434(8589937434) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201593.967646:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097c27 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1788201593.967660:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097c27 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.967675:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/396 (0 0) 00000080:00200000:0.0:1788201593.967682:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201593.967698:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=run_IOR.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:0.0:1788201593.967739:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x18c:0x0](ffff8bc1446821c8) 00000080:00200000:0.0:1788201593.968052:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x18c:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1788201593.968065:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x18c:0x0](ffff8bc1446821c8) 00000080:00010000:0.0:1788201593.968069:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x18c:0x0](ffff8bc1446821c8) for lock 0xd138388016f6f5aa 00000080:00010000:0.0:1788201593.968083:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x18c:0x0](ffff8bc1446821c8) 00000080:00200008:0.0:1788201593.968103:0:24470:0:(file.c:1090:ll_file_open()) START file run_IOR.sh:[0x200000bd7:0x18c:0x0](ffff8bc1446821c8), flags 100301 00000002:00100000:0.0:1788201593.968125:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1474d4000 x1875064728000256/t8589937434(8589937434) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201609 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1788201593.968189:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f5aa from it ffff8bc146937360 00010000:00010000:0.0:1788201593.968195:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097c27 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.968206:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097c27 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201593.968234:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x18c:0x0](ffff8bc1446821c8), inode mode 81ed mask 40 00000080:00200008:0.0:1788201593.968270:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file run_IOR.sh:[0x200000bd7:0x18c:0x0](ffff8bc1446821c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201593.968277:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x18c:0x0](ffff8bc1446821c8),name=run_IOR.sh 00000002:00010000:0.0:1788201593.968298:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x18c:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201593.968310:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097c27 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.968322:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097c27 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201593.968330:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201593.968335:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x18c:0x0](ffff8bc1446821c8) 00000080:00010000:0.0:1788201593.968339:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x18c:0x0](ffff8bc1446821c8) for lock 0xd138388016f6f5aa 00000080:00010000:0.0:1788201593.968344:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f5aa from it ffffadd1c7debcd8 00010000:00010000:0.0:1788201593.968347:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097c27 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201593.968355:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097c27 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201593.968918:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18c:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201593.968929:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x18c:0x0] 00000008:00010000:1.0:1788201593.968962:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201593.968967:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d44b0, osc lock ffff8bc145d09c80, flags 0x400001002 00010000:00010000:1.0:1788201593.969023:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5b1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.969034:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5b1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201593.969084:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1788201593.969242:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201593.969264:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146028a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728000384:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201593.972150:0:10055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5b1 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.972186:0:10055:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5b1 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097c35 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.972206:0:10055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5b1 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097c35 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.972221:0:10055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5b1 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097c35 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201593.972238:0:10055:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5b1 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097c35 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201593.972247:0:10055:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201593.972259:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5b1 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097c35 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.972275:0:10055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5b1 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097c35 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.972284:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5b1 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097c35 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.972294:0:10055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171097c35 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201593.972300:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x18c:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201593.972306:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e27090 (ffff8bc148e3bcf8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201593.972311:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e27090 (ffff8bc148e3bcf8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.972315:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d44b0 (ffff8bc148e3bb48/1) at cl_lock_cancel():142 00000100:00100000:0.0:1788201593.972319:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146028a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728000384:192.168.201.143@tcp:101:cp.0 00000020:00010000:1.0:1788201593.972320:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e27090 (ffff8bc148e3bcf8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201593.972323:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d44b0 (ffff8bc148e3bcf8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201593.972387:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18c:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201593.972461:0:24470:0:(file.c:2638:do_file_write_iter()) START file run_IOR.sh:[0x200000bd7:0x18c:0x0], ppos: 0, count: 1753 00000080:00200000:1.0:1788201593.972478:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 1753 bytes 00000080:00200000:1.0:1788201593.972483:0:24470:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 1753 00000080:00200000:1.0:1788201593.972508:0:24470:0:(file.c:2090:ll_file_io_generic()) run_IOR.sh: write ppos: 0, bytes: 1753 00000080:00200000:1.0:1788201593.972514:0:24470:0:(file.c:1848:ll_io_set_mirror()) run_IOR.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201593.972519:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000cc3769ba[0x110, 1, [0x200000bd7:0x18c:0x0] hash] 00000020:00200000:1.0:1788201593.972522:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 1753) 0 0 00000080:00200000:1.0:1788201593.972525:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18c:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201593.972606:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1788201593.972616:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 1753) 1753, 1753 00020000:00200000:1.0:1788201593.972620:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201593.972710:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1788201593.972721:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201593.972725:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d44b0, osc lock ffff8bc145d09c80, flags 0x0 00010000:00010000:1.0:1788201593.972740:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/440 (0 4095) 00010000:00010000:1.0:1788201593.972776:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.972782:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.972830:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.972855:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146029c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728000512:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201593.973270:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201593.978058:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201593.978157:0:20876:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788201593.978183:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743483520 00000100:00100000:1.0:1788201593.978196:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743483520 00000100:00100000:1.0:1788201593.978288:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 783 00000100:00100000:1.0:1788201593.978298:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc145d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21821:x1875064743483520:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201593.978317:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097c35 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.978500:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201593.978507:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc145d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21821:x1875064743483520:12345-192.168.201.143@tcp:104: Request processed in 211us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201593.978518:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 783 00010000:00010000:2.0:1788201593.978539:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201593.978548:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097c35 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201593.978558:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17261f600 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:2.0:1788201593.978564:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171097c35 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201593.978630:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201593.978646:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:2.0:1788201593.978728:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097c35 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201593.978738:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201593.978768:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5b1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097c35 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201593.978778:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097c35 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201593.978782:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728000640:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201593.978911:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201593.978914:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201593.978916:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201593.981601:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201593.981989:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146029c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728000512:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201593.982025:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.982044:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.982053:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201593.982158:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743483648 00000100:00100000:0.0:1788201593.982166:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743483648 00000100:00100000:0.0:1788201593.982229:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 784 00000100:00100000:0.0:1788201593.982241:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1726cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21005:x1875064743483648:12345-192.168.201.143@tcp:105: 00010000:00010000:0.0:1788201593.982253:0:20877:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.982263:0:20877:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.982273:0:20877:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.982291:0:20877:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.982302:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.982314:0:20877:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.982347:0:20877:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc17261ec00) 00010000:00010000:1.0:1788201593.982493:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.982504:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.982522:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201593.982547:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.982561:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.982575:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201593.982609:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) run_IOR.sh: write [0, 1753) append 0 append lockpos 0 00000080:00200000:1.0:1788201593.982632:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 1753 bytes 00000080:00200000:1.0:1788201593.982704:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 1753, copied 1753 00000080:00200000:1.0:1788201593.982718:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e73365d6[3 0000000094ffd11c 2 1 00000000aeb2063c 0 0 0] 00000080:00200000:1.0:1788201593.982723:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003f2d6d37 17ffffc0001001 3:0 ffff8bc1468cd2a0 0 lru 00000080:00200000:1.0:1788201593.982730:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000089db7c26 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 000000005067509e > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201593.982733:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e73365d6 00000080:00200000:1.0:1788201593.982734:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201593.982740:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 1753 prio 0 00000008:00010000:1.0:1788201593.982764:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000fa2f0cf3 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201593.982784:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc144682378, count 1, dirtied 1 00000080:00200000:1.0:1788201593.982825:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 1753 bytes, tot: 1753 00000080:00200000:1.0:1788201593.982828:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) run_IOR.sh: write bytes 0, result: 1753 00000020:00010000:1.0:1788201593.982847:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c48a8 (ffff8bc148e3bcf8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201593.982851:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c48a8 (ffff8bc148e3bcf8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.982854:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d44b0 (ffff8bc148e3bb48/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201593.982860:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.982871:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201593.982895:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c48a8 (ffff8bc148e3bcf8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201593.982898:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d44b0 (ffff8bc148e3bcf8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201593.982908:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 1753 bytes 00000080:00200000:1.0:1788201593.982916:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1788201593.982954:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18c:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201593.982958:0:24470:0:(file.c:2238:ll_file_io_generic()) run_IOR.sh: 2 io complete with rc: 0, result: 1753, restart: 0 00000080:00200000:1.0:1788201593.982967:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x18c:0x0] updating i_size 1753 i_blocks 1 00000080:00200000:1.0:1788201593.982973:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 1753 00000080:00200008:1.0:1788201593.983027:0:24470:0:(file.c:479:ll_file_release()) START file run_IOR.sh:[0x200000bd7:0x18c:0x0](ffff8bc1446821c8), flags 100001 00000002:00100000:1.0:1788201593.983082:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1474d4000 x1875064728000256/t8589937434(8589937434) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201609 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201593.983095:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201593.983101:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146029c00 x1875064728000896/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201593.983124:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146029c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728000896:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201593.983224:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201593.983808:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1726cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21005:x1875064743483648:12345-192.168.201.143@tcp:105: Request processed in 1550us (2200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201593.983821:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 784 00000100:00100000:1.0:1788201593.986944:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146029c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728000896:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201593.986988:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1474d4000 x1875064728000256/t8589937434(8589937434) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201593.987083:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201593.987109:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.987132:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 199 lru_type: 1 00010000:00010000:1.0:1788201593.987150:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 199 lru_type: 1 00000080:00200000:1.0:1788201593.987169:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.987199:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201593.987203:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201593.987212:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201593.987217:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 199 lru_type: 1 00010000:00010000:1.0:1788201593.987228:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 200 lru_type: 1 00000080:00200000:1.0:1788201593.987247:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.987255:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201593.987262:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.987266:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=run_IOR.sh, flags=8 00000080:00200008:1.0:1788201593.987275:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file run_IOR.sh:[0x200000bd7:0x18c:0x0](ffff8bc1446821c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201593.987281:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x18c:0x0](ffff8bc1446821c8),name=run_IOR.sh 00000002:00010000:1.0:1788201593.987293:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x18c:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.987302:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097c27 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201593.987310:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097c27 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201593.987323:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.987327:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x18c:0x0](ffff8bc1446821c8) 00000080:00010000:1.0:1788201593.987329:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x18c:0x0](ffff8bc1446821c8) for lock 0xd138388016f6f5aa 00000080:00010000:1.0:1788201593.987333:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f5aa from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201593.987336:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097c27 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201593.987345:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097c27 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201593.987413:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18c:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201593.987424:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x18c:0x0] 00000008:00010000:1.0:1788201593.987460:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201593.987464:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d44b0, osc lock ffff8bc145d09c80, flags 0x400001002 00010000:00010000:1.0:1788201593.987484:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.987497:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201593.987512:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201593.987517:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201593.987525:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201593.987552:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201593.987563:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x18c:0x0] updating i_size 1753 i_blocks 1 00000020:00010000:1.0:1788201593.987567:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e27090 (ffff8bc148e3bcf8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201593.987570:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e27090 (ffff8bc148e3bcf8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.987573:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d44b0 (ffff8bc148e3bb48/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201593.987577:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e27090 (ffff8bc148e3bcf8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201593.987580:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d44b0 (ffff8bc148e3bcf8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201593.987611:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18c:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201593.987865:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201593.987875:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.987882:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 200 lru_type: 1 00010000:00010000:1.0:1788201593.987892:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 200 lru_type: 1 00000080:00200000:1.0:1788201593.987899:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.987904:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201593.987907:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201593.987910:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201593.987914:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 200 lru_type: 1 00010000:00010000:1.0:1788201593.987921:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 201 lru_type: 1 00000080:00200000:1.0:1788201593.987936:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.987941:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201593.987945:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.987961:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=run_iozone.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201593.987966:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run_iozone.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201593.987975:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run_iozone.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201593.988027:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5bf lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.988035:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5bf lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.988047:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5bf lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.988074:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728001024:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201593.988171:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201593.996197:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728001024:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201593.996227:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5bf lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.996245:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5bf lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.996251:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5bf lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.996259:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5bf lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.996269:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5bf lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.996276:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17261ee00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201593.996281:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5bf lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.996289:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5bf lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.996296:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5bf lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.996304:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201593.996312:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5bf lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.996318:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5bf lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201593.996340:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14602aa00 x1875064728001024/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201593.996358:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201593.996405:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201593.996492:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201593.996512:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201593.996524:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 201 lru_type: 1 00010000:00010000:1.0:1788201593.996543:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 201 lru_type: 1 00000100:00100000:3.0:1788201593.996698:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728000640:192.168.201.143@tcp:103:ldlm_bl.0 00000080:00200000:1.0:1788201593.996929:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201593.996936:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201593.996941:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201593.996949:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201593.996954:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 201 lru_type: 1 00010000:00010000:1.0:1788201593.996964:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 202 lru_type: 1 00000080:00200000:1.0:1788201593.996985:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.996995:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201593.997002:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201593.997018:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=run_iozone.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:1.0:1788201593.997023:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run_iozone.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201593.997037:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run_iozone.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201593.997101:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5c6 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.997111:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5c6 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.997123:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5c6 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.997167:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728001152:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201593.997266:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201594.013135:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728001152:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201594.013176:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5c6 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.013193:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5c6 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.013200:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5c6 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.013208:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5c6 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.013218:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5c6 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.013225:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17261fc00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201594.013230:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5c6 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.013237:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5c6 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.013246:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5c6 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.013253:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201594.013262:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5c6 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.013270:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5c6 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201594.013294:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14602aa00 x1875064728001152/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201609 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201594.013312:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201594.013342:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201594.013492:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201594.013511:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.013523:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 202 lru_type: 1 00010000:00010000:1.0:1788201594.013553:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 202 lru_type: 1 00000080:00200000:1.0:1788201594.013561:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.013568:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201594.013572:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201594.013578:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:1.0:1788201594.013582:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 202 lru_type: 1 00010000:00010000:1.0:1788201594.013591:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 203 lru_type: 1 00000080:00200000:1.0:1788201594.013609:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.013618:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201594.013624:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.013869:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201594.013877:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=run_iozone.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14304a600, open_flags 80c1, mode 81ed opened 0 00000080:00200000:1.0:1788201594.013886:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run_iozone.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:1.0:1788201594.013911:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run_iozone.sh,[0x200000bd7:0x18d:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201594.014276:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.014286:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201594.014301:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201594.014312:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14602aa00 x1875064728001408/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201594.014321:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201594.014349:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728001408:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201594.014946:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201594.028931:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728001408:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201594.028969:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097c82 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.029037:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x18d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097c82 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.029046:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097c82 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.029060:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097c82 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.029073:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097c82 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.029088:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097c82 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.029482:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097c82 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.029491:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097c82 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201594.029506:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc14602aa00 x1875064728001408/t8589937436(8589937436) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201594.029521:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14602aa00 x1875064728001408/t8589937436(8589937436) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201594.029599:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097c82 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201594.029619:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097c82 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.029634:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/397 (0 0) 00000080:00200000:1.0:1788201594.029711:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201594.029731:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=run_iozone.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:1.0:1788201594.029777:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x18d:0x0](ffff8bc14592aa08) 00000080:00200000:1.0:1788201594.030008:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x18d:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201594.030021:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x18d:0x0](ffff8bc14592aa08) 00000080:00010000:1.0:1788201594.030025:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x18d:0x0](ffff8bc14592aa08) for lock 0xd138388016f6f5cd 00000080:00010000:1.0:1788201594.030038:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x18d:0x0](ffff8bc14592aa08) 00000080:00200008:1.0:1788201594.030057:0:24470:0:(file.c:1090:ll_file_open()) START file run_iozone.sh:[0x200000bd7:0x18d:0x0](ffff8bc14592aa08), flags 100301 00000002:00100000:1.0:1788201594.030081:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14602aa00 x1875064728001408/t8589937436(8589937436) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201594.030308:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f5cd from it ffff8bc1466cd120 00010000:00010000:1.0:1788201594.030314:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097c82 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.030325:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097c82 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201594.030354:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x18d:0x0](ffff8bc14592aa08), inode mode 81ed mask 40 00000080:00200008:1.0:1788201594.030398:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file run_iozone.sh:[0x200000bd7:0x18d:0x0](ffff8bc14592aa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201594.030405:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x18d:0x0](ffff8bc14592aa08),name=run_iozone.sh 00000002:00010000:1.0:1788201594.030475:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x18d:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.030488:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097c82 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.030501:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097c82 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201594.030514:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.030518:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x18d:0x0](ffff8bc14592aa08) 00000080:00010000:1.0:1788201594.030522:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x18d:0x0](ffff8bc14592aa08) for lock 0xd138388016f6f5cd 00000080:00010000:1.0:1788201594.030526:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f5cd from it ffffadd1c7debcd8 00010000:00010000:1.0:1788201594.030529:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097c82 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.030613:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097c82 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201594.030720:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18d:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201594.030731:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x18d:0x0] 00000008:00010000:1.0:1788201594.030763:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201594.030767:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4d30, osc lock ffff8bc145d09c80, flags 0x400001002 00010000:00010000:1.0:1788201594.030931:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5d4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.030944:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5d4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.031055:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146028a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728001536:192.168.201.143@tcp:101:cp.0 00000020:00200000:1.0:1788201594.031740:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1788201594.036007:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5d4 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.036044:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5d4 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097c90 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.036063:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5d4 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097c90 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.036078:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5d4 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097c90 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1788201594.036204:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5d4 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097c90 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1788201594.036219:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:2.0:1788201594.036282:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5d4 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097c90 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.036295:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5d4 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097c90 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.036305:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5d4 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097c90 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.036315:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171097c90 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1788201594.036341:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146028a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728001536:192.168.201.143@tcp:101:cp.0 00000080:00200000:1.0:1788201594.036476:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x18d:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201594.036484:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e27090 (ffff8bc148e3bcf8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201594.036488:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e27090 (ffff8bc148e3bcf8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201594.036493:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4d30 (ffff8bc148e3bb48/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201594.036498:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e27090 (ffff8bc148e3bcf8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201594.036501:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4d30 (ffff8bc148e3bcf8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201594.036615:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18d:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201594.036763:0:24470:0:(file.c:2638:do_file_write_iter()) START file run_iozone.sh:[0x200000bd7:0x18d:0x0], ppos: 0, count: 1408 00000080:00200000:1.0:1788201594.036781:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 1408 bytes 00000080:00200000:1.0:1788201594.036787:0:24470:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 1408 00000080:00200000:1.0:1788201594.036842:0:24470:0:(file.c:2090:ll_file_io_generic()) run_iozone.sh: write ppos: 0, bytes: 1408 00000080:00200000:1.0:1788201594.036849:0:24470:0:(file.c:1848:ll_io_set_mirror()) run_iozone.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201594.036856:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000637c08fa[0x110, 1, [0x200000bd7:0x18d:0x0] hash] 00000020:00200000:1.0:1788201594.036859:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 1408) 0 0 00000080:00200000:1.0:1788201594.036863:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18d:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201594.036877:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1788201594.036886:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 1408) 1408, 1408 00020000:00200000:1.0:1788201594.036890:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201594.036923:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1788201594.036937:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201594.036942:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4d30, osc lock ffff8bc145d09c80, flags 0x0 00010000:00010000:1.0:1788201594.036963:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/441 (0 4095) 00010000:00010000:1.0:1788201594.037014:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.037026:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.037038:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201594.037063:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146029500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728001664:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201594.037503:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201594.040554:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201594.040826:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743483776 00000100:00100000:1.0:1788201594.040840:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743483776 00000100:00100000:1.0:1788201594.040909:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 785 00000100:00100000:1.0:1788201594.040920:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23131:x1875064743483776:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201594.040942:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5d4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097c90 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.041048:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201594.041055:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23131:x1875064743483776:12345-192.168.201.143@tcp:104: Request processed in 137us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201594.041063:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 785 00010000:00010000:1.0:1788201594.041091:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201594.041100:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5d4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097c90 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.041111:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17261fc00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201594.041119:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171097c90 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201594.041254:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201594.041269:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201594.041345:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097c90 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.041354:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201594.041396:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5d4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097c90 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.041405:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097c90 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.042633:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201594.042636:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201594.042749:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728001792:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201594.043334:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201594.047156:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201594.047304:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743483904 00000100:00100000:2.0:1788201594.047316:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743483904 00000100:00100000:2.0:1788201594.047395:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 786 00000100:00100000:2.0:1788201594.047407:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1474d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21003:x1875064743483904:12345-192.168.201.143@tcp:105: 00010000:00010000:2.0:1788201594.047439:0:20877:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.047456:0:20877:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.047467:0:20877:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.047486:0:20877:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.047498:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.047510:0:20877:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.047535:0:20877:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc17261f600) 00000100:00100000:2.0:1788201594.047628:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1474d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21003:x1875064743483904:12345-192.168.201.143@tcp:105: Request processed in 223us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201594.047752:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 786 00000100:00100000:1.0:1788201594.048161:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146029500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728001664:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201594.048189:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.048208:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201594.048223:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.048236:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.048244:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201594.048280:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) run_iozone.sh: write [0, 1408) append 0 append lockpos 0 00000080:00200000:1.0:1788201594.048304:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 1408 bytes 00000080:00200000:1.0:1788201594.048392:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 1408, copied 1408 00000080:00200000:1.0:1788201594.048405:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007a31a372[3 000000008101ea52 2 1 00000000aeb2063c 0 0 0] 00000080:00200000:1.0:1788201594.048418:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001fd170b2 17ffffc0001001 3:0 ffff8bc1468cd0e0 0 lru 00000080:00200000:1.0:1788201594.048427:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000cbd26e90 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 00000000a17d3c47 > 3< 0 0 > 4< 0 0 8 28966912 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.048430:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007a31a372 00000080:00200000:1.0:1788201594.048432:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201594.048438:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 1408 prio 0 00000008:00010000:1.0:1788201594.048464:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000398cf242 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201594.048487:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc14592abb8, count 1, dirtied 1 00000080:00200000:1.0:1788201594.048494:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 1408 bytes, tot: 1408 00000080:00200000:1.0:1788201594.048497:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) run_iozone.sh: write bytes 0, result: 1408 00000020:00010000:1.0:1788201594.048517:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c48a8 (ffff8bc148e3bcf8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201594.048521:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c48a8 (ffff8bc148e3bcf8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201594.048525:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4d30 (ffff8bc148e3bb48/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201594.048530:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.048552:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201594.048570:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c48a8 (ffff8bc148e3bcf8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201594.048573:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4d30 (ffff8bc148e3bcf8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201594.048584:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 1408 bytes 00000080:00200000:1.0:1788201594.048591:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1788201594.048625:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18d:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201594.048630:0:24470:0:(file.c:2238:ll_file_io_generic()) run_iozone.sh: 2 io complete with rc: 0, result: 1408, restart: 0 00000080:00200000:1.0:1788201594.048833:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x18d:0x0] updating i_size 1408 i_blocks 1 00000080:00200000:1.0:1788201594.048840:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 1408 00000080:00200008:1.0:1788201594.048898:0:24470:0:(file.c:479:ll_file_release()) START file run_iozone.sh:[0x200000bd7:0x18d:0x0](ffff8bc14592aa08), flags 100001 00000002:00100000:1.0:1788201594.048955:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc14602aa00 x1875064728001408/t8589937436(8589937436) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201594.048974:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201594.048979:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146029500 x1875064728002048/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201594.049004:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146029500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728002048:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201594.049070:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc14b95d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201594.054317:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728001792:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201594.054635:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146029500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728002048:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201594.054678:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc14602aa00 x1875064728001408/t8589937436(8589937436) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201594.054769:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201594.054826:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.054850:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 203 lru_type: 1 00010000:00010000:1.0:1788201594.054867:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 203 lru_type: 1 00000080:00200000:1.0:1788201594.054876:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.054882:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201594.054886:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201594.054894:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201594.054899:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 203 lru_type: 1 00010000:00010000:1.0:1788201594.054909:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 204 lru_type: 1 00000080:00200000:1.0:1788201594.054932:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.054940:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201594.054946:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.054950:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=run_iozone.sh, flags=8 00000080:00200008:1.0:1788201594.054957:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file run_iozone.sh:[0x200000bd7:0x18d:0x0](ffff8bc14592aa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201594.054962:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x18d:0x0](ffff8bc14592aa08),name=run_iozone.sh 00000002:00010000:1.0:1788201594.054974:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x18d:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.054982:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097c82 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201594.054990:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097c82 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201594.054997:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.055000:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x18d:0x0](ffff8bc14592aa08) 00000080:00010000:1.0:1788201594.055003:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x18d:0x0](ffff8bc14592aa08) for lock 0xd138388016f6f5cd 00000080:00010000:1.0:1788201594.055006:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f5cd from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201594.055009:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097c82 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201594.055017:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097c82 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201594.055066:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18d:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201594.055078:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x18d:0x0] 00000008:00010000:1.0:1788201594.055112:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201594.055116:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4d30, osc lock ffff8bc145d09c80, flags 0x400001002 00010000:00010000:1.0:1788201594.055134:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.055159:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201594.055176:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201594.055181:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.055190:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201594.055200:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201594.055210:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x18d:0x0] updating i_size 1408 i_blocks 1 00000020:00010000:1.0:1788201594.055213:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e27090 (ffff8bc148e3bcf8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201594.055217:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e27090 (ffff8bc148e3bcf8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201594.055219:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4d30 (ffff8bc148e3bb48/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201594.055224:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e27090 (ffff8bc148e3bcf8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201594.055227:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4d30 (ffff8bc148e3bcf8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201594.055258:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18d:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201594.055312:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201594.055319:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.055326:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 204 lru_type: 1 00010000:00010000:1.0:1788201594.055335:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 204 lru_type: 1 00000080:00200000:1.0:1788201594.055343:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.055347:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201594.055350:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201594.055353:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201594.055357:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 204 lru_type: 1 00010000:00010000:1.0:1788201594.055375:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 205 lru_type: 1 00000080:00200000:1.0:1788201594.055384:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.055388:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201594.055391:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.055406:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=run-llog.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201594.055420:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run-llog.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201594.055431:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run-llog.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201594.055482:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5e2 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.055489:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5e2 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.055499:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5e2 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201594.055524:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146029f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728002176:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201594.055628:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc14b95d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201594.059351:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146029f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728002176:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201594.059393:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5e2 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.059625:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5e2 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.059635:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5e2 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.059724:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5e2 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.059736:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5e2 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.059744:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17261fc00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201594.059749:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5e2 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.059758:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5e2 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.059767:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5e2 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.059775:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201594.059784:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5e2 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.059822:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fc00/0xd138388016f6f5e2 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201594.059855:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc146029f80 x1875064728002176/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201594.059874:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201594.059906:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201594.059989:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201594.060008:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.060020:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 205 lru_type: 1 00010000:00010000:1.0:1788201594.060035:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 205 lru_type: 1 00000080:00200000:1.0:1788201594.060042:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.060047:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201594.060051:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201594.060057:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201594.060062:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 205 lru_type: 1 00010000:00010000:1.0:1788201594.060071:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 206 lru_type: 1 00000080:00200000:1.0:1788201594.060090:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.060101:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201594.060108:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.060129:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=run-llog.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:1.0:1788201594.060135:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run-llog.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201594.060162:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run-llog.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201594.060217:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f5e9 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.060224:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f5e9 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.060236:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f5e9 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201594.060263:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146029f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728002304:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201594.060384:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc14b95d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201594.064588:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146029f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728002304:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201594.064629:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f5e9 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.064650:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f5e9 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.064658:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f5e9 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.064666:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f5e9 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.064678:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f5e9 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.064687:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17261e600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201594.064694:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f5e9 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.064701:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f5e9 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.064709:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f5e9 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.064718:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201594.064725:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f5e9 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.064733:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f5e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201594.064759:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc146029f80 x1875064728002304/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201594.064778:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201594.064848:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201594.064981:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201594.064998:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.065009:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 206 lru_type: 1 00010000:00010000:1.0:1788201594.065022:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 206 lru_type: 1 00000080:00200000:1.0:1788201594.065030:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.065035:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201594.065039:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201594.065045:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:1.0:1788201594.065050:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 206 lru_type: 1 00010000:00010000:1.0:1788201594.065058:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 207 lru_type: 1 00000080:00200000:1.0:1788201594.065078:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.065087:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201594.065093:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.065110:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201594.065115:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=run-llog.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14304a600, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:1.0:1788201594.065124:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run-llog.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:1.0:1788201594.065159:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run-llog.sh,[0x200000bd7:0x18e:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201594.065224:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.065231:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201594.065245:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201594.065253:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146029f80 x1875064728002560/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201594.065262:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201594.065286:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146029f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728002560:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201594.065632:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc14b95d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201594.072945:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146029f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728002560:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201594.072982:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097cdd expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.073008:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x18e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097cdd expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.073017:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097cdd expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.073030:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097cdd expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.073044:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097cdd expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.073059:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097cdd expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.073068:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097cdd expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.073077:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097cdd expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201594.073103:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc146029f80 x1875064728002560/t8589937438(8589937438) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201594.073121:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc146029f80 x1875064728002560/t8589937438(8589937438) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201594.073137:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097cdd expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201594.073161:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097cdd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.073173:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/398 (0 0) 00000080:00200000:1.0:1788201594.073182:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201594.073200:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=run-llog.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:1.0:1788201594.073234:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x18e:0x0](ffff8bc14592a1c8) 00000080:00200000:1.0:1788201594.073392:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x18e:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201594.073402:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x18e:0x0](ffff8bc14592a1c8) 00000080:00010000:1.0:1788201594.073406:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x18e:0x0](ffff8bc14592a1c8) for lock 0xd138388016f6f5f0 00000080:00010000:1.0:1788201594.073419:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x18e:0x0](ffff8bc14592a1c8) 00000080:00200008:1.0:1788201594.073440:0:24470:0:(file.c:1090:ll_file_open()) START file run-llog.sh:[0x200000bd7:0x18e:0x0](ffff8bc14592a1c8), flags 100301 00000002:00100000:1.0:1788201594.073463:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc146029f80 x1875064728002560/t8589937438(8589937438) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201594.073516:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f5f0 from it ffff8bc1466cd120 00010000:00010000:1.0:1788201594.073521:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097cdd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.073533:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097cdd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201594.073564:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x18e:0x0](ffff8bc14592a1c8), inode mode 81a4 mask 40 00000080:00200008:1.0:1788201594.073597:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file run-llog.sh:[0x200000bd7:0x18e:0x0](ffff8bc14592a1c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201594.073604:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x18e:0x0](ffff8bc14592a1c8),name=run-llog.sh 00000002:00010000:1.0:1788201594.073626:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x18e:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.073637:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097cdd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.073650:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097cdd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201594.073657:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.073663:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x18e:0x0](ffff8bc14592a1c8) 00000080:00010000:1.0:1788201594.073666:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x18e:0x0](ffff8bc14592a1c8) for lock 0xd138388016f6f5f0 00000080:00010000:1.0:1788201594.073669:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f5f0 from it ffffadd1c7debcd8 00010000:00010000:1.0:1788201594.073672:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097cdd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.073680:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097cdd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201594.073708:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18e:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201594.073718:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x18e:0x0] 00000008:00010000:1.0:1788201594.073747:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201594.073752:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4430, osc lock ffff8bc145d09c80, flags 0x400001002 00010000:00010000:1.0:1788201594.073851:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f5f7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.073868:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f5f7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201594.073919:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1788201594.074709:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146029180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728002688:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201594.079051:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f5f7 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.079087:0:10054:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f5f7 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097ceb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.079106:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f5f7 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097ceb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.079122:0:10054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f5f7 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097ceb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201594.079141:0:10054:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f5f7 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097ceb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201594.079166:0:10054:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201594.079180:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f5f7 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097ceb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.079190:0:10054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f5f7 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097ceb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.079199:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f5f7 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097ceb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.079215:0:10054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f5f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171097ceb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201594.079243:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146029180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728002688:192.168.201.143@tcp:101:cp.0 00000080:00200000:1.0:1788201594.079427:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x18e:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201594.079435:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e27090 (ffff8bc148e3bcf8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201594.079439:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e27090 (ffff8bc148e3bcf8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201594.079444:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4430 (ffff8bc148e3bb48/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201594.079450:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e27090 (ffff8bc148e3bcf8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201594.079453:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4430 (ffff8bc148e3bcf8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201594.079499:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18e:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201594.079579:0:24470:0:(file.c:2638:do_file_write_iter()) START file run-llog.sh:[0x200000bd7:0x18e:0x0], ppos: 0, count: 855 00000080:00200000:1.0:1788201594.079597:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 855 bytes 00000080:00200000:1.0:1788201594.079603:0:24470:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 855 00000080:00200000:1.0:1788201594.079631:0:24470:0:(file.c:2090:ll_file_io_generic()) run-llog.sh: write ppos: 0, bytes: 855 00000080:00200000:1.0:1788201594.079637:0:24470:0:(file.c:1848:ll_io_set_mirror()) run-llog.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201594.079644:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@000000001afeecfa[0x110, 1, [0x200000bd7:0x18e:0x0] hash] 00000020:00200000:1.0:1788201594.079646:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 855) 0 0 00000080:00200000:1.0:1788201594.079650:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18e:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201594.079664:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1788201594.079673:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 855) 855, 855 00020000:00200000:1.0:1788201594.079677:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201594.079709:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1788201594.079722:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201594.079727:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4430, osc lock ffff8bc145d09c80, flags 0x0 00010000:00010000:1.0:1788201594.079744:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/441 (0 4095) 00010000:00010000:1.0:1788201594.079816:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.079833:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.079845:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201594.079872:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146029880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728002816:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201594.079980:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201594.082900:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201594.083001:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743484032 00000100:00100000:3.0:1788201594.083014:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743484032 00000100:00100000:3.0:1788201594.083085:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 787 00000100:00100000:3.0:1788201594.083109:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23415:x1875064743484032:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201594.083132:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f5f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097ceb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201594.083243:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201594.083250:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23415:x1875064743484032:12345-192.168.201.143@tcp:104: Request processed in 146us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201594.083259:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 787 00010000:00010000:1.0:1788201594.083859:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201594.083870:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f5f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097ceb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.083893:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17261e600 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201594.083902:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f5f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171097ceb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201594.083973:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201594.083988:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201594.084070:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f5f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097ceb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.084079:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201594.084123:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f5f7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097ceb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.084139:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f5f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097ceb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.084164:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201594.084166:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201594.084168:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201594.084744:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728002944:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788201594.088910:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201594.089786:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743484160 00000100:00100000:3.0:1788201594.089843:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743484160 00000100:00100000:3.0:1788201594.089917:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 788 00000100:00100000:3.0:1788201594.089931:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21004:x1875064743484160:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201594.089953:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.089971:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.089987:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.090000:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.090011:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.090089:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.090116:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc17261fc00) 00000100:00100000:3.0:1788201594.090260:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21004:x1875064743484160:12345-192.168.201.143@tcp:105: Request processed in 331us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201594.090268:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 788 00000100:00100000:0.0:1788201594.092906:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728002944:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201594.096010:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146029880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728002816:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201594.096061:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.096095:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201594.096113:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.096128:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.096137:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201594.096177:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) run-llog.sh: write [0, 855) append 0 append lockpos 0 00000080:00200000:1.0:1788201594.096205:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 855 bytes 00000080:00200000:1.0:1788201594.096290:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 855, copied 855 00000080:00200000:1.0:1788201594.096307:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000043a7c000[3 00000000d7c3e8cc 2 1 00000000aeb2063c 0 0 0] 00000080:00200000:1.0:1788201594.096311:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b475f5d8 17ffffc0001001 3:0 ffff8bc149f50a80 0 lru 00000080:00200000:1.0:1788201594.096319:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000055036a6e 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 0000000032fa6c89 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.096321:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000043a7c000 00000080:00200000:1.0:1788201594.096322:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201594.096329:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 855 prio 0 00000008:00010000:1.0:1788201594.096356:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 000000005de6e866 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201594.096393:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc14592a378, count 1, dirtied 1 00000080:00200000:1.0:1788201594.096398:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 855 bytes, tot: 855 00000080:00200000:1.0:1788201594.096401:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) run-llog.sh: write bytes 0, result: 855 00000020:00010000:1.0:1788201594.096421:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c48a8 (ffff8bc148e3bcf8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201594.096424:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c48a8 (ffff8bc148e3bcf8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201594.096428:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4430 (ffff8bc148e3bb48/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201594.096433:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.096444:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201594.096462:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c48a8 (ffff8bc148e3bcf8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201594.096465:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4430 (ffff8bc148e3bcf8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201594.096476:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 855 bytes 00000080:00200000:1.0:1788201594.096487:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1788201594.096525:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18e:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201594.096529:0:24470:0:(file.c:2238:ll_file_io_generic()) run-llog.sh: 2 io complete with rc: 0, result: 855, restart: 0 00000080:00200000:1.0:1788201594.096553:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x18e:0x0] updating i_size 855 i_blocks 1 00000080:00200000:1.0:1788201594.096560:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 855 00000080:00200008:1.0:1788201594.096619:0:24470:0:(file.c:479:ll_file_release()) START file run-llog.sh:[0x200000bd7:0x18e:0x0](ffff8bc14592a1c8), flags 100001 00000002:00100000:1.0:1788201594.096690:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc146029f80 x1875064728002560/t8589937438(8589937438) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201594.096703:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201594.096709:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146029880 x1875064728003200/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201594.096734:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146029880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728003200:192.168.201.143@tcp:35:cp.0 00000100:00100000:0.0:1788201594.099356:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.101991:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146029880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728003200:192.168.201.143@tcp:35:cp.0 00000002:00100000:0.0:1788201594.102041:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc146029f80 x1875064728002560/t8589937438(8589937438) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201594.102466:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201594.102495:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.102521:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 207 lru_type: 1 00010000:00010000:0.0:1788201594.102611:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 207 lru_type: 1 00000080:00200000:0.0:1788201594.102625:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.102634:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201594.102639:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201594.102650:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201594.102655:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 207 lru_type: 1 00010000:00010000:0.0:1788201594.102666:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 208 lru_type: 1 00000080:00200000:0.0:1788201594.102686:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.102695:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201594.102703:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.102707:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=run-llog.sh, flags=8 00000080:00200008:0.0:1788201594.102716:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file run-llog.sh:[0x200000bd7:0x18e:0x0](ffff8bc14592a1c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201594.102722:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x18e:0x0](ffff8bc14592a1c8),name=run-llog.sh 00000002:00010000:0.0:1788201594.102735:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x18e:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.102745:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097cdd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201594.102754:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097cdd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201594.102760:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.102764:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x18e:0x0](ffff8bc14592a1c8) 00000080:00010000:0.0:1788201594.102766:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x18e:0x0](ffff8bc14592a1c8) for lock 0xd138388016f6f5f0 00000080:00010000:0.0:1788201594.102771:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f5f0 from it ffffadd1c7debcb8 00010000:00010000:0.0:1788201594.102775:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097cdd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201594.102782:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097cdd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201594.102991:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18e:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201594.103004:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x18e:0x0] 00000008:00010000:0.0:1788201594.103041:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201594.103045:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456030, osc lock ffff8bc145d34ab0, flags 0x400001002 00010000:00010000:0.0:1788201594.103065:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.103078:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:0.0:1788201594.103475:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1788201594.103483:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.103494:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1788201594.103506:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1788201594.103518:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x18e:0x0] updating i_size 855 i_blocks 1 00000020:00010000:0.0:1788201594.103523:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201594.103526:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.103530:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456030 (ffff8bc1499c4518/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.103534:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201594.103548:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456030 (ffff8bc1499c46c8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201594.103580:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18e:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201594.103652:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201594.103665:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.103675:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 208 lru_type: 1 00010000:00010000:0.0:1788201594.103685:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 208 lru_type: 1 00000080:00200000:0.0:1788201594.103693:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.103697:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201594.103700:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201594.103704:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201594.103706:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 208 lru_type: 1 00010000:00010000:0.0:1788201594.103714:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 209 lru_type: 1 00000080:00200000:0.0:1788201594.103722:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.103728:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201594.103731:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.103748:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=run_tar.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:0.0:1788201594.103753:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run_tar.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201594.103764:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run_tar.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201594.104002:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f605 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.104011:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f605 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.104022:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f605 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201594.104056:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d7b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728003328:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201594.104317:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145ea5600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201594.109069:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d7b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728003328:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201594.109249:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f605 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.109269:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f605 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.109277:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f605 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.109285:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f605 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.109298:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f605 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.109306:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc146085e00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:2.0:1788201594.109312:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f605 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.109321:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f605 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.109329:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f605 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.109338:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201594.109347:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f605 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.109354:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085e00/0xd138388016f6f605 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201594.109393:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1474d7b80 x1875064728003328/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201594.109479:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1788201594.109518:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201594.109674:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201594.109694:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.109707:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 209 lru_type: 1 00010000:00010000:2.0:1788201594.109726:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 209 lru_type: 1 00000080:00200000:2.0:1788201594.109733:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.109739:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201594.109744:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201594.109751:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201594.109755:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 209 lru_type: 1 00010000:00010000:2.0:1788201594.109764:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 210 lru_type: 1 00000080:00200000:2.0:1788201594.109782:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.110010:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201594.110019:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.110035:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=run_tar.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:2.0:1788201594.110039:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run_tar.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201594.110054:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run_tar.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201594.110128:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f60c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.110136:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f60c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.110221:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f60c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.110256:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728003456:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201594.110484:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc153920e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201594.115916:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728003456:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201594.115949:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f60c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.115965:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f60c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.115972:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f60c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.115984:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f60c lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.115994:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f60c lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.116001:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172473800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201594.116007:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f60c lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.116014:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f60c lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.116022:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f60c lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.116031:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201594.116039:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f60c lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.116045:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f60c lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201594.116070:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a1f80 x1875064728003456/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201594.116101:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201594.116133:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:3.0:1788201594.116281:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201594.116306:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201594.116318:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 210 lru_type: 1 00010000:00010000:3.0:1788201594.116332:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 210 lru_type: 1 00000080:00200000:3.0:1788201594.116339:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201594.116346:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201594.116350:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201594.116356:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:3.0:1788201594.116372:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 210 lru_type: 1 00010000:00010000:3.0:1788201594.116382:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 211 lru_type: 1 00000080:00200000:3.0:1788201594.116400:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201594.116419:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201594.116428:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201594.116446:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:3.0:1788201594.116452:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=run_tar.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc146421680, open_flags 80c1, mode 81ed opened 0 00000080:00200000:3.0:1788201594.116460:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run_tar.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:3.0:1788201594.116485:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run_tar.sh,[0x200000bd7:0x18f:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:3.0:1788201594.116785:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.116908:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1788201594.116930:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1788201594.116939:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1726cce00 x1875064728003712/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1788201594.116950:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201594.117245:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728003712:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201594.117875:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201594.124058:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728003712:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201594.124200:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097d38 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.125069:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097d38 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.125085:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097d38 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.125463:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097d38 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.125482:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097d38 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.125505:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097d38 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.125516:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097d38 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.125524:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097d38 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201594.125610:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1726cce00 x1875064728003712/t8589937440(8589937440) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201594.125626:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1726cce00 x1875064728003712/t8589937440(8589937440) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201594.125915:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097d38 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1788201594.126074:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097d38 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.126220:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/399 (0 0) 00000080:00200000:0.0:1788201594.126232:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201594.126251:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=run_tar.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:0.0:1788201594.126293:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x18f:0x0](ffff8bc144681988) 00000080:00200000:0.0:1788201594.126532:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x18f:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1788201594.126621:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x18f:0x0](ffff8bc144681988) 00000080:00010000:0.0:1788201594.126626:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x18f:0x0](ffff8bc144681988) for lock 0xd138388016f6f613 00000080:00010000:0.0:1788201594.126713:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x18f:0x0](ffff8bc144681988) 00000080:00200008:0.0:1788201594.126737:0:24470:0:(file.c:1090:ll_file_open()) START file run_tar.sh:[0x200000bd7:0x18f:0x0](ffff8bc144681988), flags 100301 00000002:00100000:0.0:1788201594.126768:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1726cce00 x1875064728003712/t8589937440(8589937440) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1788201594.126973:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f613 from it ffff8bc148c9b060 00010000:00010000:0.0:1788201594.126981:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097d38 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.126999:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097d38 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201594.127030:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x18f:0x0](ffff8bc144681988), inode mode 81ed mask 40 00000080:00200008:0.0:1788201594.127067:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file run_tar.sh:[0x200000bd7:0x18f:0x0](ffff8bc144681988), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201594.127074:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x18f:0x0](ffff8bc144681988),name=run_tar.sh 00000002:00010000:0.0:1788201594.127221:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x18f:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.127239:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097d38 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.127252:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097d38 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201594.127262:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.127269:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x18f:0x0](ffff8bc144681988) 00000080:00010000:0.0:1788201594.127272:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x18f:0x0](ffff8bc144681988) for lock 0xd138388016f6f613 00000080:00010000:0.0:1788201594.127276:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f613 from it ffffadd1c7debcd8 00010000:00010000:0.0:1788201594.127281:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097d38 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.127289:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097d38 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201594.127320:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18f:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201594.127332:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x18f:0x0] 00000008:00010000:0.0:1788201594.127377:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201594.127383:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456130, osc lock ffff8bc145d34ab0, flags 0x400001002 00010000:00010000:0.0:1788201594.127513:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f61a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.127525:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f61a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.127850:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728003840:192.168.201.143@tcp:101:cp.0 00000020:00200000:0.0:1788201594.131086:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1788201594.131750:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f61a lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.131781:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f61a lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097d46 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.131920:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f61a lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097d46 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.131935:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f61a lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097d46 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1788201594.131953:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f61a lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097d46 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1788201594.131964:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:2.0:1788201594.132020:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f61a lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097d46 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.132032:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f61a lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097d46 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.132046:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f61a lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097d46 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.132056:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f61a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171097d46 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1788201594.132085:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728003840:192.168.201.143@tcp:101:cp.0 00000080:00200000:0.0:1788201594.132304:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x18f:0x0] updating i_size 0 i_blocks 1 00000020:00010000:0.0:1788201594.132311:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201594.132315:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.132321:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456130 (ffff8bc1499c4518/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.132326:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201594.132329:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456130 (ffff8bc1499c46c8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201594.132386:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18f:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1788201594.132517:0:24470:0:(file.c:2638:do_file_write_iter()) START file run_tar.sh:[0x200000bd7:0x18f:0x0], ppos: 0, count: 1654 00000080:00200000:0.0:1788201594.132616:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 1654 bytes 00000080:00200000:0.0:1788201594.132623:0:24470:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 1654 00000080:00200000:0.0:1788201594.132730:0:24470:0:(file.c:2090:ll_file_io_generic()) run_tar.sh: write ppos: 0, bytes: 1654 00000080:00200000:0.0:1788201594.132736:0:24470:0:(file.c:1848:ll_io_set_mirror()) run_tar.sh: desiginated mirror: 0 00000020:00200000:0.0:1788201594.132743:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000060c42d8[0x110, 1, [0x200000bd7:0x18f:0x0] hash] 00000020:00200000:0.0:1788201594.132746:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 1654) 0 0 00000080:00200000:0.0:1788201594.132751:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18f:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201594.132764:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1788201594.132772:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 1654) 1654, 1654 00020000:00200000:0.0:1788201594.132776:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201594.132977:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:0.0:1788201594.132993:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1788201594.132999:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456130, osc lock ffff8bc145d34ab0, flags 0x0 00010000:00010000:0.0:1788201594.133018:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/442 (0 4095) 00010000:00010000:0.0:1788201594.133071:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.133084:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.133259:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201594.133287:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d7800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728003968:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201594.133509:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc148293600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201594.140474:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201594.148762:0:20877:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788201594.148827:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743484288 00000100:00100000:2.0:1788201594.148840:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743484288 00000100:00100000:2.0:1788201594.148925:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 789 00000100:00100000:2.0:1788201594.148937:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc141466450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23408:x1875064743484288:12345-192.168.201.143@tcp:104: 00010000:00010000:2.0:1788201594.148959:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f61a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097d46 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.149077:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201594.149085:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc141466450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23408:x1875064743484288:12345-192.168.201.143@tcp:104: Request processed in 150us (8628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201594.149093:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 789 00010000:00010000:1.0:1788201594.152343:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201594.152375:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f61a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097d46 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.152394:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc146084800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201594.152405:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f61a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171097d46 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201594.152495:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201594.152511:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201594.152612:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f61a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097d46 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.152621:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201594.152660:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f61a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097d46 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.152674:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f61a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097d46 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.152694:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201594.152696:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201594.152698:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201594.152788:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728004096:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201594.157067:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d7800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728003968:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201594.157126:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.157145:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.157156:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201594.162749:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201594.163227:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743484416 00000100:00100000:1.0:1788201594.163241:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743484416 00000100:00100000:1.0:1788201594.163326:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 790 00000100:00100000:1.0:1788201594.163338:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1474d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21005:x1875064743484416:12345-192.168.201.143@tcp:105: 00010000:00010000:1.0:1788201594.163370:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.163388:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.163399:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.163413:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.163424:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.163453:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.163492:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc146084200) 00000100:00100000:1.0:1788201594.163574:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1474d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21005:x1875064743484416:12345-192.168.201.143@tcp:105: Request processed in 237us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201594.163582:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 790 00010000:00010000:3.0:1788201594.166469:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.166501:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.166525:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201594.166552:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.166567:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.166575:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201594.166615:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) run_tar.sh: write [0, 1654) append 0 append lockpos 0 00000100:00100000:2.0:1788201594.166716:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728004096:192.168.201.143@tcp:103:ldlm_bl.0 00000080:00200000:3.0:1788201594.167875:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 1654 bytes 00000080:00200000:0.0:1788201594.178544:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 1654, copied 1654 00000080:00200000:0.0:1788201594.178572:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a25e7f14[3 0000000002dbd894 2 1 0000000005f45737 0 0 0] 00000080:00200000:0.0:1788201594.178576:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000001dcea1e 17ffffc0001001 3:0 ffff8bc1726e59a0 0 lru 00000080:00200000:0.0:1788201594.178586:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003ec1b068 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 00000000b44c1565 > 3< 0 0 > 4< 0 0 8 27262976 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.178589:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a25e7f14 00000080:00200000:0.0:1788201594.178591:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1788201594.178598:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 1654 prio 0 00000008:00010000:0.0:1788201594.178632:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 000000009fce27d9 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201594.178823:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc144681b38, count 1, dirtied 1 00000080:00200000:0.0:1788201594.178831:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 1654 bytes, tot: 1654 00000080:00200000:0.0:1788201594.178835:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) run_tar.sh: write bytes 0, result: 1654 00000020:00010000:0.0:1788201594.178856:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc148fb1998 (ffff8bc1499c46c8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201594.178860:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc148fb1998 (ffff8bc1499c46c8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.178864:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456130 (ffff8bc1499c4518/1) at cl_lock_cancel():142 00010000:00010000:0.0:1788201594.178874:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.178895:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1788201594.178916:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc148fb1998 (ffff8bc1499c46c8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201594.178920:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456130 (ffff8bc1499c46c8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201594.178930:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 1654 bytes 00000080:00200000:0.0:1788201594.178939:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1788201594.178978:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18f:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201594.178983:0:24470:0:(file.c:2238:ll_file_io_generic()) run_tar.sh: 2 io complete with rc: 0, result: 1654, restart: 0 00000080:00200000:0.0:1788201594.178992:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x18f:0x0] updating i_size 1654 i_blocks 1 00000080:00200000:0.0:1788201594.178999:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 1654 00000080:00200008:0.0:1788201594.179054:0:24470:0:(file.c:479:ll_file_release()) START file run_tar.sh:[0x200000bd7:0x18f:0x0](ffff8bc144681988), flags 100001 00000002:00100000:0.0:1788201594.179130:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1726cce00 x1875064728003712/t8589937440(8589937440) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1788201594.179215:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1788201594.179223:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1474d5c00 x1875064728004352/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1788201594.179255:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d5c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728004352:192.168.201.143@tcp:35:cp.0 00000100:00100000:0.0:1788201594.179469:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc148293600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201594.190004:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d5c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728004352:192.168.201.143@tcp:35:cp.0 00000002:00100000:3.0:1788201594.190051:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1726cce00 x1875064728003712/t8589937440(8589937440) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201594.190163:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201594.190188:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201594.190213:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 211 lru_type: 1 00010000:00010000:3.0:1788201594.190238:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 211 lru_type: 1 00000080:00200000:3.0:1788201594.190248:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201594.190255:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201594.190260:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201594.190269:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201594.190274:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 211 lru_type: 1 00010000:00010000:3.0:1788201594.190285:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 212 lru_type: 1 00000080:00200000:3.0:1788201594.190304:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201594.190312:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201594.190320:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201594.190323:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=run_tar.sh, flags=8 00000080:00200008:3.0:1788201594.190332:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file run_tar.sh:[0x200000bd7:0x18f:0x0](ffff8bc144681988), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201594.190337:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x18f:0x0](ffff8bc144681988),name=run_tar.sh 00000002:00010000:3.0:1788201594.190351:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x18f:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201594.190372:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097d38 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201594.190382:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097d38 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201594.190394:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201594.190399:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x18f:0x0](ffff8bc144681988) 00000080:00010000:3.0:1788201594.190402:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x18f:0x0](ffff8bc144681988) for lock 0xd138388016f6f613 00000080:00010000:3.0:1788201594.190406:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f613 from it ffffadd1c7debcb8 00010000:00010000:3.0:1788201594.190409:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097d38 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201594.190418:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097d38 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201594.190477:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18f:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201594.190489:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x18f:0x0] 00000008:00010000:3.0:1788201594.190528:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201594.190532:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149feca30, osc lock ffff8bc14691aab0, flags 0x400001002 00010000:00010000:3.0:1788201594.190565:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201594.190580:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:3.0:1788201594.190596:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1788201594.190601:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201594.190609:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1788201594.190624:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1788201594.191203:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x18f:0x0] updating i_size 1654 i_blocks 1 00000020:00010000:3.0:1788201594.191212:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc6500 (ffff8bc1460e9a28/0) at cl_lock_release():245 00000020:00010000:3.0:1788201594.191215:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc6500 (ffff8bc1460e9a28/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201594.191219:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149feca30 (ffff8bc1460e9878/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201594.191225:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc6500 (ffff8bc1460e9a28/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201594.191228:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149feca30 (ffff8bc1460e9a28/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201594.191266:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18f:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201594.193453:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201594.193489:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201594.193513:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 212 lru_type: 1 00010000:00010000:3.0:1788201594.193533:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 212 lru_type: 1 00000080:00200000:3.0:1788201594.193555:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201594.193566:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201594.193570:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201594.193579:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201594.193584:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 212 lru_type: 1 00010000:00010000:3.0:1788201594.193594:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 213 lru_type: 1 00000080:00200000:3.0:1788201594.193623:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201594.193632:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201594.194004:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201594.194025:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-benchmark.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:3.0:1788201594.194030:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-benchmark.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:3.0:1788201594.194049:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-benchmark.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201594.194118:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f628 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.194126:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f628 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.194138:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f628 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201594.194417:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728004480:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201594.194584:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc148293600 going to sleep for 11 seconds 00010000:00010000:1.0:1788201594.197802:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201594.198842:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728004480:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201594.198874:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f628 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.198893:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f628 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.198903:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f628 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.198911:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f628 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.198922:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f628 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.198930:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1725a1000 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201594.198935:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f628 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.198949:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f628 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.198957:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f628 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.198965:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201594.198973:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f628 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.198980:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1000/0xd138388016f6f628 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201594.199005:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1726cea00 x1875064728004480/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201594.199023:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201594.199056:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201594.199154:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201594.199178:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.199189:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 213 lru_type: 1 00010000:00010000:1.0:1788201594.199202:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 213 lru_type: 1 00000080:00200000:1.0:1788201594.199209:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.199216:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201594.199220:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201594.199226:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201594.199230:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 213 lru_type: 1 00010000:00010000:1.0:1788201594.199240:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 214 lru_type: 1 00000080:00200000:1.0:1788201594.199256:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.199266:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201594.199274:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.199295:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-benchmark.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:1.0:1788201594.199299:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-benchmark.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201594.199313:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-benchmark.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201594.199390:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f62f lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.199398:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f62f lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.199409:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f62f lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201594.199445:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146029180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728004608:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201594.199564:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201594.204689:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146029180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728004608:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201594.204721:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f62f lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.204738:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f62f lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.204746:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f62f lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.204753:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f62f lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.204763:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f62f lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.204770:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17261fe00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201594.204775:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f62f lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.204782:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f62f lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.204828:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f62f lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.204837:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201594.204844:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f62f lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.204851:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f62f lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201594.204875:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc146029180 x1875064728004608/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201594.204893:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201594.204923:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201594.205055:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201594.205072:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.205083:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 214 lru_type: 1 00010000:00010000:1.0:1788201594.205097:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 214 lru_type: 1 00000080:00200000:1.0:1788201594.205104:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.205110:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201594.205114:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201594.205120:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:1.0:1788201594.205125:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 214 lru_type: 1 00010000:00010000:1.0:1788201594.205135:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 215 lru_type: 1 00000080:00200000:1.0:1788201594.205152:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.205163:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201594.205169:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.205184:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201594.205189:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sanity-benchmark.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14304a300, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:1.0:1788201594.205198:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-benchmark.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:1.0:1788201594.205221:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-benchmark.sh,[0x200000bd7:0x190:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201594.205282:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.205294:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201594.205310:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201594.205317:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc146029180 x1875064728004864/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201594.205326:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201594.205350:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146029180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728004864:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201594.205532:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201594.212935:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146029180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728004864:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201594.212976:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097d93 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.213006:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x190:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097d93 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.213015:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097d93 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.213029:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097d93 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.213042:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097d93 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.213065:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097d93 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.213074:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097d93 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.213083:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097d93 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201594.213097:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc146029180 x1875064728004864/t8589937442(8589937442) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201594.213113:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc146029180 x1875064728004864/t8589937442(8589937442) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201594.213130:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097d93 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201594.213144:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097d93 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.213156:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/400 (0 0) 00000080:00200000:1.0:1788201594.213164:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201594.213182:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=sanity-benchmark.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:1.0:1788201594.213221:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x190:0x0](ffff8bc14592db88) 00000080:00200000:1.0:1788201594.213380:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x190:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201594.213392:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x190:0x0](ffff8bc14592db88) 00000080:00010000:1.0:1788201594.213396:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x190:0x0](ffff8bc14592db88) for lock 0xd138388016f6f636 00000080:00010000:1.0:1788201594.213407:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x190:0x0](ffff8bc14592db88) 00000080:00200008:1.0:1788201594.213438:0:24470:0:(file.c:1090:ll_file_open()) START file sanity-benchmark.sh:[0x200000bd7:0x190:0x0](ffff8bc14592db88), flags 100301 00000002:00100000:1.0:1788201594.213460:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc146029180 x1875064728004864/t8589937442(8589937442) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201594.213509:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f636 from it ffff8bc1466cd120 00010000:00010000:1.0:1788201594.213515:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097d93 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.213525:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097d93 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201594.213564:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x190:0x0](ffff8bc14592db88), inode mode 81a4 mask 40 00000080:00200008:1.0:1788201594.213599:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-benchmark.sh:[0x200000bd7:0x190:0x0](ffff8bc14592db88), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201594.213606:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x190:0x0](ffff8bc14592db88),name=sanity-benchmark.sh 00000002:00010000:1.0:1788201594.213626:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x190:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.213644:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097d93 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.213657:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097d93 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201594.213666:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.213672:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x190:0x0](ffff8bc14592db88) 00000080:00010000:1.0:1788201594.213675:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x190:0x0](ffff8bc14592db88) for lock 0xd138388016f6f636 00000080:00010000:1.0:1788201594.213679:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f636 from it ffffadd1c7debcd8 00010000:00010000:1.0:1788201594.213682:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097d93 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.213690:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097d93 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201594.213718:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x190:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201594.213729:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x190:0x0] 00000008:00010000:1.0:1788201594.213761:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201594.213766:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4730, osc lock ffff8bc145d09c80, flags 0x400001002 00010000:00010000:1.0:1788201594.213881:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007d98314c/0xd138388016f6f63d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.213893:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007d98314c/0xd138388016f6f63d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201594.213944:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:2.0:1788201594.214206:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728004992:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201594.218232:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007d98314c/0xd138388016f6f63d lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.218277:0:10054:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007d98314c/0xd138388016f6f63d lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097da1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.218297:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007d98314c/0xd138388016f6f63d lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097da1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.218312:0:10054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007d98314c/0xd138388016f6f63d lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097da1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1788201594.218331:0:10054:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007d98314c/0xd138388016f6f63d lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097da1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1788201594.218345:0:10054:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:2.0:1788201594.218374:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007d98314c/0xd138388016f6f63d lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097da1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.218384:0:10054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007d98314c/0xd138388016f6f63d lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097da1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.218392:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007d98314c/0xd138388016f6f63d lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097da1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.218402:0:10054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007d98314c/0xd138388016f6f63d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171097da1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1788201594.218551:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728004992:192.168.201.143@tcp:101:cp.0 00000080:00200000:0.0:1788201594.218850:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x190:0x0] updating i_size 0 i_blocks 1 00000020:00010000:0.0:1788201594.218858:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e27090 (ffff8bc148e3bcf8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201594.218862:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e27090 (ffff8bc148e3bcf8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.218867:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4730 (ffff8bc148e3bb48/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.218873:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e27090 (ffff8bc148e3bcf8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201594.218876:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4730 (ffff8bc148e3bcf8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201594.218925:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x190:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1788201594.219010:0:24470:0:(file.c:2638:do_file_write_iter()) START file sanity-benchmark.sh:[0x200000bd7:0x190:0x0], ppos: 0, count: 6548 00000080:00200000:0.0:1788201594.219048:0:24470:0:(file.c:2090:ll_file_io_generic()) sanity-benchmark.sh: write ppos: 0, bytes: 6548 00000080:00200000:0.0:1788201594.219056:0:24470:0:(file.c:1848:ll_io_set_mirror()) sanity-benchmark.sh: desiginated mirror: 0 00000020:00200000:0.0:1788201594.219063:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@000000009f2158d0[0x110, 1, [0x200000bd7:0x190:0x0] hash] 00000020:00200000:0.0:1788201594.219065:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 6548) 0 0 00000080:00200000:0.0:1788201594.219069:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x190:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201594.219085:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 1] 00020000:00200000:0.0:1788201594.219094:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 6548) 6548, 6548 00020000:00200000:0.0:1788201594.219099:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201594.219148:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 1] 00000008:00010000:0.0:1788201594.219165:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1788201594.219171:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456130, osc lock ffff8bc145d34ab0, flags 0x0 00010000:00010000:0.0:1788201594.219191:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/442 (0 8191) 00010000:00010000:0.0:1788201594.219244:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.219254:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.219266:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201594.219293:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d7800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728005120:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201594.222787:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc148293600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.223738:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201594.223920:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743484544 00000100:00100000:3.0:1788201594.223934:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743484544 00000100:00100000:3.0:1788201594.224058:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 791 00000100:00100000:3.0:1788201594.224071:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1474d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23411:x1875064743484544:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201594.224112:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007d98314c/0xd138388016f6f63d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097da1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201594.224236:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201594.224244:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1474d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23411:x1875064743484544:12345-192.168.201.143@tcp:104: Request processed in 176us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201594.224253:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 791 00010000:00010000:0.0:1788201594.224307:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201594.224316:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007d98314c/0xd138388016f6f63d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097da1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.224328:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17261fe00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201594.224337:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007d98314c/0xd138388016f6f63d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171097da1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201594.224425:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x190:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201594.224442:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x190:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1788201594.224528:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007d98314c/0xd138388016f6f63d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097da1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.224549:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201594.224579:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007d98314c/0xd138388016f6f63d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097da1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.224589:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007d98314c/0xd138388016f6f63d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097da1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.224608:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201594.224611:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201594.224612:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201594.224643:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728005248:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201594.231187:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201594.231382:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743484672 00000100:00100000:3.0:1788201594.231396:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743484672 00000100:00100000:3.0:1788201594.231488:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 792 00000100:00100000:3.0:1788201594.231501:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc146028a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743484672:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201594.231527:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.231554:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.231567:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.231580:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.231591:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.231604:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.231630:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc146084400) 00000100:00100000:3.0:1788201594.231721:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc146028a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743484672:12345-192.168.201.143@tcp:105: Request processed in 222us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201594.231729:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 792 00000100:00100000:2.0:1788201594.235103:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728005248:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201594.235511:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d7800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728005120:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201594.235599:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.235703:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201594.235721:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.235737:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.235747:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201594.235776:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) sanity-benchmark.sh: write [0, 6548) append 0 append lockpos 0 00000080:00200000:0.0:1788201594.235827:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.235891:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:0.0:1788201594.235905:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005cf267ab[3 0000000018847cc0 2 1 0000000005f45737 0 0 0] 00000080:00200000:0.0:1788201594.235910:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000738624d8 17ffffc0001001 3:0 ffff8bc1726e5c40 0 lru 00000080:00200000:0.0:1788201594.235919:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a90b66cb 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 000000003f5d7db6 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.235921:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005cf267ab 00000080:00200000:0.0:1788201594.235923:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1788201594.235928:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 2452 bytes 00000080:00200000:0.0:1788201594.235970:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 2452, copied 2452 00000080:00200000:0.0:1788201594.235975:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000148ddaa2[3 0000000018847cc0 2 1 0000000005f45737 0 0 1] 00000080:00200000:0.0:1788201594.235978:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000bf5c089b 17ffffc0001001 3:0 ffff8bc1726e5a80 1 lru 00000080:00200000:0.0:1788201594.235984:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000060ce4fb0 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 000000003f5d7db6 > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.235987:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000148ddaa2 00000080:00200000:0.0:1788201594.235989:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:0.0:1788201594.235993:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 2, from 0, to 2452 prio 0 00000008:00010000:0.0:1788201594.236021:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000637616f9 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201594.236048:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc14592dd38, count 2, dirtied 2 00000080:00200000:0.0:1788201594.236054:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 2 pages 6548 bytes, tot: 6548 00000080:00200000:0.0:1788201594.236057:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) sanity-benchmark.sh: write bytes 0, result: 6548 00000020:00010000:0.0:1788201594.236079:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc148fb1998 (ffff8bc1499c46c8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201594.236084:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc148fb1998 (ffff8bc1499c46c8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.236088:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456130 (ffff8bc1499c4518/1) at cl_lock_cancel():142 00010000:00010000:0.0:1788201594.236229:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.236241:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1788201594.236259:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc148fb1998 (ffff8bc1499c46c8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201594.236262:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456130 (ffff8bc1499c46c8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201594.236271:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 6548 bytes 00000080:00200000:0.0:1788201594.236279:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 1] 00000080:00200000:0.0:1788201594.236313:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x190:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201594.236317:0:24470:0:(file.c:2238:ll_file_io_generic()) sanity-benchmark.sh: 2 io complete with rc: 0, result: 6548, restart: 0 00000080:00200000:0.0:1788201594.236326:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x190:0x0] updating i_size 6548 i_blocks 1 00000080:00200000:0.0:1788201594.236331:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 6548 00000080:00200008:0.0:1788201594.236394:0:24470:0:(file.c:479:ll_file_release()) START file sanity-benchmark.sh:[0x200000bd7:0x190:0x0](ffff8bc14592db88), flags 100001 00000002:00100000:0.0:1788201594.236527:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc146029180 x1875064728004864/t8589937442(8589937442) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1788201594.236603:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1788201594.236610:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1474d7800 x1875064728005504/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1788201594.236697:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d7800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728005504:192.168.201.143@tcp:35:cp.0 00000100:00100000:0.0:1788201594.236899:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc148293600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.240880:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d7800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728005504:192.168.201.143@tcp:35:cp.0 00000002:00100000:0.0:1788201594.240928:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc146029180 x1875064728004864/t8589937442(8589937442) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201594.241027:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201594.241051:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.241074:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 215 lru_type: 1 00010000:00010000:0.0:1788201594.241105:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 215 lru_type: 1 00000080:00200000:0.0:1788201594.241115:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.241122:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201594.241126:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201594.241136:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201594.241151:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 215 lru_type: 1 00010000:00010000:0.0:1788201594.241162:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 216 lru_type: 1 00000080:00200000:0.0:1788201594.241182:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.241192:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201594.241199:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.241203:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-benchmark.sh, flags=8 00000080:00200008:0.0:1788201594.241213:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-benchmark.sh:[0x200000bd7:0x190:0x0](ffff8bc14592db88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201594.241219:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x190:0x0](ffff8bc14592db88),name=sanity-benchmark.sh 00000002:00010000:0.0:1788201594.241233:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x190:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.241242:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097d93 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201594.241251:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097d93 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201594.241259:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.241263:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x190:0x0](ffff8bc14592db88) 00000080:00010000:0.0:1788201594.241265:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x190:0x0](ffff8bc14592db88) for lock 0xd138388016f6f636 00000080:00010000:0.0:1788201594.241270:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f636 from it ffffadd1c7debcb8 00010000:00010000:0.0:1788201594.241272:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097d93 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201594.241280:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097d93 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201594.241335:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x190:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201594.241345:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x190:0x0] 00000008:00010000:0.0:1788201594.241395:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201594.241399:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456130, osc lock ffff8bc145d34ab0, flags 0x400001002 00010000:00010000:0.0:1788201594.241431:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.241450:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:0.0:1788201594.241465:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1788201594.241470:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.241478:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1788201594.241488:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1788201594.241498:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x190:0x0] updating i_size 6548 i_blocks 1 00000020:00010000:0.0:1788201594.241502:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201594.241505:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.241508:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456130 (ffff8bc1499c4518/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.241512:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201594.241515:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456130 (ffff8bc1499c46c8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201594.241783:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x190:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201594.241913:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201594.241922:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.241931:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 216 lru_type: 1 00010000:00010000:0.0:1788201594.241941:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 216 lru_type: 1 00000080:00200000:0.0:1788201594.241954:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.241958:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201594.241960:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201594.241964:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201594.241968:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 216 lru_type: 1 00010000:00010000:0.0:1788201594.241976:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 217 lru_type: 1 00000080:00200000:0.0:1788201594.241986:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.241989:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201594.241993:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.242006:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-compr.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:0.0:1788201594.242011:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-compr.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201594.242020:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-compr.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201594.242075:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f64b lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.242084:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f64b lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.242188:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f64b lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201594.242215:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d7b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728005632:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201594.242314:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc148293600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.247073:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d7b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728005632:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201594.247119:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f64b lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.247137:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f64b lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.247291:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f64b lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.247300:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f64b lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.247314:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f64b lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.247321:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc146085200 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201594.247327:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f64b lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.247334:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f64b lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.247342:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f64b lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.247349:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201594.247369:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f64b lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.247376:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f64b lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201594.247403:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1474d7b80 x1875064728005632/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201594.247477:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201594.247509:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201594.247775:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201594.247833:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.247846:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 217 lru_type: 1 00010000:00010000:0.0:1788201594.247859:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 217 lru_type: 1 00000080:00200000:0.0:1788201594.247867:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.247874:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201594.247877:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201594.247884:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201594.247888:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 217 lru_type: 1 00010000:00010000:0.0:1788201594.247896:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 218 lru_type: 1 00000080:00200000:0.0:1788201594.247914:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.247923:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201594.247928:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.247946:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-compr.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:0.0:1788201594.247951:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-compr.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201594.247964:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-compr.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201594.248018:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f652 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.248026:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f652 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.248056:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f652 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201594.248082:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d7b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728005760:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201594.249015:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc148293600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.252603:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d7b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728005760:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201594.252644:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f652 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.252660:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f652 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.252668:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f652 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.252676:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f652 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.252687:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f652 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.252694:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc146084600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201594.252699:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f652 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.252707:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f652 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.252715:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f652 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.252723:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201594.252729:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f652 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.252736:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f652 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201594.252756:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1474d7b80 x1875064728005760/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201594.252774:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201594.252858:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201594.252992:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201594.253011:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.253023:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 218 lru_type: 1 00010000:00010000:0.0:1788201594.253036:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 218 lru_type: 1 00000080:00200000:0.0:1788201594.253044:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.253049:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201594.253053:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201594.253059:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:0.0:1788201594.253064:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 218 lru_type: 1 00010000:00010000:0.0:1788201594.253073:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 219 lru_type: 1 00000080:00200000:0.0:1788201594.253090:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.253098:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201594.253105:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.253120:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201594.253126:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sanity-compr.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc152c97200, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:0.0:1788201594.253134:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-compr.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:0.0:1788201594.253169:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-compr.sh,[0x200000bd7:0x191:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:0.0:1788201594.253229:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.253238:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1788201594.253253:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1788201594.253260:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1474d7b80 x1875064728006016/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1788201594.253270:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201594.253296:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1474d7b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728006016:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201594.253469:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc148293600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.266377:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1474d7b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728006016:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201594.266418:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097dee expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.266448:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x191:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097dee expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.266460:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097dee expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.266474:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097dee expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.266490:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097dee expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.266508:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097dee expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.266518:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097dee expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.266527:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097dee expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201594.266553:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1474d7b80 x1875064728006016/t8589937444(8589937444) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201594.266570:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1474d7b80 x1875064728006016/t8589937444(8589937444) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201594.266587:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097dee expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1788201594.266604:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097dee expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.266617:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/401 (0 0) 00000080:00200000:0.0:1788201594.266626:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201594.266644:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=sanity-compr.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:0.0:1788201594.266692:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x191:0x0](ffff8bc1459b63c8) 00000080:00200000:0.0:1788201594.266893:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x191:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1788201594.266905:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x191:0x0](ffff8bc1459b63c8) 00000080:00010000:0.0:1788201594.266909:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x191:0x0](ffff8bc1459b63c8) for lock 0xd138388016f6f659 00000080:00010000:0.0:1788201594.266921:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x191:0x0](ffff8bc1459b63c8) 00000080:00200008:0.0:1788201594.266941:0:24470:0:(file.c:1090:ll_file_open()) START file sanity-compr.sh:[0x200000bd7:0x191:0x0](ffff8bc1459b63c8), flags 100301 00000002:00100000:0.0:1788201594.266965:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1474d7b80 x1875064728006016/t8589937444(8589937444) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1788201594.267020:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f659 from it ffff8bc146937720 00010000:00010000:0.0:1788201594.267025:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097dee expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.267036:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097dee expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201594.267068:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x191:0x0](ffff8bc1459b63c8), inode mode 81a4 mask 40 00000080:00200008:0.0:1788201594.267114:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-compr.sh:[0x200000bd7:0x191:0x0](ffff8bc1459b63c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201594.267122:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x191:0x0](ffff8bc1459b63c8),name=sanity-compr.sh 00000002:00010000:0.0:1788201594.267154:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x191:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.267167:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097dee expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.267180:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097dee expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201594.267188:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.267194:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x191:0x0](ffff8bc1459b63c8) 00000080:00010000:0.0:1788201594.267198:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x191:0x0](ffff8bc1459b63c8) for lock 0xd138388016f6f659 00000080:00010000:0.0:1788201594.267202:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f659 from it ffffadd1c7debcd8 00010000:00010000:0.0:1788201594.267205:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097dee expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.267213:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097dee expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201594.267241:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x191:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201594.267252:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x191:0x0] 00000008:00010000:0.0:1788201594.267283:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201594.267287:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456a30, osc lock ffff8bc145d34ab0, flags 0x400001002 00010000:00010000:0.0:1788201594.267347:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bb550939/0xd138388016f6f660 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.267375:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bb550939/0xd138388016f6f660 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.267473:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728006144:192.168.201.143@tcp:101:cp.0 00000020:00200000:0.0:1788201594.267887:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1788201594.278285:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bb550939/0xd138388016f6f660 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.278337:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bb550939/0xd138388016f6f660 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097dfc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.278395:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bb550939/0xd138388016f6f660 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097dfc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.278412:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bb550939/0xd138388016f6f660 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097dfc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1788201594.278430:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bb550939/0xd138388016f6f660 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097dfc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1788201594.278444:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:2.0:1788201594.278870:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bb550939/0xd138388016f6f660 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097dfc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.278888:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bb550939/0xd138388016f6f660 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097dfc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.278897:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bb550939/0xd138388016f6f660 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097dfc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.278908:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bb550939/0xd138388016f6f660 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171097dfc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1788201594.278939:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728006144:192.168.201.143@tcp:101:cp.0 00000080:00200000:0.0:1788201594.289772:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x191:0x0] updating i_size 0 i_blocks 1 00000020:00010000:0.0:1788201594.289787:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201594.290301:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.290308:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456a30 (ffff8bc1499c4518/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.290315:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201594.290317:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456a30 (ffff8bc1499c46c8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201594.290374:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x191:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1788201594.290460:0:24470:0:(file.c:2638:do_file_write_iter()) START file sanity-compr.sh:[0x200000bd7:0x191:0x0], ppos: 0, count: 4750 00000080:00200000:0.0:1788201594.290500:0:24470:0:(file.c:2090:ll_file_io_generic()) sanity-compr.sh: write ppos: 0, bytes: 4750 00000080:00200000:0.0:1788201594.290508:0:24470:0:(file.c:1848:ll_io_set_mirror()) sanity-compr.sh: desiginated mirror: 0 00000020:00200000:0.0:1788201594.290516:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@0000000010156e51[0x110, 1, [0x200000bd7:0x191:0x0] hash] 00000020:00200000:0.0:1788201594.290519:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4750) 0 0 00000080:00200000:0.0:1788201594.290523:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x191:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201594.291326:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 1] 00020000:00200000:0.0:1788201594.291338:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4750) 4750, 4750 00020000:00200000:0.0:1788201594.291343:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201594.291403:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 1] 00000008:00010000:0.0:1788201594.291464:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1788201594.291472:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456a30, osc lock ffff8bc145d34ab0, flags 0x0 00010000:00010000:0.0:1788201594.291495:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/443 (0 8191) 00010000:00010000:0.0:1788201594.292226:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.292244:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.292258:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201594.292295:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172649880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728006272:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201594.292673:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201594.299322:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201594.299436:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743484800 00000100:00100000:0.0:1788201594.299450:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743484800 00000100:00100000:0.0:1788201594.299527:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 793 00000100:00100000:0.0:1788201594.299548:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1726cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21821:x1875064743484800:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201594.299573:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bb550939/0xd138388016f6f660 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097dfc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.308745:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201594.308777:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1726cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21821:x1875064743484800:12345-192.168.201.143@tcp:104: Request processed in 9229us (9459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201594.308810:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 793 00010000:00010000:1.0:1788201594.310623:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201594.310641:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bb550939/0xd138388016f6f660 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097dfc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.310660:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc146084600 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201594.310670:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bb550939/0xd138388016f6f660 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171097dfc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201594.310746:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x191:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201594.310762:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x191:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201594.310913:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bb550939/0xd138388016f6f660 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097dfc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.310923:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201594.310963:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bb550939/0xd138388016f6f660 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097dfc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.310972:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000bb550939/0xd138388016f6f660 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097dfc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.310994:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201594.310996:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201594.310998:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201594.311008:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201594.311032:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728006400:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201594.311911:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172649880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728006272:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201594.311938:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.311952:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.311961:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201594.321179:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201594.321455:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743485056 00000100:00100000:2.0:1788201594.321468:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743485056 00000100:00100000:2.0:1788201594.321558:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 794 00000100:00100000:2.0:1788201594.321571:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14602b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21004:x1875064743485056:12345-192.168.201.143@tcp:105: 00010000:00010000:2.0:1788201594.321592:0:20877:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.321611:0:20877:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.321623:0:20877:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.321635:0:20877:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.321646:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.321658:0:20877:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.321696:0:20877:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc146085600) 00000100:00100000:2.0:1788201594.321772:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14602b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21004:x1875064743485056:12345-192.168.201.143@tcp:105: Request processed in 204us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201594.321781:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 794 00010000:00010000:0.0:1788201594.322743:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.322763:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.322784:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201594.322841:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.322856:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.322865:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201594.322902:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) sanity-compr.sh: write [0, 4750) append 0 append lockpos 0 00000080:00200000:0.0:1788201594.322924:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.322994:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:0.0:1788201594.323007:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006fdfe73f[3 00000000e558d3f0 2 1 0000000005f45737 0 0 0] 00000080:00200000:0.0:1788201594.323011:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006be809f8 17ffffc0001001 3:0 ffff8bc1726e5540 0 lru 00000080:00200000:0.0:1788201594.323019:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000961abc43 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 000000009b1536e8 > 3< 0 0 > 4< 0 0 8 25559040 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.323021:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006fdfe73f 00000080:00200000:0.0:1788201594.323023:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1788201594.323027:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 654 bytes 00000080:00200000:0.0:1788201594.323061:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 654, copied 654 00000080:00200000:0.0:1788201594.323066:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000558bde0e[3 00000000e558d3f0 2 1 0000000005f45737 0 0 1] 00000080:00200000:0.0:1788201594.323070:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000011f8f87f 17ffffc0001001 3:0 ffff8bc1726e58c0 1 lru 00000080:00200000:0.0:1788201594.323075:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000dacfda16 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 000000009b1536e8 > 3< 0 0 > 4< 0 0 8 25559040 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.323078:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000558bde0e 00000080:00200000:0.0:1788201594.323079:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:0.0:1788201594.323083:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 2, from 0, to 654 prio 0 00000008:00010000:0.0:1788201594.323110:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 0000000015882d22 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201594.323136:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459b6578, count 2, dirtied 2 00000080:00200000:0.0:1788201594.323142:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 2 pages 4750 bytes, tot: 4750 00000080:00200000:0.0:1788201594.323145:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) sanity-compr.sh: write bytes 0, result: 4750 00000020:00010000:0.0:1788201594.323164:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc148fb1998 (ffff8bc1499c46c8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201594.323168:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc148fb1998 (ffff8bc1499c46c8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.323171:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456a30 (ffff8bc1499c4518/1) at cl_lock_cancel():142 00010000:00010000:0.0:1788201594.323177:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.323187:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1788201594.323207:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc148fb1998 (ffff8bc1499c46c8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201594.323210:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456a30 (ffff8bc1499c46c8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201594.323220:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 4750 bytes 00000080:00200000:0.0:1788201594.323229:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 1] 00000080:00200000:0.0:1788201594.323266:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x191:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201594.323271:0:24470:0:(file.c:2238:ll_file_io_generic()) sanity-compr.sh: 2 io complete with rc: 0, result: 4750, restart: 0 00000080:00200000:0.0:1788201594.323280:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x191:0x0] updating i_size 4750 i_blocks 1 00000080:00200000:0.0:1788201594.323286:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 4750 00000080:00200008:0.0:1788201594.323346:0:24470:0:(file.c:479:ll_file_release()) START file sanity-compr.sh:[0x200000bd7:0x191:0x0](ffff8bc1459b63c8), flags 100001 00000002:00100000:0.0:1788201594.323431:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1474d7b80 x1875064728006016/t8589937444(8589937444) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1788201594.323445:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1788201594.323451:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172649880 x1875064728006656/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1788201594.323480:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172649880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728006656:192.168.201.143@tcp:35:cp.0 00000100:00100000:0.0:1788201594.323599:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201594.333502:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728006400:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201594.339101:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172649880 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728006656:192.168.201.143@tcp:35:cp.0 00000002:00100000:0.0:1788201594.339157:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1474d7b80 x1875064728006016/t8589937444(8589937444) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201594.339253:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201594.339281:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.339306:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 219 lru_type: 1 00010000:00010000:0.0:1788201594.339330:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 219 lru_type: 1 00000080:00200000:0.0:1788201594.339342:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.339349:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201594.339352:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201594.339371:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201594.339375:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 219 lru_type: 1 00010000:00010000:0.0:1788201594.339387:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 220 lru_type: 1 00000080:00200000:0.0:1788201594.339405:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.339416:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201594.339422:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.339425:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-compr.sh, flags=8 00000080:00200008:0.0:1788201594.339433:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-compr.sh:[0x200000bd7:0x191:0x0](ffff8bc1459b63c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201594.339438:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x191:0x0](ffff8bc1459b63c8),name=sanity-compr.sh 00000002:00010000:0.0:1788201594.339450:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x191:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.339458:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097dee expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201594.339466:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097dee expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201594.339473:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.339476:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x191:0x0](ffff8bc1459b63c8) 00000080:00010000:0.0:1788201594.339478:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x191:0x0](ffff8bc1459b63c8) for lock 0xd138388016f6f659 00000080:00010000:0.0:1788201594.339481:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f659 from it ffffadd1c7debcb8 00010000:00010000:0.0:1788201594.339484:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097dee expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201594.339493:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097dee expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201594.339706:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x191:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201594.339719:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x191:0x0] 00000008:00010000:0.0:1788201594.339756:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201594.339761:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456a30, osc lock ffff8bc145d34ab0, flags 0x400001002 00010000:00010000:0.0:1788201594.339782:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.339855:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:0.0:1788201594.339870:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1788201594.339876:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.339884:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1788201594.339896:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1788201594.339906:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x191:0x0] updating i_size 4750 i_blocks 1 00000020:00010000:0.0:1788201594.339909:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201594.339912:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.339915:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456a30 (ffff8bc1499c4518/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.339919:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201594.339922:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456a30 (ffff8bc1499c46c8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201594.339950:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x191:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201594.340008:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201594.340017:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.340025:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 220 lru_type: 1 00010000:00010000:0.0:1788201594.340034:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 220 lru_type: 1 00000080:00200000:0.0:1788201594.340042:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.340046:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201594.340049:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201594.340053:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201594.340057:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 220 lru_type: 1 00010000:00010000:0.0:1788201594.340065:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 221 lru_type: 1 00000080:00200000:0.0:1788201594.340074:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.340078:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201594.340081:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.340097:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-dom.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:0.0:1788201594.340102:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-dom.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201594.340114:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-dom.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201594.340181:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f66e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.340190:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f66e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.340206:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f66e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201594.340239:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172649c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728006784:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201594.340394:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.347603:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172649c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728006784:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201594.347635:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f66e lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.347653:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f66e lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.347661:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f66e lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.347669:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f66e lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.347679:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f66e lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.347688:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc146084c00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201594.347693:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f66e lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.347700:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f66e lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.347708:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f66e lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.347716:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201594.347725:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f66e lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.347732:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f66e lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201594.347757:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc172649c00 x1875064728006784/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201594.347775:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201594.347871:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201594.347951:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201594.347971:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.347982:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 221 lru_type: 1 00010000:00010000:0.0:1788201594.347997:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 221 lru_type: 1 00000080:00200000:0.0:1788201594.348004:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.348010:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201594.348014:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201594.348020:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201594.348024:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 221 lru_type: 1 00010000:00010000:0.0:1788201594.348033:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 222 lru_type: 1 00000080:00200000:0.0:1788201594.348051:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.348061:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201594.348067:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.348085:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-dom.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:0.0:1788201594.348090:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-dom.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201594.348104:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-dom.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201594.348155:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f675 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.348163:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f675 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.348175:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f675 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201594.348201:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172649c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728006912:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201594.348292:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.352744:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172649c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728006912:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201594.352774:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f675 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.352789:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f675 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.352838:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f675 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.352845:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f675 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.352857:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f675 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.352864:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc146084e00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201594.352870:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f675 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.352878:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f675 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.352886:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f675 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.352894:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201594.352901:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f675 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.352908:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f675 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201594.352929:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc172649c00 x1875064728006912/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201594.352948:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201594.352983:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201594.353126:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201594.353143:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.353164:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 222 lru_type: 1 00010000:00010000:0.0:1788201594.353182:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 222 lru_type: 1 00000080:00200000:0.0:1788201594.353190:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.353196:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201594.353200:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201594.353206:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:0.0:1788201594.353210:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 222 lru_type: 1 00010000:00010000:0.0:1788201594.353219:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 223 lru_type: 1 00000080:00200000:0.0:1788201594.353238:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.353248:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201594.353254:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.353272:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201594.353277:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sanity-dom.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc152c97200, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:0.0:1788201594.353287:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-dom.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:0.0:1788201594.353309:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-dom.sh,[0x200000bd7:0x192:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:0.0:1788201594.353378:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.353386:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1788201594.353400:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1788201594.353409:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172649c00 x1875064728007168/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1788201594.353419:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201594.353443:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172649c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728007168:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201594.353595:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.366920:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172649c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728007168:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201594.366958:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097e49 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.366986:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097e49 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.366995:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097e49 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.367008:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097e49 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.367021:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097e49 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.367039:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097e49 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.367048:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097e49 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.367057:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097e49 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201594.367071:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc172649c00 x1875064728007168/t8589937446(8589937446) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201594.367088:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc172649c00 x1875064728007168/t8589937446(8589937446) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201594.367113:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097e49 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1788201594.367127:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097e49 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.367199:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/402 (0 0) 00000080:00200000:0.0:1788201594.367210:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201594.367229:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=sanity-dom.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:0.0:1788201594.367276:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x192:0x0](ffff8bc1459b2a08) 00000080:00200000:0.0:1788201594.367468:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x192:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1788201594.367480:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x192:0x0](ffff8bc1459b2a08) 00000080:00010000:0.0:1788201594.367484:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x192:0x0](ffff8bc1459b2a08) for lock 0xd138388016f6f67c 00000080:00010000:0.0:1788201594.367498:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x192:0x0](ffff8bc1459b2a08) 00000080:00200008:0.0:1788201594.367517:0:24470:0:(file.c:1090:ll_file_open()) START file sanity-dom.sh:[0x200000bd7:0x192:0x0](ffff8bc1459b2a08), flags 100301 00000002:00100000:0.0:1788201594.368079:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc172649c00 x1875064728007168/t8589937446(8589937446) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1788201594.368135:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f67c from it ffff8bc146937600 00010000:00010000:0.0:1788201594.368513:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097e49 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.368613:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097e49 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201594.368649:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x192:0x0](ffff8bc1459b2a08), inode mode 81a4 mask 40 00000080:00200008:0.0:1788201594.368686:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-dom.sh:[0x200000bd7:0x192:0x0](ffff8bc1459b2a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201594.368693:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x192:0x0](ffff8bc1459b2a08),name=sanity-dom.sh 00000002:00010000:0.0:1788201594.368720:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x192:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.368737:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097e49 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.368750:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097e49 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201594.368758:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.368765:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x192:0x0](ffff8bc1459b2a08) 00000080:00010000:0.0:1788201594.368769:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x192:0x0](ffff8bc1459b2a08) for lock 0xd138388016f6f67c 00000080:00010000:0.0:1788201594.368775:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f67c from it ffffadd1c7debcd8 00010000:00010000:0.0:1788201594.368778:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097e49 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.368786:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097e49 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201594.368852:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x192:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201594.368862:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x192:0x0] 00000008:00010000:0.0:1788201594.368897:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201594.368902:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456e30, osc lock ffff8bc145d34ab0, flags 0x400001002 00010000:00010000:0.0:1788201594.368965:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f683 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.368975:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f683 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.369082:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728007296:192.168.201.143@tcp:101:cp.0 00000020:00200000:0.0:1788201594.369422:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1788201594.376919:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f683 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.376958:0:10054:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f683 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097e57 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.376976:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f683 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097e57 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.376991:0:10054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f683 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097e57 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1788201594.377017:0:10054:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f683 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097e57 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1788201594.377030:0:10054:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:2.0:1788201594.377239:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f683 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097e57 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.377251:0:10054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f683 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097e57 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.377260:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f683 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097e57 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.377269:0:10054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f683 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171097e57 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1788201594.377295:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728007296:192.168.201.143@tcp:101:cp.0 00000080:00200000:0.0:1788201594.377432:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x192:0x0] updating i_size 0 i_blocks 1 00000020:00010000:0.0:1788201594.377439:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201594.377443:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.377448:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456e30 (ffff8bc1499c4518/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.377453:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201594.377456:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456e30 (ffff8bc1499c46c8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201594.377499:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x192:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1788201594.377572:0:24470:0:(file.c:2638:do_file_write_iter()) START file sanity-dom.sh:[0x200000bd7:0x192:0x0], ppos: 0, count: 6821 00000080:00200000:0.0:1788201594.377608:0:24470:0:(file.c:2090:ll_file_io_generic()) sanity-dom.sh: write ppos: 0, bytes: 6821 00000080:00200000:0.0:1788201594.377746:0:24470:0:(file.c:1848:ll_io_set_mirror()) sanity-dom.sh: desiginated mirror: 0 00000020:00200000:0.0:1788201594.377753:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@000000004b297108[0x110, 1, [0x200000bd7:0x192:0x0] hash] 00000020:00200000:0.0:1788201594.377756:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 6821) 0 0 00000080:00200000:0.0:1788201594.377760:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x192:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201594.377773:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 1] 00020000:00200000:0.0:1788201594.377781:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 6821) 6821, 6821 00020000:00200000:0.0:1788201594.377785:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201594.377903:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 1] 00000008:00010000:0.0:1788201594.377916:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1788201594.377922:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456e30, osc lock ffff8bc145d34ab0, flags 0x0 00010000:00010000:0.0:1788201594.377940:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/443 (0 8191) 00010000:00010000:0.0:1788201594.377984:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.377994:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.378005:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201594.378032:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172648a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728007424:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201594.378321:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788201594.382089:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201594.382267:0:20876:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788201594.382294:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743485184 00000100:00100000:0.0:1788201594.382306:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743485184 00000100:00100000:0.0:1788201594.382383:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 795 00000100:00100000:0.0:1788201594.382394:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1726ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23131:x1875064743485184:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201594.382418:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f683 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097e57 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.382521:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201594.382529:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1726ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23131:x1875064743485184:12345-192.168.201.143@tcp:104: Request processed in 137us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201594.382536:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 795 00010000:00010000:3.0:1788201594.382737:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201594.382748:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f683 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097e57 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201594.382759:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc146084e00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201594.382766:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f683 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171097e57 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201594.382874:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x192:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201594.382890:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x192:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201594.382972:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f683 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097e57 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201594.382981:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201594.383016:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f683 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097e57 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201594.383026:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f683 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097e57 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201594.383044:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201594.383046:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201594.383047:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201594.383102:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728007552:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201594.391485:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201594.391586:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743485312 00000100:00100000:2.0:1788201594.391598:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743485312 00000100:00100000:2.0:1788201594.391663:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 796 00000100:00100000:2.0:1788201594.391674:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1726cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21005:x1875064743485312:12345-192.168.201.143@tcp:105: 00010000:00010000:2.0:1788201594.391694:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.391711:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.391722:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.391735:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.391745:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.391756:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.391777:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc146084800) 00000100:00100000:2.0:1788201594.391873:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1726cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21005:x1875064743485312:12345-192.168.201.143@tcp:105: Request processed in 200us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201594.391880:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 796 00000100:00100000:0.0:1788201594.392454:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172648a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728007424:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201594.392479:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.392500:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201594.392514:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.392528:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.392543:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201594.392576:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) sanity-dom.sh: write [0, 6821) append 0 append lockpos 0 00000080:00200000:0.0:1788201594.392596:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.392651:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:0.0:1788201594.392663:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000016ce7c7[3 00000000e2bd2472 2 1 0000000005f45737 0 0 0] 00000080:00200000:0.0:1788201594.392666:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000056fd2916 17ffffc0001001 3:0 ffff8bc1726e5e00 0 lru 00000080:00200000:0.0:1788201594.392675:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000aeed258f 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000dc1d7463 > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.392678:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000016ce7c7 00000080:00200000:0.0:1788201594.392680:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1788201594.392683:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 2725 bytes 00000080:00200000:0.0:1788201594.392727:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 2725, copied 2725 00000080:00200000:0.0:1788201594.392732:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b83f8ed9[3 00000000e2bd2472 2 1 0000000005f45737 0 0 1] 00000080:00200000:0.0:1788201594.392735:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008b5621ad 17ffffc0001021 2:0 ffff8bc1440262a0 1 lru 00000080:00200000:0.0:1788201594.392741:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000011ac7a8d 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 00000000dc1d7463 > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.392743:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b83f8ed9 00000080:00200000:0.0:1788201594.392744:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:0.0:1788201594.392747:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 2, from 0, to 2725 prio 0 00000008:00010000:0.0:1788201594.392771:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 000000007e2782b1 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201594.392845:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459b2bb8, count 2, dirtied 2 00000080:00200000:0.0:1788201594.392851:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 2 pages 6821 bytes, tot: 6821 00000080:00200000:0.0:1788201594.392855:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) sanity-dom.sh: write bytes 0, result: 6821 00000020:00010000:0.0:1788201594.392877:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc148fb1998 (ffff8bc1499c46c8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201594.392880:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc148fb1998 (ffff8bc1499c46c8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.392884:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456e30 (ffff8bc1499c4518/1) at cl_lock_cancel():142 00010000:00010000:0.0:1788201594.392890:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.392900:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1788201594.392919:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc148fb1998 (ffff8bc1499c46c8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201594.392922:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456e30 (ffff8bc1499c46c8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201594.392931:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 6821 bytes 00000080:00200000:0.0:1788201594.392941:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 1] 00000080:00200000:0.0:1788201594.392978:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x192:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201594.392983:0:24470:0:(file.c:2238:ll_file_io_generic()) sanity-dom.sh: 2 io complete with rc: 0, result: 6821, restart: 0 00000080:00200000:0.0:1788201594.392990:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x192:0x0] updating i_size 6821 i_blocks 1 00000080:00200000:0.0:1788201594.392996:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 6821 00000080:00200008:0.0:1788201594.393048:0:24470:0:(file.c:479:ll_file_release()) START file sanity-dom.sh:[0x200000bd7:0x192:0x0](ffff8bc1459b2a08), flags 100001 00000002:00100000:0.0:1788201594.393120:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc172649c00 x1875064728007168/t8589937446(8589937446) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1788201594.393134:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1788201594.393153:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172648a80 x1875064728007808/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1788201594.393185:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172648a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728007808:192.168.201.143@tcp:35:cp.0 00000100:00100000:0.0:1788201594.393276:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1467050c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.397592:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172648a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728007808:192.168.201.143@tcp:35:cp.0 00000002:00100000:0.0:1788201594.397636:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc172649c00 x1875064728007168/t8589937446(8589937446) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201594.397732:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201594.397759:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.397783:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 223 lru_type: 1 00010000:00010000:1.0:1788201594.398150:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 223 lru_type: 1 00000080:00200000:1.0:1788201594.398163:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.398172:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201594.398176:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201594.398186:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201594.398190:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 223 lru_type: 1 00010000:00010000:1.0:1788201594.398201:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 224 lru_type: 1 00000080:00200000:1.0:1788201594.398222:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.398231:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201594.398237:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.398241:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-dom.sh, flags=8 00000080:00200008:1.0:1788201594.398251:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-dom.sh:[0x200000bd7:0x192:0x0](ffff8bc1459b2a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201594.398257:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x192:0x0](ffff8bc1459b2a08),name=sanity-dom.sh 00000002:00010000:1.0:1788201594.398271:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x192:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.398280:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097e49 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201594.398289:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097e49 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201594.398295:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.398300:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x192:0x0](ffff8bc1459b2a08) 00000080:00010000:1.0:1788201594.398303:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x192:0x0](ffff8bc1459b2a08) for lock 0xd138388016f6f67c 00000080:00010000:1.0:1788201594.398307:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f67c from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201594.398310:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097e49 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201594.398319:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097e49 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201594.398384:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x192:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201594.398396:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x192:0x0] 00000008:00010000:1.0:1788201594.398435:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201594.398439:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4cb0, osc lock ffff8bc145d08260, flags 0x400001002 00010000:00010000:1.0:1788201594.398460:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.398473:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201594.398488:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201594.398493:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.398502:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201594.398514:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201594.398524:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x192:0x0] updating i_size 6821 i_blocks 1 00000020:00010000:1.0:1788201594.398541:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e25280 (ffff8bc148e3b3f8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201594.398545:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e25280 (ffff8bc148e3b3f8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201594.398548:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4cb0 (ffff8bc148e3ba28/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201594.398552:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e25280 (ffff8bc148e3b3f8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201594.398555:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4cb0 (ffff8bc148e3b3f8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201594.398588:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x192:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201594.398655:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201594.398663:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.398671:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 224 lru_type: 1 00010000:00010000:1.0:1788201594.398681:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 224 lru_type: 1 00000080:00200000:1.0:1788201594.398689:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.398693:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201594.398696:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201594.398700:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201594.398703:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 224 lru_type: 1 00010000:00010000:1.0:1788201594.398711:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 225 lru_type: 1 00000080:00200000:1.0:1788201594.398720:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.398725:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201594.398728:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.398744:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-ec.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201594.398748:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-ec.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201594.398760:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-ec.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201594.398862:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e200/0xd138388016f6f691 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.398872:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e200/0xd138388016f6f691 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.398884:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e200/0xd138388016f6f691 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201594.398913:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146028a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728007936:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201594.399142:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201594.404084:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146028a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728007936:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201594.404127:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e200/0xd138388016f6f691 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.404153:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e200/0xd138388016f6f691 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.404161:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e200/0xd138388016f6f691 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.404169:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e200/0xd138388016f6f691 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.404180:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e200/0xd138388016f6f691 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.404187:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17261e200 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201594.404193:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e200/0xd138388016f6f691 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.404200:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e200/0xd138388016f6f691 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.404209:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e200/0xd138388016f6f691 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.404217:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201594.404225:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e200/0xd138388016f6f691 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.404233:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e200/0xd138388016f6f691 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201594.404263:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc146028a80 x1875064728007936/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201594.404282:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201594.404315:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201594.404402:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201594.404420:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.404432:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 225 lru_type: 1 00010000:00010000:1.0:1788201594.404444:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 225 lru_type: 1 00000080:00200000:1.0:1788201594.404451:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.404456:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201594.404460:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201594.404466:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201594.404470:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 225 lru_type: 1 00010000:00010000:1.0:1788201594.404478:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 226 lru_type: 1 00000080:00200000:1.0:1788201594.404495:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.404503:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201594.404509:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.404524:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-ec.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:1.0:1788201594.405351:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-ec.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201594.405624:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-ec.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201594.405693:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fa00/0xd138388016f6f698 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.405702:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fa00/0xd138388016f6f698 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.405714:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fa00/0xd138388016f6f698 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201594.405744:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146028a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728008064:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201594.406168:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.409388:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728007552:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788201594.409578:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146028a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728008064:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201594.409601:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fa00/0xd138388016f6f698 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.409617:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fa00/0xd138388016f6f698 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.409628:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fa00/0xd138388016f6f698 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.409636:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fa00/0xd138388016f6f698 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.409647:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fa00/0xd138388016f6f698 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.409655:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17261fa00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:2.0:1788201594.409660:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fa00/0xd138388016f6f698 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.409668:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fa00/0xd138388016f6f698 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.409675:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fa00/0xd138388016f6f698 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.409684:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201594.409692:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fa00/0xd138388016f6f698 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.409699:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fa00/0xd138388016f6f698 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201594.409722:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc146028a80 x1875064728008064/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201594.409739:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1788201594.409770:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201594.409955:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201594.409975:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.409987:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 226 lru_type: 1 00010000:00010000:2.0:1788201594.410001:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 226 lru_type: 1 00000080:00200000:2.0:1788201594.410009:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.410015:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201594.410020:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201594.410026:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:2.0:1788201594.410031:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 226 lru_type: 1 00010000:00010000:2.0:1788201594.410041:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 227 lru_type: 1 00000080:00200000:2.0:1788201594.410060:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.410070:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201594.410077:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.410093:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1788201594.410099:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sanity-ec.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14c595500, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:2.0:1788201594.410108:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-ec.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:2.0:1788201594.410149:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-ec.sh,[0x200000bd7:0x193:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:2.0:1788201594.410222:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.410235:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1788201594.410251:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1788201594.410259:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a3480 x1875064728008320/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1788201594.410269:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.410298:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a3480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728008320:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201594.410485:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc153920e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201594.416196:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a3480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728008320:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201594.416238:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097ea4 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.416272:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097ea4 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.416282:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097ea4 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.416297:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097ea4 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.416311:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097ea4 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.416333:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097ea4 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.416342:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097ea4 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.416351:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097ea4 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201594.416375:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1724a3480 x1875064728008320/t8589937448(8589937448) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1788201594.416391:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a3480 x1875064728008320/t8589937448(8589937448) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1788201594.416409:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097ea4 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1788201594.416424:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097ea4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.416436:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/403 (0 0) 00000080:00200000:2.0:1788201594.416444:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1788201594.416463:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=sanity-ec.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:2.0:1788201594.416500:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x193:0x0](ffff8bc1459f4b08) 00000080:00200000:2.0:1788201594.416646:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x193:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1788201594.416655:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x193:0x0](ffff8bc1459f4b08) 00000080:00010000:2.0:1788201594.416660:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x193:0x0](ffff8bc1459f4b08) for lock 0xd138388016f6f69f 00000080:00010000:2.0:1788201594.416671:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x193:0x0](ffff8bc1459f4b08) 00000080:00200008:2.0:1788201594.416687:0:24470:0:(file.c:1090:ll_file_open()) START file sanity-ec.sh:[0x200000bd7:0x193:0x0](ffff8bc1459f4b08), flags 100301 00000002:00100000:2.0:1788201594.416707:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a3480 x1875064728008320/t8589937448(8589937448) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1788201594.416757:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f69f from it ffff8bc1507dbae0 00010000:00010000:2.0:1788201594.416762:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097ea4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.416773:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097ea4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201594.416829:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x193:0x0](ffff8bc1459f4b08), inode mode 81a4 mask 40 00000080:00200008:2.0:1788201594.416866:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-ec.sh:[0x200000bd7:0x193:0x0](ffff8bc1459f4b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1788201594.416872:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x193:0x0](ffff8bc1459f4b08),name=sanity-ec.sh 00000002:00010000:2.0:1788201594.416894:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x193:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.416907:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097ea4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.416920:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097ea4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201594.416928:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.416933:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x193:0x0](ffff8bc1459f4b08) 00000080:00010000:2.0:1788201594.416936:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x193:0x0](ffff8bc1459f4b08) for lock 0xd138388016f6f69f 00000080:00010000:2.0:1788201594.416939:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f69f from it ffffadd1c7debcd8 00010000:00010000:2.0:1788201594.416943:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097ea4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.416952:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097ea4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1788201594.416976:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x193:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201594.416985:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x193:0x0] 00000008:00010000:2.0:1788201594.417011:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201594.417014:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d3b0, osc lock ffff8bc151fc0850, flags 0x400001002 00010000:00010000:2.0:1788201594.417062:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f6a6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.417074:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f6a6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1788201594.417119:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1788201594.418503:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728008448:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201594.424473:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f6a6 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.424519:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f6a6 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097eb2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.424604:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f6a6 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097eb2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.424623:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f6a6 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097eb2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1788201594.424652:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f6a6 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097eb2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1788201594.424666:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:2.0:1788201594.424770:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f6a6 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097eb2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.424782:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f6a6 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097eb2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.424815:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f6a6 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097eb2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.424827:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f6a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171097eb2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1788201594.424854:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728008448:192.168.201.143@tcp:101:cp.0 00000080:00200000:1.0:1788201594.424972:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x193:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201594.424980:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc146005bc0 (ffff8bc146919b48/0) at cl_lock_release():245 00000020:00010000:1.0:1788201594.424983:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146005bc0 (ffff8bc146919b48/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201594.424990:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d3b0 (ffff8bc146919488/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201594.424995:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146005bc0 (ffff8bc146919b48/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201594.424998:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d3b0 (ffff8bc146919b48/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201594.425050:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x193:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201594.426924:0:24470:0:(file.c:2638:do_file_write_iter()) START file sanity-ec.sh:[0x200000bd7:0x193:0x0], ppos: 0, count: 116978 00000080:00200000:1.0:1788201594.426987:0:24470:0:(file.c:2090:ll_file_io_generic()) sanity-ec.sh: write ppos: 0, bytes: 116978 00000080:00200000:1.0:1788201594.426996:0:24470:0:(file.c:1848:ll_io_set_mirror()) sanity-ec.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201594.427006:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@0000000008f8b085[0x110, 1, [0x200000bd7:0x193:0x0] hash] 00000020:00200000:1.0:1788201594.427009:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 116978) 0 0 00000080:00200000:1.0:1788201594.427015:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x193:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201594.427030:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 28] 00020000:00200000:1.0:1788201594.427041:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 116978) 116978, 116978 00020000:00200000:1.0:1788201594.427046:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201594.427084:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 28] 00000008:00010000:1.0:1788201594.427113:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201594.427121:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4cb0, osc lock ffff8bc145d08260, flags 0x0 00010000:00010000:1.0:1788201594.427153:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/444 (0 118783) 00010000:00010000:1.0:1788201594.427224:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.427236:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->118783] (req 0->118783) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.427250:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->118783] (req 0->118783) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201594.427282:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728008576:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201594.427443:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201594.430573:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201594.430764:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743485440 00000100:00100000:1.0:1788201594.430777:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743485440 00000100:00100000:1.0:1788201594.430877:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 797 00000100:00100000:1.0:1788201594.430888:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23415:x1875064743485440:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201594.430910:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f6a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097eb2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.430997:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201594.431004:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23415:x1875064743485440:12345-192.168.201.143@tcp:104: Request processed in 119us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201594.431011:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 797 00010000:00010000:0.0:1788201594.431079:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201594.431089:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f6a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097eb2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.431099:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172472e00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201594.431106:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f6a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171097eb2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201594.431173:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x193:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201594.431187:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x193:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1788201594.431258:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f6a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097eb2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.431272:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201594.431311:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f6a6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097eb2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.431320:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c176d48c/0xd138388016f6f6a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097eb2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.431336:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201594.431338:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201594.431339:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201594.431348:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201594.431776:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17264b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728008704:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201594.437368:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201594.437564:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743485568 00000100:00100000:0.0:1788201594.437576:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743485568 00000100:00100000:0.0:1788201594.437654:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 798 00000100:00100000:0.0:1788201594.437667:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1726cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21003:x1875064743485568:12345-192.168.201.143@tcp:105: 00010000:00010000:0.0:1788201594.437694:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->118783] (req 0->118783) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.437712:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->118783] (req 0->118783) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.437724:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.437744:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.437758:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.437769:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.437826:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc17261e200) 00000100:00100000:0.0:1788201594.437901:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1726cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21003:x1875064743485568:12345-192.168.201.143@tcp:105: Request processed in 238us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201594.437909:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 798 00000100:00100000:1.0:1788201594.438033:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728008576:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201594.438060:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.438091:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201594.438107:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.438121:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.438129:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201594.438161:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) sanity-ec.sh: write [0, 116978) append 0 append lockpos 0 00000080:00200000:1.0:1788201594.438182:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.438249:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:1.0:1788201594.438262:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005337068a[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 0] 00000080:00200000:1.0:1788201594.438266:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000959773c3 17ffffc0001001 3:0 ffff8bc149f500e0 0 lru 00000080:00200000:1.0:1788201594.438274:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007281822b 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.438276:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005337068a 00000080:00200000:1.0:1788201594.438277:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201594.438281:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.438312:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:1.0:1788201594.438317:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d6ad1dd1[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 1] 00000080:00200000:1.0:1788201594.438320:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000039e91e7a 17ffffc0001001 3:0 ffff8bc149f509a0 1 lru 00000080:00200000:1.0:1788201594.438325:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000aa90ec84 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.438327:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d6ad1dd1 00000080:00200000:1.0:1788201594.438329:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:1.0:1788201594.438332:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.438373:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:1.0:1788201594.438378:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005ba7eb4c[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 2] 00000080:00200000:1.0:1788201594.438381:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000026649053 17ffffc0001021 2:0 ffff8bc149f50c40 2 lru 00000080:00200000:1.0:1788201594.438387:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000026f96494 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.438389:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005ba7eb4c 00000080:00200000:1.0:1788201594.438390:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:1.0:1788201594.438392:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.438409:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:1.0:1788201594.438413:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ddb306fe[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 3] 00000080:00200000:1.0:1788201594.438416:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000cc0cef48 17ffffc0001001 3:0 ffff8bc149f50b60 3 lru 00000080:00200000:1.0:1788201594.438422:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000684cfb11 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.438424:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ddb306fe 00000080:00200000:1.0:1788201594.438425:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:1.0:1788201594.438427:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.438444:0:24470:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:1.0:1788201594.438449:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000071e35a29[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 4] 00000080:00200000:1.0:1788201594.438452:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003e3ddc88 17ffffc0001001 3:0 ffff8bc149f502a0 4 lru 00000080:00200000:1.0:1788201594.438457:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000082412d1f 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.438459:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000071e35a29 00000080:00200000:1.0:1788201594.438461:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:1.0:1788201594.438463:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.438480:0:24470:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:1.0:1788201594.438484:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000057cf235d[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 5] 00000080:00200000:1.0:1788201594.438487:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000f40d02a 17ffffc0001001 3:0 ffff8bc149f50460 5 lru 00000080:00200000:1.0:1788201594.438492:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a57e9abb 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.438495:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000057cf235d 00000080:00200000:1.0:1788201594.438496:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:1.0:1788201594.438498:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.438515:0:24470:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:1.0:1788201594.438519:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ce4e3570[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 6] 00000080:00200000:1.0:1788201594.438522:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d5b0f3f5 17ffffc0001001 3:0 ffff8bc149f50d20 6 lru 00000080:00200000:1.0:1788201594.438527:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e1a5a383 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.438529:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ce4e3570 00000080:00200000:1.0:1788201594.438531:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:1.0:1788201594.438532:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.438549:0:24470:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:1.0:1788201594.438554:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005513189e[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 7] 00000080:00200000:1.0:1788201594.438557:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003ecf2abe 17ffffc0001001 3:0 ffff8bc149f50000 7 lru 00000080:00200000:1.0:1788201594.438562:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ed18c21f 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.438565:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005513189e 00000080:00200000:1.0:1788201594.438566:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:1.0:1788201594.438568:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.438584:0:24470:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:1.0:1788201594.438588:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004b8ac4ea[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 8] 00000080:00200000:1.0:1788201594.438591:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b7f33d2f 17ffffc0001001 3:0 ffff8bc149f50380 8 lru 00000080:00200000:1.0:1788201594.438596:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000470ce6a5 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.438599:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004b8ac4ea 00000080:00200000:1.0:1788201594.438600:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:1.0:1788201594.438602:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.438616:0:24470:0:(rw26.c:898:ll_write_end()) pos 36864, len 4096, copied 4096 00000080:00200000:1.0:1788201594.438620:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002da566d7[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 9] 00000080:00200000:1.0:1788201594.438624:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003f9ed31e 17ffffc0001001 3:0 ffff8bc149f501c0 9 lru 00000080:00200000:1.0:1788201594.438629:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000050d3dc0f 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.438632:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002da566d7 00000080:00200000:1.0:1788201594.438633:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:1.0:1788201594.438635:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 10 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.438653:0:24470:0:(rw26.c:898:ll_write_end()) pos 40960, len 4096, copied 4096 00000080:00200000:1.0:1788201594.438657:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e3687ea5[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 10] 00000080:00200000:1.0:1788201594.438660:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000bb8bf80a 17ffffc0001001 3:0 ffff8bc149f50540 10 lru 00000080:00200000:1.0:1788201594.438665:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a2fd455f 10: 1< 0 - - > 2< 40960 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.438668:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e3687ea5 00000080:00200000:1.0:1788201594.438669:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 11. 00000080:00200000:1.0:1788201594.438672:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 11 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.438686:0:24470:0:(rw26.c:898:ll_write_end()) pos 45056, len 4096, copied 4096 00000080:00200000:1.0:1788201594.438691:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b420fbfd[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 11] 00000080:00200000:1.0:1788201594.438693:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d54a76f6 17ffffc0001001 3:0 ffff8bc149f508c0 11 lru 00000080:00200000:1.0:1788201594.438698:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b5cb8152 11: 1< 0 - - > 2< 45056 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.438700:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b420fbfd 00000080:00200000:1.0:1788201594.438701:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 12. 00000080:00200000:1.0:1788201594.438703:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 12 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.438718:0:24470:0:(rw26.c:898:ll_write_end()) pos 49152, len 4096, copied 4096 00000080:00200000:1.0:1788201594.438722:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f22d00e3[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 12] 00000080:00200000:1.0:1788201594.438725:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000007cecd95 17ffffc0001001 3:0 ffff8bc149f50e00 12 lru 00000080:00200000:1.0:1788201594.438731:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003e81feba 12: 1< 0 - - > 2< 49152 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.438732:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f22d00e3 00000080:00200000:1.0:1788201594.438734:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 13. 00000080:00200000:1.0:1788201594.438736:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 13 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.438758:0:24470:0:(rw26.c:898:ll_write_end()) pos 53248, len 4096, copied 4096 00000080:00200000:1.0:1788201594.438762:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b93ce946[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 13] 00000080:00200000:1.0:1788201594.438764:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001b76d4ae 17ffffc0001001 3:0 ffff8bc149f50ee0 13 lru 00000080:00200000:1.0:1788201594.438768:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000258a9001 13: 1< 0 - - > 2< 53248 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.438770:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b93ce946 00000080:00200000:1.0:1788201594.438771:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 14. 00000080:00200000:1.0:1788201594.438772:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 14 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.438788:0:24470:0:(rw26.c:898:ll_write_end()) pos 57344, len 4096, copied 4096 00000080:00200000:1.0:1788201594.438838:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008c0964d5[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 14] 00000080:00200000:1.0:1788201594.438841:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000006dd58ff 17ffffc0001001 3:0 ffff8bc149f50620 14 lru 00000080:00200000:1.0:1788201594.438846:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000110c2fbc 14: 1< 0 - - > 2< 57344 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.438848:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008c0964d5 00000080:00200000:1.0:1788201594.438849:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 15. 00000080:00200000:1.0:1788201594.438851:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 15 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.438869:0:24470:0:(rw26.c:898:ll_write_end()) pos 61440, len 4096, copied 4096 00000080:00200000:1.0:1788201594.438873:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001d5417f2[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 15] 00000080:00200000:1.0:1788201594.438875:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009e31f733 17ffffc0001001 3:0 ffff8bc149f507e0 15 lru 00000080:00200000:1.0:1788201594.438881:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000da525864 15: 1< 0 - - > 2< 61440 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.438882:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001d5417f2 00000080:00200000:1.0:1788201594.438883:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 16. 00000080:00200000:1.0:1788201594.438886:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 16 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.438900:0:24470:0:(rw26.c:898:ll_write_end()) pos 65536, len 4096, copied 4096 00000080:00200000:1.0:1788201594.438903:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007581f16d[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 16] 00000080:00200000:1.0:1788201594.438906:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000067a7ce0 17ffffc0001001 3:0 ffff8bc149f50700 16 lru 00000080:00200000:1.0:1788201594.438910:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008bf5bc6a 16: 1< 0 - - > 2< 65536 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.438912:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007581f16d 00000080:00200000:1.0:1788201594.438913:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 17. 00000080:00200000:1.0:1788201594.438915:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 17 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.438936:0:24470:0:(rw26.c:898:ll_write_end()) pos 69632, len 4096, copied 4096 00000080:00200000:1.0:1788201594.438940:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e7ba1488[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 17] 00000080:00200000:1.0:1788201594.438943:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000812f078d 17ffffc0001021 2:0 ffff8bc149e881c0 17 lru 00000080:00200000:1.0:1788201594.438947:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006af13576 17: 1< 0 - - > 2< 69632 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.438949:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e7ba1488 00000080:00200000:1.0:1788201594.438950:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 18. 00000080:00200000:1.0:1788201594.438952:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 18 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.438967:0:24470:0:(rw26.c:898:ll_write_end()) pos 73728, len 4096, copied 4096 00000080:00200000:1.0:1788201594.438970:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000029b8b282[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 18] 00000080:00200000:1.0:1788201594.438973:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000badd9ec 17ffffc0001001 3:0 ffff8bc149e880e0 18 lru 00000080:00200000:1.0:1788201594.438978:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ac575bf8 18: 1< 0 - - > 2< 73728 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.438980:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000029b8b282 00000080:00200000:1.0:1788201594.438981:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 19. 00000080:00200000:1.0:1788201594.438982:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 19 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.438995:0:24470:0:(rw26.c:898:ll_write_end()) pos 77824, len 4096, copied 4096 00000080:00200000:1.0:1788201594.438999:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c102fc83[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 19] 00000080:00200000:1.0:1788201594.439002:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000fdb63f4e 17ffffc0001001 3:0 ffff8bc149e889a0 19 lru 00000080:00200000:1.0:1788201594.439007:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000035bc754a 19: 1< 0 - - > 2< 77824 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.439010:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c102fc83 00000080:00200000:1.0:1788201594.439011:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 20. 00000080:00200000:1.0:1788201594.439013:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 20 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.439032:0:24470:0:(rw26.c:898:ll_write_end()) pos 81920, len 4096, copied 4096 00000080:00200000:1.0:1788201594.439037:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007da6f78c[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 20] 00000080:00200000:1.0:1788201594.439040:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002bd4b345 17ffffc0001001 3:0 ffff8bc149e88c40 20 lru 00000080:00200000:1.0:1788201594.439046:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009538aa87 20: 1< 0 - - > 2< 81920 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.439048:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007da6f78c 00000080:00200000:1.0:1788201594.439049:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 21. 00000080:00200000:1.0:1788201594.439051:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 21 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.439067:0:24470:0:(rw26.c:898:ll_write_end()) pos 86016, len 4096, copied 4096 00000080:00200000:1.0:1788201594.439072:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d5baaa15[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 21] 00000080:00200000:1.0:1788201594.439074:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f2b3caf0 17ffffc0001001 3:0 ffff8bc149e88a80 21 lru 00000080:00200000:1.0:1788201594.439080:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ac6dd5bf 21: 1< 0 - - > 2< 86016 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.439082:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d5baaa15 00000080:00200000:1.0:1788201594.439083:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 22. 00000080:00200000:1.0:1788201594.439085:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 22 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.439100:0:24470:0:(rw26.c:898:ll_write_end()) pos 90112, len 4096, copied 4096 00000080:00200000:1.0:1788201594.439105:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000025e710f1[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 22] 00000080:00200000:1.0:1788201594.439107:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000081fada22 17ffffc0001001 3:0 ffff8bc149e88540 22 lru 00000080:00200000:1.0:1788201594.439113:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a937c7ba 22: 1< 0 - - > 2< 90112 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.439115:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000025e710f1 00000080:00200000:1.0:1788201594.439116:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 23. 00000080:00200000:1.0:1788201594.439118:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 23 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.439134:0:24470:0:(rw26.c:898:ll_write_end()) pos 94208, len 4096, copied 4096 00000080:00200000:1.0:1788201594.439139:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009d696375[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 23] 00000080:00200000:1.0:1788201594.439141:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b40ef6c8 17ffffc0001001 3:0 ffff8bc149e888c0 23 lru 00000080:00200000:1.0:1788201594.439146:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f0cf9647 23: 1< 0 - - > 2< 94208 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.439148:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009d696375 00000080:00200000:1.0:1788201594.439150:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 24. 00000080:00200000:1.0:1788201594.439152:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 24 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.439166:0:24470:0:(rw26.c:898:ll_write_end()) pos 98304, len 4096, copied 4096 00000080:00200000:1.0:1788201594.439171:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000030ad2329[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 24] 00000080:00200000:1.0:1788201594.439174:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003b4da940 17ffffc0001001 3:0 ffff8bc149e88e00 24 lru 00000080:00200000:1.0:1788201594.439180:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000bf7078dd 24: 1< 0 - - > 2< 98304 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.439182:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000030ad2329 00000080:00200000:1.0:1788201594.439183:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 25. 00000080:00200000:1.0:1788201594.439185:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 25 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.439201:0:24470:0:(rw26.c:898:ll_write_end()) pos 102400, len 4096, copied 4096 00000080:00200000:1.0:1788201594.439206:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000039e990e3[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 25] 00000080:00200000:1.0:1788201594.439208:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007346173b 17ffffc0001001 3:0 ffff8bc149e88ee0 25 lru 00000080:00200000:1.0:1788201594.439214:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000093a8e0f0 25: 1< 0 - - > 2< 102400 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.439216:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000039e990e3 00000080:00200000:1.0:1788201594.439217:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 26. 00000080:00200000:1.0:1788201594.439219:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 26 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.439235:0:24470:0:(rw26.c:898:ll_write_end()) pos 106496, len 4096, copied 4096 00000080:00200000:1.0:1788201594.439240:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008a026f39[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 26] 00000080:00200000:1.0:1788201594.439244:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000047c9f231 17ffffc0001001 3:0 ffff8bc149e88620 26 lru 00000080:00200000:1.0:1788201594.439249:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000067b4de9d 26: 1< 0 - - > 2< 106496 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.439252:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008a026f39 00000080:00200000:1.0:1788201594.439253:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 27. 00000080:00200000:1.0:1788201594.439255:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 27 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.439273:0:24470:0:(rw26.c:898:ll_write_end()) pos 110592, len 4096, copied 4096 00000080:00200000:1.0:1788201594.439278:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000bebcff08[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 27] 00000080:00200000:1.0:1788201594.439281:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c1ccbc6c 17ffffc0001001 3:0 ffff8bc149e887e0 27 lru 00000080:00200000:1.0:1788201594.439286:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c1f3cf85 27: 1< 0 - - > 2< 110592 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.439289:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000bebcff08 00000080:00200000:1.0:1788201594.439290:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 28. 00000080:00200000:1.0:1788201594.439292:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 28 of 0 to 2290 bytes 00000080:00200000:1.0:1788201594.439318:0:24470:0:(rw26.c:898:ll_write_end()) pos 114688, len 2290, copied 2290 00000080:00200000:1.0:1788201594.439322:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003738f284[3 00000000cf3e3dde 2 1 00000000b8d441ae 0 0 28] 00000080:00200000:1.0:1788201594.439325:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000061c1b141 17ffffc0001001 3:0 ffff8bc149e88700 28 lru 00000080:00200000:1.0:1788201594.439331:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000004959ba5 28: 1< 0 - - > 2< 114688 0 0 0x0 0x0 | 000000008930e75a 00000000683930a5 > 3< 0 0 > 4< 0 0 8 23855104 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.439333:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003738f284 00000080:00200000:1.0:1788201594.439335:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 29. 00000080:00200000:1.0:1788201594.439339:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 29, from 0, to 2290 prio 0 00000008:00010000:1.0:1788201594.439382:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000911ee68f ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201594.439417:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459f4cb8, count 15, dirtied 15 00000080:00200000:1.0:1788201594.439433:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459f4cb8, count 14, dirtied 14 00000080:00200000:1.0:1788201594.439438:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 29 pages 116978 bytes, tot: 116978 00000080:00200000:1.0:1788201594.439441:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) sanity-ec.sh: write bytes 0, result: 116978 00000020:00010000:1.0:1788201594.439461:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c4d58 (ffff8bc148e3b3f8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201594.439464:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c4d58 (ffff8bc148e3b3f8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201594.439468:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4cb0 (ffff8bc148e3ba28/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201594.439475:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.439486:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201594.439506:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c4d58 (ffff8bc148e3b3f8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201594.439509:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4cb0 (ffff8bc148e3b3f8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201594.439521:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 116978 bytes 00000080:00200000:1.0:1788201594.439530:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 28] 00000080:00200000:1.0:1788201594.439572:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x193:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201594.439577:0:24470:0:(file.c:2238:ll_file_io_generic()) sanity-ec.sh: 2 io complete with rc: 0, result: 116978, restart: 0 00000080:00200000:1.0:1788201594.439586:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x193:0x0] updating i_size 116978 i_blocks 1 00000080:00200000:1.0:1788201594.439592:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 116978 00000080:00200008:1.0:1788201594.439648:0:24470:0:(file.c:479:ll_file_release()) START file sanity-ec.sh:[0x200000bd7:0x193:0x0](ffff8bc1459f4b08), flags 100001 00000002:00100000:1.0:1788201594.439723:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1724a3480 x1875064728008320/t8589937448(8589937448) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201594.439743:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201594.439750:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14602b100 x1875064728008960/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201594.439777:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728008960:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201594.439889:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150fa0000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201594.452370:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602b100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728008960:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201594.452414:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1724a3480 x1875064728008320/t8589937448(8589937448) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201594.452515:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201594.453269:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.453295:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 227 lru_type: 1 00010000:00010000:1.0:1788201594.453312:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 227 lru_type: 1 00000080:00200000:1.0:1788201594.453320:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.453330:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201594.453334:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201594.453344:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201594.453349:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 227 lru_type: 1 00010000:00010000:1.0:1788201594.453373:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 228 lru_type: 1 00000080:00200000:1.0:1788201594.453397:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.453408:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201594.453415:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.453418:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-ec.sh, flags=8 00000080:00200008:1.0:1788201594.453428:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-ec.sh:[0x200000bd7:0x193:0x0](ffff8bc1459f4b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201594.453433:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x193:0x0](ffff8bc1459f4b08),name=sanity-ec.sh 00000002:00010000:1.0:1788201594.453449:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x193:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.453458:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097ea4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201594.453466:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097ea4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201594.453473:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.453477:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x193:0x0](ffff8bc1459f4b08) 00000080:00010000:1.0:1788201594.453480:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x193:0x0](ffff8bc1459f4b08) for lock 0xd138388016f6f69f 00000080:00010000:1.0:1788201594.453484:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f69f from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201594.453487:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097ea4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201594.453495:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097ea4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201594.454463:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x193:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201594.454479:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x193:0x0] 00000008:00010000:1.0:1788201594.454518:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201594.454523:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4cb0, osc lock ffff8bc145d08260, flags 0x400001002 00010000:00010000:1.0:1788201594.455441:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.455466:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201594.455482:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201594.455488:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.455498:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201594.455513:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201594.455526:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x193:0x0] updating i_size 116978 i_blocks 1 00000020:00010000:1.0:1788201594.455838:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e25280 (ffff8bc148e3b3f8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201594.455843:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e25280 (ffff8bc148e3b3f8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201594.455848:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4cb0 (ffff8bc148e3ba28/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201594.455852:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e25280 (ffff8bc148e3b3f8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201594.455855:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4cb0 (ffff8bc148e3b3f8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201594.455901:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x193:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201594.455994:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201594.456017:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.456030:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 228 lru_type: 1 00010000:00010000:1.0:1788201594.456041:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 228 lru_type: 1 00000080:00200000:1.0:1788201594.456051:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.456069:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201594.456074:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201594.456080:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201594.456084:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 228 lru_type: 1 00010000:00010000:1.0:1788201594.456100:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 229 lru_type: 1 00000080:00200000:1.0:1788201594.456113:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.456120:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201594.456126:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.456150:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-flr.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201594.456155:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-flr.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201594.456170:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-flr.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201594.456237:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e000/0xd138388016f6f6b4 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.456245:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e000/0xd138388016f6f6b4 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.456258:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e000/0xd138388016f6f6b4 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201594.456293:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602a680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728009088:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201594.456454:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150fa0000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201594.463321:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602a680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728009088:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201594.463365:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e000/0xd138388016f6f6b4 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.463382:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e000/0xd138388016f6f6b4 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.463388:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e000/0xd138388016f6f6b4 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.463396:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e000/0xd138388016f6f6b4 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.463406:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e000/0xd138388016f6f6b4 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.463412:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17261e000 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201594.463418:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e000/0xd138388016f6f6b4 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.463425:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e000/0xd138388016f6f6b4 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.463432:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e000/0xd138388016f6f6b4 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.463440:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201594.463447:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e000/0xd138388016f6f6b4 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.463453:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e000/0xd138388016f6f6b4 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201594.463479:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14602a680 x1875064728009088/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201594.463498:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201594.463541:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201594.463623:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201594.463639:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.463650:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 229 lru_type: 1 00010000:00010000:1.0:1788201594.463664:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 229 lru_type: 1 00000080:00200000:1.0:1788201594.463671:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.463677:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201594.463680:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201594.463686:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201594.463690:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 229 lru_type: 1 00010000:00010000:1.0:1788201594.463699:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 230 lru_type: 1 00000080:00200000:1.0:1788201594.463718:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.463727:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201594.463734:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.463749:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-flr.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:1.0:1788201594.463755:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-flr.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201594.463769:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-flr.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201594.463863:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f6bb lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.463871:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f6bb lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.463883:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f6bb lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201594.463909:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602a680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728009216:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201594.464115:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150fa0000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.470159:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17264b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728008704:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201594.472400:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602a680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728009216:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201594.472427:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f6bb lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.472443:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f6bb lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.472451:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f6bb lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.472459:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f6bb lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.472469:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f6bb lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.472477:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17261e600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201594.472482:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f6bb lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.472491:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f6bb lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.472499:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f6bb lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.472506:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201594.472514:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f6bb lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.472522:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f6bb lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201594.472560:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc14602a680 x1875064728009216/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201594.472580:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201594.472614:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201594.472749:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201594.472767:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.472778:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 230 lru_type: 1 00010000:00010000:1.0:1788201594.472814:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 230 lru_type: 1 00000080:00200000:1.0:1788201594.472824:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.472830:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201594.472834:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201594.472840:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:1.0:1788201594.472844:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 230 lru_type: 1 00010000:00010000:1.0:1788201594.472853:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 231 lru_type: 1 00000080:00200000:1.0:1788201594.472871:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.472880:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201594.472886:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.472901:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201594.472908:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sanity-flr.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14304a000, open_flags 80c1, mode 81ed opened 0 00000080:00200000:1.0:1788201594.472918:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-flr.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:1.0:1788201594.472940:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-flr.sh,[0x200000bd7:0x194:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201594.473001:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.473008:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201594.473022:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201594.473030:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc14602a680 x1875064728009472/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201594.473040:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201594.473066:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc14602a680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728009472:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201594.473278:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150fa0000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201594.478093:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc14602a680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728009472:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201594.478128:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097eff expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.478167:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x194:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097eff expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.478177:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097eff expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.478190:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097eff expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.478204:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097eff expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.478221:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097eff expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.478230:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097eff expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.478238:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097eff expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201594.478252:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc14602a680 x1875064728009472/t8589937450(8589937450) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201594.478267:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14602a680 x1875064728009472/t8589937450(8589937450) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201594.478283:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097eff expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201594.478297:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097eff expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.478310:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/404 (0 0) 00000080:00200000:1.0:1788201594.478318:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201594.478335:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=sanity-flr.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:1.0:1788201594.478396:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x194:0x0](ffff8bc14592e3c8) 00000080:00200000:1.0:1788201594.478554:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x194:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201594.478566:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x194:0x0](ffff8bc14592e3c8) 00000080:00010000:1.0:1788201594.478569:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x194:0x0](ffff8bc14592e3c8) for lock 0xd138388016f6f6c2 00000080:00010000:1.0:1788201594.478583:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x194:0x0](ffff8bc14592e3c8) 00000080:00200008:1.0:1788201594.478600:0:24470:0:(file.c:1090:ll_file_open()) START file sanity-flr.sh:[0x200000bd7:0x194:0x0](ffff8bc14592e3c8), flags 100301 00000002:00100000:1.0:1788201594.478623:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc14602a680 x1875064728009472/t8589937450(8589937450) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201594.478672:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f6c2 from it ffff8bc1466cd360 00010000:00010000:1.0:1788201594.478677:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097eff expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.478688:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097eff expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201594.478721:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x194:0x0](ffff8bc14592e3c8), inode mode 81ed mask 40 00000080:00200008:1.0:1788201594.478755:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-flr.sh:[0x200000bd7:0x194:0x0](ffff8bc14592e3c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201594.478762:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x194:0x0](ffff8bc14592e3c8),name=sanity-flr.sh 00000002:00010000:1.0:1788201594.478785:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x194:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.479361:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097eff expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.479376:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097eff expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201594.479384:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.479391:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x194:0x0](ffff8bc14592e3c8) 00000080:00010000:1.0:1788201594.479394:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x194:0x0](ffff8bc14592e3c8) for lock 0xd138388016f6f6c2 00000080:00010000:1.0:1788201594.479398:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f6c2 from it ffffadd1c7debcd8 00010000:00010000:1.0:1788201594.479402:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097eff expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.479409:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097eff expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201594.479441:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x194:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201594.479451:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x194:0x0] 00000008:00010000:1.0:1788201594.479482:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201594.479486:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4130, osc lock ffff8bc145d08260, flags 0x400001002 00010000:00010000:1.0:1788201594.480330:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f6c9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.480350:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f6c9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201594.480550:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146028a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728009600:192.168.201.143@tcp:101:cp.0 00000020:00200000:1.0:1788201594.480708:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1788201594.486689:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f6c9 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.486725:0:10054:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f6c9 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097f0d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.486742:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f6c9 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097f0d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.486762:0:10054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f6c9 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097f0d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201594.486780:0:10054:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f6c9 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097f0d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201594.486931:0:10054:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201594.486985:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f6c9 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097f0d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.486995:0:10054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f6c9 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097f0d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.487003:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f6c9 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097f0d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.487013:0:10054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f6c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171097f0d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201594.487040:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146028a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728009600:192.168.201.143@tcp:101:cp.0 00000080:00200000:1.0:1788201594.487274:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x194:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201594.487282:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e25280 (ffff8bc148e3b3f8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201594.487286:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e25280 (ffff8bc148e3b3f8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201594.487291:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4130 (ffff8bc148e3ba28/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201594.487296:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e25280 (ffff8bc148e3b3f8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201594.487299:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4130 (ffff8bc148e3b3f8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201594.487347:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x194:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201594.487646:0:24470:0:(file.c:2638:do_file_write_iter()) START file sanity-flr.sh:[0x200000bd7:0x194:0x0], ppos: 0, count: 143467 00000080:00200000:1.0:1788201594.487686:0:24470:0:(file.c:2090:ll_file_io_generic()) sanity-flr.sh: write ppos: 0, bytes: 143467 00000080:00200000:1.0:1788201594.487693:0:24470:0:(file.c:1848:ll_io_set_mirror()) sanity-flr.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201594.487699:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000e3d274e5[0x110, 1, [0x200000bd7:0x194:0x0] hash] 00000020:00200000:1.0:1788201594.487701:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 143467) 0 0 00000080:00200000:1.0:1788201594.487705:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x194:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201594.487719:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 35] 00020000:00200000:1.0:1788201594.487728:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 143467) 143467, 143467 00020000:00200000:1.0:1788201594.487732:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201594.487768:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 35] 00000008:00010000:1.0:1788201594.487782:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201594.487788:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4130, osc lock ffff8bc145d08260, flags 0x0 00010000:00010000:1.0:1788201594.487837:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/444 (0 147455) 00010000:00010000:1.0:1788201594.487887:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.487897:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->147455] (req 0->147455) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.487910:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->147455] (req 0->147455) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201594.487936:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc146028a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728009728:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201594.488763:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201594.491981:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201594.492062:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743485696 00000100:00100000:3.0:1788201594.492075:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743485696 00000100:00100000:3.0:1788201594.492151:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 799 00000100:00100000:3.0:1788201594.492163:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23408:x1875064743485696:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201594.492186:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f6c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097f0d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201594.492520:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201594.492528:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23408:x1875064743485696:12345-192.168.201.143@tcp:104: Request processed in 368us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201594.492546:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 799 00010000:00010000:3.0:1788201594.492572:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201594.492581:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f6c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097f0d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201594.492591:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17261e000 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201594.492599:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f6c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171097f0d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201594.492658:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x194:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201594.492674:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x194:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201594.492756:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f6c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097f0d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201594.492764:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201594.492808:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f6c9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097f0d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201594.492823:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f6c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097f0d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201594.492839:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201594.492841:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201594.492843:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201594.492863:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728009856:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201594.515158:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc146028a80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728009728:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201594.515202:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->147455] (req 0->147455) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.515226:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->147455] (req 0->147455) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.515236:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->147455] (req 0->147455) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201594.522195:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201594.522407:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743485824 00000100:00100000:2.0:1788201594.522422:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743485824 00000100:00100000:2.0:1788201594.522502:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 800 00000100:00100000:2.0:1788201594.522517:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17275bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21004:x1875064743485824:12345-192.168.201.143@tcp:105: 00010000:00010000:2.0:1788201594.522771:0:20877:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->147455] (req 0->147455) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.522825:0:20877:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->147455] (req 0->147455) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.522844:0:20877:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.523032:0:20877:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.523045:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.523057:0:20877:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.523085:0:20877:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc17261fa00) 00000100:00100000:2.0:1788201594.523176:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17275bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21004:x1875064743485824:12345-192.168.201.143@tcp:105: Request processed in 663us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201594.523185:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 800 00010000:00010000:0.0:1788201594.523257:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.523269:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.523286:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201594.523300:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.523315:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.523323:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201594.523372:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) sanity-flr.sh: write [0, 143467) append 0 append lockpos 0 00000080:00200000:0.0:1788201594.523395:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.523457:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:0.0:1788201594.523470:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000099779d9a[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 0] 00000080:00200000:0.0:1788201594.523474:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009876b430 17ffffc0001001 3:0 ffff8bc144026460 0 lru 00000080:00200000:0.0:1788201594.523493:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001b962c22 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.523495:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000099779d9a 00000080:00200000:0.0:1788201594.523496:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1788201594.523500:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.523527:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:0.0:1788201594.523639:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000093872d8[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 1] 00000080:00200000:0.0:1788201594.523642:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000073668a17 17ffffc0001001 3:0 ffff8bc144026d20 1 lru 00000080:00200000:0.0:1788201594.523648:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a5797e25 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.523650:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000093872d8 00000080:00200000:0.0:1788201594.523652:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:0.0:1788201594.523654:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.523739:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:0.0:1788201594.523744:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000086119a96[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 2] 00000080:00200000:0.0:1788201594.523747:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006ab238e0 17ffffc0001001 3:0 ffff8bc144026000 2 lru 00000080:00200000:0.0:1788201594.523752:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007fb62734 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.523754:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000086119a96 00000080:00200000:0.0:1788201594.523756:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:0.0:1788201594.523758:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.523775:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:0.0:1788201594.523779:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f8fb09df[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 3] 00000080:00200000:0.0:1788201594.523782:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000adc4389f 17ffffc0001001 3:0 ffff8bc144026380 3 lru 00000080:00200000:0.0:1788201594.523787:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000f156969 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.523836:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f8fb09df 00000080:00200000:0.0:1788201594.523838:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:0.0:1788201594.523840:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.524372:0:24470:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:0.0:1788201594.524378:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d0bcc36e[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 4] 00000080:00200000:0.0:1788201594.524381:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000bb630337 17ffffc0001001 3:0 ffff8bc1440261c0 4 lru 00000080:00200000:0.0:1788201594.524387:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000091910f75 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.524389:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d0bcc36e 00000080:00200000:0.0:1788201594.524390:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:0.0:1788201594.524392:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.524410:0:24470:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:0.0:1788201594.524415:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007fecdd61[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 5] 00000080:00200000:0.0:1788201594.524418:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b4bf8e6b 17ffffc0001001 3:0 ffff8bc1440260e0 5 lru 00000080:00200000:0.0:1788201594.524422:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000098c6dc32 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.524425:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007fecdd61 00000080:00200000:0.0:1788201594.524426:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:0.0:1788201594.524428:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.524446:0:24470:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:0.0:1788201594.524449:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000763b4c6f[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 6] 00000080:00200000:0.0:1788201594.524451:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f712687c 17ffffc0001001 3:0 ffff8bc1440269a0 6 lru 00000080:00200000:0.0:1788201594.524456:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000fb0e0e26 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.524458:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000763b4c6f 00000080:00200000:0.0:1788201594.524459:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:0.0:1788201594.524461:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.524473:0:24470:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:0.0:1788201594.524476:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006584504e[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 7] 00000080:00200000:0.0:1788201594.524491:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000764cf3bc 17ffffc0001001 3:0 ffff8bc144026c40 7 lru 00000080:00200000:0.0:1788201594.524496:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000070b16171 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.524499:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006584504e 00000080:00200000:0.0:1788201594.524500:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:0.0:1788201594.524502:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.524522:0:24470:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:0.0:1788201594.524527:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a6a08298[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 8] 00000080:00200000:0.0:1788201594.524652:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000087056f09 17ffffc0001001 3:0 ffff8bc144026a80 8 lru 00000080:00200000:0.0:1788201594.524657:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009251912e 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.524659:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a6a08298 00000080:00200000:0.0:1788201594.524661:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:0.0:1788201594.524663:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.524750:0:24470:0:(rw26.c:898:ll_write_end()) pos 36864, len 4096, copied 4096 00000080:00200000:0.0:1788201594.524755:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e3c2cbd6[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 9] 00000080:00200000:0.0:1788201594.524758:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000068fa839 17ffffc0001001 3:0 ffff8bc144026540 9 lru 00000080:00200000:0.0:1788201594.524763:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009cd8489c 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.524765:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e3c2cbd6 00000080:00200000:0.0:1788201594.524766:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:0.0:1788201594.524769:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 10 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.524820:0:24470:0:(rw26.c:898:ll_write_end()) pos 40960, len 4096, copied 4096 00000080:00200000:0.0:1788201594.524826:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000352ff5a9[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 10] 00000080:00200000:0.0:1788201594.524829:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000b6abdb5 17ffffc0001001 3:0 ffff8bc1440268c0 10 lru 00000080:00200000:0.0:1788201594.524834:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ccac3a2b 10: 1< 0 - - > 2< 40960 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.524836:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000352ff5a9 00000080:00200000:0.0:1788201594.524838:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 11. 00000080:00200000:0.0:1788201594.524840:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 11 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.525293:0:24470:0:(rw26.c:898:ll_write_end()) pos 45056, len 4096, copied 4096 00000080:00200000:0.0:1788201594.525298:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002c01d1cf[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 11] 00000080:00200000:0.0:1788201594.525301:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a85c47e1 17ffffc0001001 3:0 ffff8bc144026e00 11 lru 00000080:00200000:0.0:1788201594.525306:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000cd560326 11: 1< 0 - - > 2< 45056 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.525309:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002c01d1cf 00000080:00200000:0.0:1788201594.525311:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 12. 00000080:00200000:2.0:1788201594.526003:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 12 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.526036:0:24470:0:(rw26.c:898:ll_write_end()) pos 49152, len 4096, copied 4096 00000080:00200000:2.0:1788201594.526042:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000037a95e99[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 12] 00000080:00200000:2.0:1788201594.526045:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ee08c691 17ffffc0001001 3:0 ffff8bc1506b37e0 12 lru 00000080:00200000:2.0:1788201594.526050:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b0629ac6 12: 1< 0 - - > 2< 49152 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.526052:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000037a95e99 00000080:00200000:2.0:1788201594.526055:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 13. 00000080:00200000:2.0:1788201594.526057:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 13 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.526076:0:24470:0:(rw26.c:898:ll_write_end()) pos 53248, len 4096, copied 4096 00000080:00200000:2.0:1788201594.526081:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b939155f[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 13] 00000080:00200000:2.0:1788201594.526084:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a9581b54 17ffffc0001001 3:0 ffff8bc1506b3700 13 lru 00000080:00200000:2.0:1788201594.526089:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007dc81fd0 13: 1< 0 - - > 2< 53248 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.526091:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b939155f 00000080:00200000:2.0:1788201594.526092:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 14. 00000080:00200000:2.0:1788201594.526094:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 14 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.526109:0:24470:0:(rw26.c:898:ll_write_end()) pos 57344, len 4096, copied 4096 00000080:00200000:2.0:1788201594.526114:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000083416958[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 14] 00000080:00200000:2.0:1788201594.526117:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d4d0450f 17ffffc0001001 3:0 ffff8bc1506b3b60 14 lru 00000080:00200000:2.0:1788201594.526122:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d4377136 14: 1< 0 - - > 2< 57344 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.526124:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000083416958 00000080:00200000:2.0:1788201594.526125:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 15. 00000080:00200000:2.0:1788201594.526127:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 15 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.526143:0:24470:0:(rw26.c:898:ll_write_end()) pos 61440, len 4096, copied 4096 00000080:00200000:2.0:1788201594.526148:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005a4f37b0[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 15] 00000080:00200000:2.0:1788201594.526151:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000cae75f27 17ffffc0001001 3:0 ffff8bc1506b32a0 15 lru 00000080:00200000:2.0:1788201594.526156:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a8742f6e 15: 1< 0 - - > 2< 61440 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.526159:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005a4f37b0 00000080:00200000:2.0:1788201594.526160:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 16. 00000080:00200000:2.0:1788201594.526162:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 16 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.526178:0:24470:0:(rw26.c:898:ll_write_end()) pos 65536, len 4096, copied 4096 00000080:00200000:2.0:1788201594.526182:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006d655b4a[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 16] 00000080:00200000:2.0:1788201594.526185:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b64a86ce 17ffffc0001001 3:0 ffff8bc1506b3460 16 lru 00000080:00200000:2.0:1788201594.526191:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000074e965 16: 1< 0 - - > 2< 65536 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.526193:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006d655b4a 00000080:00200000:2.0:1788201594.526194:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 17. 00000080:00200000:2.0:1788201594.526196:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 17 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.526215:0:24470:0:(rw26.c:898:ll_write_end()) pos 69632, len 4096, copied 4096 00000080:00200000:2.0:1788201594.526219:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000930bf6b8[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 17] 00000080:00200000:2.0:1788201594.526222:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b94d87c5 17ffffc0001001 3:0 ffff8bc1506b3d20 17 lru 00000080:00200000:2.0:1788201594.526228:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007ab8f9fb 17: 1< 0 - - > 2< 69632 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.526230:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000930bf6b8 00000080:00200000:2.0:1788201594.526231:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 18. 00000080:00200000:2.0:1788201594.526234:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 18 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.526250:0:24470:0:(rw26.c:898:ll_write_end()) pos 73728, len 4096, copied 4096 00000080:00200000:2.0:1788201594.526255:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e310a5f4[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 18] 00000080:00200000:2.0:1788201594.526258:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000089066a1e 17ffffc0001001 3:0 ffff8bc1506b3000 18 lru 00000080:00200000:2.0:1788201594.526263:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e88d3623 18: 1< 0 - - > 2< 73728 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.526265:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e310a5f4 00000080:00200000:2.0:1788201594.526267:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 19. 00000080:00200000:2.0:1788201594.526269:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 19 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.526284:0:24470:0:(rw26.c:898:ll_write_end()) pos 77824, len 4096, copied 4096 00000080:00200000:2.0:1788201594.526289:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007d2a916e[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 19] 00000080:00200000:2.0:1788201594.526293:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c57e8445 17ffffc0001001 3:0 ffff8bc1506b3380 19 lru 00000080:00200000:2.0:1788201594.526298:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f09b96ea 19: 1< 0 - - > 2< 77824 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.526300:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007d2a916e 00000080:00200000:2.0:1788201594.526301:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 20. 00000080:00200000:2.0:1788201594.526303:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 20 of 0 to 4096 bytes 00000100:00100000:3.0:1788201594.527033:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728009856:192.168.201.143@tcp:103:ldlm_bl.0 00000080:00200000:2.0:1788201594.527422:0:24470:0:(rw26.c:898:ll_write_end()) pos 81920, len 4096, copied 4096 00000080:00200000:2.0:1788201594.527430:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000049e9e29f[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 20] 00000080:00200000:2.0:1788201594.527433:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d34657a7 17ffffc0001021 2:0 ffff8bc1506b31c0 20 lru 00000080:00200000:2.0:1788201594.527439:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000041a620ac 20: 1< 0 - - > 2< 81920 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.527440:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000049e9e29f 00000080:00200000:2.0:1788201594.527442:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 21. 00000080:00200000:2.0:1788201594.527445:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 21 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.527472:0:24470:0:(rw26.c:898:ll_write_end()) pos 86016, len 4096, copied 4096 00000080:00200000:2.0:1788201594.527768:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000186e9d3d[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 21] 00000080:00200000:2.0:1788201594.527772:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004be0ea7c 17ffffc0001001 3:0 ffff8bc1506b30e0 21 lru 00000080:00200000:2.0:1788201594.527777:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000062a244d4 21: 1< 0 - - > 2< 86016 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.527779:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000186e9d3d 00000080:00200000:2.0:1788201594.527782:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 22. 00000080:00200000:2.0:1788201594.527785:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 22 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.527824:0:24470:0:(rw26.c:898:ll_write_end()) pos 90112, len 4096, copied 4096 00000080:00200000:2.0:1788201594.527829:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002469d46e[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 22] 00000080:00200000:2.0:1788201594.527832:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000014fab724 17ffffc0001001 3:0 ffff8bc1506b39a0 22 lru 00000080:00200000:2.0:1788201594.527836:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ef7c36f1 22: 1< 0 - - > 2< 90112 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.527839:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002469d46e 00000080:00200000:2.0:1788201594.527840:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 23. 00000080:00200000:2.0:1788201594.527842:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 23 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.527871:0:24470:0:(rw26.c:898:ll_write_end()) pos 94208, len 4096, copied 4096 00000080:00200000:2.0:1788201594.527876:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000051cf82d4[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 23] 00000080:00200000:2.0:1788201594.527879:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000002865540 17ffffc0001001 3:0 ffff8bc1506b3c40 23 lru 00000080:00200000:2.0:1788201594.527884:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ac1d81ce 23: 1< 0 - - > 2< 94208 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.527886:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000051cf82d4 00000080:00200000:2.0:1788201594.527887:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 24. 00000080:00200000:2.0:1788201594.527889:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 24 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.527904:0:24470:0:(rw26.c:898:ll_write_end()) pos 98304, len 4096, copied 4096 00000080:00200000:2.0:1788201594.527908:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a438f740[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 24] 00000080:00200000:2.0:1788201594.527911:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000023347890 17ffffc0001001 3:0 ffff8bc1506b3a80 24 lru 00000080:00200000:2.0:1788201594.527916:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000022fcf13 24: 1< 0 - - > 2< 98304 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.527918:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a438f740 00000080:00200000:2.0:1788201594.527919:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 25. 00000080:00200000:2.0:1788201594.527921:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 25 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.527937:0:24470:0:(rw26.c:898:ll_write_end()) pos 102400, len 4096, copied 4096 00000080:00200000:2.0:1788201594.527941:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000fa03972b[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 25] 00000080:00200000:2.0:1788201594.527944:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000020e4b690 17ffffc0001001 3:0 ffff8bc1506b3540 25 lru 00000080:00200000:2.0:1788201594.527950:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000905e9bfe 25: 1< 0 - - > 2< 102400 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.527952:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000fa03972b 00000080:00200000:2.0:1788201594.527953:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 26. 00000080:00200000:2.0:1788201594.527955:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 26 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.527972:0:24470:0:(rw26.c:898:ll_write_end()) pos 106496, len 4096, copied 4096 00000080:00200000:2.0:1788201594.527976:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007924fd63[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 26] 00000080:00200000:2.0:1788201594.527980:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000cb5532ec 17ffffc0001001 3:0 ffff8bc1506b38c0 26 lru 00000080:00200000:2.0:1788201594.527985:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000bac22446 26: 1< 0 - - > 2< 106496 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.527988:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007924fd63 00000080:00200000:2.0:1788201594.527989:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 27. 00000080:00200000:2.0:1788201594.527991:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 27 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.528014:0:24470:0:(rw26.c:898:ll_write_end()) pos 110592, len 4096, copied 4096 00000080:00200000:2.0:1788201594.528019:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000055b6ff42[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 27] 00000080:00200000:2.0:1788201594.528022:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000096ecb1ab 17ffffc0001001 3:0 ffff8bc145cc5b60 27 lru 00000080:00200000:2.0:1788201594.528028:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000831a4c53 27: 1< 0 - - > 2< 110592 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.528030:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000055b6ff42 00000080:00200000:2.0:1788201594.528031:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 28. 00000080:00200000:2.0:1788201594.528033:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 28 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.528050:0:24470:0:(rw26.c:898:ll_write_end()) pos 114688, len 4096, copied 4096 00000080:00200000:2.0:1788201594.528054:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000029cd5b85[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 28] 00000080:00200000:2.0:1788201594.528057:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b0072f52 17ffffc0001001 3:0 ffff8bc145cc52a0 28 lru 00000080:00200000:2.0:1788201594.528062:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000151ef08b 28: 1< 0 - - > 2< 114688 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.528064:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000029cd5b85 00000080:00200000:2.0:1788201594.528065:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 29. 00000080:00200000:2.0:1788201594.528067:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 29 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.528082:0:24470:0:(rw26.c:898:ll_write_end()) pos 118784, len 4096, copied 4096 00000080:00200000:2.0:1788201594.528086:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000027a1138[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 29] 00000080:00200000:2.0:1788201594.528089:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a31ab1a7 17ffffc0001001 3:0 ffff8bc145cc5460 29 lru 00000080:00200000:2.0:1788201594.528094:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000de97ea2 29: 1< 0 - - > 2< 118784 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.528095:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000027a1138 00000080:00200000:2.0:1788201594.528097:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 30. 00000080:00200000:2.0:1788201594.528098:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 30 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.528111:0:24470:0:(rw26.c:898:ll_write_end()) pos 122880, len 4096, copied 4096 00000080:00200000:2.0:1788201594.528115:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000053c68b7d[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 30] 00000080:00200000:2.0:1788201594.528119:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008722f9c1 17ffffc0001001 3:0 ffff8bc145cc5d20 30 lru 00000080:00200000:2.0:1788201594.528124:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005343cf44 30: 1< 0 - - > 2< 122880 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.528126:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000053c68b7d 00000080:00200000:2.0:1788201594.528128:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 31. 00000080:00200000:2.0:1788201594.528131:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 31 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.528145:0:24470:0:(rw26.c:898:ll_write_end()) pos 126976, len 4096, copied 4096 00000080:00200000:2.0:1788201594.528150:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001dc68604[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 31] 00000080:00200000:2.0:1788201594.528153:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002980fc2c 17ffffc0001001 3:0 ffff8bc145cc5000 31 lru 00000080:00200000:2.0:1788201594.528157:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d997c851 31: 1< 0 - - > 2< 126976 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.528159:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001dc68604 00000080:00200000:2.0:1788201594.528160:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 32. 00000080:00200000:2.0:1788201594.528163:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 32 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.528177:0:24470:0:(rw26.c:898:ll_write_end()) pos 131072, len 4096, copied 4096 00000080:00200000:2.0:1788201594.528181:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001b5c68a7[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 32] 00000080:00200000:2.0:1788201594.528184:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002c45ca27 17ffffc0001001 3:0 ffff8bc145cc5380 32 lru 00000080:00200000:2.0:1788201594.528189:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000030754133 32: 1< 0 - - > 2< 131072 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.528192:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001b5c68a7 00000080:00200000:2.0:1788201594.528193:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 33. 00000080:00200000:2.0:1788201594.528195:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 33 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.528216:0:24470:0:(rw26.c:898:ll_write_end()) pos 135168, len 4096, copied 4096 00000080:00200000:2.0:1788201594.528221:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000d08252f[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 33] 00000080:00200000:2.0:1788201594.528224:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d388bd51 17ffffc0001001 3:0 ffff8bc145cc51c0 33 lru 00000080:00200000:2.0:1788201594.528229:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c1d3aa6d 33: 1< 0 - - > 2< 135168 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.528231:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000d08252f 00000080:00200000:2.0:1788201594.528232:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 34. 00000080:00200000:2.0:1788201594.528234:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 34 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.528251:0:24470:0:(rw26.c:898:ll_write_end()) pos 139264, len 4096, copied 4096 00000080:00200000:2.0:1788201594.528255:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004f1fce99[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 34] 00000080:00200000:2.0:1788201594.528258:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000c2560f3 17ffffc0001001 3:0 ffff8bc145cc50e0 34 lru 00000080:00200000:2.0:1788201594.528263:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d0fde444 34: 1< 0 - - > 2< 139264 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.528265:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004f1fce99 00000080:00200000:2.0:1788201594.528266:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 35. 00000080:00200000:2.0:1788201594.528268:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 35 of 0 to 107 bytes 00000080:00200000:2.0:1788201594.528301:0:24470:0:(rw26.c:898:ll_write_end()) pos 143360, len 107, copied 107 00000080:00200000:2.0:1788201594.528305:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e45e147a[3 00000000ebbd0d2f 2 1 00000000b8d441ae 0 0 35] 00000080:00200000:2.0:1788201594.528308:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a63dd0d2 17ffffc0001021 2:0 ffff8bc145cc59a0 35 lru 00000080:00200000:2.0:1788201594.528313:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e0a41b91 35: 1< 0 - - > 2< 143360 0 0 0x0 0x0 | 000000000ce25486 0000000090307aba > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.528315:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e45e147a 00000080:00200000:2.0:1788201594.528317:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 36. 00000080:00200000:2.0:1788201594.528321:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 36, from 0, to 107 prio 0 00000008:00010000:2.0:1788201594.528377:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 0000000055bc5188 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1788201594.528419:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc14592e578, count 15, dirtied 15 00000080:00200000:2.0:1788201594.528435:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc14592e578, count 15, dirtied 15 00000080:00200000:2.0:1788201594.528443:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc14592e578, count 6, dirtied 6 00000080:00200000:2.0:1788201594.528446:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 36 pages 143467 bytes, tot: 143467 00000080:00200000:2.0:1788201594.528450:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) sanity-flr.sh: write bytes 0, result: 143467 00000020:00010000:2.0:1788201594.528470:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c4d58 (ffff8bc148e3b3f8/0) at cl_lock_release():245 00000020:00010000:2.0:1788201594.528473:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c4d58 (ffff8bc148e3b3f8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201594.528477:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4130 (ffff8bc148e3ba28/1) at cl_lock_cancel():142 00010000:00010000:2.0:1788201594.528497:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.528510:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1788201594.528911:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c4d58 (ffff8bc148e3b3f8/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201594.528916:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4130 (ffff8bc148e3b3f8/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201594.528930:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 143467 bytes 00000080:00200000:2.0:1788201594.528940:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 35] 00000080:00200000:2.0:1788201594.528979:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x194:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201594.528983:0:24470:0:(file.c:2238:ll_file_io_generic()) sanity-flr.sh: 2 io complete with rc: 0, result: 143467, restart: 0 00000080:00200000:2.0:1788201594.528993:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x194:0x0] updating i_size 143467 i_blocks 1 00000080:00200000:2.0:1788201594.529000:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 143467 00000080:00200008:2.0:1788201594.529057:0:24470:0:(file.c:479:ll_file_release()) START file sanity-flr.sh:[0x200000bd7:0x194:0x0](ffff8bc14592e3c8), flags 100001 00000002:00100000:2.0:1788201594.529130:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc14602a680 x1875064728009472/t8589937450(8589937450) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1788201594.529145:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1788201594.529151:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a2300 x1875064728010112/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1788201594.529177:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728010112:192.168.201.143@tcp:35:cp.0 00000100:00100000:2.0:1788201594.529300:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1539203c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201594.532623:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a2300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728010112:192.168.201.143@tcp:35:cp.0 00000002:00100000:2.0:1788201594.532662:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc14602a680 x1875064728009472/t8589937450(8589937450) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201594.533120:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201594.533146:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.533172:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 231 lru_type: 1 00010000:00010000:2.0:1788201594.533188:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 231 lru_type: 1 00000080:00200000:2.0:1788201594.533196:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.533203:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201594.533207:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201594.533215:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201594.533220:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 231 lru_type: 1 00010000:00010000:2.0:1788201594.533236:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 232 lru_type: 1 00000080:00200000:2.0:1788201594.533256:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.533264:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201594.533271:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.533275:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-flr.sh, flags=8 00000080:00200008:2.0:1788201594.533283:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-flr.sh:[0x200000bd7:0x194:0x0](ffff8bc14592e3c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1788201594.533289:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x194:0x0](ffff8bc14592e3c8),name=sanity-flr.sh 00000002:00010000:2.0:1788201594.533302:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x194:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.533310:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097eff expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201594.533318:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097eff expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1788201594.533405:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.533410:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x194:0x0](ffff8bc14592e3c8) 00000080:00010000:2.0:1788201594.533413:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x194:0x0](ffff8bc14592e3c8) for lock 0xd138388016f6f6c2 00000080:00010000:2.0:1788201594.533418:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f6c2 from it ffffadd1c7debcb8 00010000:00010000:2.0:1788201594.533421:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097eff expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201594.533430:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097eff expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201594.533576:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x194:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201594.533587:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x194:0x0] 00000008:00010000:2.0:1788201594.533617:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201594.533621:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d330, osc lock ffff8bc151fc1560, flags 0x400001002 00010000:00010000:2.0:1788201594.533641:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.533653:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:2.0:1788201594.533666:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1788201594.533740:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.533750:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1788201594.533763:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1788201594.533773:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x194:0x0] updating i_size 143467 i_blocks 1 00000020:00010000:2.0:1788201594.533777:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc146006060 (ffff8bc146919a28/0) at cl_lock_release():245 00000020:00010000:2.0:1788201594.533781:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146006060 (ffff8bc146919a28/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201594.533783:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d330 (ffff8bc146919878/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201594.533787:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146006060 (ffff8bc146919a28/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201594.533828:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d330 (ffff8bc146919a28/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201594.533988:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x194:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201594.534056:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201594.534065:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.534073:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 232 lru_type: 1 00010000:00010000:2.0:1788201594.534082:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 232 lru_type: 1 00000080:00200000:2.0:1788201594.534088:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.534092:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201594.534094:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201594.534098:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201594.534101:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 232 lru_type: 1 00010000:00010000:2.0:1788201594.534109:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 233 lru_type: 1 00000080:00200000:2.0:1788201594.534118:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.534123:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201594.534127:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.534141:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-hsm.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:2.0:1788201594.534145:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-hsm.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201594.534156:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-hsm.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201594.534207:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473e00/0xd138388016f6f6d7 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.534215:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473e00/0xd138388016f6f6d7 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.534231:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473e00/0xd138388016f6f6d7 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.534260:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a3100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728010240:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201594.534652:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1539203c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201594.543986:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a3100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728010240:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201594.544019:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473e00/0xd138388016f6f6d7 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.544038:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473e00/0xd138388016f6f6d7 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.544046:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473e00/0xd138388016f6f6d7 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.544053:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473e00/0xd138388016f6f6d7 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.544063:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473e00/0xd138388016f6f6d7 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.544071:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172473e00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:2.0:1788201594.544076:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473e00/0xd138388016f6f6d7 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.544083:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473e00/0xd138388016f6f6d7 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.544090:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473e00/0xd138388016f6f6d7 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.544099:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201594.544107:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473e00/0xd138388016f6f6d7 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.544113:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473e00/0xd138388016f6f6d7 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201594.544137:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a3100 x1875064728010240/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201594.544154:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1788201594.544185:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201594.544259:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201594.544275:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.544286:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 233 lru_type: 1 00010000:00010000:2.0:1788201594.544299:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 233 lru_type: 1 00000080:00200000:2.0:1788201594.544306:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.544311:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201594.544315:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201594.544333:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201594.544337:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 233 lru_type: 1 00010000:00010000:2.0:1788201594.544347:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 234 lru_type: 1 00000080:00200000:2.0:1788201594.544375:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.544384:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201594.544390:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.544405:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-hsm.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:2.0:1788201594.544409:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-hsm.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201594.544421:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-hsm.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201594.544467:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6de lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.544474:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6de lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.544495:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6de lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.544516:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a3100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728010368:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201594.544612:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1539203c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201594.556574:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a3100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728010368:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201594.556606:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6de lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.556622:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6de lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.556630:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6de lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.556638:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6de lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.556649:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6de lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.556656:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172473800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:2.0:1788201594.556661:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6de lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.556681:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6de lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.556689:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6de lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.556698:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201594.556705:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6de lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.556713:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6de lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201594.556738:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a3100 x1875064728010368/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201594.556757:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1788201594.556787:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201594.556960:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201594.556978:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.556990:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 234 lru_type: 1 00010000:00010000:2.0:1788201594.557008:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 234 lru_type: 1 00000080:00200000:2.0:1788201594.557015:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.557020:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201594.557025:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201594.557030:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:2.0:1788201594.557034:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 234 lru_type: 1 00010000:00010000:2.0:1788201594.557041:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 235 lru_type: 1 00000080:00200000:2.0:1788201594.557058:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.557066:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201594.557072:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.557104:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1788201594.557109:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sanity-hsm.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14c594c00, open_flags 80c1, mode 81ed opened 0 00000080:00200000:2.0:1788201594.557117:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-hsm.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:2.0:1788201594.557139:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-hsm.sh,[0x200000bd7:0x195:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:2.0:1788201594.557196:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.557204:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1788201594.557217:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1788201594.557224:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a3100 x1875064728010624/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1788201594.557234:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.557257:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a3100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728010624:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201594.557834:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1539203c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201594.562431:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a3100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728010624:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201594.562465:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097f5a expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.562505:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x195:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097f5a expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.562513:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097f5a expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.562536:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097f5a expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.562549:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097f5a expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.562566:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097f5a expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.562576:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097f5a expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.562585:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097f5a expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201594.562599:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1724a3100 x1875064728010624/t8589937452(8589937452) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1788201594.562614:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a3100 x1875064728010624/t8589937452(8589937452) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1788201594.562631:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097f5a expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1788201594.562645:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097f5a expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.562658:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/405 (0 0) 00000080:00200000:2.0:1788201594.562666:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1788201594.562693:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=sanity-hsm.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:2.0:1788201594.562730:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x195:0x0](ffff8bc145982a08) 00000080:00200000:2.0:1788201594.562950:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x195:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1788201594.562960:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x195:0x0](ffff8bc145982a08) 00000080:00010000:2.0:1788201594.562963:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x195:0x0](ffff8bc145982a08) for lock 0xd138388016f6f6e5 00000080:00010000:2.0:1788201594.562975:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x195:0x0](ffff8bc145982a08) 00000080:00200008:2.0:1788201594.562999:0:24470:0:(file.c:1090:ll_file_open()) START file sanity-hsm.sh:[0x200000bd7:0x195:0x0](ffff8bc145982a08), flags 100301 00000002:00100000:2.0:1788201594.563019:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a3100 x1875064728010624/t8589937452(8589937452) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1788201594.563091:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f6e5 from it ffff8bc1507dba80 00010000:00010000:2.0:1788201594.563097:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097f5a expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.563108:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097f5a expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201594.563135:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x195:0x0](ffff8bc145982a08), inode mode 81ed mask 40 00000080:00200008:2.0:1788201594.563168:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-hsm.sh:[0x200000bd7:0x195:0x0](ffff8bc145982a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1788201594.563175:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x195:0x0](ffff8bc145982a08),name=sanity-hsm.sh 00000002:00010000:2.0:1788201594.563196:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x195:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.563208:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097f5a expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.563221:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097f5a expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201594.563229:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.563233:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x195:0x0](ffff8bc145982a08) 00000080:00010000:2.0:1788201594.563236:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x195:0x0](ffff8bc145982a08) for lock 0xd138388016f6f6e5 00000080:00010000:2.0:1788201594.563240:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f6e5 from it ffffadd1c7debcd8 00010000:00010000:2.0:1788201594.563243:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097f5a expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.563251:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097f5a expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1788201594.563277:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x195:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201594.563288:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x195:0x0] 00000008:00010000:2.0:1788201594.563321:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201594.563325:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d030, osc lock ffff8bc151fc1560, flags 0x400001002 00010000:00010000:2.0:1788201594.563395:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f6ec lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.563406:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f6ec lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1788201594.563450:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1788201594.563943:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728010752:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201594.582128:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f6ec lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.582175:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f6ec lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097f68 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.582194:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f6ec lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097f68 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.582213:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f6ec lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097f68 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201594.582231:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f6ec lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097f68 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201594.582243:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201594.582263:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f6ec lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097f68 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.582272:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f6ec lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097f68 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.582281:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f6ec lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097f68 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.582290:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f6ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171097f68 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201594.582315:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728010752:192.168.201.143@tcp:101:cp.0 00000080:00200000:2.0:1788201594.583747:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x195:0x0] updating i_size 0 i_blocks 1 00000020:00010000:2.0:1788201594.583759:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc146006060 (ffff8bc146919a28/0) at cl_lock_release():245 00000020:00010000:2.0:1788201594.583765:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146006060 (ffff8bc146919a28/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201594.583771:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d030 (ffff8bc146919878/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201594.583778:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146006060 (ffff8bc146919a28/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201594.583781:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d030 (ffff8bc146919a28/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201594.583876:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x195:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1788201594.584045:0:24470:0:(file.c:2638:do_file_write_iter()) START file sanity-hsm.sh:[0x200000bd7:0x195:0x0], ppos: 0, count: 170595 00000080:00200000:2.0:1788201594.584084:0:24470:0:(file.c:2090:ll_file_io_generic()) sanity-hsm.sh: write ppos: 0, bytes: 170595 00000080:00200000:2.0:1788201594.584092:0:24470:0:(file.c:1848:ll_io_set_mirror()) sanity-hsm.sh: desiginated mirror: 0 00000020:00200000:2.0:1788201594.584100:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@0000000083c8cd88[0x110, 1, [0x200000bd7:0x195:0x0] hash] 00000020:00200000:2.0:1788201594.584103:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 170595) 0 0 00000080:00200000:2.0:1788201594.584107:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x195:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201594.584122:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 41] 00020000:00200000:2.0:1788201594.584132:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 170595) 170595, 170595 00020000:00200000:2.0:1788201594.584266:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201594.584302:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 41] 00000008:00010000:2.0:1788201594.584317:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1788201594.584407:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d030, osc lock ffff8bc151fc1560, flags 0x0 00010000:00010000:2.0:1788201594.584429:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/445 (0 172031) 00010000:00010000:2.0:1788201594.584491:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.584503:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->172031] (req 0->172031) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.584514:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->172031] (req 0->172031) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.585117:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a3800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728010880:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201594.585472:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc15040ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201594.595204:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201594.597105:0:21781:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201594.597141:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743485952 00000100:00100000:3.0:1788201594.597154:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743485952 00000100:00100000:3.0:1788201594.597227:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 801 00000100:00100000:3.0:1788201594.597240:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc149fa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23411:x1875064743485952:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201594.597265:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f6ec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097f68 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201594.597468:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201594.597484:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc149fa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23411:x1875064743485952:12345-192.168.201.143@tcp:104: Request processed in 239us (2287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201594.597493:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 801 00010000:00010000:2.0:1788201594.597683:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201594.597693:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f6ec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097f68 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.597703:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172473800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:2.0:1788201594.597710:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f6ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171097f68 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201594.597777:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x195:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201594.597828:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x195:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:2.0:1788201594.597932:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f6ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097f68 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.597940:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201594.597969:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f6ec lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097f68 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.597984:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f6ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097f68 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.598003:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201594.598005:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201594.598007:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201594.598017:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201594.598035:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728011008:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201594.612291:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201594.612487:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a3800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728010880:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201594.612524:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->172031] (req 0->172031) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.612542:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->172031] (req 0->172031) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.612553:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->172031] (req 0->172031) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.612683:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743486080 00000100:00100000:2.0:1788201594.612693:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743486080 00000100:00100000:2.0:1788201594.612755:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 802 00000100:00100000:2.0:1788201594.612767:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17264b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21005:x1875064743486080:12345-192.168.201.143@tcp:105: 00010000:00010000:2.0:1788201594.612781:0:20877:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->172031] (req 0->172031) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.612827:0:20877:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->172031] (req 0->172031) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.612838:0:20877:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.612952:0:20877:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.612965:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.612977:0:20877:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.613010:0:20877:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc172473e00) 00000100:00100000:2.0:1788201594.613083:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17264b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21005:x1875064743486080:12345-192.168.201.143@tcp:105: Request processed in 318us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201594.613092:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 802 00010000:00010000:1.0:1788201594.613500:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.613514:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.613536:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201594.613559:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.613575:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.613584:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201594.613624:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) sanity-hsm.sh: write [0, 170595) append 0 append lockpos 0 00000080:00200000:1.0:1788201594.613651:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.613754:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:1.0:1788201594.613768:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002d986dd8[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 0] 00000080:00200000:1.0:1788201594.613772:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000ae53d14 17ffffc0001001 3:0 ffff8bc149e88b60 0 lru 00000080:00200000:1.0:1788201594.613782:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000e55f71c 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.613784:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002d986dd8 00000080:00200000:1.0:1788201594.613786:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201594.613827:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.614046:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:1.0:1788201594.614052:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000071fc0c29[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 1] 00000080:00200000:1.0:1788201594.614055:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000015d40545 17ffffc0001001 3:0 ffff8bc149e882a0 1 lru 00000080:00200000:1.0:1788201594.614061:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003603c4d6 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.614063:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000071fc0c29 00000080:00200000:1.0:1788201594.614064:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:1.0:1788201594.614066:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.614084:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:1.0:1788201594.614088:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007f84007e[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 2] 00000080:00200000:1.0:1788201594.614091:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002f912ec4 17ffffc0001001 3:0 ffff8bc149e88460 2 lru 00000080:00200000:1.0:1788201594.614097:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000030d7323 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.614100:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007f84007e 00000080:00200000:1.0:1788201594.614101:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:1.0:1788201594.614103:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.614130:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:1.0:1788201594.614135:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002726dbdd[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 3] 00000080:00200000:1.0:1788201594.614138:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001550c7a9 17ffffc0001021 2:0 ffff8bc149e88d20 3 lru 00000080:00200000:1.0:1788201594.614143:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000003c62dd8 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.614145:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002726dbdd 00000080:00200000:1.0:1788201594.614146:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:1.0:1788201594.614148:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.614164:0:24470:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:1.0:1788201594.614168:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000cceff395[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 4] 00000080:00200000:1.0:1788201594.614171:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000093d62c5e 17ffffc0001001 3:0 ffff8bc149e88000 4 lru 00000080:00200000:1.0:1788201594.614175:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003c7af077 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.614177:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000cceff395 00000080:00200000:1.0:1788201594.614178:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:1.0:1788201594.614180:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.614197:0:24470:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:1.0:1788201594.614202:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008bbdfe41[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 5] 00000080:00200000:1.0:1788201594.614205:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004a29ec8a 17ffffc0001001 3:0 ffff8bc149e88380 5 lru 00000080:00200000:1.0:1788201594.614211:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000055df2299 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.614213:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008bbdfe41 00000080:00200000:1.0:1788201594.614214:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:1.0:1788201594.614216:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.614232:0:24470:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:1.0:1788201594.614237:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000954ae06a[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 6] 00000080:00200000:1.0:1788201594.614239:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000028bd4bdb 17ffffc0001001 3:0 ffff8bc14747d9a0 6 lru 00000080:00200000:1.0:1788201594.614244:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005a56d2ee 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.614246:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000954ae06a 00000080:00200000:1.0:1788201594.614247:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:1.0:1788201594.614249:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.614263:0:24470:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:1.0:1788201594.614267:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000025e6bc68[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 7] 00000080:00200000:1.0:1788201594.614271:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000005b99d5a 17ffffc0001001 3:0 ffff8bc14747dc40 7 lru 00000080:00200000:1.0:1788201594.614277:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000eedd06a4 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.614279:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000025e6bc68 00000080:00200000:1.0:1788201594.614280:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:1.0:1788201594.614282:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.614296:0:24470:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:1.0:1788201594.614300:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002f00bbfb[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 8] 00000080:00200000:1.0:1788201594.614303:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000599bafbc 17ffffc0001001 3:0 ffff8bc14747da80 8 lru 00000080:00200000:1.0:1788201594.614308:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007aa45c3a 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.614311:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002f00bbfb 00000080:00200000:1.0:1788201594.614312:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:1.0:1788201594.614314:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.614329:0:24470:0:(rw26.c:898:ll_write_end()) pos 36864, len 4096, copied 4096 00000080:00200000:1.0:1788201594.614333:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e9c30c93[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 9] 00000080:00200000:1.0:1788201594.614336:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003bb8c4b5 17ffffc0001001 3:0 ffff8bc14747d540 9 lru 00000080:00200000:1.0:1788201594.614341:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003f1158fc 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.614343:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e9c30c93 00000080:00200000:1.0:1788201594.614345:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:1.0:1788201594.614347:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 10 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.614371:0:24470:0:(rw26.c:898:ll_write_end()) pos 40960, len 4096, copied 4096 00000080:00200000:1.0:1788201594.614376:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007b77e245[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 10] 00000080:00200000:1.0:1788201594.614379:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000aa462d2f 17ffffc0001001 3:0 ffff8bc14747d8c0 10 lru 00000080:00200000:1.0:1788201594.614384:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000bc16850b 10: 1< 0 - - > 2< 40960 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.614386:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007b77e245 00000080:00200000:1.0:1788201594.614388:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 11. 00000080:00200000:1.0:1788201594.614389:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 11 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.614399:0:24470:0:(rw26.c:898:ll_write_end()) pos 45056, len 4096, copied 4096 00000080:00200000:1.0:1788201594.614403:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000011c6d2f1[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 11] 00000080:00200000:1.0:1788201594.614405:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000098042e13 17ffffc0001001 3:0 ffff8bc14747de00 11 lru 00000080:00200000:1.0:1788201594.614411:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000b3c198a 11: 1< 0 - - > 2< 45056 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.614413:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000011c6d2f1 00000080:00200000:1.0:1788201594.614415:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 12. 00000080:00200000:1.0:1788201594.614416:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 12 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.614429:0:24470:0:(rw26.c:898:ll_write_end()) pos 49152, len 4096, copied 4096 00000080:00200000:1.0:1788201594.614432:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000957e2330[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 12] 00000080:00200000:1.0:1788201594.614434:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f50d01bc 17ffffc0001001 3:0 ffff8bc14747dee0 12 lru 00000080:00200000:1.0:1788201594.614440:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000072d1ed22 12: 1< 0 - - > 2< 49152 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.614442:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000957e2330 00000080:00200000:1.0:1788201594.614443:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 13. 00000080:00200000:1.0:1788201594.614445:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 13 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.614455:0:24470:0:(rw26.c:898:ll_write_end()) pos 53248, len 4096, copied 4096 00000080:00200000:1.0:1788201594.614458:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002b2be2ce[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 13] 00000080:00200000:1.0:1788201594.614461:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000fa4f7869 17ffffc0001001 3:0 ffff8bc14747d620 13 lru 00000080:00200000:1.0:1788201594.614467:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000323cc092 13: 1< 0 - - > 2< 53248 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.614469:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002b2be2ce 00000080:00200000:1.0:1788201594.614470:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 14. 00000080:00200000:1.0:1788201594.614472:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 14 of 0 to 4096 bytes 00000100:00100000:2.0:1788201594.618157:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728011008:192.168.201.143@tcp:103:ldlm_bl.0 00000080:00200000:3.0:1788201594.618285:0:24470:0:(rw26.c:898:ll_write_end()) pos 57344, len 4096, copied 4096 00000080:00200000:3.0:1788201594.618300:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c326e3b9[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 14] 00000080:00200000:3.0:1788201594.618305:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001a0a9e6f 17ffffc0001001 3:0 ffff8bc147418c40 14 lru 00000080:00200000:3.0:1788201594.618316:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b08bc452 14: 1< 0 - - > 2< 57344 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.618320:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c326e3b9 00000080:00200000:3.0:1788201594.618322:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 15. 00000080:00200000:3.0:1788201594.618329:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 15 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.618371:0:24470:0:(rw26.c:898:ll_write_end()) pos 61440, len 4096, copied 4096 00000080:00200000:3.0:1788201594.618376:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c47db777[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 15] 00000080:00200000:3.0:1788201594.618379:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c6a9c73c 17ffffc0001001 3:0 ffff8bc147418a80 15 lru 00000080:00200000:3.0:1788201594.618385:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000733a0a3f 15: 1< 0 - - > 2< 61440 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.618387:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c47db777 00000080:00200000:3.0:1788201594.618388:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 16. 00000080:00200000:3.0:1788201594.618391:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 16 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.618408:0:24470:0:(rw26.c:898:ll_write_end()) pos 65536, len 4096, copied 4096 00000080:00200000:3.0:1788201594.618413:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000adcbceb3[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 16] 00000080:00200000:3.0:1788201594.618416:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000024398c16 17ffffc0001001 3:0 ffff8bc147418540 16 lru 00000080:00200000:3.0:1788201594.618421:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ada99ecf 16: 1< 0 - - > 2< 65536 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.618423:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000adcbceb3 00000080:00200000:3.0:1788201594.618425:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 17. 00000080:00200000:3.0:1788201594.618427:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 17 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.618449:0:24470:0:(rw26.c:898:ll_write_end()) pos 69632, len 4096, copied 4096 00000080:00200000:3.0:1788201594.618454:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004d18e611[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 17] 00000080:00200000:3.0:1788201594.618458:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f01475e2 17ffffc0001001 3:0 ffff8bc1474188c0 17 lru 00000080:00200000:3.0:1788201594.618463:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000090724fc0 17: 1< 0 - - > 2< 69632 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.618466:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004d18e611 00000080:00200000:3.0:1788201594.618467:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 18. 00000080:00200000:3.0:1788201594.618470:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 18 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.618501:0:24470:0:(rw26.c:898:ll_write_end()) pos 73728, len 4096, copied 4096 00000080:00200000:3.0:1788201594.618505:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000044a3c580[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 18] 00000080:00200000:3.0:1788201594.618508:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d5e832e8 17ffffc0001001 3:0 ffff8bc147418e00 18 lru 00000080:00200000:3.0:1788201594.618513:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000726af7e2 18: 1< 0 - - > 2< 73728 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.618515:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000044a3c580 00000080:00200000:3.0:1788201594.618516:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 19. 00000080:00200000:3.0:1788201594.618518:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 19 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.618532:0:24470:0:(rw26.c:898:ll_write_end()) pos 77824, len 4096, copied 4096 00000080:00200000:3.0:1788201594.618536:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e8faa72f[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 19] 00000080:00200000:3.0:1788201594.618539:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004f9f3381 17ffffc0001001 3:0 ffff8bc1474181c0 19 lru 00000080:00200000:3.0:1788201594.618544:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000002ba8fcc8 19: 1< 0 - - > 2< 77824 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.618546:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e8faa72f 00000080:00200000:3.0:1788201594.618548:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 20. 00000080:00200000:3.0:1788201594.618549:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 20 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.618567:0:24470:0:(rw26.c:898:ll_write_end()) pos 81920, len 4096, copied 4096 00000080:00200000:3.0:1788201594.618572:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a6e62bbb[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 20] 00000080:00200000:3.0:1788201594.618575:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e3493026 17ffffc0001001 3:0 ffff8bc147418ee0 20 lru 00000080:00200000:3.0:1788201594.618580:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d18c8c75 20: 1< 0 - - > 2< 81920 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.618583:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a6e62bbb 00000080:00200000:3.0:1788201594.618584:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 21. 00000080:00200000:3.0:1788201594.618586:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 21 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.618601:0:24470:0:(rw26.c:898:ll_write_end()) pos 86016, len 4096, copied 4096 00000080:00200000:3.0:1788201594.618605:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001ec54dc0[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 21] 00000080:00200000:3.0:1788201594.618608:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004ec21401 17ffffc0001001 3:0 ffff8bc1474189a0 21 lru 00000080:00200000:3.0:1788201594.618613:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000097f818a0 21: 1< 0 - - > 2< 86016 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.618615:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001ec54dc0 00000080:00200000:3.0:1788201594.618616:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 22. 00000080:00200000:3.0:1788201594.618618:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 22 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.618634:0:24470:0:(rw26.c:898:ll_write_end()) pos 90112, len 4096, copied 4096 00000080:00200000:3.0:1788201594.618638:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b9ea55d8[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 22] 00000080:00200000:3.0:1788201594.618641:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000205fd3b8 17ffffc0001001 3:0 ffff8bc1727c1d20 22 lru 00000080:00200000:3.0:1788201594.618645:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d5480662 22: 1< 0 - - > 2< 90112 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.618648:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b9ea55d8 00000080:00200000:3.0:1788201594.618649:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 23. 00000080:00200000:3.0:1788201594.618651:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 23 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.618662:0:24470:0:(rw26.c:898:ll_write_end()) pos 94208, len 4096, copied 4096 00000080:00200000:3.0:1788201594.618786:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000086cd5b67[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 23] 00000080:00200000:3.0:1788201594.618828:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000485a982 17ffffc0001001 3:0 ffff8bc1727c1460 23 lru 00000080:00200000:3.0:1788201594.618834:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a085f4b1 23: 1< 0 - - > 2< 94208 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.618837:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000086cd5b67 00000080:00200000:3.0:1788201594.618839:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 24. 00000080:00200000:3.0:1788201594.618841:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 24 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.620043:0:24470:0:(rw26.c:898:ll_write_end()) pos 98304, len 4096, copied 4096 00000080:00200000:3.0:1788201594.620055:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000420e4d31[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 24] 00000080:00200000:3.0:1788201594.620057:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000eaab4395 17ffffc0001021 2:0 ffff8bc1727c1540 24 lru 00000080:00200000:3.0:1788201594.620063:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000024c2b4af 24: 1< 0 - - > 2< 98304 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.620066:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000420e4d31 00000080:00200000:3.0:1788201594.620067:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 25. 00000080:00200000:3.0:1788201594.620069:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 25 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.620097:0:24470:0:(rw26.c:898:ll_write_end()) pos 102400, len 4096, copied 4096 00000080:00200000:3.0:1788201594.620101:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f4a737c7[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 25] 00000080:00200000:3.0:1788201594.620104:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b634592e 17ffffc0001001 3:0 ffff8bc1727c12a0 25 lru 00000080:00200000:3.0:1788201594.620110:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000306bd0de 25: 1< 0 - - > 2< 102400 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.620112:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f4a737c7 00000080:00200000:3.0:1788201594.620114:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 26. 00000080:00200000:3.0:1788201594.620116:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 26 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.620132:0:24470:0:(rw26.c:898:ll_write_end()) pos 106496, len 4096, copied 4096 00000080:00200000:3.0:1788201594.620137:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007eb154d5[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 26] 00000080:00200000:3.0:1788201594.620140:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003e7e3ab2 17ffffc0001001 3:0 ffff8bc1727c1b60 26 lru 00000080:00200000:3.0:1788201594.620145:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000080fb4b1e 26: 1< 0 - - > 2< 106496 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.620148:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007eb154d5 00000080:00200000:3.0:1788201594.620149:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 27. 00000080:00200000:3.0:1788201594.620151:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 27 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.620166:0:24470:0:(rw26.c:898:ll_write_end()) pos 110592, len 4096, copied 4096 00000080:00200000:3.0:1788201594.620171:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000af542dc0[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 27] 00000080:00200000:3.0:1788201594.620173:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e706697f 17ffffc0001001 3:0 ffff8bc1727c1700 27 lru 00000080:00200000:3.0:1788201594.620179:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e042c905 27: 1< 0 - - > 2< 110592 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.620182:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000af542dc0 00000080:00200000:3.0:1788201594.620183:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 28. 00000080:00200000:3.0:1788201594.620185:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 28 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.620200:0:24470:0:(rw26.c:898:ll_write_end()) pos 114688, len 4096, copied 4096 00000080:00200000:3.0:1788201594.620205:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000055a24974[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 28] 00000080:00200000:3.0:1788201594.620208:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f60acca6 17ffffc0001001 3:0 ffff8bc1727c17e0 28 lru 00000080:00200000:3.0:1788201594.620213:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e0ccf39a 28: 1< 0 - - > 2< 114688 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.620215:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000055a24974 00000080:00200000:3.0:1788201594.620216:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 29. 00000080:00200000:3.0:1788201594.620218:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 29 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.620234:0:24470:0:(rw26.c:898:ll_write_end()) pos 118784, len 4096, copied 4096 00000080:00200000:3.0:1788201594.620238:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000cdc0a9e[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 29] 00000080:00200000:3.0:1788201594.620241:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000f41e991 17ffffc0001001 3:0 ffff8bc1727c1380 29 lru 00000080:00200000:3.0:1788201594.620247:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c1a3bf22 29: 1< 0 - - > 2< 118784 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.620249:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000cdc0a9e 00000080:00200000:3.0:1788201594.620250:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 30. 00000080:00200000:3.0:1788201594.620252:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 30 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.620268:0:24470:0:(rw26.c:898:ll_write_end()) pos 122880, len 4096, copied 4096 00000080:00200000:3.0:1788201594.620273:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000102a79d2[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 30] 00000080:00200000:3.0:1788201594.620275:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a16d2a27 17ffffc0001001 3:0 ffff8bc1727c1620 30 lru 00000080:00200000:3.0:1788201594.620280:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005cff78a3 30: 1< 0 - - > 2< 122880 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.620282:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000102a79d2 00000080:00200000:3.0:1788201594.620283:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 31. 00000080:00200000:3.0:1788201594.620285:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 31 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.620299:0:24470:0:(rw26.c:898:ll_write_end()) pos 126976, len 4096, copied 4096 00000080:00200000:3.0:1788201594.620303:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000071c4d365[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 31] 00000080:00200000:3.0:1788201594.620306:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c430beb1 17ffffc0001001 3:0 ffff8bc1727c1ee0 31 lru 00000080:00200000:3.0:1788201594.620311:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003917ea3e 31: 1< 0 - - > 2< 126976 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.620314:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000071c4d365 00000080:00200000:3.0:1788201594.620315:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 32. 00000080:00200000:3.0:1788201594.620316:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 32 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.620330:0:24470:0:(rw26.c:898:ll_write_end()) pos 131072, len 4096, copied 4096 00000080:00200000:3.0:1788201594.620334:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002f7f77e8[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 32] 00000080:00200000:3.0:1788201594.620336:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000fbc32ad1 17ffffc0001001 3:0 ffff8bc1727c11c0 32 lru 00000080:00200000:3.0:1788201594.620342:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a87c0bc0 32: 1< 0 - - > 2< 131072 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.620344:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002f7f77e8 00000080:00200000:3.0:1788201594.620346:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 33. 00000080:00200000:3.0:1788201594.620347:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 33 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.620377:0:24470:0:(rw26.c:898:ll_write_end()) pos 135168, len 4096, copied 4096 00000080:00200000:3.0:1788201594.620382:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000035aff0c0[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 33] 00000080:00200000:3.0:1788201594.620385:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000075b34454 17ffffc0001001 3:0 ffff8bc1727c10e0 33 lru 00000080:00200000:3.0:1788201594.620390:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000abfb968f 33: 1< 0 - - > 2< 135168 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.620393:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000035aff0c0 00000080:00200000:3.0:1788201594.620394:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 34. 00000080:00200000:3.0:1788201594.620396:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 34 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.620411:0:24470:0:(rw26.c:898:ll_write_end()) pos 139264, len 4096, copied 4096 00000080:00200000:3.0:1788201594.620416:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005f8d02f1[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 34] 00000080:00200000:3.0:1788201594.620418:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005cad64d8 17ffffc0001001 3:0 ffff8bc1727c19a0 34 lru 00000080:00200000:3.0:1788201594.620423:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000047fdb953 34: 1< 0 - - > 2< 139264 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.620425:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005f8d02f1 00000080:00200000:3.0:1788201594.620426:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 35. 00000080:00200000:3.0:1788201594.620428:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 35 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.620442:0:24470:0:(rw26.c:898:ll_write_end()) pos 143360, len 4096, copied 4096 00000080:00200000:3.0:1788201594.620446:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004c1f6584[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 35] 00000080:00200000:3.0:1788201594.620448:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000582dc1f2 17ffffc0001001 3:0 ffff8bc1727c1c40 35 lru 00000080:00200000:3.0:1788201594.620453:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c29509e7 35: 1< 0 - - > 2< 143360 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.620455:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004c1f6584 00000080:00200000:3.0:1788201594.620456:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 36. 00000080:00200000:3.0:1788201594.620458:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 36 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.620471:0:24470:0:(rw26.c:898:ll_write_end()) pos 147456, len 4096, copied 4096 00000080:00200000:3.0:1788201594.620475:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008aee0e05[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 36] 00000080:00200000:3.0:1788201594.621602:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007330a42b 17ffffc0001001 3:0 ffff8bc1727c1e00 36 lru 00000080:00200000:3.0:1788201594.621614:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005f675d2d 36: 1< 0 - - > 2< 147456 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.621617:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008aee0e05 00000080:00200000:3.0:1788201594.621619:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 37. 00000080:00200000:2.0:1788201594.622142:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 37 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.622206:0:24470:0:(rw26.c:898:ll_write_end()) pos 151552, len 4096, copied 4096 00000080:00200000:2.0:1788201594.622214:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006949c413[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 37] 00000080:00200000:2.0:1788201594.622217:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d06c538f 17ffffc0001001 3:0 ffff8bc145cc5620 37 lru 00000080:00200000:2.0:1788201594.622222:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000035b4e88d 37: 1< 0 - - > 2< 151552 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.622224:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006949c413 00000080:00200000:2.0:1788201594.622226:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 38. 00000080:00200000:2.0:1788201594.622228:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 38 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.622244:0:24470:0:(rw26.c:898:ll_write_end()) pos 155648, len 4096, copied 4096 00000080:00200000:2.0:1788201594.622247:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000010e20074[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 38] 00000080:00200000:2.0:1788201594.622250:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b1eafc25 17ffffc0001001 3:0 ffff8bc145cc57e0 38 lru 00000080:00200000:2.0:1788201594.622255:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e60acd52 38: 1< 0 - - > 2< 155648 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.622257:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000010e20074 00000080:00200000:2.0:1788201594.622258:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 39. 00000080:00200000:2.0:1788201594.622260:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 39 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.622274:0:24470:0:(rw26.c:898:ll_write_end()) pos 159744, len 4096, copied 4096 00000080:00200000:2.0:1788201594.622278:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000062fd7dc6[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 39] 00000080:00200000:2.0:1788201594.622281:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ab88eee1 17ffffc0001001 3:0 ffff8bc145cc5700 39 lru 00000080:00200000:2.0:1788201594.622286:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000af8a4ba1 39: 1< 0 - - > 2< 159744 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.622288:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000062fd7dc6 00000080:00200000:2.0:1788201594.622289:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 40. 00000080:00200000:2.0:1788201594.622291:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 40 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.622307:0:24470:0:(rw26.c:898:ll_write_end()) pos 163840, len 4096, copied 4096 00000080:00200000:2.0:1788201594.622311:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000df2bb9d6[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 40] 00000080:00200000:2.0:1788201594.622314:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d3435230 17ffffc0001001 3:0 ffff8bc145cc5c40 40 lru 00000080:00200000:2.0:1788201594.622319:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000087b0f775 40: 1< 0 - - > 2< 163840 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.622321:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000df2bb9d6 00000080:00200000:2.0:1788201594.622322:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 41. 00000080:00200000:2.0:1788201594.622324:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 41 of 0 to 2659 bytes 00000080:00200000:2.0:1788201594.622362:0:24470:0:(rw26.c:898:ll_write_end()) pos 167936, len 2659, copied 2659 00000080:00200000:2.0:1788201594.622367:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d0ff51e3[3 00000000f6cf99a3 2 1 000000001af0523d 0 0 41] 00000080:00200000:2.0:1788201594.622369:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000071857e6e 17ffffc0001001 3:0 ffff8bc145cc5a80 41 lru 00000080:00200000:2.0:1788201594.622374:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e68a1f44 41: 1< 0 - - > 2< 167936 0 0 0x0 0x0 | 000000008930e75a 00000000a9528b35 > 3< 0 0 > 4< 0 0 8 22151168 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.622376:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d0ff51e3 00000080:00200000:2.0:1788201594.622378:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 42. 00000080:00200000:2.0:1788201594.622383:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 42, from 0, to 2659 prio 0 00000008:00010000:2.0:1788201594.622423:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000d04bdfba ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1788201594.622465:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145982bb8, count 15, dirtied 15 00000080:00200000:2.0:1788201594.622497:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145982bb8, count 15, dirtied 15 00000080:00200000:2.0:1788201594.622511:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145982bb8, count 12, dirtied 12 00000080:00200000:2.0:1788201594.622516:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 42 pages 170595 bytes, tot: 170595 00000080:00200000:2.0:1788201594.622521:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) sanity-hsm.sh: write bytes 0, result: 170595 00000020:00010000:2.0:1788201594.622543:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc149844f38 (ffff8bc146919a28/0) at cl_lock_release():245 00000020:00010000:2.0:1788201594.622547:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149844f38 (ffff8bc146919a28/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201594.622550:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d030 (ffff8bc146919878/1) at cl_lock_cancel():142 00010000:00010000:2.0:1788201594.622559:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.622578:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1788201594.622599:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149844f38 (ffff8bc146919a28/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201594.622602:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d030 (ffff8bc146919a28/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201594.622615:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 170595 bytes 00000080:00200000:2.0:1788201594.622624:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 41] 00000080:00200000:2.0:1788201594.622976:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x195:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201594.622982:0:24470:0:(file.c:2238:ll_file_io_generic()) sanity-hsm.sh: 2 io complete with rc: 0, result: 170595, restart: 0 00000080:00200000:2.0:1788201594.622991:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x195:0x0] updating i_size 170595 i_blocks 1 00000080:00200000:2.0:1788201594.622997:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 170595 00000080:00200008:2.0:1788201594.623057:0:24470:0:(file.c:479:ll_file_release()) START file sanity-hsm.sh:[0x200000bd7:0x195:0x0](ffff8bc145982a08), flags 100001 00000002:00100000:2.0:1788201594.623132:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1724a3100 x1875064728010624/t8589937452(8589937452) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1788201594.623147:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1788201594.623153:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a1c00 x1875064728011264/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1788201594.623181:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728011264:192.168.201.143@tcp:35:cp.0 00000100:00100000:2.0:1788201594.623328:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc15040b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201594.626145:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728011264:192.168.201.143@tcp:35:cp.0 00000002:00100000:3.0:1788201594.626189:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1724a3100 x1875064728010624/t8589937452(8589937452) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201594.626276:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201594.626300:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201594.626329:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 235 lru_type: 1 00010000:00010000:3.0:1788201594.626346:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 235 lru_type: 1 00000080:00200000:3.0:1788201594.626366:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201594.626375:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201594.626379:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201594.626388:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201594.626392:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 235 lru_type: 1 00010000:00010000:3.0:1788201594.626402:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 236 lru_type: 1 00000080:00200000:3.0:1788201594.626421:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201594.626429:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201594.626437:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201594.626441:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-hsm.sh, flags=8 00000080:00200008:3.0:1788201594.626450:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-hsm.sh:[0x200000bd7:0x195:0x0](ffff8bc145982a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201594.626455:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x195:0x0](ffff8bc145982a08),name=sanity-hsm.sh 00000002:00010000:3.0:1788201594.626469:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x195:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201594.626490:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097f5a expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201594.626498:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097f5a expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201594.626504:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201594.626508:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x195:0x0](ffff8bc145982a08) 00000080:00010000:3.0:1788201594.626511:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x195:0x0](ffff8bc145982a08) for lock 0xd138388016f6f6e5 00000080:00010000:3.0:1788201594.626515:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f6e5 from it ffffadd1c7debcb8 00010000:00010000:3.0:1788201594.626517:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097f5a expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201594.626525:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097f5a expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201594.626580:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x195:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201594.626594:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x195:0x0] 00000008:00010000:3.0:1788201594.626630:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201594.626635:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149feca30, osc lock ffff8bc14691aab0, flags 0x400001002 00010000:00010000:3.0:1788201594.626657:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201594.629251:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:3.0:1788201594.629280:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1788201594.629286:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201594.629299:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1788201594.629319:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1788201594.629336:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x195:0x0] updating i_size 170595 i_blocks 1 00000020:00010000:3.0:1788201594.629341:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc6500 (ffff8bc1460e9a28/0) at cl_lock_release():245 00000020:00010000:3.0:1788201594.629345:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc6500 (ffff8bc1460e9a28/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201594.629362:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149feca30 (ffff8bc1460e9878/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201594.629368:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc6500 (ffff8bc1460e9a28/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201594.629371:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149feca30 (ffff8bc1460e9a28/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201594.629422:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x195:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201594.630950:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201594.630987:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.631012:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 236 lru_type: 1 00010000:00010000:2.0:1788201594.631029:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 236 lru_type: 1 00000080:00200000:2.0:1788201594.631040:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.631050:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201594.631054:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201594.631063:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201594.631067:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 236 lru_type: 1 00010000:00010000:2.0:1788201594.631077:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 237 lru_type: 1 00000080:00200000:2.0:1788201594.631096:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.631105:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201594.631113:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.631130:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-krb5.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:2.0:1788201594.631136:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-krb5.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201594.631150:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-krb5.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201594.631214:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6fa lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.631223:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6fa lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.631237:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6fa lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.631274:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728011392:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201594.631415:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc15040b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201594.638641:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728011392:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201594.639169:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6fa lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.639190:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6fa lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.639198:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6fa lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.639206:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6fa lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.639217:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6fa lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.639225:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172473800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:2.0:1788201594.639231:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6fa lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.639239:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6fa lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.639247:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6fa lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.639256:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201594.639263:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6fa lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.639270:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f6fa lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201594.639301:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a1180 x1875064728011392/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201594.639319:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1788201594.639364:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201594.639444:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201594.639462:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.639473:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 237 lru_type: 1 00010000:00010000:2.0:1788201594.639497:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 237 lru_type: 1 00000080:00200000:2.0:1788201594.639504:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.639509:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201594.639513:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201594.639518:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201594.639523:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 237 lru_type: 1 00010000:00010000:2.0:1788201594.639532:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 238 lru_type: 1 00000080:00200000:2.0:1788201594.639549:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.639559:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201594.639565:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.639580:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-krb5.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:2.0:1788201594.639585:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-krb5.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201594.639599:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-krb5.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201594.639649:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f701 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.639655:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f701 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.639665:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f701 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.640621:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728011520:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201594.640740:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc15040b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201594.649089:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728011520:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201594.649128:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f701 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.649146:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f701 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.649154:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f701 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.649162:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f701 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.649172:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f701 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.649179:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172472200 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:2.0:1788201594.649185:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f701 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.649193:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f701 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.649201:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f701 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.649209:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201594.649217:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f701 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.649225:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472200/0xd138388016f6f701 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201594.649250:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a1180 x1875064728011520/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201594.649269:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1788201594.649302:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201594.649459:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201594.649487:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.649497:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 238 lru_type: 1 00010000:00010000:2.0:1788201594.649511:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 238 lru_type: 1 00000080:00200000:2.0:1788201594.649518:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.649523:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201594.649528:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201594.649534:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:2.0:1788201594.649538:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 238 lru_type: 1 00010000:00010000:2.0:1788201594.649547:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 239 lru_type: 1 00000080:00200000:2.0:1788201594.649564:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.649574:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201594.649580:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.649598:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1788201594.649604:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sanity-krb5.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14c594a80, open_flags 80c1, mode 81ed opened 0 00000080:00200000:2.0:1788201594.649613:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-krb5.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:2.0:1788201594.649636:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-krb5.sh,[0x200000bd7:0x196:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:2.0:1788201594.649704:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.649711:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1788201594.649724:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1788201594.649732:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a1180 x1875064728011776/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1788201594.649741:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.649765:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728011776:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201594.649944:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc15040b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201594.657932:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728011776:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201594.657969:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097fb5 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.657997:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x196:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097fb5 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.658007:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097fb5 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.658021:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097fb5 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.658034:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097fb5 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.658050:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097fb5 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.658060:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097fb5 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.658068:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097fb5 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201594.658083:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1724a1180 x1875064728011776/t8589937454(8589937454) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1788201594.658098:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a1180 x1875064728011776/t8589937454(8589937454) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1788201594.658118:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097fb5 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1788201594.658133:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097fb5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.658146:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/406 (0 0) 00000080:00200000:2.0:1788201594.658154:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1788201594.658173:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=sanity-krb5.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:2.0:1788201594.658217:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x196:0x0](ffff8bc1459821c8) 00000080:00200000:2.0:1788201594.658388:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x196:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1788201594.658399:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x196:0x0](ffff8bc1459821c8) 00000080:00010000:2.0:1788201594.658403:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x196:0x0](ffff8bc1459821c8) for lock 0xd138388016f6f708 00000080:00010000:2.0:1788201594.658416:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x196:0x0](ffff8bc1459821c8) 00000080:00200008:2.0:1788201594.658434:0:24470:0:(file.c:1090:ll_file_open()) START file sanity-krb5.sh:[0x200000bd7:0x196:0x0](ffff8bc1459821c8), flags 100301 00000002:00100000:2.0:1788201594.658457:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a1180 x1875064728011776/t8589937454(8589937454) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1788201594.658506:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f708 from it ffff8bc1507dbc00 00010000:00010000:2.0:1788201594.658512:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097fb5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.658522:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097fb5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201594.658555:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x196:0x0](ffff8bc1459821c8), inode mode 81ed mask 40 00000080:00200008:2.0:1788201594.658590:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-krb5.sh:[0x200000bd7:0x196:0x0](ffff8bc1459821c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1788201594.658597:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x196:0x0](ffff8bc1459821c8),name=sanity-krb5.sh 00000002:00010000:2.0:1788201594.658620:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x196:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.658631:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097fb5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.658643:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097fb5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201594.658652:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.658657:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x196:0x0](ffff8bc1459821c8) 00000080:00010000:2.0:1788201594.658661:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x196:0x0](ffff8bc1459821c8) for lock 0xd138388016f6f708 00000080:00010000:2.0:1788201594.658665:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f708 from it ffffadd1c7debcd8 00010000:00010000:2.0:1788201594.658669:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097fb5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.658677:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097fb5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1788201594.658704:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x196:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201594.658715:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x196:0x0] 00000008:00010000:2.0:1788201594.658745:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201594.658749:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d130, osc lock ffff8bc151fc1560, flags 0x400001002 00010000:00010000:2.0:1788201594.658834:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f70f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.658851:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f70f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1788201594.658894:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1788201594.658978:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728011904:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201594.663889:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f70f lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.663931:0:10054:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f70f lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097fc3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.663951:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f70f lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171097fc3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.663968:0:10054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f70f lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171097fc3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1788201594.663990:0:10054:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f70f lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097fc3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1788201594.664003:0:10054:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:2.0:1788201594.664328:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f70f lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097fc3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.664340:0:10054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f70f lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097fc3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.664363:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f70f lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171097fc3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.664374:0:10054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f70f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171097fc3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1788201594.664401:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728011904:192.168.201.143@tcp:101:cp.0 00000080:00200000:0.0:1788201594.668051:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x196:0x0] updating i_size 0 i_blocks 1 00000020:00010000:0.0:1788201594.668067:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc146006060 (ffff8bc146919a28/0) at cl_lock_release():245 00000020:00010000:0.0:1788201594.668073:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146006060 (ffff8bc146919a28/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.668080:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d130 (ffff8bc146919878/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.668087:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146006060 (ffff8bc146919a28/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201594.668090:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d130 (ffff8bc146919a28/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201594.668149:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x196:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1788201594.668244:0:24470:0:(file.c:2638:do_file_write_iter()) START file sanity-krb5.sh:[0x200000bd7:0x196:0x0], ppos: 0, count: 31711 00000080:00200000:0.0:1788201594.668289:0:24470:0:(file.c:2090:ll_file_io_generic()) sanity-krb5.sh: write ppos: 0, bytes: 31711 00000080:00200000:0.0:1788201594.668296:0:24470:0:(file.c:1848:ll_io_set_mirror()) sanity-krb5.sh: desiginated mirror: 0 00000020:00200000:0.0:1788201594.668304:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000c040cbd7[0x110, 1, [0x200000bd7:0x196:0x0] hash] 00000020:00200000:0.0:1788201594.668306:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 31711) 0 0 00000080:00200000:0.0:1788201594.668310:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x196:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201594.668324:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 7] 00020000:00200000:0.0:1788201594.668332:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 31711) 31711, 31711 00020000:00200000:0.0:1788201594.668336:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201594.668552:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 7] 00000008:00010000:0.0:1788201594.668570:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1788201594.668577:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456e30, osc lock ffff8bc145d34ab0, flags 0x0 00010000:00010000:0.0:1788201594.668599:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/445 (0 32767) 00010000:00010000:0.0:1788201594.669770:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.670554:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.670576:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201594.670619:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172649f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728012032:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201594.670944:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1467050c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201594.676698:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201594.676783:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743486208 00000100:00100000:0.0:1788201594.676815:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743486208 00000100:00100000:0.0:1788201594.676888:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 803 00000100:00100000:0.0:1788201594.676900:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1726cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21821:x1875064743486208:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201594.676925:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f70f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097fc3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.682872:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201594.682903:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1726cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21821:x1875064743486208:12345-192.168.201.143@tcp:104: Request processed in 5993us (6209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201594.682920:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 803 00010000:00010000:0.0:1788201594.682981:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201594.682991:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f70f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171097fc3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.683010:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172473800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201594.683020:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f70f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171097fc3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201594.683102:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x196:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201594.683117:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x196:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1788201594.683216:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f70f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097fc3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.683225:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201594.683253:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f70f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097fc3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.683268:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f70f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171097fc3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.683287:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201594.683289:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201594.683290:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201594.683310:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17264b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728012160:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201594.688298:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172649f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728012032:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201594.688339:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.688372:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.688384:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201594.691707:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201594.691964:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743486336 00000100:00100000:3.0:1788201594.691978:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743486336 00000100:00100000:3.0:1788201594.692342:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 804 00000100:00100000:3.0:1788201594.692366:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17275bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743486336:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201594.692388:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.692403:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.692414:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.692428:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.692438:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.692450:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.692489:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc146084a00) 00010000:00010000:0.0:1788201594.692621:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.692635:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.692656:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201594.692671:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.692686:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.692695:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201594.692741:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) sanity-krb5.sh: write [0, 31711) append 0 append lockpos 0 00000080:00200000:0.0:1788201594.692765:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.692850:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:0.0:1788201594.692863:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002a18f6cc[3 00000000c2828d52 2 1 0000000005f45737 0 0 0] 00000080:00200000:0.0:1788201594.692867:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000df75aa7e 17ffffc0001001 3:0 ffff8bc144026ee0 0 lru 00000080:00200000:0.0:1788201594.692875:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000082f45d1d 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000325effe3 > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.692878:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002a18f6cc 00000080:00200000:0.0:1788201594.692880:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1788201594.692883:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.692912:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:0.0:1788201594.692917:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000d76b44f[3 00000000c2828d52 2 1 0000000005f45737 0 0 1] 00000080:00200000:0.0:1788201594.692920:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000068de40fc 17ffffc0001001 3:0 ffff8bc144026620 1 lru 00000080:00200000:0.0:1788201594.692925:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000556187be 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 00000000325effe3 > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.692928:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000d76b44f 00000080:00200000:0.0:1788201594.692929:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:0.0:1788201594.692931:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.692955:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:0.0:1788201594.692960:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c5ab1249[3 00000000c2828d52 2 1 0000000005f45737 0 0 2] 00000080:00200000:0.0:1788201594.692963:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002290c3e8 17ffffc0001021 2:0 ffff8bc1440267e0 2 lru 00000080:00200000:0.0:1788201594.692969:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000011653a5a 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000000ce25486 00000000325effe3 > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.692971:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c5ab1249 00000080:00200000:0.0:1788201594.692973:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:0.0:1788201594.692975:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.692990:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:0.0:1788201594.692994:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a65c357d[3 00000000c2828d52 2 1 0000000005f45737 0 0 3] 00000080:00200000:0.0:1788201594.692998:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000971f1fda 17ffffc0001001 3:0 ffff8bc144026700 3 lru 00000080:00200000:0.0:1788201594.693003:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000cb931e0b 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000000ce25486 00000000325effe3 > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.693006:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a65c357d 00000080:00200000:0.0:1788201594.693007:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:0.0:1788201594.693009:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.693040:0:24470:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:0.0:1788201594.693045:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e1bc1380[3 00000000c2828d52 2 1 0000000005f45737 0 0 4] 00000080:00200000:0.0:1788201594.693048:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d0395e85 17ffffc0001001 3:0 ffff8bc144026b60 4 lru 00000080:00200000:0.0:1788201594.693054:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009c750a09 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000000ce25486 00000000325effe3 > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.693056:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e1bc1380 00000080:00200000:0.0:1788201594.693057:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:0.0:1788201594.693060:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.693077:0:24470:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:0.0:1788201594.693081:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009ca02a25[3 00000000c2828d52 2 1 0000000005f45737 0 0 5] 00000080:00200000:0.0:1788201594.693084:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000019cd15b4 17ffffc0001001 3:0 ffff8bc1726fd2a0 5 lru 00000080:00200000:0.0:1788201594.693089:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000370cde49 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000000ce25486 00000000325effe3 > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.693101:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009ca02a25 00000080:00200000:0.0:1788201594.693103:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:0.0:1788201594.693105:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.693120:0:24470:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:0.0:1788201594.693124:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002ba51b97[3 00000000c2828d52 2 1 0000000005f45737 0 0 6] 00000080:00200000:0.0:1788201594.693127:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000066db8a2d 17ffffc0001001 3:0 ffff8bc1726fdb60 6 lru 00000080:00200000:0.0:1788201594.693246:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009d5f665b 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000000ce25486 00000000325effe3 > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.693249:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002ba51b97 00000080:00200000:0.0:1788201594.693251:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:0.0:1788201594.693253:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 3039 bytes 00000080:00200000:0.0:1788201594.693279:0:24470:0:(rw26.c:898:ll_write_end()) pos 28672, len 3039, copied 3039 00000080:00200000:0.0:1788201594.693284:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ec08593e[3 00000000c2828d52 2 1 0000000005f45737 0 0 7] 00000080:00200000:0.0:1788201594.693287:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000040fc07f8 17ffffc0001001 3:0 ffff8bc1726fd700 7 lru 00000080:00200000:0.0:1788201594.693291:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003dacf19f 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000000ce25486 00000000325effe3 > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.693293:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ec08593e 00000080:00200000:0.0:1788201594.693294:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:0.0:1788201594.693298:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 8, from 0, to 3039 prio 0 00000008:00010000:0.0:1788201594.693324:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000cd0be2df ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201594.693368:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145982378, count 8, dirtied 8 00000080:00200000:0.0:1788201594.693375:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 8 pages 31711 bytes, tot: 31711 00000080:00200000:0.0:1788201594.693377:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) sanity-krb5.sh: write bytes 0, result: 31711 00000020:00010000:0.0:1788201594.693397:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc148fb1998 (ffff8bc1499c46c8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201594.693400:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc148fb1998 (ffff8bc1499c46c8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.693404:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456e30 (ffff8bc1499c4518/1) at cl_lock_cancel():142 00010000:00010000:0.0:1788201594.693409:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.693420:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1788201594.693438:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc148fb1998 (ffff8bc1499c46c8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201594.693441:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456e30 (ffff8bc1499c46c8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201594.693449:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 31711 bytes 00000080:00200000:0.0:1788201594.693457:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 7] 00000080:00200000:0.0:1788201594.693493:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x196:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201594.693497:0:24470:0:(file.c:2238:ll_file_io_generic()) sanity-krb5.sh: 2 io complete with rc: 0, result: 31711, restart: 0 00000080:00200000:0.0:1788201594.693506:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x196:0x0] updating i_size 31711 i_blocks 1 00000080:00200000:0.0:1788201594.693511:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 31711 00000080:00200008:0.0:1788201594.693634:0:24470:0:(file.c:479:ll_file_release()) START file sanity-krb5.sh:[0x200000bd7:0x196:0x0](ffff8bc1459821c8), flags 100001 00000002:00100000:0.0:1788201594.693695:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1724a1180 x1875064728011776/t8589937454(8589937454) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1788201594.693709:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1788201594.693715:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172649f80 x1875064728012416/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1788201594.693745:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172649f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728012416:192.168.201.143@tcp:35:cp.0 00000100:00100000:3.0:1788201594.694015:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17275bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743486336:12345-192.168.201.143@tcp:105: Request processed in 1651us (2321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201594.694039:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 804 00000100:00100000:0.0:1788201594.696324:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc146705480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.696990:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17264b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728012160:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201594.699987:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172649f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728012416:192.168.201.143@tcp:35:cp.0 00000002:00100000:0.0:1788201594.700294:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1724a1180 x1875064728011776/t8589937454(8589937454) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201594.700398:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201594.700421:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.700444:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 239 lru_type: 1 00010000:00010000:0.0:1788201594.700460:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 239 lru_type: 1 00000080:00200000:0.0:1788201594.700469:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.700476:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201594.700480:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201594.700488:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201594.700493:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 239 lru_type: 1 00010000:00010000:0.0:1788201594.700503:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 240 lru_type: 1 00000080:00200000:0.0:1788201594.700521:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.700589:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201594.700597:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.700601:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-krb5.sh, flags=8 00000080:00200008:0.0:1788201594.700609:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-krb5.sh:[0x200000bd7:0x196:0x0](ffff8bc1459821c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201594.700614:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x196:0x0](ffff8bc1459821c8),name=sanity-krb5.sh 00000002:00010000:0.0:1788201594.700626:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x196:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.700636:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097fb5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201594.700644:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097fb5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201594.700651:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.700655:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x196:0x0](ffff8bc1459821c8) 00000080:00010000:0.0:1788201594.700658:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x196:0x0](ffff8bc1459821c8) for lock 0xd138388016f6f708 00000080:00010000:0.0:1788201594.700662:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f708 from it ffffadd1c7debcb8 00010000:00010000:0.0:1788201594.700665:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171097fb5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201594.700673:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171097fb5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201594.700724:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x196:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201594.700734:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x196:0x0] 00000008:00010000:0.0:1788201594.700766:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201594.700770:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456e30, osc lock ffff8bc145d34ab0, flags 0x400001002 00010000:00010000:0.0:1788201594.700787:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.700958:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:0.0:1788201594.700973:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1788201594.700978:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.700986:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1788201594.700999:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1788201594.701010:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x196:0x0] updating i_size 31711 i_blocks 1 00000020:00010000:0.0:1788201594.701014:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201594.701018:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.701021:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456e30 (ffff8bc1499c4518/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.701026:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201594.701029:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456e30 (ffff8bc1499c46c8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201594.701060:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x196:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201594.701113:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201594.701121:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.701128:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 240 lru_type: 1 00010000:00010000:0.0:1788201594.701200:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 240 lru_type: 1 00000080:00200000:0.0:1788201594.701215:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.701219:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201594.701222:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201594.701226:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201594.701229:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 240 lru_type: 1 00010000:00010000:0.0:1788201594.701238:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 241 lru_type: 1 00000080:00200000:0.0:1788201594.701246:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.701250:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201594.701254:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.701268:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-lfsck.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:0.0:1788201594.701272:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-lfsck.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201594.701282:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-lfsck.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201594.701333:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f71d lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.701341:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f71d lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.701364:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f71d lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201594.701389:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17264b480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728012544:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201594.701553:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc146705480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.704646:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17264b480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728012544:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201594.704674:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f71d lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.704690:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f71d lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.704697:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f71d lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.704703:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f71d lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.704713:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f71d lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.704721:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc146085c00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201594.704727:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f71d lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.704735:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f71d lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.704743:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f71d lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.704751:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201594.704759:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f71d lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.704766:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f71d lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201594.704908:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc17264b480 x1875064728012544/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201594.704926:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201594.704957:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201594.705025:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201594.705042:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.705054:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 241 lru_type: 1 00010000:00010000:0.0:1788201594.705065:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 241 lru_type: 1 00000080:00200000:0.0:1788201594.705071:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.705077:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201594.705081:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201594.705086:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201594.705089:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 241 lru_type: 1 00010000:00010000:0.0:1788201594.705224:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 242 lru_type: 1 00000080:00200000:0.0:1788201594.705244:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.705254:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201594.705261:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.705275:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-lfsck.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:0.0:1788201594.705280:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-lfsck.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201594.705294:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-lfsck.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201594.705341:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f724 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.705361:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f724 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.705373:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f724 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201594.705396:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17264b480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728012672:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201594.705541:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc146705480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.708646:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17264b480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728012672:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201594.708672:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f724 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.708687:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f724 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.708695:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f724 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.708702:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f724 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.708713:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f724 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.708720:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc146084e00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201594.708727:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f724 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.708734:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f724 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.708742:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f724 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.708750:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201594.708758:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f724 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.708766:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084e00/0xd138388016f6f724 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201594.708787:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc17264b480 x1875064728012672/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201594.708903:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1788201594.709015:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201594.709263:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201594.709282:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.709294:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 242 lru_type: 1 00010000:00010000:2.0:1788201594.709307:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 242 lru_type: 1 00000080:00200000:2.0:1788201594.709315:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.709321:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201594.709325:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201594.709332:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:2.0:1788201594.709336:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 242 lru_type: 1 00010000:00010000:2.0:1788201594.709345:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 243 lru_type: 1 00000080:00200000:2.0:1788201594.709378:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.709388:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201594.709394:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.709408:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1788201594.709413:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sanity-lfsck.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14c594000, open_flags 80c1, mode 81ed opened 0 00000080:00200000:2.0:1788201594.709422:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-lfsck.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:2.0:1788201594.709446:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-lfsck.sh,[0x200000bd7:0x197:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:2.0:1788201594.709509:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.709517:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1788201594.709597:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1788201594.709609:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a1500 x1875064728012928/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1788201594.709619:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.709645:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728012928:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201594.709946:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc15040b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201594.716952:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728012928:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201594.716991:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098010 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.717020:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x197:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098010 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.717030:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098010 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.717042:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098010 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.717054:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098010 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.717070:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098010 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.717078:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098010 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.717086:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098010 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201594.717295:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1724a1500 x1875064728012928/t8589937456(8589937456) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1788201594.717309:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a1500 x1875064728012928/t8589937456(8589937456) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1788201594.717325:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098010 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1788201594.717341:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098010 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.717364:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/407 (0 0) 00000080:00200000:2.0:1788201594.717373:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1788201594.717391:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=sanity-lfsck.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:2.0:1788201594.717432:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x197:0x0](ffff8bc1459842c8) 00000080:00200000:2.0:1788201594.717666:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x197:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1788201594.717678:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x197:0x0](ffff8bc1459842c8) 00000080:00010000:2.0:1788201594.717682:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x197:0x0](ffff8bc1459842c8) for lock 0xd138388016f6f72b 00000080:00010000:2.0:1788201594.717695:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x197:0x0](ffff8bc1459842c8) 00000080:00200008:2.0:1788201594.717712:0:24470:0:(file.c:1090:ll_file_open()) START file sanity-lfsck.sh:[0x200000bd7:0x197:0x0](ffff8bc1459842c8), flags 100301 00000002:00100000:2.0:1788201594.717735:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a1500 x1875064728012928/t8589937456(8589937456) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1788201594.717926:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f72b from it ffff8bc1507dbf60 00010000:00010000:2.0:1788201594.717932:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171098010 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.717942:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098010 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201594.717969:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x197:0x0](ffff8bc1459842c8), inode mode 81ed mask 40 00000080:00200008:2.0:1788201594.718003:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-lfsck.sh:[0x200000bd7:0x197:0x0](ffff8bc1459842c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1788201594.718010:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x197:0x0](ffff8bc1459842c8),name=sanity-lfsck.sh 00000002:00010000:2.0:1788201594.718033:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x197:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.718044:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098010 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.718059:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098010 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201594.718065:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.718070:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x197:0x0](ffff8bc1459842c8) 00000080:00010000:2.0:1788201594.718073:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x197:0x0](ffff8bc1459842c8) for lock 0xd138388016f6f72b 00000080:00010000:2.0:1788201594.718076:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f72b from it ffffadd1c7debcd8 00010000:00010000:2.0:1788201594.718080:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171098010 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.718087:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098010 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1788201594.718507:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x197:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201594.718519:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x197:0x0] 00000008:00010000:2.0:1788201594.718610:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201594.718614:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d530, osc lock ffff8bc151fc1430, flags 0x400001002 00010000:00010000:2.0:1788201594.718671:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f732 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.718683:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f732 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201594.718772:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728013056:192.168.201.143@tcp:101:cp.0 00000020:00200000:2.0:1788201594.719256:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1788201594.722589:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f732 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.722629:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f732 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109801e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.722646:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f732 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109801e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.722668:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f732 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109801e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201594.722685:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f732 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109801e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201594.722698:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201594.722765:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f732 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109801e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.722776:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f732 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109801e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.722784:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f732 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109801e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.722818:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f732 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e217109801e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201594.722844:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728013056:192.168.201.143@tcp:101:cp.0 00000080:00200000:2.0:1788201594.723013:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x197:0x0] updating i_size 0 i_blocks 1 00000020:00010000:2.0:1788201594.723020:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc146005e10 (ffff8bc146919cf8/0) at cl_lock_release():245 00000020:00010000:2.0:1788201594.723023:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146005e10 (ffff8bc146919cf8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201594.723029:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d530 (ffff8bc1469195a8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201594.723033:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146005e10 (ffff8bc146919cf8/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201594.723036:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d530 (ffff8bc146919cf8/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201594.723080:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x197:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1788201594.723503:0:24470:0:(file.c:2638:do_file_write_iter()) START file sanity-lfsck.sh:[0x200000bd7:0x197:0x0], ppos: 0, count: 215293 00000080:00200000:2.0:1788201594.723609:0:24470:0:(file.c:2090:ll_file_io_generic()) sanity-lfsck.sh: write ppos: 0, bytes: 215293 00000080:00200000:2.0:1788201594.723617:0:24470:0:(file.c:1848:ll_io_set_mirror()) sanity-lfsck.sh: desiginated mirror: 0 00000020:00200000:2.0:1788201594.723623:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000151a866e[0x110, 1, [0x200000bd7:0x197:0x0] hash] 00000020:00200000:2.0:1788201594.723625:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 215293) 0 0 00000080:00200000:2.0:1788201594.723630:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x197:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201594.723644:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 52] 00020000:00200000:2.0:1788201594.723652:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 215293) 215293, 215293 00020000:00200000:2.0:1788201594.723656:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201594.723687:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 52] 00000008:00010000:2.0:1788201594.723700:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1788201594.723707:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d530, osc lock ffff8bc151fc1430, flags 0x0 00010000:00010000:2.0:1788201594.723725:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/446 (0 217087) 00010000:00010000:2.0:1788201594.723768:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.723778:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 3 type: EXT [0->217087] (req 0->217087) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.723980:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 3 type: EXT [0->217087] (req 0->217087) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.724007:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a0380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728013184:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201594.724123:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc15040ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201594.726211:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201594.726444:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743486464 00000100:00100000:3.0:1788201594.726456:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743486464 00000100:00100000:3.0:1788201594.726532:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 805 00000100:00100000:3.0:1788201594.726544:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1727d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23131:x1875064743486464:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201594.726565:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f732 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109801e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201594.726656:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201594.726664:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1727d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23131:x1875064743486464:12345-192.168.201.143@tcp:104: Request processed in 123us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201594.726671:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 805 00010000:00010000:3.0:1788201594.726700:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201594.726709:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f732 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109801e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201594.726720:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172473800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201594.726727:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f732 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e217109801e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201594.726780:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x197:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201594.726827:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x197:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201594.726903:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f732 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109801e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201594.726912:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201594.726939:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f732 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109801e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201594.726948:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008c4943d7/0xd138388016f6f732 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109801e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201594.726967:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201594.726969:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201594.726971:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201594.726989:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728013312:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201594.730119:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201594.730375:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743486592 00000100:00100000:3.0:1788201594.730386:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743486592 00000100:00100000:3.0:1788201594.730454:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 806 00000100:00100000:3.0:1788201594.730466:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1727d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21004:x1875064743486592:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201594.730487:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->217087] (req 0->217087) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.730503:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->217087] (req 0->217087) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.730514:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.730537:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.730549:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.730561:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.730584:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc172472200) 00000100:00100000:3.0:1788201594.730655:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1727d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21004:x1875064743486592:12345-192.168.201.143@tcp:105: Request processed in 190us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201594.730662:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 806 00000100:00100000:2.0:1788201594.730863:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a0380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728013184:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201594.730887:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.730905:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1788201594.730918:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.730931:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.730939:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1788201594.730969:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) sanity-lfsck.sh: write [0, 215293) append 0 append lockpos 0 00000080:00200000:2.0:1788201594.730990:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.731069:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:2.0:1788201594.731082:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002b887316[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 0] 00000080:00200000:2.0:1788201594.731085:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000020e4bcbc 17ffffc0001001 3:0 ffff8bc145cc5540 0 lru 00000080:00200000:2.0:1788201594.731107:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000020cd987b 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.731110:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002b887316 00000080:00200000:2.0:1788201594.731111:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1788201594.731115:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.731419:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:2.0:1788201594.731425:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009a825976[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 1] 00000080:00200000:2.0:1788201594.731427:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000fceac271 17ffffc0001001 3:0 ffff8bc145cc58c0 1 lru 00000080:00200000:2.0:1788201594.731433:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000934c304c 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.731436:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009a825976 00000080:00200000:2.0:1788201594.731437:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:2.0:1788201594.731439:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.731459:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:2.0:1788201594.731463:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000791a696b[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 2] 00000080:00200000:2.0:1788201594.731466:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000093a48d54 17ffffc0001001 3:0 ffff8bc145cc5e00 2 lru 00000080:00200000:2.0:1788201594.731471:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000008b1a8a2 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.731474:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000791a696b 00000080:00200000:2.0:1788201594.731475:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:2.0:1788201594.731477:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.731493:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:2.0:1788201594.731497:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c24ef939[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 3] 00000080:00200000:2.0:1788201594.731500:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b67971a7 17ffffc0001001 3:0 ffff8bc145cc5ee0 3 lru 00000080:00200000:2.0:1788201594.731505:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005ec40622 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.731508:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c24ef939 00000080:00200000:2.0:1788201594.731509:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:2.0:1788201594.731511:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.731593:0:24470:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:2.0:1788201594.731599:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000004b5282c[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 4] 00000080:00200000:2.0:1788201594.731602:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000009e843f5 17ffffc0001001 3:0 ffff8bc148dec540 4 lru 00000080:00200000:2.0:1788201594.731606:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006e2d1cfa 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.731608:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000004b5282c 00000080:00200000:2.0:1788201594.731609:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:2.0:1788201594.731611:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.731627:0:24470:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:2.0:1788201594.731630:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e3405c08[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 5] 00000080:00200000:2.0:1788201594.731633:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000089f8c155 17ffffc0001001 3:0 ffff8bc148deca80 5 lru 00000080:00200000:2.0:1788201594.731637:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000085ba5ccc 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.731640:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e3405c08 00000080:00200000:2.0:1788201594.731641:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:2.0:1788201594.731642:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.731658:0:24470:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:2.0:1788201594.731662:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005cfaaa06[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 6] 00000080:00200000:2.0:1788201594.731664:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d520aa8c 17ffffc0001001 3:0 ffff8bc148decc40 6 lru 00000080:00200000:2.0:1788201594.731670:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001806f64b 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.731671:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005cfaaa06 00000080:00200000:2.0:1788201594.731672:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:2.0:1788201594.731674:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.731689:0:24470:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:2.0:1788201594.731693:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c90826a3[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 7] 00000080:00200000:2.0:1788201594.731696:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009c226ee2 17ffffc0001001 3:0 ffff8bc148dec9a0 7 lru 00000080:00200000:2.0:1788201594.731701:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f82afe65 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.731704:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c90826a3 00000080:00200000:2.0:1788201594.731705:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:2.0:1788201594.731708:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.731733:0:24470:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:2.0:1788201594.731738:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c2210f6f[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 8] 00000080:00200000:2.0:1788201594.731740:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000000290b79 17ffffc0001021 2:0 ffff8bc148dec0e0 8 lru 00000080:00200000:2.0:1788201594.731745:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f9b9eba6 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.731747:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c2210f6f 00000080:00200000:2.0:1788201594.731748:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:2.0:1788201594.731750:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.731764:0:24470:0:(rw26.c:898:ll_write_end()) pos 36864, len 4096, copied 4096 00000080:00200000:2.0:1788201594.731768:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000484e7e5[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 9] 00000080:00200000:2.0:1788201594.731770:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005907bf86 17ffffc0001001 3:0 ffff8bc148dec1c0 9 lru 00000080:00200000:2.0:1788201594.731775:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000ba7cbd1 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.731778:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000484e7e5 00000080:00200000:2.0:1788201594.731780:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:2.0:1788201594.731781:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 10 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.731829:0:24470:0:(rw26.c:898:ll_write_end()) pos 40960, len 4096, copied 4096 00000080:00200000:2.0:1788201594.731833:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000088d4339[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 10] 00000080:00200000:2.0:1788201594.731836:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000519a1f73 17ffffc0001001 3:0 ffff8bc148dec380 10 lru 00000080:00200000:2.0:1788201594.731840:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000093de627e 10: 1< 0 - - > 2< 40960 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.731843:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000088d4339 00000080:00200000:2.0:1788201594.731844:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 11. 00000080:00200000:2.0:1788201594.731845:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 11 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.731861:0:24470:0:(rw26.c:898:ll_write_end()) pos 45056, len 4096, copied 4096 00000080:00200000:2.0:1788201594.731866:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003b0d458e[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 11] 00000080:00200000:2.0:1788201594.731869:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000edecd31f 17ffffc0001001 3:0 ffff8bc148dec000 11 lru 00000080:00200000:2.0:1788201594.731873:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000012840271 11: 1< 0 - - > 2< 45056 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.731875:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003b0d458e 00000080:00200000:2.0:1788201594.731876:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 12. 00000080:00200000:2.0:1788201594.731878:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 12 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.731893:0:24470:0:(rw26.c:898:ll_write_end()) pos 49152, len 4096, copied 4096 00000080:00200000:2.0:1788201594.731897:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008be580e6[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 12] 00000080:00200000:2.0:1788201594.731900:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f8676969 17ffffc0001001 3:0 ffff8bc148decd20 12 lru 00000080:00200000:2.0:1788201594.731905:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000deb0dfe0 12: 1< 0 - - > 2< 49152 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.731908:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008be580e6 00000080:00200000:2.0:1788201594.731908:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 13. 00000080:00200000:2.0:1788201594.731910:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 13 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.731928:0:24470:0:(rw26.c:898:ll_write_end()) pos 53248, len 4096, copied 4096 00000080:00200000:2.0:1788201594.731932:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ed28b14a[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 13] 00000080:00200000:2.0:1788201594.731935:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000640ef4e3 17ffffc0001001 3:0 ffff8bc148dec700 13 lru 00000080:00200000:2.0:1788201594.731940:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f02dbc67 13: 1< 0 - - > 2< 53248 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.731942:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ed28b14a 00000080:00200000:2.0:1788201594.731943:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 14. 00000080:00200000:2.0:1788201594.731944:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 14 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.731958:0:24470:0:(rw26.c:898:ll_write_end()) pos 57344, len 4096, copied 4096 00000080:00200000:2.0:1788201594.731962:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a043db63[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 14] 00000080:00200000:2.0:1788201594.731965:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000028c844d8 17ffffc0001001 3:0 ffff8bc148dec7e0 14 lru 00000080:00200000:2.0:1788201594.731970:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000007046de9 14: 1< 0 - - > 2< 57344 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.731972:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a043db63 00000080:00200000:2.0:1788201594.731973:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 15. 00000080:00200000:2.0:1788201594.731975:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 15 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.731992:0:24470:0:(rw26.c:898:ll_write_end()) pos 61440, len 4096, copied 4096 00000080:00200000:2.0:1788201594.731996:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000001a1e9fc[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 15] 00000080:00200000:2.0:1788201594.731999:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004153bde7 17ffffc0001001 3:0 ffff8bc148dec620 15 lru 00000080:00200000:2.0:1788201594.732004:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000077d1c923 15: 1< 0 - - > 2< 61440 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.732007:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000001a1e9fc 00000080:00200000:2.0:1788201594.732008:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 16. 00000080:00200000:2.0:1788201594.732010:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 16 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.732025:0:24470:0:(rw26.c:898:ll_write_end()) pos 65536, len 4096, copied 4096 00000080:00200000:2.0:1788201594.732029:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009e25b6e9[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 16] 00000080:00200000:2.0:1788201594.732032:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c28f2a58 17ffffc0001001 3:0 ffff8bc148decee0 16 lru 00000080:00200000:2.0:1788201594.732037:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000089fded6 16: 1< 0 - - > 2< 65536 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.732040:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009e25b6e9 00000080:00200000:2.0:1788201594.732040:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 17. 00000080:00200000:2.0:1788201594.732042:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 17 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.734304:0:24470:0:(rw26.c:898:ll_write_end()) pos 69632, len 4096, copied 4096 00000080:00200000:2.0:1788201594.734324:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d565cb3e[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 17] 00000080:00200000:2.0:1788201594.734328:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000ef1eabd 17ffffc0001001 3:0 ffff8bc148dece00 17 lru 00000080:00200000:2.0:1788201594.734336:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000003024ae0 17: 1< 0 - - > 2< 69632 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.734338:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d565cb3e 00000080:00200000:2.0:1788201594.734340:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 18. 00000080:00200000:2.0:1788201594.734344:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 18 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.734378:0:24470:0:(rw26.c:898:ll_write_end()) pos 73728, len 4096, copied 4096 00000080:00200000:2.0:1788201594.734383:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002a136ef7[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 18] 00000080:00200000:2.0:1788201594.734386:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a11e15d7 17ffffc0001001 3:0 ffff8bc148dec8c0 18 lru 00000080:00200000:2.0:1788201594.734392:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000002db88535 18: 1< 0 - - > 2< 73728 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.734394:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002a136ef7 00000080:00200000:2.0:1788201594.734395:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 19. 00000080:00200000:2.0:1788201594.734397:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 19 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.734411:0:24470:0:(rw26.c:898:ll_write_end()) pos 77824, len 4096, copied 4096 00000080:00200000:2.0:1788201594.734415:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009ba8a800[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 19] 00000080:00200000:2.0:1788201594.734419:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e1386528 17ffffc0001001 3:0 ffff8bc148dec460 19 lru 00000080:00200000:2.0:1788201594.734424:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f5efb6da 19: 1< 0 - - > 2< 77824 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.734426:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009ba8a800 00000080:00200000:2.0:1788201594.734428:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 20. 00000080:00200000:2.0:1788201594.734430:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 20 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.734446:0:24470:0:(rw26.c:898:ll_write_end()) pos 81920, len 4096, copied 4096 00000080:00200000:2.0:1788201594.734450:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f0318971[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 20] 00000080:00200000:2.0:1788201594.734453:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007480ccc5 17ffffc0001001 3:0 ffff8bc148dec2a0 20 lru 00000080:00200000:2.0:1788201594.734458:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003029b15d 20: 1< 0 - - > 2< 81920 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.734460:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f0318971 00000080:00200000:2.0:1788201594.734461:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 21. 00000080:00200000:2.0:1788201594.734463:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 21 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.734475:0:24470:0:(rw26.c:898:ll_write_end()) pos 86016, len 4096, copied 4096 00000080:00200000:2.0:1788201594.734479:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b89b0644[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 21] 00000080:00200000:2.0:1788201594.734482:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a77efed3 17ffffc0001001 3:0 ffff8bc148decb60 21 lru 00000080:00200000:2.0:1788201594.734487:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004bea21ea 21: 1< 0 - - > 2< 86016 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.734489:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b89b0644 00000080:00200000:2.0:1788201594.734490:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 22. 00000080:00200000:2.0:1788201594.734492:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 22 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.734514:0:24470:0:(rw26.c:898:ll_write_end()) pos 90112, len 4096, copied 4096 00000080:00200000:2.0:1788201594.734519:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003317b022[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 22] 00000080:00200000:2.0:1788201594.734521:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007d672daa 17ffffc0001001 3:0 ffff8bc150630b60 22 lru 00000100:00100000:3.0:1788201594.735129:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728013312:192.168.201.143@tcp:103:ldlm_bl.0 00000080:00200000:2.0:1788201594.735947:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d7257dd4 22: 1< 0 - - > 2< 90112 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.735956:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003317b022 00000080:00200000:2.0:1788201594.735958:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 23. 00000080:00200000:2.0:1788201594.735962:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 23 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.736015:0:24470:0:(rw26.c:898:ll_write_end()) pos 94208, len 4096, copied 4096 00000080:00200000:2.0:1788201594.736022:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008db56286[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 23] 00000080:00200000:2.0:1788201594.736025:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000063825738 17ffffc0001021 2:0 ffff8bc150630700 23 lru 00000080:00200000:2.0:1788201594.736033:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004aa1d51a 23: 1< 0 - - > 2< 94208 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.736035:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008db56286 00000080:00200000:2.0:1788201594.736036:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 24. 00000080:00200000:2.0:1788201594.736039:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 24 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.736056:0:24470:0:(rw26.c:898:ll_write_end()) pos 98304, len 4096, copied 4096 00000080:00200000:2.0:1788201594.736061:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000048e1df11[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 24] 00000080:00200000:2.0:1788201594.736064:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000041aaaa24 17ffffc0001001 3:0 ffff8bc1506307e0 24 lru 00000080:00200000:2.0:1788201594.736070:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f319e0a9 24: 1< 0 - - > 2< 98304 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.736072:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000048e1df11 00000080:00200000:2.0:1788201594.736074:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 25. 00000080:00200000:2.0:1788201594.736075:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 25 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.736088:0:24470:0:(rw26.c:898:ll_write_end()) pos 102400, len 4096, copied 4096 00000080:00200000:2.0:1788201594.736092:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f66c0ee6[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 25] 00000080:00200000:2.0:1788201594.736095:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000095b33a83 17ffffc0001001 3:0 ffff8bc150630620 25 lru 00000080:00200000:2.0:1788201594.736101:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000025107200 25: 1< 0 - - > 2< 102400 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.736103:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f66c0ee6 00000080:00200000:2.0:1788201594.736104:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 26. 00000080:00200000:2.0:1788201594.736105:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 26 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.736115:0:24470:0:(rw26.c:898:ll_write_end()) pos 106496, len 4096, copied 4096 00000080:00200000:2.0:1788201594.736119:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003cbbdd68[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 26] 00000080:00200000:2.0:1788201594.736121:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009bebfa02 17ffffc0001001 3:0 ffff8bc150630ee0 26 lru 00000080:00200000:2.0:1788201594.736126:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000095904098 26: 1< 0 - - > 2< 106496 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.736129:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003cbbdd68 00000080:00200000:2.0:1788201594.736130:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 27. 00000080:00200000:2.0:1788201594.736196:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 27 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.736215:0:24470:0:(rw26.c:898:ll_write_end()) pos 110592, len 4096, copied 4096 00000080:00200000:2.0:1788201594.736220:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000bbbff64c[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 27] 00000080:00200000:2.0:1788201594.736223:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000045e7ece0 17ffffc0001001 3:0 ffff8bc150630e00 27 lru 00000080:00200000:2.0:1788201594.736229:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000331103e0 27: 1< 0 - - > 2< 110592 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.736231:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000bbbff64c 00000080:00200000:2.0:1788201594.736232:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 28. 00000080:00200000:2.0:1788201594.736234:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 28 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.736244:0:24470:0:(rw26.c:898:ll_write_end()) pos 114688, len 4096, copied 4096 00000080:00200000:2.0:1788201594.736247:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009077f060[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 28] 00000080:00200000:2.0:1788201594.736250:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d9d11895 17ffffc0001001 3:0 ffff8bc1506308c0 28 lru 00000080:00200000:2.0:1788201594.736255:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008a864754 28: 1< 0 - - > 2< 114688 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.736258:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009077f060 00000080:00200000:2.0:1788201594.736259:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 29. 00000080:00200000:2.0:1788201594.736261:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 29 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.736271:0:24470:0:(rw26.c:898:ll_write_end()) pos 118784, len 4096, copied 4096 00000080:00200000:2.0:1788201594.736274:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000059cdf10c[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 29] 00000080:00200000:2.0:1788201594.736277:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000840cee28 17ffffc0001001 3:0 ffff8bc150630540 29 lru 00000080:00200000:2.0:1788201594.736283:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f3755eb7 29: 1< 0 - - > 2< 118784 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.736285:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000059cdf10c 00000080:00200000:2.0:1788201594.736286:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 30. 00000080:00200000:2.0:1788201594.736288:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 30 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.736297:0:24470:0:(rw26.c:898:ll_write_end()) pos 122880, len 4096, copied 4096 00000080:00200000:2.0:1788201594.736301:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004b80c09a[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 30] 00000080:00200000:2.0:1788201594.736303:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000bcfbf1bd 17ffffc0001001 3:0 ffff8bc150630a80 30 lru 00000080:00200000:2.0:1788201594.736308:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000098f03510 30: 1< 0 - - > 2< 122880 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.736310:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004b80c09a 00000080:00200000:2.0:1788201594.736311:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 31. 00000080:00200000:2.0:1788201594.736313:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 31 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.736323:0:24470:0:(rw26.c:898:ll_write_end()) pos 126976, len 4096, copied 4096 00000080:00200000:2.0:1788201594.736326:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f8f1dc32[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 31] 00000080:00200000:2.0:1788201594.736329:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006bb43e9c 17ffffc0001001 3:0 ffff8bc150630c40 31 lru 00000080:00200000:2.0:1788201594.736334:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000002b4c1f4f 31: 1< 0 - - > 2< 126976 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.736336:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f8f1dc32 00000080:00200000:2.0:1788201594.736337:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 32. 00000080:00200000:2.0:1788201594.736338:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 32 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.736360:0:24470:0:(rw26.c:898:ll_write_end()) pos 131072, len 4096, copied 4096 00000080:00200000:2.0:1788201594.736364:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002848f431[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 32] 00000080:00200000:2.0:1788201594.736367:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f6602069 17ffffc0001001 3:0 ffff8bc1506309a0 32 lru 00000080:00200000:2.0:1788201594.736372:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000db588585 32: 1< 0 - - > 2< 131072 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.736374:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002848f431 00000080:00200000:2.0:1788201594.736375:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 33. 00000080:00200000:2.0:1788201594.736376:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 33 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.736389:0:24470:0:(rw26.c:898:ll_write_end()) pos 135168, len 4096, copied 4096 00000080:00200000:2.0:1788201594.736393:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007463a59b[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 33] 00000080:00200000:2.0:1788201594.736396:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a0fd04c0 17ffffc0001001 3:0 ffff8bc1506300e0 33 lru 00000080:00200000:2.0:1788201594.736401:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000042af94ae 33: 1< 0 - - > 2< 135168 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.736403:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007463a59b 00000080:00200000:2.0:1788201594.736404:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 34. 00000080:00200000:2.0:1788201594.736405:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 34 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.736417:0:24470:0:(rw26.c:898:ll_write_end()) pos 139264, len 4096, copied 4096 00000080:00200000:2.0:1788201594.736421:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f9780758[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 34] 00000080:00200000:2.0:1788201594.736423:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000602366ea 17ffffc0001001 3:0 ffff8bc1506301c0 34 lru 00000080:00200000:2.0:1788201594.736485:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c429b8ea 34: 1< 0 - - > 2< 139264 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.736486:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f9780758 00000080:00200000:2.0:1788201594.736487:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 35. 00000080:00200000:2.0:1788201594.736490:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 35 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.736507:0:24470:0:(rw26.c:898:ll_write_end()) pos 143360, len 4096, copied 4096 00000080:00200000:2.0:1788201594.736513:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001e0e3913[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 35] 00000080:00200000:2.0:1788201594.736515:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e418e9f6 17ffffc0001001 3:0 ffff8bc150630380 35 lru 00000080:00200000:2.0:1788201594.736521:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000de6dbbec 35: 1< 0 - - > 2< 143360 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.736523:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001e0e3913 00000080:00200000:2.0:1788201594.736585:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 36. 00000080:00200000:2.0:1788201594.736588:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 36 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.736606:0:24470:0:(rw26.c:898:ll_write_end()) pos 147456, len 4096, copied 4096 00000080:00200000:2.0:1788201594.736611:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000404e246[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 36] 00000080:00200000:2.0:1788201594.736614:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000049a6743d 17ffffc0001001 3:0 ffff8bc150630000 36 lru 00000080:00200000:2.0:1788201594.736620:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004342bf2e 36: 1< 0 - - > 2< 147456 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.736623:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000404e246 00000080:00200000:2.0:1788201594.736624:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 37. 00000080:00200000:2.0:1788201594.736626:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 37 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.736641:0:24470:0:(rw26.c:898:ll_write_end()) pos 151552, len 4096, copied 4096 00000080:00200000:2.0:1788201594.736646:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009b537a77[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 37] 00000080:00200000:2.0:1788201594.736648:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000074d2f150 17ffffc0001001 3:0 ffff8bc150630d20 37 lru 00000080:00200000:2.0:1788201594.736653:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007e06a28b 37: 1< 0 - - > 2< 151552 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.736656:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009b537a77 00000080:00200000:2.0:1788201594.736657:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 38. 00000080:00200000:2.0:1788201594.736659:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 38 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.736680:0:24470:0:(rw26.c:898:ll_write_end()) pos 155648, len 4096, copied 4096 00000080:00200000:2.0:1788201594.736686:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009b9dc6ad[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 38] 00000080:00200000:2.0:1788201594.736688:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b250e596 17ffffc0001021 2:0 ffff8bc150630460 38 lru 00000080:00200000:2.0:1788201594.736693:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009c2aaf47 38: 1< 0 - - > 2< 155648 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.736695:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009b9dc6ad 00000080:00200000:2.0:1788201594.736697:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 39. 00000080:00200000:2.0:1788201594.736699:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 39 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.736713:0:24470:0:(rw26.c:898:ll_write_end()) pos 159744, len 4096, copied 4096 00000080:00200000:2.0:1788201594.736717:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009c9d758a[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 39] 00000080:00200000:2.0:1788201594.736720:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ecff2924 17ffffc0001001 3:0 ffff8bc1506302a0 39 lru 00000080:00200000:2.0:1788201594.736725:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f714ecd2 39: 1< 0 - - > 2< 159744 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.736727:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009c9d758a 00000080:00200000:2.0:1788201594.736728:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 40. 00000080:00200000:2.0:1788201594.736730:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 40 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.736757:0:24470:0:(rw26.c:898:ll_write_end()) pos 163840, len 4096, copied 4096 00000080:00200000:2.0:1788201594.736762:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000011539754[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 40] 00000080:00200000:2.0:1788201594.736765:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b9e49f99 17ffffc0001001 3:0 ffff8bc1725b8e00 40 lru 00000080:00200000:2.0:1788201594.736770:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004a15bd25 40: 1< 0 - - > 2< 163840 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.736772:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000011539754 00000080:00200000:2.0:1788201594.736774:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 41. 00000080:00200000:2.0:1788201594.736776:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 41 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.736830:0:24470:0:(rw26.c:898:ll_write_end()) pos 167936, len 4096, copied 4096 00000080:00200000:2.0:1788201594.736836:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002525e5f3[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 41] 00000080:00200000:2.0:1788201594.736839:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007170a8f3 17ffffc0001001 3:0 ffff8bc1725b8ee0 41 lru 00000080:00200000:2.0:1788201594.736844:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d4c79c42 41: 1< 0 - - > 2< 167936 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.736846:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002525e5f3 00000080:00200000:2.0:1788201594.736848:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 42. 00000080:00200000:2.0:1788201594.736850:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 42 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.736867:0:24470:0:(rw26.c:898:ll_write_end()) pos 172032, len 4096, copied 4096 00000080:00200000:2.0:1788201594.736871:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002f9102ce[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 42] 00000080:00200000:2.0:1788201594.736874:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000bfc1f77c 17ffffc0001001 3:0 ffff8bc1725b8620 42 lru 00000080:00200000:2.0:1788201594.736880:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a4efc0d8 42: 1< 0 - - > 2< 172032 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.736882:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002f9102ce 00000080:00200000:2.0:1788201594.736883:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 43. 00000080:00200000:2.0:1788201594.736885:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 43 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.736901:0:24470:0:(rw26.c:898:ll_write_end()) pos 176128, len 4096, copied 4096 00000080:00200000:2.0:1788201594.736906:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003a17458f[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 43] 00000080:00200000:2.0:1788201594.736908:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000055e0838e 17ffffc0001001 3:0 ffff8bc1725b87e0 43 lru 00000080:00200000:2.0:1788201594.736913:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000114cda3e 43: 1< 0 - - > 2< 176128 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.736915:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003a17458f 00000080:00200000:2.0:1788201594.736916:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 44. 00000080:00200000:2.0:1788201594.736918:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 44 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.736932:0:24470:0:(rw26.c:898:ll_write_end()) pos 180224, len 4096, copied 4096 00000080:00200000:2.0:1788201594.736935:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000079ce9fbf[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 44] 00000080:00200000:2.0:1788201594.736938:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000941e0098 17ffffc0001001 3:0 ffff8bc1725b8700 44 lru 00000080:00200000:2.0:1788201594.736943:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000bbb71c01 44: 1< 0 - - > 2< 180224 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.736945:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000079ce9fbf 00000080:00200000:2.0:1788201594.736946:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 45. 00000080:00200000:2.0:1788201594.736947:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 45 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.736960:0:24470:0:(rw26.c:898:ll_write_end()) pos 184320, len 4096, copied 4096 00000080:00200000:2.0:1788201594.736963:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000091bcb050[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 45] 00000080:00200000:2.0:1788201594.736965:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005051c2a1 17ffffc0001001 3:0 ffff8bc1725b8b60 45 lru 00000080:00200000:2.0:1788201594.736970:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003d8b0077 45: 1< 0 - - > 2< 184320 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.736971:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000091bcb050 00000080:00200000:2.0:1788201594.736972:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 46. 00000080:00200000:2.0:1788201594.736974:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 46 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.736986:0:24470:0:(rw26.c:898:ll_write_end()) pos 188416, len 4096, copied 4096 00000080:00200000:2.0:1788201594.736990:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000236df95f[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 46] 00000080:00200000:2.0:1788201594.736992:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000053996373 17ffffc0001001 3:0 ffff8bc1725b82a0 46 lru 00000080:00200000:2.0:1788201594.736996:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000212fd841 46: 1< 0 - - > 2< 188416 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.737000:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000236df95f 00000080:00200000:2.0:1788201594.737001:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 47. 00000080:00200000:2.0:1788201594.737002:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 47 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.737015:0:24470:0:(rw26.c:898:ll_write_end()) pos 192512, len 4096, copied 4096 00000080:00200000:2.0:1788201594.737018:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007436a3a4[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 47] 00000080:00200000:2.0:1788201594.737020:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f7784cf7 17ffffc0001001 3:0 ffff8bc1725b8460 47 lru 00000080:00200000:2.0:1788201594.737024:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003441b691 47: 1< 0 - - > 2< 192512 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.737027:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007436a3a4 00000080:00200000:2.0:1788201594.737028:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 48. 00000080:00200000:2.0:1788201594.737029:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 48 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.737043:0:24470:0:(rw26.c:898:ll_write_end()) pos 196608, len 4096, copied 4096 00000080:00200000:2.0:1788201594.737046:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000034f7f340[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 48] 00000080:00200000:2.0:1788201594.737049:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000002bc5047 17ffffc0001001 3:0 ffff8bc1725b8d20 48 lru 00000080:00200000:2.0:1788201594.737053:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000f01c409 48: 1< 0 - - > 2< 196608 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.737054:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000034f7f340 00000080:00200000:2.0:1788201594.737055:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 49. 00000080:00200000:2.0:1788201594.737057:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 49 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.737068:0:24470:0:(rw26.c:898:ll_write_end()) pos 200704, len 4096, copied 4096 00000080:00200000:2.0:1788201594.737071:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000395b853a[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 49] 00000080:00200000:2.0:1788201594.737073:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000446ecab4 17ffffc0001001 3:0 ffff8bc1725b8000 49 lru 00000080:00200000:2.0:1788201594.737078:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000013daecf4 49: 1< 0 - - > 2< 200704 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.737080:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000395b853a 00000080:00200000:2.0:1788201594.737081:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 50. 00000080:00200000:2.0:1788201594.737083:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 50 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.737096:0:24470:0:(rw26.c:898:ll_write_end()) pos 204800, len 4096, copied 4096 00000080:00200000:2.0:1788201594.737100:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d9644341[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 50] 00000080:00200000:2.0:1788201594.737103:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000077319c0c 17ffffc0001001 3:0 ffff8bc1725b8380 50 lru 00000080:00200000:2.0:1788201594.737108:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001dfa28ad 50: 1< 0 - - > 2< 204800 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.737111:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d9644341 00000080:00200000:2.0:1788201594.737112:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 51. 00000080:00200000:2.0:1788201594.737114:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 51 of 0 to 4096 bytes 00000080:00200000:2.0:1788201594.737129:0:24470:0:(rw26.c:898:ll_write_end()) pos 208896, len 4096, copied 4096 00000080:00200000:2.0:1788201594.737246:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008b7f6c20[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 51] 00000080:00200000:2.0:1788201594.737249:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000aa82af90 17ffffc0001001 3:0 ffff8bc1725b81c0 51 lru 00000080:00200000:2.0:1788201594.737254:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000652f74cc 51: 1< 0 - - > 2< 208896 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.737257:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008b7f6c20 00000080:00200000:2.0:1788201594.737258:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 52. 00000080:00200000:2.0:1788201594.737260:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 52 of 0 to 2301 bytes 00000080:00200000:2.0:1788201594.737289:0:24470:0:(rw26.c:898:ll_write_end()) pos 212992, len 2301, copied 2301 00000080:00200000:2.0:1788201594.737294:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001b8d804e[3 00000000b4ed979b 2 1 00000000bab2d509 0 0 52] 00000080:00200000:2.0:1788201594.737296:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000d27a551 17ffffc0001001 3:0 ffff8bc1725b80e0 52 lru 00000080:00200000:2.0:1788201594.737301:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000061874d28 52: 1< 0 - - > 2< 212992 0 0 0x0 0x0 | 000000008930e75a 000000001819d88d > 3< 0 0 > 4< 0 0 8 20447232 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201594.737303:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001b8d804e 00000080:00200000:2.0:1788201594.737304:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 53. 00000080:00200000:2.0:1788201594.737309:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 53, from 0, to 2301 prio 0 00000008:00010000:2.0:1788201594.737345:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000efb6ca0b ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1788201594.737395:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145984478, count 15, dirtied 15 00000080:00200000:2.0:1788201594.737413:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145984478, count 15, dirtied 15 00000080:00200000:2.0:1788201594.737427:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145984478, count 15, dirtied 15 00000080:00200000:2.0:1788201594.737441:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145984478, count 8, dirtied 8 00000080:00200000:2.0:1788201594.737445:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 53 pages 215293 bytes, tot: 215293 00000080:00200000:2.0:1788201594.737449:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) sanity-lfsck.sh: write bytes 0, result: 215293 00000020:00010000:2.0:1788201594.737471:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1498447b8 (ffff8bc146919cf8/0) at cl_lock_release():245 00000020:00010000:2.0:1788201594.737475:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1498447b8 (ffff8bc146919cf8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201594.737478:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d530 (ffff8bc1469195a8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1788201594.737487:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.737501:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1788201594.737522:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1498447b8 (ffff8bc146919cf8/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201594.737590:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d530 (ffff8bc146919cf8/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201594.737603:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 215293 bytes 00000080:00200000:2.0:1788201594.737611:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 52] 00000080:00200000:2.0:1788201594.737650:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x197:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201594.737654:0:24470:0:(file.c:2238:ll_file_io_generic()) sanity-lfsck.sh: 2 io complete with rc: 0, result: 215293, restart: 0 00000080:00200000:2.0:1788201594.737662:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x197:0x0] updating i_size 215293 i_blocks 1 00000080:00200000:2.0:1788201594.737667:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 215293 00000080:00200008:2.0:1788201594.737727:0:24470:0:(file.c:479:ll_file_release()) START file sanity-lfsck.sh:[0x200000bd7:0x197:0x0](ffff8bc1459842c8), flags 100001 00000002:00100000:2.0:1788201594.737887:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1724a1500 x1875064728012928/t8589937456(8589937456) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1788201594.737902:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1788201594.737908:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a0380 x1875064728013568/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1788201594.737936:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a0380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728013568:192.168.201.143@tcp:35:cp.0 00000100:00100000:2.0:1788201594.738057:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc15040ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201594.741120:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a0380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728013568:192.168.201.143@tcp:35:cp.0 00000002:00100000:2.0:1788201594.741233:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1724a1500 x1875064728012928/t8589937456(8589937456) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201594.741325:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201594.741346:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.741383:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 243 lru_type: 1 00010000:00010000:2.0:1788201594.741406:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 243 lru_type: 1 00000080:00200000:2.0:1788201594.741414:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.741420:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201594.741424:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201594.741434:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201594.741439:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 243 lru_type: 1 00010000:00010000:2.0:1788201594.741449:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 244 lru_type: 1 00000080:00200000:2.0:1788201594.741467:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.741476:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201594.741483:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.741487:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-lfsck.sh, flags=8 00000080:00200008:2.0:1788201594.741495:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-lfsck.sh:[0x200000bd7:0x197:0x0](ffff8bc1459842c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1788201594.741501:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x197:0x0](ffff8bc1459842c8),name=sanity-lfsck.sh 00000002:00010000:2.0:1788201594.741514:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x197:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.741588:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098010 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201594.741600:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098010 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1788201594.741613:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.741618:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x197:0x0](ffff8bc1459842c8) 00000080:00010000:2.0:1788201594.741620:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x197:0x0](ffff8bc1459842c8) for lock 0xd138388016f6f72b 00000080:00010000:2.0:1788201594.741625:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f72b from it ffffadd1c7debcb8 00010000:00010000:2.0:1788201594.741629:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171098010 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201594.741636:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098010 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201594.741694:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x197:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201594.741705:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x197:0x0] 00000008:00010000:2.0:1788201594.741740:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201594.741744:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d530, osc lock ffff8bc151fc1430, flags 0x400001002 00010000:00010000:2.0:1788201594.741764:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.741776:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:2.0:1788201594.741941:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1788201594.741947:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.741957:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1788201594.741974:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1788201594.741985:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x197:0x0] updating i_size 215293 i_blocks 1 00000020:00010000:2.0:1788201594.741990:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc146005e10 (ffff8bc146919cf8/0) at cl_lock_release():245 00000020:00010000:2.0:1788201594.741994:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146005e10 (ffff8bc146919cf8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201594.741997:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d530 (ffff8bc1469195a8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201594.742001:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146005e10 (ffff8bc146919cf8/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201594.742004:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d530 (ffff8bc146919cf8/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201594.742038:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x197:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201594.742109:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201594.742117:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.742125:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 244 lru_type: 1 00010000:00010000:2.0:1788201594.742148:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 244 lru_type: 1 00000080:00200000:2.0:1788201594.742156:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.742161:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201594.742164:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201594.742168:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201594.742172:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 244 lru_type: 1 00010000:00010000:2.0:1788201594.742179:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 245 lru_type: 1 00000080:00200000:2.0:1788201594.742192:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.742197:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201594.742200:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.742216:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-lnet.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:2.0:1788201594.742220:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-lnet.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201594.742230:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-lnet.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201594.742285:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f740 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.742293:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f740 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.742305:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f740 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.742330:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a0e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728013696:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201594.742449:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc15040ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201594.745598:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a0e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728013696:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201594.745633:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f740 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.745650:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f740 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.745657:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f740 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.745664:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f740 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.745676:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f740 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.745683:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172473800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:2.0:1788201594.745688:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f740 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.745695:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f740 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.745703:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f740 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.745712:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201594.745720:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f740 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.745728:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f740 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201594.745753:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a0e00 x1875064728013696/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201594.745772:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1788201594.745843:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201594.745918:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201594.745936:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.745946:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 245 lru_type: 1 00010000:00010000:2.0:1788201594.745964:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 245 lru_type: 1 00000080:00200000:2.0:1788201594.745972:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.745977:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201594.745981:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201594.745987:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201594.745991:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 245 lru_type: 1 00010000:00010000:2.0:1788201594.746001:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 246 lru_type: 1 00000080:00200000:2.0:1788201594.746018:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.746026:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201594.746033:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.746046:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-lnet.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:2.0:1788201594.746051:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-lnet.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201594.746062:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-lnet.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201594.746202:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6600/0xd138388016f6f747 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.746211:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6600/0xd138388016f6f747 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.746224:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6600/0xd138388016f6f747 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.746253:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a0e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728013824:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201594.746361:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc15040ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201594.754040:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a0e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728013824:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201594.754077:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6600/0xd138388016f6f747 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.754110:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6600/0xd138388016f6f747 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.754119:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6600/0xd138388016f6f747 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.754126:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6600/0xd138388016f6f747 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.754148:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6600/0xd138388016f6f747 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.754155:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1443b6600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:2.0:1788201594.754160:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6600/0xd138388016f6f747 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.754168:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6600/0xd138388016f6f747 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.754176:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6600/0xd138388016f6f747 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.754183:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201594.754192:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6600/0xd138388016f6f747 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.754199:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6600/0xd138388016f6f747 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201594.754223:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a0e00 x1875064728013824/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201594.754240:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1788201594.754271:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201594.754419:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201594.754439:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.754451:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 246 lru_type: 1 00010000:00010000:2.0:1788201594.754464:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 246 lru_type: 1 00000080:00200000:2.0:1788201594.754470:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.754476:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201594.754480:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201594.754487:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:2.0:1788201594.754492:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 246 lru_type: 1 00010000:00010000:2.0:1788201594.754500:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 247 lru_type: 1 00000080:00200000:2.0:1788201594.754518:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.754539:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201594.754546:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.754563:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1788201594.754569:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sanity-lnet.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14c594000, open_flags 80c1, mode 81ed opened 0 00000080:00200000:2.0:1788201594.754578:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-lnet.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:2.0:1788201594.754602:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-lnet.sh,[0x200000bd7:0x198:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:2.0:1788201594.754664:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.754671:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1788201594.754685:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1788201594.754693:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a0e00 x1875064728014080/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1788201594.754704:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.754730:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a0e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728014080:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201594.754925:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc15040ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201594.760689:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a0e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728014080:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201594.760723:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109806b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.760751:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x198:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109806b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.760759:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109806b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.760773:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109806b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.760787:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109806b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.760835:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109806b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.760845:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109806b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.760852:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109806b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201594.760868:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1724a0e00 x1875064728014080/t8589937458(8589937458) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1788201594.760882:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a0e00 x1875064728014080/t8589937458(8589937458) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1788201594.760898:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109806b expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1788201594.760912:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109806b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.760924:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/408 (0 0) 00000080:00200000:2.0:1788201594.760933:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1788201594.760950:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=sanity-lnet.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:2.0:1788201594.760993:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x198:0x0](ffff8bc1459863c8) 00000080:00200000:2.0:1788201594.761483:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x198:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1788201594.761496:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x198:0x0](ffff8bc1459863c8) 00000080:00010000:2.0:1788201594.761500:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x198:0x0](ffff8bc1459863c8) for lock 0xd138388016f6f74e 00000080:00010000:2.0:1788201594.761514:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x198:0x0](ffff8bc1459863c8) 00000080:00200008:2.0:1788201594.761608:0:24470:0:(file.c:1090:ll_file_open()) START file sanity-lnet.sh:[0x200000bd7:0x198:0x0](ffff8bc1459863c8), flags 100301 00000002:00100000:2.0:1788201594.761635:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a0e00 x1875064728014080/t8589937458(8589937458) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1788201594.761689:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f74e from it ffff8bc1507dbf60 00010000:00010000:2.0:1788201594.761696:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109806b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.761708:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109806b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201594.761737:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x198:0x0](ffff8bc1459863c8), inode mode 81ed mask 40 00000080:00200008:2.0:1788201594.761774:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-lnet.sh:[0x200000bd7:0x198:0x0](ffff8bc1459863c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1788201594.761781:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x198:0x0](ffff8bc1459863c8),name=sanity-lnet.sh 00000002:00010000:2.0:1788201594.761866:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x198:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.761881:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109806b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.761894:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109806b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201594.761907:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.761913:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x198:0x0](ffff8bc1459863c8) 00000080:00010000:2.0:1788201594.761916:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x198:0x0](ffff8bc1459863c8) for lock 0xd138388016f6f74e 00000080:00010000:2.0:1788201594.761919:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f74e from it ffffadd1c7debcd8 00010000:00010000:2.0:1788201594.761922:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109806b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.761930:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109806b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1788201594.761957:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x198:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201594.761967:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x198:0x0] 00000008:00010000:2.0:1788201594.761998:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201594.762002:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d9b0, osc lock ffff8bc151fc1430, flags 0x400001002 00010000:00010000:2.0:1788201594.762058:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f755 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.762069:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f755 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201594.763573:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728014208:192.168.201.143@tcp:101:cp.0 00000020:00200000:2.0:1788201594.764000:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1788201594.767379:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f755 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.767420:0:10054:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f755 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098079 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.767440:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f755 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098079 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.767455:0:10054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f755 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098079 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201594.767476:0:10054:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f755 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171098079 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201594.767490:0:10054:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201594.767601:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f755 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171098079 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.767612:0:10054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f755 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171098079 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.767622:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f755 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171098079 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.767633:0:10054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f755 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171098079 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201594.767666:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728014208:192.168.201.143@tcp:101:cp.0 00000080:00200000:2.0:1788201594.767750:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x198:0x0] updating i_size 0 i_blocks 1 00000020:00010000:2.0:1788201594.767757:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc146005e10 (ffff8bc146919cf8/0) at cl_lock_release():245 00000020:00010000:2.0:1788201594.767761:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146005e10 (ffff8bc146919cf8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201594.767766:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d9b0 (ffff8bc1469195a8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201594.767771:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146005e10 (ffff8bc146919cf8/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201594.767774:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d9b0 (ffff8bc146919cf8/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201594.767890:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x198:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1788201594.768677:0:24470:0:(file.c:2638:do_file_write_iter()) START file sanity-lnet.sh:[0x200000bd7:0x198:0x0], ppos: 0, count: 199288 00000080:00200000:2.0:1788201594.768720:0:24470:0:(file.c:2090:ll_file_io_generic()) sanity-lnet.sh: write ppos: 0, bytes: 199288 00000080:00200000:2.0:1788201594.768727:0:24470:0:(file.c:1848:ll_io_set_mirror()) sanity-lnet.sh: desiginated mirror: 0 00000020:00200000:2.0:1788201594.768734:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000e39be8d1[0x110, 1, [0x200000bd7:0x198:0x0] hash] 00000020:00200000:2.0:1788201594.768737:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 199288) 0 0 00000080:00200000:2.0:1788201594.768741:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x198:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201594.768755:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 48] 00020000:00200000:2.0:1788201594.768764:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 199288) 199288, 199288 00020000:00200000:2.0:1788201594.768769:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201594.768947:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 48] 00000008:00010000:2.0:1788201594.768962:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1788201594.768967:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d9b0, osc lock ffff8bc151fc1430, flags 0x0 00010000:00010000:2.0:1788201594.768985:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/446 (0 200703) 00010000:00010000:2.0:1788201594.769203:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.769216:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 3 type: EXT [0->200703] (req 0->200703) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.769229:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 3 type: EXT [0->200703] (req 0->200703) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.769255:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728014336:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201594.769366:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc146467780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201594.771956:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201594.772288:0:20877:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788201594.772310:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743486720 00000100:00100000:2.0:1788201594.772321:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743486720 00000100:00100000:2.0:1788201594.772423:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 807 00000100:00100000:2.0:1788201594.772434:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc145d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23415:x1875064743486720:12345-192.168.201.143@tcp:104: 00010000:00010000:2.0:1788201594.772457:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f755 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171098079 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.772608:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201594.772615:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc145d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23415:x1875064743486720:12345-192.168.201.143@tcp:104: Request processed in 183us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201594.772624:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 807 00010000:00010000:0.0:1788201594.773037:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201594.773048:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f755 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171098079 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.773060:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1443b6c00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201594.773069:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f755 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171098079 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201594.773274:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x198:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201594.773289:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x198:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1788201594.773380:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f755 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171098079 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.773388:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201594.773427:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f755 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171098079 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.773437:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f755 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171098079 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.773460:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201594.773463:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201594.773464:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201594.773476:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201594.773494:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728014464:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201594.776480:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201594.776650:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728014336:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201594.776688:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->200703] (req 0->200703) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.776705:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->200703] (req 0->200703) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.776715:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->200703] (req 0->200703) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201594.777894:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743486848 00000100:00100000:3.0:1788201594.777909:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743486848 00000100:00100000:3.0:1788201594.777985:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 808 00000100:00100000:3.0:1788201594.777998:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1727d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21005:x1875064743486848:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201594.778015:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->200703] (req 0->200703) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.778028:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->200703] (req 0->200703) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.778040:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.778051:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.778060:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.778073:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.778118:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1443b6600) 00000100:00100000:3.0:1788201594.778345:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1727d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21005:x1875064743486848:12345-192.168.201.143@tcp:105: Request processed in 349us (1879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201594.778376:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 808 00010000:00010000:1.0:1788201594.780406:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.780431:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.780456:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201594.780471:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.780486:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.780496:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201594.780548:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) sanity-lnet.sh: write [0, 199288) append 0 append lockpos 0 00000080:00200000:1.0:1788201594.780573:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.780635:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:1.0:1788201594.780650:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000cf0597c9[3 0000000046337b78 2 1 00000000bab2d509 0 0 0] 00000080:00200000:1.0:1788201594.780654:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001dad94d8 17ffffc0001001 3:0 ffff8bc14747d7e0 0 lru 00000080:00200000:1.0:1788201594.780663:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007acb7114 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.780666:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000cf0597c9 00000080:00200000:1.0:1788201594.780668:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201594.780671:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.780695:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:1.0:1788201594.780700:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f877a8ed[3 0000000046337b78 2 1 00000000bab2d509 0 0 1] 00000080:00200000:1.0:1788201594.780703:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000404ab78a 17ffffc0001001 3:0 ffff8bc14747d700 1 lru 00000080:00200000:1.0:1788201594.780710:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004c5c1176 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.780712:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f877a8ed 00000080:00200000:1.0:1788201594.780714:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:1.0:1788201594.780716:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.780729:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:1.0:1788201594.780734:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009c4be99e[3 0000000046337b78 2 1 00000000bab2d509 0 0 2] 00000080:00200000:1.0:1788201594.780737:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000fc680308 17ffffc0001001 3:0 ffff8bc14747db60 2 lru 00000080:00200000:1.0:1788201594.780742:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006f026f14 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.780744:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009c4be99e 00000080:00200000:1.0:1788201594.780745:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:1.0:1788201594.780747:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.780772:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:1.0:1788201594.780776:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ec3a15ed[3 0000000046337b78 2 1 00000000bab2d509 0 0 3] 00000080:00200000:1.0:1788201594.780779:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000094b962aa 17ffffc0001021 2:0 ffff8bc14747d2a0 3 lru 00000080:00200000:1.0:1788201594.780784:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008f00ff3a 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.780786:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ec3a15ed 00000080:00200000:1.0:1788201594.780787:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:1.0:1788201594.780828:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.780848:0:24470:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:1.0:1788201594.780853:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001f8931d9[3 0000000046337b78 2 1 00000000bab2d509 0 0 4] 00000080:00200000:1.0:1788201594.780856:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ccd37485 17ffffc0001001 3:0 ffff8bc14747d460 4 lru 00000080:00200000:1.0:1788201594.780861:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000e9269b6 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.780863:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001f8931d9 00000080:00200000:1.0:1788201594.780864:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:1.0:1788201594.780866:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.780882:0:24470:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:1.0:1788201594.780886:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000490e00e1[3 0000000046337b78 2 1 00000000bab2d509 0 0 5] 00000080:00200000:1.0:1788201594.780889:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ebbf3570 17ffffc0001001 3:0 ffff8bc14747dd20 5 lru 00000080:00200000:1.0:1788201594.780894:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000728d3307 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.780896:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000490e00e1 00000080:00200000:1.0:1788201594.780897:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:1.0:1788201594.780899:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.780913:0:24470:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:1.0:1788201594.780917:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000099ccabf[3 0000000046337b78 2 1 00000000bab2d509 0 0 6] 00000080:00200000:1.0:1788201594.780920:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c787ac1d 17ffffc0001001 3:0 ffff8bc14747d000 6 lru 00000080:00200000:1.0:1788201594.780925:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000053f8c377 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.780927:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000099ccabf 00000080:00200000:1.0:1788201594.780928:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:1.0:1788201594.780930:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.780943:0:24470:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:1.0:1788201594.780948:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000bf42ebd6[3 0000000046337b78 2 1 00000000bab2d509 0 0 7] 00000080:00200000:1.0:1788201594.780950:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004ee2982f 17ffffc0001001 3:0 ffff8bc14747d380 7 lru 00000080:00200000:1.0:1788201594.780955:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006f77250d 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.780957:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000bf42ebd6 00000080:00200000:1.0:1788201594.780958:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:1.0:1788201594.780960:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.780976:0:24470:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:1.0:1788201594.780980:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000034e0e4dc[3 0000000046337b78 2 1 00000000bab2d509 0 0 8] 00000080:00200000:1.0:1788201594.780982:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003d447e98 17ffffc0001001 3:0 ffff8bc14747d1c0 8 lru 00000080:00200000:1.0:1788201594.780988:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000318529e8 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.780990:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000034e0e4dc 00000080:00200000:1.0:1788201594.780991:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:1.0:1788201594.780993:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.781006:0:24470:0:(rw26.c:898:ll_write_end()) pos 36864, len 4096, copied 4096 00000080:00200000:1.0:1788201594.781011:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000644f339b[3 0000000046337b78 2 1 00000000bab2d509 0 0 9] 00000080:00200000:1.0:1788201594.781013:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000da45744e 17ffffc0001001 3:0 ffff8bc14747d0e0 9 lru 00000080:00200000:1.0:1788201594.781018:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009d51473c 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.781021:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000644f339b 00000080:00200000:1.0:1788201594.781022:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:1.0:1788201594.781025:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 10 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.781043:0:24470:0:(rw26.c:898:ll_write_end()) pos 40960, len 4096, copied 4096 00000080:00200000:1.0:1788201594.781047:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e5ea564a[3 0000000046337b78 2 1 00000000bab2d509 0 0 10] 00000080:00200000:1.0:1788201594.781050:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007fe4a1c0 17ffffc0001001 3:0 ffff8bc17263be00 10 lru 00000080:00200000:1.0:1788201594.781054:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000016711c0d 10: 1< 0 - - > 2< 40960 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.781056:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e5ea564a 00000080:00200000:1.0:1788201594.781057:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 11. 00000080:00200000:1.0:1788201594.781059:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 11 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.781074:0:24470:0:(rw26.c:898:ll_write_end()) pos 45056, len 4096, copied 4096 00000080:00200000:1.0:1788201594.781078:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000210843ca[3 0000000046337b78 2 1 00000000bab2d509 0 0 11] 00000080:00200000:1.0:1788201594.781081:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006d01fdae 17ffffc0001001 3:0 ffff8bc17263bee0 11 lru 00000080:00200000:1.0:1788201594.781086:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e7c41cc9 11: 1< 0 - - > 2< 45056 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.781088:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000210843ca 00000080:00200000:1.0:1788201594.781102:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 12. 00000080:00200000:1.0:1788201594.781105:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 12 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.781121:0:24470:0:(rw26.c:898:ll_write_end()) pos 49152, len 4096, copied 4096 00000080:00200000:1.0:1788201594.781126:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007f67ee01[3 0000000046337b78 2 1 00000000bab2d509 0 0 12] 00000080:00200000:1.0:1788201594.781129:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000cad844bd 17ffffc0001001 3:0 ffff8bc17263b620 12 lru 00000100:00100000:3.0:1788201594.781673:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728014464:192.168.201.143@tcp:103:ldlm_bl.0 00000080:00200000:1.0:1788201594.782276:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000066ecc679 12: 1< 0 - - > 2< 49152 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.782279:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007f67ee01 00000080:00200000:1.0:1788201594.782280:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 13. 00000080:00200000:1.0:1788201594.782284:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 13 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.782318:0:24470:0:(rw26.c:898:ll_write_end()) pos 53248, len 4096, copied 4096 00000080:00200000:1.0:1788201594.782325:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009e5f5bf4[3 0000000046337b78 2 1 00000000bab2d509 0 0 13] 00000080:00200000:1.0:1788201594.782328:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000afe5a933 17ffffc0001001 3:0 ffff8bc17263b7e0 13 lru 00000080:00200000:1.0:1788201594.782332:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000576d6b3f 13: 1< 0 - - > 2< 53248 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.782335:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009e5f5bf4 00000080:00200000:1.0:1788201594.782336:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 14. 00000080:00200000:1.0:1788201594.782338:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 14 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.782365:0:24470:0:(rw26.c:898:ll_write_end()) pos 57344, len 4096, copied 4096 00000080:00200000:1.0:1788201594.782370:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000dab40dcc[3 0000000046337b78 2 1 00000000bab2d509 0 0 14] 00000080:00200000:1.0:1788201594.782372:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000099abd1bf 17ffffc0001001 3:0 ffff8bc17263b700 14 lru 00000080:00200000:1.0:1788201594.782377:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000099a4822c 14: 1< 0 - - > 2< 57344 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.782379:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000dab40dcc 00000080:00200000:1.0:1788201594.782380:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 15. 00000080:00200000:1.0:1788201594.782382:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 15 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.782398:0:24470:0:(rw26.c:898:ll_write_end()) pos 61440, len 4096, copied 4096 00000080:00200000:1.0:1788201594.782403:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000aad3f9cb[3 0000000046337b78 2 1 00000000bab2d509 0 0 15] 00000080:00200000:1.0:1788201594.782405:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000642dcc5f 17ffffc0001001 3:0 ffff8bc17263bb60 15 lru 00000080:00200000:1.0:1788201594.782410:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001718cc57 15: 1< 0 - - > 2< 61440 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.782412:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000aad3f9cb 00000080:00200000:1.0:1788201594.782412:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 16. 00000080:00200000:1.0:1788201594.782414:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 16 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.782428:0:24470:0:(rw26.c:898:ll_write_end()) pos 65536, len 4096, copied 4096 00000080:00200000:1.0:1788201594.782431:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000bdc6b525[3 0000000046337b78 2 1 00000000bab2d509 0 0 16] 00000080:00200000:1.0:1788201594.782434:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d9963167 17ffffc0001001 3:0 ffff8bc17263b2a0 16 lru 00000080:00200000:1.0:1788201594.782439:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000fa31f859 16: 1< 0 - - > 2< 65536 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.782441:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000bdc6b525 00000080:00200000:1.0:1788201594.782442:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 17. 00000080:00200000:1.0:1788201594.782444:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 17 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.782458:0:24470:0:(rw26.c:898:ll_write_end()) pos 69632, len 4096, copied 4096 00000080:00200000:1.0:1788201594.782462:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000088b6ec3b[3 0000000046337b78 2 1 00000000bab2d509 0 0 17] 00000080:00200000:1.0:1788201594.782465:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ea3e74d4 17ffffc0001001 3:0 ffff8bc17263b460 17 lru 00000080:00200000:1.0:1788201594.782469:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e01110c3 17: 1< 0 - - > 2< 69632 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.782471:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000088b6ec3b 00000080:00200000:1.0:1788201594.782472:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 18. 00000080:00200000:1.0:1788201594.782474:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 18 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.782499:0:24470:0:(rw26.c:898:ll_write_end()) pos 73728, len 4096, copied 4096 00000080:00200000:1.0:1788201594.782504:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c8ac99ff[3 0000000046337b78 2 1 00000000bab2d509 0 0 18] 00000080:00200000:1.0:1788201594.782506:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000810adda0 17ffffc0001021 2:0 ffff8bc17263bd20 18 lru 00000080:00200000:1.0:1788201594.782512:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000002a2acc77 18: 1< 0 - - > 2< 73728 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.782515:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c8ac99ff 00000080:00200000:1.0:1788201594.782516:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 19. 00000080:00200000:1.0:1788201594.782518:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 19 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.783097:0:24470:0:(rw26.c:898:ll_write_end()) pos 77824, len 4096, copied 4096 00000080:00200000:1.0:1788201594.783104:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f41cdc94[3 0000000046337b78 2 1 00000000bab2d509 0 0 19] 00000080:00200000:1.0:1788201594.783107:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007cdf7412 17ffffc0001001 3:0 ffff8bc17263b000 19 lru 00000080:00200000:1.0:1788201594.783112:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000090d4a79 19: 1< 0 - - > 2< 77824 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.783114:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f41cdc94 00000080:00200000:1.0:1788201594.783115:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 20. 00000080:00200000:1.0:1788201594.783117:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 20 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.783384:0:24470:0:(rw26.c:898:ll_write_end()) pos 81920, len 4096, copied 4096 00000080:00200000:1.0:1788201594.783390:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000023a0a7a9[3 0000000046337b78 2 1 00000000bab2d509 0 0 20] 00000080:00200000:1.0:1788201594.783393:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000080fdfb72 17ffffc0001001 3:0 ffff8bc17263b380 20 lru 00000080:00200000:1.0:1788201594.783398:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000788bfcf6 20: 1< 0 - - > 2< 81920 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.783400:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000023a0a7a9 00000080:00200000:1.0:1788201594.783402:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 21. 00000080:00200000:1.0:1788201594.783404:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 21 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.783418:0:24470:0:(rw26.c:898:ll_write_end()) pos 86016, len 4096, copied 4096 00000080:00200000:1.0:1788201594.783422:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000aa7bd5e8[3 0000000046337b78 2 1 00000000bab2d509 0 0 21] 00000080:00200000:1.0:1788201594.783425:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d5071ce5 17ffffc0001001 3:0 ffff8bc17263b1c0 21 lru 00000080:00200000:1.0:1788201594.783430:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000cc18416c 21: 1< 0 - - > 2< 86016 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.783433:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000aa7bd5e8 00000080:00200000:1.0:1788201594.783434:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 22. 00000080:00200000:1.0:1788201594.783436:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 22 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.783452:0:24470:0:(rw26.c:898:ll_write_end()) pos 90112, len 4096, copied 4096 00000080:00200000:1.0:1788201594.783456:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000039fb043d[3 0000000046337b78 2 1 00000000bab2d509 0 0 22] 00000080:00200000:1.0:1788201594.783459:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000045bb167e 17ffffc0001001 3:0 ffff8bc17263b0e0 22 lru 00000080:00200000:1.0:1788201594.783464:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e39c335c 22: 1< 0 - - > 2< 90112 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.783467:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000039fb043d 00000080:00200000:1.0:1788201594.783468:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 23. 00000080:00200000:1.0:1788201594.783470:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 23 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.783486:0:24470:0:(rw26.c:898:ll_write_end()) pos 94208, len 4096, copied 4096 00000080:00200000:1.0:1788201594.783491:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000046070a35[3 0000000046337b78 2 1 00000000bab2d509 0 0 23] 00000080:00200000:1.0:1788201594.783494:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007aa25ac6 17ffffc0001001 3:0 ffff8bc17263b9a0 23 lru 00000080:00200000:1.0:1788201594.783499:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000046e309ec 23: 1< 0 - - > 2< 94208 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.783501:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000046070a35 00000080:00200000:1.0:1788201594.783502:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 24. 00000080:00200000:1.0:1788201594.783504:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 24 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.783519:0:24470:0:(rw26.c:898:ll_write_end()) pos 98304, len 4096, copied 4096 00000080:00200000:1.0:1788201594.783523:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000dd387472[3 0000000046337b78 2 1 00000000bab2d509 0 0 24] 00000080:00200000:1.0:1788201594.783958:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005df515c7 17ffffc0001001 3:0 ffff8bc17263bc40 24 lru 00000080:00200000:1.0:1788201594.783964:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000fd6af688 24: 1< 0 - - > 2< 98304 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.783967:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000dd387472 00000080:00200000:1.0:1788201594.783969:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 25. 00000080:00200000:1.0:1788201594.783971:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 25 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.783994:0:24470:0:(rw26.c:898:ll_write_end()) pos 102400, len 4096, copied 4096 00000080:00200000:1.0:1788201594.783999:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006900ea5b[3 0000000046337b78 2 1 00000000bab2d509 0 0 25] 00000080:00200000:1.0:1788201594.784002:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e10f489e 17ffffc0001001 3:0 ffff8bc17263ba80 25 lru 00000080:00200000:1.0:1788201594.784008:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000002628df9b 25: 1< 0 - - > 2< 102400 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.784010:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006900ea5b 00000080:00200000:1.0:1788201594.784011:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 26. 00000080:00200000:1.0:1788201594.784013:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 26 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.784612:0:24470:0:(rw26.c:898:ll_write_end()) pos 106496, len 4096, copied 4096 00000080:00200000:1.0:1788201594.784621:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002cdd9c36[3 0000000046337b78 2 1 00000000bab2d509 0 0 26] 00000080:00200000:1.0:1788201594.784624:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000074286727 17ffffc0001001 3:0 ffff8bc17263b540 26 lru 00000080:00200000:1.0:1788201594.784630:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001a4b2fee 26: 1< 0 - - > 2< 106496 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.784632:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002cdd9c36 00000080:00200000:1.0:1788201594.784634:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 27. 00000080:00200000:1.0:1788201594.784636:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 27 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.784654:0:24470:0:(rw26.c:898:ll_write_end()) pos 110592, len 4096, copied 4096 00000080:00200000:1.0:1788201594.784659:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000653a5989[3 0000000046337b78 2 1 00000000bab2d509 0 0 27] 00000080:00200000:1.0:1788201594.784662:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002d2508fa 17ffffc0001001 3:0 ffff8bc17263b8c0 27 lru 00000080:00200000:1.0:1788201594.784667:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a969c44d 27: 1< 0 - - > 2< 110592 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.784670:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000653a5989 00000080:00200000:1.0:1788201594.784671:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 28. 00000080:00200000:1.0:1788201594.784674:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 28 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.784692:0:24470:0:(rw26.c:898:ll_write_end()) pos 114688, len 4096, copied 4096 00000080:00200000:1.0:1788201594.784696:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000209a7b75[3 0000000046337b78 2 1 00000000bab2d509 0 0 28] 00000080:00200000:1.0:1788201594.784699:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000fd0aa09e 17ffffc0001001 3:0 ffff8bc144296540 28 lru 00000080:00200000:1.0:1788201594.784705:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a61b334e 28: 1< 0 - - > 2< 114688 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.784707:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000209a7b75 00000080:00200000:1.0:1788201594.784708:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 29. 00000080:00200000:1.0:1788201594.784710:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 29 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.784729:0:24470:0:(rw26.c:898:ll_write_end()) pos 118784, len 4096, copied 4096 00000080:00200000:1.0:1788201594.784733:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008c1dd6d3[3 0000000046337b78 2 1 00000000bab2d509 0 0 29] 00000080:00200000:1.0:1788201594.784736:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000048343717 17ffffc0001001 3:0 ffff8bc1442968c0 29 lru 00000080:00200000:1.0:1788201594.784742:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a36a4299 29: 1< 0 - - > 2< 118784 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.784744:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008c1dd6d3 00000080:00200000:1.0:1788201594.784745:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 30. 00000080:00200000:1.0:1788201594.784747:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 30 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.784762:0:24470:0:(rw26.c:898:ll_write_end()) pos 122880, len 4096, copied 4096 00000080:00200000:1.0:1788201594.784766:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009cdd6525[3 0000000046337b78 2 1 00000000bab2d509 0 0 30] 00000080:00200000:1.0:1788201594.784769:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005b77529f 17ffffc0001001 3:0 ffff8bc144296e00 30 lru 00000080:00200000:1.0:1788201594.784774:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007498f46d 30: 1< 0 - - > 2< 122880 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.784776:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009cdd6525 00000080:00200000:1.0:1788201594.784778:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 31. 00000080:00200000:1.0:1788201594.784779:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 31 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.784914:0:24470:0:(rw26.c:898:ll_write_end()) pos 126976, len 4096, copied 4096 00000080:00200000:1.0:1788201594.784920:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a8d49d54[3 0000000046337b78 2 1 00000000bab2d509 0 0 31] 00000080:00200000:1.0:1788201594.784922:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c407400b 17ffffc0001001 3:0 ffff8bc144296ee0 31 lru 00000080:00200000:1.0:1788201594.784928:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d75c9086 31: 1< 0 - - > 2< 126976 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.784930:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a8d49d54 00000080:00200000:1.0:1788201594.784931:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 32. 00000080:00200000:1.0:1788201594.784934:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 32 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.784956:0:24470:0:(rw26.c:898:ll_write_end()) pos 131072, len 4096, copied 4096 00000080:00200000:1.0:1788201594.784960:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006583b4fd[3 0000000046337b78 2 1 00000000bab2d509 0 0 32] 00000080:00200000:1.0:1788201594.784963:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000189cbfe4 17ffffc0001001 3:0 ffff8bc144296620 32 lru 00000080:00200000:1.0:1788201594.784968:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c9a65587 32: 1< 0 - - > 2< 131072 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.784970:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006583b4fd 00000080:00200000:1.0:1788201594.784971:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 33. 00000080:00200000:1.0:1788201594.784973:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 33 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.784997:0:24470:0:(rw26.c:898:ll_write_end()) pos 135168, len 4096, copied 4096 00000080:00200000:1.0:1788201594.785002:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000dd248f82[3 0000000046337b78 2 1 00000000bab2d509 0 0 33] 00000080:00200000:1.0:1788201594.785004:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d264dea2 17ffffc0001021 2:0 ffff8bc1442967e0 33 lru 00000080:00200000:1.0:1788201594.785010:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000dcdced74 33: 1< 0 - - > 2< 135168 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.785012:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000dd248f82 00000080:00200000:1.0:1788201594.785013:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 34. 00000080:00200000:1.0:1788201594.785015:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 34 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.785031:0:24470:0:(rw26.c:898:ll_write_end()) pos 139264, len 4096, copied 4096 00000080:00200000:1.0:1788201594.785035:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000053db4f52[3 0000000046337b78 2 1 00000000bab2d509 0 0 34] 00000080:00200000:1.0:1788201594.785038:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000049eae878 17ffffc0001001 3:0 ffff8bc144296700 34 lru 00000080:00200000:1.0:1788201594.785043:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a9b7db9e 34: 1< 0 - - > 2< 139264 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.785045:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000053db4f52 00000080:00200000:1.0:1788201594.785046:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 35. 00000080:00200000:1.0:1788201594.785048:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 35 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.785654:0:24470:0:(rw26.c:898:ll_write_end()) pos 143360, len 4096, copied 4096 00000080:00200000:1.0:1788201594.785664:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008be9491c[3 0000000046337b78 2 1 00000000bab2d509 0 0 35] 00000080:00200000:1.0:1788201594.785667:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000083e9ce0b 17ffffc0001001 3:0 ffff8bc144296b60 35 lru 00000080:00200000:1.0:1788201594.785673:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006f176e3b 35: 1< 0 - - > 2< 143360 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.785676:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008be9491c 00000080:00200000:1.0:1788201594.785677:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 36. 00000080:00200000:1.0:1788201594.785679:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 36 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.786257:0:24470:0:(rw26.c:898:ll_write_end()) pos 147456, len 4096, copied 4096 00000080:00200000:1.0:1788201594.786264:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000029669824[3 0000000046337b78 2 1 00000000bab2d509 0 0 36] 00000080:00200000:1.0:1788201594.786268:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007ff2e4be 17ffffc0001001 3:0 ffff8bc1442962a0 36 lru 00000080:00200000:1.0:1788201594.786274:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000002bf0a529 36: 1< 0 - - > 2< 147456 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.786276:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000029669824 00000080:00200000:1.0:1788201594.786278:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 37. 00000080:00200000:1.0:1788201594.786280:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 37 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.786298:0:24470:0:(rw26.c:898:ll_write_end()) pos 151552, len 4096, copied 4096 00000080:00200000:1.0:1788201594.786301:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e4989499[3 0000000046337b78 2 1 00000000bab2d509 0 0 37] 00000080:00200000:1.0:1788201594.786304:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008a4c2909 17ffffc0001001 3:0 ffff8bc144296460 37 lru 00000080:00200000:1.0:1788201594.786309:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000048953dc3 37: 1< 0 - - > 2< 151552 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.786311:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e4989499 00000080:00200000:1.0:1788201594.786312:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 38. 00000080:00200000:1.0:1788201594.786313:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 38 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.786325:0:24470:0:(rw26.c:898:ll_write_end()) pos 155648, len 4096, copied 4096 00000080:00200000:1.0:1788201594.786329:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001891e6b3[3 0000000046337b78 2 1 00000000bab2d509 0 0 38] 00000080:00200000:1.0:1788201594.786331:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004af52ab1 17ffffc0001001 3:0 ffff8bc144296d20 38 lru 00000080:00200000:1.0:1788201594.786336:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ee7b655c 38: 1< 0 - - > 2< 155648 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.786338:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001891e6b3 00000080:00200000:1.0:1788201594.786339:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 39. 00000080:00200000:1.0:1788201594.786340:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 39 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.786368:0:24470:0:(rw26.c:898:ll_write_end()) pos 159744, len 4096, copied 4096 00000080:00200000:1.0:1788201594.786372:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003544d879[3 0000000046337b78 2 1 00000000bab2d509 0 0 39] 00000080:00200000:1.0:1788201594.786374:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ed9af707 17ffffc0001001 3:0 ffff8bc144296000 39 lru 00000080:00200000:1.0:1788201594.786379:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a163cb8c 39: 1< 0 - - > 2< 159744 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.786380:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003544d879 00000080:00200000:1.0:1788201594.786381:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 40. 00000080:00200000:1.0:1788201594.786383:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 40 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.786395:0:24470:0:(rw26.c:898:ll_write_end()) pos 163840, len 4096, copied 4096 00000080:00200000:1.0:1788201594.786399:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000753f70c1[3 0000000046337b78 2 1 00000000bab2d509 0 0 40] 00000080:00200000:1.0:1788201594.786402:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002f312396 17ffffc0001001 3:0 ffff8bc144296380 40 lru 00000080:00200000:1.0:1788201594.786407:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f843c205 40: 1< 0 - - > 2< 163840 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.786409:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000753f70c1 00000080:00200000:1.0:1788201594.786410:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 41. 00000080:00200000:1.0:1788201594.786412:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 41 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.786429:0:24470:0:(rw26.c:898:ll_write_end()) pos 167936, len 4096, copied 4096 00000080:00200000:1.0:1788201594.786434:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006fa029bc[3 0000000046337b78 2 1 00000000bab2d509 0 0 41] 00000080:00200000:1.0:1788201594.786437:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ecdf980f 17ffffc0001001 3:0 ffff8bc1442961c0 41 lru 00000080:00200000:1.0:1788201594.786442:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000094c64bcb 41: 1< 0 - - > 2< 167936 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.786445:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006fa029bc 00000080:00200000:1.0:1788201594.786446:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 42. 00000080:00200000:1.0:1788201594.786448:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 42 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.786464:0:24470:0:(rw26.c:898:ll_write_end()) pos 172032, len 4096, copied 4096 00000080:00200000:1.0:1788201594.786468:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000043210e62[3 0000000046337b78 2 1 00000000bab2d509 0 0 42] 00000080:00200000:1.0:1788201594.786471:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008159a5a6 17ffffc0001001 3:0 ffff8bc1442960e0 42 lru 00000080:00200000:1.0:1788201594.786476:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000069c6b87a 42: 1< 0 - - > 2< 172032 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.786479:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000043210e62 00000080:00200000:1.0:1788201594.786480:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 43. 00000080:00200000:1.0:1788201594.786482:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 43 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.786499:0:24470:0:(rw26.c:898:ll_write_end()) pos 176128, len 4096, copied 4096 00000080:00200000:1.0:1788201594.786503:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004b0bbca4[3 0000000046337b78 2 1 00000000bab2d509 0 0 43] 00000080:00200000:1.0:1788201594.786506:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e374ccc5 17ffffc0001001 3:0 ffff8bc1442969a0 43 lru 00000080:00200000:1.0:1788201594.786512:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f1d84b18 43: 1< 0 - - > 2< 176128 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.786514:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004b0bbca4 00000080:00200000:1.0:1788201594.786515:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 44. 00000080:00200000:1.0:1788201594.786517:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 44 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.787358:0:24470:0:(rw26.c:898:ll_write_end()) pos 180224, len 4096, copied 4096 00000080:00200000:1.0:1788201594.787369:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000144bd55d[3 0000000046337b78 2 1 00000000bab2d509 0 0 44] 00000080:00200000:1.0:1788201594.787372:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000720c1a0b 17ffffc0001001 3:0 ffff8bc144296c40 44 lru 00000080:00200000:1.0:1788201594.787379:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003c1dc849 44: 1< 0 - - > 2< 180224 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.787381:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000144bd55d 00000080:00200000:1.0:1788201594.787383:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 45. 00000080:00200000:1.0:1788201594.787386:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 45 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.787411:0:24470:0:(rw26.c:898:ll_write_end()) pos 184320, len 4096, copied 4096 00000080:00200000:1.0:1788201594.787416:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002c54b7c6[3 0000000046337b78 2 1 00000000bab2d509 0 0 45] 00000080:00200000:1.0:1788201594.787418:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d10a9826 17ffffc0001001 3:0 ffff8bc144296a80 45 lru 00000080:00200000:1.0:1788201594.787424:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000089ce7971 45: 1< 0 - - > 2< 184320 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.787427:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002c54b7c6 00000080:00200000:1.0:1788201594.787428:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 46. 00000080:00200000:1.0:1788201594.787430:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 46 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.787452:0:24470:0:(rw26.c:898:ll_write_end()) pos 188416, len 4096, copied 4096 00000080:00200000:1.0:1788201594.787456:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000049de278b[3 0000000046337b78 2 1 00000000bab2d509 0 0 46] 00000080:00200000:1.0:1788201594.787459:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c4c18919 17ffffc0001001 3:0 ffff8bc1725b51c0 46 lru 00000080:00200000:1.0:1788201594.787464:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000093fecab3 46: 1< 0 - - > 2< 188416 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.787466:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000049de278b 00000080:00200000:1.0:1788201594.787467:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 47. 00000080:00200000:1.0:1788201594.787469:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 47 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.787483:0:24470:0:(rw26.c:898:ll_write_end()) pos 192512, len 4096, copied 4096 00000080:00200000:1.0:1788201594.787487:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000627b80b2[3 0000000046337b78 2 1 00000000bab2d509 0 0 47] 00000080:00200000:1.0:1788201594.787490:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f3293310 17ffffc0001001 3:0 ffff8bc1725b50e0 47 lru 00000080:00200000:1.0:1788201594.787495:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f4ecb9d0 47: 1< 0 - - > 2< 192512 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.787498:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000627b80b2 00000080:00200000:1.0:1788201594.787499:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 48. 00000080:00200000:1.0:1788201594.787501:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 48 of 0 to 2680 bytes 00000080:00200000:1.0:1788201594.788316:0:24470:0:(rw26.c:898:ll_write_end()) pos 196608, len 2680, copied 2680 00000080:00200000:1.0:1788201594.788327:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000028b92e68[3 0000000046337b78 2 1 00000000bab2d509 0 0 48] 00000080:00200000:1.0:1788201594.788330:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000cd7b7c11 17ffffc0001021 2:0 ffff8bc1725b59a0 48 lru 00000080:00200000:1.0:1788201594.788336:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004c058e2e 48: 1< 0 - - > 2< 196608 0 0 0x0 0x0 | 000000000ce25486 000000000a9aa092 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.788339:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000028b92e68 00000080:00200000:1.0:1788201594.788340:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 49. 00000080:00200000:1.0:1788201594.788356:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 49, from 0, to 2680 prio 0 00000008:00010000:1.0:1788201594.788399:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000298588cb ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201594.788439:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145986578, count 15, dirtied 15 00000080:00200000:1.0:1788201594.788456:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145986578, count 15, dirtied 15 00000080:00200000:1.0:1788201594.788471:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145986578, count 15, dirtied 15 00000080:00200000:1.0:1788201594.788479:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145986578, count 4, dirtied 4 00000080:00200000:1.0:1788201594.788484:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 49 pages 199288 bytes, tot: 199288 00000080:00200000:1.0:1788201594.788488:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) sanity-lnet.sh: write bytes 0, result: 199288 00000020:00010000:1.0:1788201594.788511:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1498447b8 (ffff8bc146919cf8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201594.788515:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1498447b8 (ffff8bc146919cf8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201594.788518:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d9b0 (ffff8bc1469195a8/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201594.789555:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.789582:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201594.789616:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1498447b8 (ffff8bc146919cf8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201594.789621:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d9b0 (ffff8bc146919cf8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201594.789649:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 199288 bytes 00000080:00200000:1.0:1788201594.789661:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 48] 00000080:00200000:1.0:1788201594.789724:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x198:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201594.789729:0:24470:0:(file.c:2238:ll_file_io_generic()) sanity-lnet.sh: 2 io complete with rc: 0, result: 199288, restart: 0 00000080:00200000:1.0:1788201594.789747:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x198:0x0] updating i_size 199288 i_blocks 1 00000080:00200000:1.0:1788201594.789755:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 199288 00000080:00200008:1.0:1788201594.789867:0:24470:0:(file.c:479:ll_file_release()) START file sanity-lnet.sh:[0x200000bd7:0x198:0x0](ffff8bc1459863c8), flags 100001 00000002:00100000:1.0:1788201594.789983:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1724a0e00 x1875064728014080/t8589937458(8589937458) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201594.789998:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201594.790005:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d7b80 x1875064728014720/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201594.790046:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728014720:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201594.792833:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201594.801366:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728014720:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201594.801416:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1724a0e00 x1875064728014080/t8589937458(8589937458) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201594.801519:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201594.801556:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.801581:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 247 lru_type: 1 00010000:00010000:1.0:1788201594.801599:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 247 lru_type: 1 00000080:00200000:1.0:1788201594.801608:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.801615:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201594.801619:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201594.801628:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201594.801632:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 247 lru_type: 1 00010000:00010000:1.0:1788201594.801642:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 248 lru_type: 1 00000080:00200000:1.0:1788201594.801662:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.801670:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201594.801677:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.801681:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-lnet.sh, flags=8 00000080:00200008:1.0:1788201594.801690:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-lnet.sh:[0x200000bd7:0x198:0x0](ffff8bc1459863c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201594.801697:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x198:0x0](ffff8bc1459863c8),name=sanity-lnet.sh 00000002:00010000:1.0:1788201594.801711:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x198:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.801720:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109806b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201594.801729:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109806b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201594.801736:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.801739:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x198:0x0](ffff8bc1459863c8) 00000080:00010000:1.0:1788201594.801742:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x198:0x0](ffff8bc1459863c8) for lock 0xd138388016f6f74e 00000080:00010000:1.0:1788201594.801746:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f74e from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201594.801749:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109806b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201594.801757:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109806b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201594.801900:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x198:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201594.801911:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x198:0x0] 00000008:00010000:1.0:1788201594.801946:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201594.801949:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4f30, osc lock ffff8bc145d09a20, flags 0x400001002 00010000:00010000:1.0:1788201594.801968:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.801981:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201594.801995:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201594.802001:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.802010:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201594.802280:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201594.802293:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x198:0x0] updating i_size 199288 i_blocks 1 00000020:00010000:1.0:1788201594.802298:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e24250 (ffff8bc148e3b5a8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201594.802302:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e24250 (ffff8bc148e3b5a8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201594.802305:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4f30 (ffff8bc148e3b878/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201594.802309:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e24250 (ffff8bc148e3b5a8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201594.802312:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4f30 (ffff8bc148e3b5a8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201594.802357:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x198:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201594.802422:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201594.802430:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.802439:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 248 lru_type: 1 00010000:00010000:1.0:1788201594.802449:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 248 lru_type: 1 00000080:00200000:1.0:1788201594.802457:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.802462:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201594.802465:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201594.802470:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201594.802473:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 248 lru_type: 1 00010000:00010000:1.0:1788201594.802482:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 249 lru_type: 1 00000080:00200000:1.0:1788201594.802492:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.802496:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201594.802500:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.802515:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-lsnapshot.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201594.802520:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-lsnapshot.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201594.802590:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-lsnapshot.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201594.802647:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f763 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.802656:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f763 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.802668:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f763 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201594.802695:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728014848:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201594.802886:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201594.816714:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728014848:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201594.816746:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f763 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.816762:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f763 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.816775:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f763 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.816783:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f763 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.816818:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f763 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.816826:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17261fe00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201594.816831:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f763 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.816839:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f763 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.816846:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f763 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.816855:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201594.816864:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f763 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.816871:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f763 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201594.816896:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1727d7100 x1875064728014848/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201594.816914:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201594.816946:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201594.817029:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201594.817050:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.817061:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 249 lru_type: 1 00010000:00010000:1.0:1788201594.817075:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 249 lru_type: 1 00000080:00200000:1.0:1788201594.817082:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.817087:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201594.817342:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201594.817358:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201594.817363:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 249 lru_type: 1 00010000:00010000:1.0:1788201594.817373:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 250 lru_type: 1 00000080:00200000:1.0:1788201594.817391:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.817400:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201594.817408:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.817423:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-lsnapshot.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:1.0:1788201594.817428:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-lsnapshot.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201594.817441:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-lsnapshot.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201594.817491:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f76a lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.817498:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f76a lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.817509:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f76a lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201594.817745:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728014976:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201594.817947:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.822486:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728014976:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201594.822517:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f76a lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.822545:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f76a lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.822552:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f76a lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.822560:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f76a lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.822570:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f76a lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.822581:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17261f800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201594.822587:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f76a lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.822596:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f76a lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.822604:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f76a lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.822611:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201594.822618:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f76a lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.822625:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f76a lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201594.822650:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1727d7100 x1875064728014976/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201594.822667:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201594.822700:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201594.822872:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201594.822893:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.822904:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 250 lru_type: 1 00010000:00010000:0.0:1788201594.822926:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 250 lru_type: 1 00000080:00200000:0.0:1788201594.822941:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.822948:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201594.822952:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201594.822958:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:0.0:1788201594.822963:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 250 lru_type: 1 00010000:00010000:0.0:1788201594.822972:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 251 lru_type: 1 00000080:00200000:0.0:1788201594.822989:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.822998:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201594.823004:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.823018:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201594.823033:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sanity-lsnapshot.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc152c97200, open_flags 80c1, mode 81ed opened 0 00000080:00200000:0.0:1788201594.823043:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-lsnapshot.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:0.0:1788201594.823070:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-lsnapshot.sh,[0x200000bd7:0x199:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:0.0:1788201594.823379:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.823387:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1788201594.823401:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1788201594.823409:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc17264a680 x1875064728015232/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1788201594.823424:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201594.823449:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17264a680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728015232:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201594.823620:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc146705480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.839788:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17264a680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728015232:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201594.839858:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710980c6 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.839886:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x199:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710980c6 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.839896:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710980c6 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.839909:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710980c6 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.839922:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710980c6 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.839938:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710980c6 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.839947:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710980c6 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.839961:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710980c6 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201594.839973:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc17264a680 x1875064728015232/t8589937460(8589937460) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201594.839988:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc17264a680 x1875064728015232/t8589937460(8589937460) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201594.840006:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710980c6 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1788201594.840031:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710980c6 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.840044:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/409 (0 0) 00000080:00200000:0.0:1788201594.840052:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201594.840068:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=sanity-lsnapshot.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:0.0:1788201594.840103:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x199:0x0](ffff8bc1459b4b08) 00000080:00200000:0.0:1788201594.840266:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x199:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1788201594.840279:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x199:0x0](ffff8bc1459b4b08) 00000080:00010000:0.0:1788201594.840283:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x199:0x0](ffff8bc1459b4b08) for lock 0xd138388016f6f771 00000080:00010000:0.0:1788201594.840296:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x199:0x0](ffff8bc1459b4b08) 00000080:00200008:0.0:1788201594.840314:0:24470:0:(file.c:1090:ll_file_open()) START file sanity-lsnapshot.sh:[0x200000bd7:0x199:0x0](ffff8bc1459b4b08), flags 100301 00000002:00100000:0.0:1788201594.840338:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc17264a680 x1875064728015232/t8589937460(8589937460) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1788201594.840402:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f771 from it ffff8bc146937600 00010000:00010000:0.0:1788201594.840409:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710980c6 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.840418:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710980c6 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201594.840449:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x199:0x0](ffff8bc1459b4b08), inode mode 81ed mask 40 00000080:00200008:0.0:1788201594.840485:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-lsnapshot.sh:[0x200000bd7:0x199:0x0](ffff8bc1459b4b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201594.840493:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x199:0x0](ffff8bc1459b4b08),name=sanity-lsnapshot.sh 00000002:00010000:0.0:1788201594.840515:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x199:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.840527:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710980c6 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.840540:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710980c6 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201594.840547:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.840552:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x199:0x0](ffff8bc1459b4b08) 00000080:00010000:0.0:1788201594.840556:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x199:0x0](ffff8bc1459b4b08) for lock 0xd138388016f6f771 00000080:00010000:0.0:1788201594.840560:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f771 from it ffffadd1c7debcd8 00010000:00010000:0.0:1788201594.840563:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710980c6 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.840571:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710980c6 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201594.840599:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x199:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201594.840608:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x199:0x0] 00000008:00010000:0.0:1788201594.840639:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201594.840642:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456f30, osc lock ffff8bc145d34ab0, flags 0x400001002 00010000:00010000:0.0:1788201594.840699:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f778 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.840711:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f778 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201594.840746:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1788201594.841075:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201594.841100:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728015360:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201594.845427:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f778 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.845465:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f778 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710980d4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.845483:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f778 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710980d4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.845497:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f778 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710980d4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201594.845516:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f778 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710980d4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201594.845597:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201594.845671:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f778 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710980d4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.845681:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f778 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710980d4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.845689:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f778 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710980d4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.845705:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f778 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e21710980d4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201594.845731:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728015360:192.168.201.143@tcp:101:cp.0 00000080:00200000:0.0:1788201594.845889:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x199:0x0] updating i_size 0 i_blocks 1 00000020:00010000:0.0:1788201594.845898:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201594.845902:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.845907:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456f30 (ffff8bc1499c4518/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.845913:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201594.845916:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456f30 (ffff8bc1499c46c8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201594.845958:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x199:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1788201594.846329:0:24470:0:(file.c:2638:do_file_write_iter()) START file sanity-lsnapshot.sh:[0x200000bd7:0x199:0x0], ppos: 0, count: 10934 00000080:00200000:0.0:1788201594.846377:0:24470:0:(file.c:2090:ll_file_io_generic()) sanity-lsnapshot.sh: write ppos: 0, bytes: 10934 00000080:00200000:0.0:1788201594.846385:0:24470:0:(file.c:1848:ll_io_set_mirror()) sanity-lsnapshot.sh: desiginated mirror: 0 00000020:00200000:0.0:1788201594.846392:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000869df68d[0x110, 1, [0x200000bd7:0x199:0x0] hash] 00000020:00200000:0.0:1788201594.846394:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 10934) 0 0 00000080:00200000:0.0:1788201594.846399:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x199:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201594.846413:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 2] 00020000:00200000:0.0:1788201594.846423:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 10934) 10934, 10934 00020000:00200000:0.0:1788201594.846427:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201594.846459:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 2] 00000008:00010000:0.0:1788201594.846474:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1788201594.846482:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456f30, osc lock ffff8bc145d34ab0, flags 0x0 00010000:00010000:0.0:1788201594.846501:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/447 (0 12287) 00010000:00010000:0.0:1788201594.846626:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.846639:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.846651:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201594.846680:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172648380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728015488:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201594.846884:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1467050c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201594.849601:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201594.849829:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743486976 00000100:00100000:0.0:1788201594.849842:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743486976 00000100:00100000:0.0:1788201594.849954:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 809 00000100:00100000:0.0:1788201594.849967:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1726cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23408:x1875064743486976:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201594.849991:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f778 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710980d4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.851742:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201594.851763:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1726cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23408:x1875064743486976:12345-192.168.201.143@tcp:104: Request processed in 1793us (2170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201594.851775:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 809 00010000:00010000:1.0:1788201594.851878:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201594.851889:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f778 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710980d4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.851903:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc146084e00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201594.851911:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f778 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e21710980d4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201594.851986:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x199:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201594.852002:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x199:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201594.852087:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f778 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710980d4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.852105:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201594.852144:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f778 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710980d4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.852153:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f778 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710980d4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.852176:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201594.852178:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201594.852179:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201594.852191:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201594.852209:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728015616:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201594.855272:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201594.855374:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743487104 00000100:00100000:2.0:1788201594.855386:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743487104 00000100:00100000:2.0:1788201594.855450:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 810 00000100:00100000:2.0:1788201594.855462:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1727d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21003:x1875064743487104:12345-192.168.201.143@tcp:105: 00010000:00010000:2.0:1788201594.855483:0:20877:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.855497:0:20877:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.855507:0:20877:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.855519:0:20877:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.855539:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.855551:0:20877:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.855577:0:20877:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc146085800) 00000100:00100000:2.0:1788201594.855650:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1727d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21003:x1875064743487104:12345-192.168.201.143@tcp:105: Request processed in 190us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201594.855658:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 810 00000100:00100000:1.0:1788201594.857588:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728015616:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201594.859296:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172648380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728015488:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201594.859337:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.859375:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201594.859396:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.859410:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.859419:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201594.859451:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) sanity-lsnapshot.sh: write [0, 10934) append 0 append lockpos 0 00000080:00200000:0.0:1788201594.859477:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.859668:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:0.0:1788201594.859681:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d2eaecb5[3 000000002245f8bc 2 1 0000000005f45737 0 0 0] 00000080:00200000:0.0:1788201594.859684:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000062740516 17ffffc0001001 3:0 ffff8bc1726fd7e0 0 lru 00000080:00200000:0.0:1788201594.859694:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a044191e 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 000000001027b7e0 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.859696:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d2eaecb5 00000080:00200000:0.0:1788201594.859698:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1788201594.859702:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.859728:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:0.0:1788201594.859734:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e261ebfd[3 000000002245f8bc 2 1 0000000005f45737 0 0 1] 00000080:00200000:0.0:1788201594.859737:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004fea02e8 17ffffc0001001 3:0 ffff8bc1726fd620 1 lru 00000080:00200000:0.0:1788201594.859743:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000264dccf4 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 000000001027b7e0 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.859745:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e261ebfd 00000080:00200000:0.0:1788201594.859746:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:0.0:1788201594.859748:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 2742 bytes 00000080:00200000:0.0:1788201594.859776:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 2742, copied 2742 00000080:00200000:0.0:1788201594.859781:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000881c8cac[3 000000002245f8bc 2 1 0000000005f45737 0 0 2] 00000080:00200000:0.0:1788201594.859784:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002ca1ba89 17ffffc0001001 3:0 ffff8bc1726fdee0 2 lru 00000080:00200000:0.0:1788201594.859928:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007d6b60f5 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000008930e75a 000000001027b7e0 > 3< 0 0 > 4< 0 0 8 18743296 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.859931:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000881c8cac 00000080:00200000:0.0:1788201594.859933:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:0.0:1788201594.859937:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 3, from 0, to 2742 prio 0 00000008:00010000:0.0:1788201594.859967:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 000000000ce1d5f3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201594.859992:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459b4cb8, count 3, dirtied 3 00000080:00200000:0.0:1788201594.859998:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 3 pages 10934 bytes, tot: 10934 00000080:00200000:0.0:1788201594.860001:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) sanity-lsnapshot.sh: write bytes 0, result: 10934 00000020:00010000:0.0:1788201594.860021:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc148fb1998 (ffff8bc1499c46c8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201594.860025:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc148fb1998 (ffff8bc1499c46c8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.860028:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456f30 (ffff8bc1499c4518/1) at cl_lock_cancel():142 00010000:00010000:0.0:1788201594.860034:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.860046:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1788201594.860063:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc148fb1998 (ffff8bc1499c46c8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201594.860066:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456f30 (ffff8bc1499c46c8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201594.860075:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 10934 bytes 00000080:00200000:0.0:1788201594.860084:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 2] 00000080:00200000:0.0:1788201594.860258:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x199:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201594.860263:0:24470:0:(file.c:2238:ll_file_io_generic()) sanity-lsnapshot.sh: 2 io complete with rc: 0, result: 10934, restart: 0 00000080:00200000:0.0:1788201594.860272:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x199:0x0] updating i_size 10934 i_blocks 1 00000080:00200000:0.0:1788201594.860278:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 10934 00000080:00200008:0.0:1788201594.860332:0:24470:0:(file.c:479:ll_file_release()) START file sanity-lsnapshot.sh:[0x200000bd7:0x199:0x0](ffff8bc1459b4b08), flags 100001 00000002:00100000:0.0:1788201594.860407:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc17264a680 x1875064728015232/t8589937460(8589937460) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1788201594.860422:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1788201594.860428:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172648380 x1875064728015872/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1788201594.860459:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172648380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728015872:192.168.201.143@tcp:35:cp.0 00000100:00100000:0.0:1788201594.860690:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc146467780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.863787:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172648380 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728015872:192.168.201.143@tcp:35:cp.0 00000002:00100000:2.0:1788201594.864006:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc17264a680 x1875064728015232/t8589937460(8589937460) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201594.864097:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201594.864121:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.864217:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 251 lru_type: 1 00010000:00010000:2.0:1788201594.864237:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 251 lru_type: 1 00000080:00200000:2.0:1788201594.864246:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.864254:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201594.864257:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201594.864266:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201594.864270:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 251 lru_type: 1 00010000:00010000:2.0:1788201594.864280:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 252 lru_type: 1 00000080:00200000:2.0:1788201594.864300:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.864310:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201594.864318:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.864323:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-lsnapshot.sh, flags=8 00000080:00200008:2.0:1788201594.864332:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-lsnapshot.sh:[0x200000bd7:0x199:0x0](ffff8bc1459b4b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1788201594.864337:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x199:0x0](ffff8bc1459b4b08),name=sanity-lsnapshot.sh 00000002:00010000:2.0:1788201594.864364:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x199:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.864375:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710980c6 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201594.864383:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710980c6 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1788201594.864390:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.864394:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x199:0x0](ffff8bc1459b4b08) 00000080:00010000:2.0:1788201594.864397:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x199:0x0](ffff8bc1459b4b08) for lock 0xd138388016f6f771 00000080:00010000:2.0:1788201594.864401:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f771 from it ffffadd1c7debcb8 00010000:00010000:2.0:1788201594.864405:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710980c6 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201594.864414:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710980c6 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201594.864477:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x199:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201594.864489:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x199:0x0] 00000008:00010000:2.0:1788201594.864521:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201594.864590:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d130, osc lock ffff8bc151fc0ab0, flags 0x400001002 00010000:00010000:2.0:1788201594.864612:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.864632:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:2.0:1788201594.864645:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1788201594.864650:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.864657:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1788201594.864669:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1788201594.864680:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x199:0x0] updating i_size 10934 i_blocks 1 00000020:00010000:2.0:1788201594.864685:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc146006e40 (ffff8bc1469193f8/0) at cl_lock_release():245 00000020:00010000:2.0:1788201594.864688:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146006e40 (ffff8bc1469193f8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201594.864691:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d130 (ffff8bc146919bd8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201594.864696:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146006e40 (ffff8bc1469193f8/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201594.864698:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d130 (ffff8bc1469193f8/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201594.864732:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x199:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201594.864894:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201594.864905:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.864913:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 252 lru_type: 1 00010000:00010000:2.0:1788201594.864924:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 252 lru_type: 1 00000080:00200000:2.0:1788201594.864936:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.864941:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201594.864944:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201594.864948:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201594.864951:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 252 lru_type: 1 00010000:00010000:2.0:1788201594.864959:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 253 lru_type: 1 00000080:00200000:2.0:1788201594.864968:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.864972:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201594.864976:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.864990:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanityn.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:2.0:1788201594.864994:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanityn.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201594.865004:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanityn.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201594.865061:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f786 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.865070:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f786 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.865082:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f786 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.865108:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728016000:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201594.865390:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc15399fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201594.868237:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728016000:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201594.868270:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f786 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.868286:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f786 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.868294:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f786 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.868302:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f786 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.868312:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f786 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.868319:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1443b6200 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201594.868325:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f786 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.868334:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f786 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.868361:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f786 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.868369:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201594.868377:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f786 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.868384:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f786 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201594.868408:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a1f80 x1875064728016000/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201594.868426:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201594.868457:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:3.0:1788201594.868550:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201594.868567:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201594.868578:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 253 lru_type: 1 00010000:00010000:3.0:1788201594.868591:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 253 lru_type: 1 00000080:00200000:3.0:1788201594.868599:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201594.868605:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201594.868609:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201594.868614:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201594.868618:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 253 lru_type: 1 00010000:00010000:3.0:1788201594.868632:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201594.868648:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201594.868656:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201594.868662:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201594.868676:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanityn.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:3.0:1788201594.868681:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanityn.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:3.0:1788201594.868694:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanityn.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201594.868744:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f78d lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.868752:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f78d lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.868762:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f78d lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201594.868788:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728016128:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201594.869822:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201594.873411:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728016128:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201594.873444:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f78d lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.873460:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f78d lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.873468:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f78d lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.873480:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f78d lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.873491:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f78d lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.873498:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1725a1600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201594.873503:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f78d lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.873515:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f78d lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.873587:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f78d lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.873597:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201594.873605:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f78d lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.873613:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1600/0xd138388016f6f78d lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201594.873635:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1726cf480 x1875064728016128/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201594.873653:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201594.873684:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201594.873994:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201594.874013:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.874024:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201594.874038:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201594.874045:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.874050:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201594.874054:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201594.874060:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:1.0:1788201594.874065:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201594.874073:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201594.874218:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.874229:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201594.874235:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.874248:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201594.874253:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sanityn.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14304b200, open_flags 80c1, mode 81ed opened 0 00000080:00200000:1.0:1788201594.874260:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanityn.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:1.0:1788201594.874282:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanityn.sh,[0x200000bd7:0x19a:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201594.874364:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.874372:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201594.874386:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201594.874394:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d7480 x1875064728016384/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201594.874405:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201594.874436:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728016384:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201594.874750:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.880993:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728016384:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201594.881031:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098121 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.881062:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098121 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.881072:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098121 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.881085:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098121 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.881210:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098121 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.881228:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098121 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.881238:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098121 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.881246:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098121 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201594.881258:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1727d7480 x1875064728016384/t8589937462(8589937462) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201594.881271:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1727d7480 x1875064728016384/t8589937462(8589937462) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201594.881286:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098121 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1788201594.881301:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098121 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.881312:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/410 (0 0) 00000080:00200000:0.0:1788201594.881319:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201594.881336:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=sanityn.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:0.0:1788201594.881392:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x19a:0x0](ffff8bc1459b1148) 00000080:00200000:0.0:1788201594.881616:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x19a:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1788201594.881628:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x19a:0x0](ffff8bc1459b1148) 00000080:00010000:0.0:1788201594.881632:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x19a:0x0](ffff8bc1459b1148) for lock 0xd138388016f6f794 00000080:00010000:0.0:1788201594.881645:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x19a:0x0](ffff8bc1459b1148) 00000080:00200008:0.0:1788201594.881663:0:24470:0:(file.c:1090:ll_file_open()) START file sanityn.sh:[0x200000bd7:0x19a:0x0](ffff8bc1459b1148), flags 100301 00000002:00100000:0.0:1788201594.881687:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1727d7480 x1875064728016384/t8589937462(8589937462) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1788201594.881740:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f794 from it ffff8bc1466cda20 00010000:00010000:0.0:1788201594.881746:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171098121 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.881756:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098121 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201594.881782:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x19a:0x0](ffff8bc1459b1148), inode mode 81ed mask 40 00000080:00200008:0.0:1788201594.881993:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanityn.sh:[0x200000bd7:0x19a:0x0](ffff8bc1459b1148), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201594.882002:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x19a:0x0](ffff8bc1459b1148),name=sanityn.sh 00000002:00010000:0.0:1788201594.882026:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x19a:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.882038:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098121 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.882051:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098121 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201594.882059:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.882064:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x19a:0x0](ffff8bc1459b1148) 00000080:00010000:0.0:1788201594.882067:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x19a:0x0](ffff8bc1459b1148) for lock 0xd138388016f6f794 00000080:00010000:0.0:1788201594.882071:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f794 from it ffffadd1c7debcd8 00010000:00010000:0.0:1788201594.882074:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171098121 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.882082:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098121 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201594.882451:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201594.882463:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x19a:0x0] 00000008:00010000:0.0:1788201594.882496:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201594.882500:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456b30, osc lock ffff8bc145d34ab0, flags 0x400001002 00010000:00010000:0.0:1788201594.882637:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000229c68b7/0xd138388016f6f79b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.882650:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000229c68b7/0xd138388016f6f79b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201594.882752:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17264a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728016512:192.168.201.143@tcp:101:cp.0 00000020:00200000:0.0:1788201594.882961:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1788201594.886296:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000229c68b7/0xd138388016f6f79b lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.886337:0:10054:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000229c68b7/0xd138388016f6f79b lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109812f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.886369:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000229c68b7/0xd138388016f6f79b lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109812f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.886384:0:10054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000229c68b7/0xd138388016f6f79b lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109812f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1788201594.886403:0:10054:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000229c68b7/0xd138388016f6f79b lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109812f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1788201594.886416:0:10054:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:2.0:1788201594.886435:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000229c68b7/0xd138388016f6f79b lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109812f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.886445:0:10054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000229c68b7/0xd138388016f6f79b lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109812f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.886453:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000229c68b7/0xd138388016f6f79b lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109812f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.886463:0:10054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000229c68b7/0xd138388016f6f79b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e217109812f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1788201594.886488:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17264a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728016512:192.168.201.143@tcp:101:cp.0 00000080:00200000:1.0:1788201594.886614:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x19a:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201594.886622:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201594.886626:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201594.886631:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456b30 (ffff8bc1499c4518/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201594.886636:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9bc0 (ffff8bc1499c46c8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201594.886639:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456b30 (ffff8bc1499c46c8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201594.886680:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19a:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201594.886940:0:24470:0:(file.c:2638:do_file_write_iter()) START file sanityn.sh:[0x200000bd7:0x19a:0x0], ppos: 0, count: 227516 00000080:00200000:1.0:1788201594.886980:0:24470:0:(file.c:2090:ll_file_io_generic()) sanityn.sh: write ppos: 0, bytes: 227516 00000080:00200000:1.0:1788201594.886987:0:24470:0:(file.c:1848:ll_io_set_mirror()) sanityn.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201594.886994:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@000000005a405326[0x110, 1, [0x200000bd7:0x19a:0x0] hash] 00000020:00200000:1.0:1788201594.886996:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 227516) 0 0 00000080:00200000:1.0:1788201594.887000:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19a:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201594.887014:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 55] 00020000:00200000:1.0:1788201594.887023:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 227516) 227516, 227516 00020000:00200000:1.0:1788201594.887027:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201594.887064:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 55] 00000008:00010000:1.0:1788201594.887079:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201594.887085:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4f30, osc lock ffff8bc145d09a20, flags 0x0 00010000:00010000:1.0:1788201594.887105:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/447 (0 229375) 00010000:00010000:1.0:1788201594.887154:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.887164:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->229375] (req 0->229375) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.887175:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->229375] (req 0->229375) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201594.887202:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728016640:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201594.887306:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201594.894354:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201594.894467:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743487232 00000100:00100000:0.0:1788201594.894480:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743487232 00000100:00100000:0.0:1788201594.894563:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 811 00000100:00100000:0.0:1788201594.894576:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1727d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:28099:x1875064743487232:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201594.894601:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000229c68b7/0xd138388016f6f79b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109812f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.894704:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201594.894712:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1727d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:28099:x1875064743487232:12345-192.168.201.143@tcp:104: Request processed in 140us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201594.894719:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 811 00010000:00010000:3.0:1788201594.895164:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201594.895176:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000229c68b7/0xd138388016f6f79b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109812f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201594.895188:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc146085e00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201594.895196:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000229c68b7/0xd138388016f6f79b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e217109812f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201594.895263:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201594.895281:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201594.895378:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000229c68b7/0xd138388016f6f79b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109812f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201594.895387:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201594.895429:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000229c68b7/0xd138388016f6f79b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109812f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201594.895439:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000229c68b7/0xd138388016f6f79b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109812f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201594.895460:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201594.895462:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201594.895464:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201594.895538:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728016768:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201594.898604:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201594.898969:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728016640:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201594.899009:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->229375] (req 0->229375) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.899031:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->229375] (req 0->229375) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.899040:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->229375] (req 0->229375) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201594.899195:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743487360 00000100:00100000:3.0:1788201594.899205:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743487360 00000100:00100000:3.0:1788201594.899257:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 812 00000100:00100000:3.0:1788201594.899267:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1727d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21004:x1875064743487360:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201594.899278:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->229375] (req 0->229375) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.899289:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->229375] (req 0->229375) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.899305:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.899316:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.899326:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.899336:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.899378:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc17261e000) 00000100:00100000:3.0:1788201594.899447:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1727d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21004:x1875064743487360:12345-192.168.201.143@tcp:105: Request processed in 180us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201594.899454:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 812 00010000:00010000:1.0:1788201594.900252:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.900267:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.900287:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201594.900301:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.900315:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.900323:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201594.900368:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) sanityn.sh: write [0, 227516) append 0 append lockpos 0 00000080:00200000:1.0:1788201594.900391:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.900452:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:1.0:1788201594.900465:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009678a4f2[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 0] 00000080:00200000:1.0:1788201594.900469:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b409065c 17ffffc0001001 3:0 ffff8bc1725b5c40 0 lru 00000080:00200000:1.0:1788201594.900478:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000bbe43643 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.900480:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009678a4f2 00000080:00200000:1.0:1788201594.900481:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1788201594.900486:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.900511:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:1.0:1788201594.900517:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003b1d168e[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 1] 00000080:00200000:1.0:1788201594.900520:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f212a257 17ffffc0001001 3:0 ffff8bc1725b5a80 1 lru 00000080:00200000:1.0:1788201594.900537:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000088d3e5d0 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.900539:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003b1d168e 00000080:00200000:1.0:1788201594.900541:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:1.0:1788201594.900543:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.900562:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:1.0:1788201594.900567:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000079f3209e[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 2] 00000080:00200000:1.0:1788201594.900570:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000634dea84 17ffffc0001001 3:0 ffff8bc1725b5540 2 lru 00000080:00200000:1.0:1788201594.900575:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008e33e7ca 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.900577:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000079f3209e 00000080:00200000:1.0:1788201594.900578:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:1.0:1788201594.900580:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.900595:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:1.0:1788201594.900599:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000051b1d42c[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 3] 00000080:00200000:1.0:1788201594.900602:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000076334bd9 17ffffc0001001 3:0 ffff8bc1725b58c0 3 lru 00000080:00200000:1.0:1788201594.900607:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000faa5e91f 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.900609:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000051b1d42c 00000080:00200000:1.0:1788201594.900611:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:1.0:1788201594.900612:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.900625:0:24470:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:1.0:1788201594.900629:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003b85d55d[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 4] 00000080:00200000:1.0:1788201594.900632:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000030cefcf9 17ffffc0001001 3:0 ffff8bc1725b5e00 4 lru 00000080:00200000:1.0:1788201594.900637:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000018e87a4b 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.900639:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003b85d55d 00000080:00200000:1.0:1788201594.900641:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:1.0:1788201594.900642:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.900652:0:24470:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:1.0:1788201594.900656:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c173bd30[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 5] 00000080:00200000:1.0:1788201594.900659:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000085ea64d7 17ffffc0001001 3:0 ffff8bc1725b5ee0 5 lru 00000080:00200000:1.0:1788201594.900663:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000cf7825c4 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.900665:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c173bd30 00000080:00200000:1.0:1788201594.900666:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:1.0:1788201594.900667:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.900681:0:24470:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:1.0:1788201594.900685:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000dafb5534[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 6] 00000080:00200000:1.0:1788201594.900687:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ec14d71b 17ffffc0001001 3:0 ffff8bc1725b5620 6 lru 00000080:00200000:1.0:1788201594.900692:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000aafd6afe 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.900695:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000dafb5534 00000080:00200000:1.0:1788201594.900696:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:1.0:1788201594.900698:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.900711:0:24470:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:1.0:1788201594.900716:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b41df999[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 7] 00000080:00200000:1.0:1788201594.900719:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000cb3f3196 17ffffc0001001 3:0 ffff8bc1725b57e0 7 lru 00000080:00200000:1.0:1788201594.900724:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b7bc126e 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.900727:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b41df999 00000080:00200000:1.0:1788201594.900728:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:1.0:1788201594.900730:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.900744:0:24470:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:1.0:1788201594.900748:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000041eb1fbe[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 8] 00000080:00200000:1.0:1788201594.900750:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000bed8f604 17ffffc0001001 3:0 ffff8bc1725b5700 8 lru 00000080:00200000:1.0:1788201594.900756:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f6e52ead 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.900758:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000041eb1fbe 00000080:00200000:1.0:1788201594.900759:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:1.0:1788201594.900761:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.900771:0:24470:0:(rw26.c:898:ll_write_end()) pos 36864, len 4096, copied 4096 00000080:00200000:1.0:1788201594.900775:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e6691da2[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 9] 00000080:00200000:1.0:1788201594.900778:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000872ee585 17ffffc0001001 3:0 ffff8bc1725b5b60 9 lru 00000080:00200000:1.0:1788201594.900784:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000031c22ddd 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.900786:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e6691da2 00000080:00200000:1.0:1788201594.900787:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:1.0:1788201594.900788:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 10 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.900823:0:24470:0:(rw26.c:898:ll_write_end()) pos 40960, len 4096, copied 4096 00000080:00200000:1.0:1788201594.900827:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000eda9721e[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 10] 00000080:00200000:1.0:1788201594.900829:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b2d4e07c 17ffffc0001001 3:0 ffff8bc1725b52a0 10 lru 00000080:00200000:1.0:1788201594.900835:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005c91b51d 10: 1< 0 - - > 2< 40960 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.900837:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000eda9721e 00000080:00200000:1.0:1788201594.900839:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 11. 00000080:00200000:1.0:1788201594.900840:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 11 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.900855:0:24470:0:(rw26.c:898:ll_write_end()) pos 45056, len 4096, copied 4096 00000080:00200000:1.0:1788201594.900859:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001238cf05[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 11] 00000080:00200000:1.0:1788201594.900862:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000bcc29285 17ffffc0001001 3:0 ffff8bc1725b5460 11 lru 00000080:00200000:1.0:1788201594.900867:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000537e2bf9 11: 1< 0 - - > 2< 45056 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.900869:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001238cf05 00000080:00200000:1.0:1788201594.900871:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 12. 00000080:00200000:1.0:1788201594.900872:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 12 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.900889:0:24470:0:(rw26.c:898:ll_write_end()) pos 49152, len 4096, copied 4096 00000080:00200000:1.0:1788201594.900893:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000bd270997[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 12] 00000080:00200000:1.0:1788201594.900896:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d4fe965a 17ffffc0001001 3:0 ffff8bc1725b5d20 12 lru 00000080:00200000:1.0:1788201594.900901:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000074f537ee 12: 1< 0 - - > 2< 49152 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.900903:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000bd270997 00000080:00200000:1.0:1788201594.900904:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 13. 00000080:00200000:1.0:1788201594.900906:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 13 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.900920:0:24470:0:(rw26.c:898:ll_write_end()) pos 53248, len 4096, copied 4096 00000080:00200000:1.0:1788201594.900925:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000075482dcd[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 13] 00000080:00200000:1.0:1788201594.900927:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000049777e3e 17ffffc0001001 3:0 ffff8bc1725b5000 13 lru 00000080:00200000:1.0:1788201594.900933:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004afd0ccb 13: 1< 0 - - > 2< 53248 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.900936:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000075482dcd 00000080:00200000:1.0:1788201594.900937:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 14. 00000080:00200000:1.0:1788201594.900939:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 14 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.900959:0:24470:0:(rw26.c:898:ll_write_end()) pos 57344, len 4096, copied 4096 00000080:00200000:1.0:1788201594.900963:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000de0c11a6[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 14] 00000080:00200000:1.0:1788201594.900966:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e0c8c534 17ffffc0001021 2:0 ffff8bc1725b5380 14 lru 00000080:00200000:1.0:1788201594.900972:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000013649862 14: 1< 0 - - > 2< 57344 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.900974:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000de0c11a6 00000080:00200000:1.0:1788201594.900975:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 15. 00000080:00200000:1.0:1788201594.900976:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 15 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.900989:0:24470:0:(rw26.c:898:ll_write_end()) pos 61440, len 4096, copied 4096 00000080:00200000:1.0:1788201594.900992:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005f83d642[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 15] 00000080:00200000:1.0:1788201594.900995:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000eb39cd99 17ffffc0001001 3:0 ffff8bc148d871c0 15 lru 00000080:00200000:1.0:1788201594.901000:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000fa0ebe0c 15: 1< 0 - - > 2< 61440 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901001:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005f83d642 00000080:00200000:1.0:1788201594.901003:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 16. 00000080:00200000:1.0:1788201594.901004:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 16 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901014:0:24470:0:(rw26.c:898:ll_write_end()) pos 65536, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901018:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000069a808a2[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 16] 00000080:00200000:1.0:1788201594.901021:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000022ea1120 17ffffc0001001 3:0 ffff8bc148d870e0 16 lru 00000080:00200000:1.0:1788201594.901026:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000078d2a914 16: 1< 0 - - > 2< 65536 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901028:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000069a808a2 00000080:00200000:1.0:1788201594.901029:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 17. 00000080:00200000:1.0:1788201594.901031:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 17 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901041:0:24470:0:(rw26.c:898:ll_write_end()) pos 69632, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901044:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a5b8377b[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 17] 00000080:00200000:1.0:1788201594.901047:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000af6780f6 17ffffc0001001 3:0 ffff8bc148d879a0 17 lru 00000080:00200000:1.0:1788201594.901052:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ad4e3e85 17: 1< 0 - - > 2< 69632 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901054:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a5b8377b 00000080:00200000:1.0:1788201594.901055:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 18. 00000080:00200000:1.0:1788201594.901056:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 18 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901068:0:24470:0:(rw26.c:898:ll_write_end()) pos 73728, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901071:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ebe8a96c[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 18] 00000080:00200000:1.0:1788201594.901074:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000086f1a89e 17ffffc0001001 3:0 ffff8bc148d87c40 18 lru 00000080:00200000:1.0:1788201594.901080:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000020516653 18: 1< 0 - - > 2< 73728 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901082:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ebe8a96c 00000080:00200000:1.0:1788201594.901083:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 19. 00000080:00200000:1.0:1788201594.901085:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 19 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901108:0:24470:0:(rw26.c:898:ll_write_end()) pos 77824, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901112:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000467e84a[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 19] 00000080:00200000:1.0:1788201594.901115:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000602f36d4 17ffffc0001001 3:0 ffff8bc148d87a80 19 lru 00000080:00200000:1.0:1788201594.901120:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000430ef360 19: 1< 0 - - > 2< 77824 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901122:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000467e84a 00000080:00200000:1.0:1788201594.901123:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 20. 00000080:00200000:1.0:1788201594.901125:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 20 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901136:0:24470:0:(rw26.c:898:ll_write_end()) pos 81920, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901139:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002a7e594f[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 20] 00000080:00200000:1.0:1788201594.901142:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003fe903c9 17ffffc0001001 3:0 ffff8bc148d87540 20 lru 00000080:00200000:1.0:1788201594.901147:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008b59e941 20: 1< 0 - - > 2< 81920 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901149:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002a7e594f 00000080:00200000:1.0:1788201594.901150:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 21. 00000080:00200000:1.0:1788201594.901152:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 21 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901162:0:24470:0:(rw26.c:898:ll_write_end()) pos 86016, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901166:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a8e5672a[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 21] 00000080:00200000:1.0:1788201594.901168:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004f26a7af 17ffffc0001001 3:0 ffff8bc148d878c0 21 lru 00000080:00200000:1.0:1788201594.901173:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000050039e6b 21: 1< 0 - - > 2< 86016 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901175:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a8e5672a 00000080:00200000:1.0:1788201594.901176:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 22. 00000080:00200000:1.0:1788201594.901178:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 22 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901187:0:24470:0:(rw26.c:898:ll_write_end()) pos 90112, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901191:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000714ed80[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 22] 00000080:00200000:1.0:1788201594.901194:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000cce159f6 17ffffc0001001 3:0 ffff8bc148d872a0 22 lru 00000080:00200000:1.0:1788201594.901200:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000097593473 22: 1< 0 - - > 2< 90112 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901202:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000714ed80 00000080:00200000:1.0:1788201594.901203:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 23. 00000080:00200000:1.0:1788201594.901204:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 23 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901213:0:24470:0:(rw26.c:898:ll_write_end()) pos 94208, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901217:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009d9b6e5c[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 23] 00000080:00200000:1.0:1788201594.901220:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006048190c 17ffffc0001001 3:0 ffff8bc148d87b60 23 lru 00000080:00200000:1.0:1788201594.901225:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e2494277 23: 1< 0 - - > 2< 94208 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901226:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009d9b6e5c 00000080:00200000:1.0:1788201594.901228:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 24. 00000080:00200000:1.0:1788201594.901229:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 24 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901239:0:24470:0:(rw26.c:898:ll_write_end()) pos 98304, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901243:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b5de8868[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 24] 00000080:00200000:1.0:1788201594.901246:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b6148e8a 17ffffc0001001 3:0 ffff8bc148d87700 24 lru 00000080:00200000:1.0:1788201594.901251:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001c8eef6e 24: 1< 0 - - > 2< 98304 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901253:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b5de8868 00000080:00200000:1.0:1788201594.901254:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 25. 00000080:00200000:1.0:1788201594.901256:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 25 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901267:0:24470:0:(rw26.c:898:ll_write_end()) pos 102400, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901271:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d1c6af1a[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 25] 00000080:00200000:1.0:1788201594.901273:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000058474591 17ffffc0001001 3:0 ffff8bc148d877e0 25 lru 00000080:00200000:1.0:1788201594.901278:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c6b5365a 25: 1< 0 - - > 2< 102400 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901280:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d1c6af1a 00000080:00200000:1.0:1788201594.901281:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 26. 00000080:00200000:1.0:1788201594.901283:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 26 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901292:0:24470:0:(rw26.c:898:ll_write_end()) pos 106496, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901296:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e9afe130[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 26] 00000080:00200000:1.0:1788201594.901299:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000089a2b3e1 17ffffc0001001 3:0 ffff8bc148d87620 26 lru 00000080:00200000:1.0:1788201594.901304:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000355cb78c 26: 1< 0 - - > 2< 106496 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901306:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e9afe130 00000080:00200000:1.0:1788201594.901307:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 27. 00000080:00200000:1.0:1788201594.901308:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 27 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901317:0:24470:0:(rw26.c:898:ll_write_end()) pos 110592, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901321:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001c406943[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 27] 00000080:00200000:1.0:1788201594.901323:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000beddd016 17ffffc0001001 3:0 ffff8bc148d87ee0 27 lru 00000080:00200000:1.0:1788201594.901329:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005bf470f3 27: 1< 0 - - > 2< 110592 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901330:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001c406943 00000080:00200000:1.0:1788201594.901331:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 28. 00000080:00200000:1.0:1788201594.901333:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 28 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901342:0:24470:0:(rw26.c:898:ll_write_end()) pos 114688, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901356:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000550c7d5f[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 28] 00000080:00200000:1.0:1788201594.901358:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007388fc35 17ffffc0001001 3:0 ffff8bc148d87e00 28 lru 00000080:00200000:1.0:1788201594.901363:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d11ce0b7 28: 1< 0 - - > 2< 114688 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901365:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000550c7d5f 00000080:00200000:1.0:1788201594.901366:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 29. 00000080:00200000:1.0:1788201594.901368:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 29 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901384:0:24470:0:(rw26.c:898:ll_write_end()) pos 118784, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901388:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000009cf6c0a[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 29] 00000080:00200000:1.0:1788201594.901390:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009fabe501 17ffffc0001021 2:0 ffff8bc148d87460 29 lru 00000080:00200000:1.0:1788201594.901395:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000000f4ac3f 29: 1< 0 - - > 2< 118784 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901397:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000009cf6c0a 00000080:00200000:1.0:1788201594.901398:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 30. 00000080:00200000:1.0:1788201594.901400:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 30 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901409:0:24470:0:(rw26.c:898:ll_write_end()) pos 122880, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901413:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007868bb91[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 30] 00000080:00200000:1.0:1788201594.901415:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000039632eba 17ffffc0001001 3:0 ffff8bc148d87d20 30 lru 00000080:00200000:1.0:1788201594.901420:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000069a27adf 30: 1< 0 - - > 2< 122880 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901423:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007868bb91 00000080:00200000:1.0:1788201594.901424:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 31. 00000080:00200000:1.0:1788201594.901426:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 31 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901436:0:24470:0:(rw26.c:898:ll_write_end()) pos 126976, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901439:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000abc44530[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 31] 00000080:00200000:1.0:1788201594.901442:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003e08fb58 17ffffc0001001 3:0 ffff8bc148d87000 31 lru 00000080:00200000:1.0:1788201594.901447:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000bed7c5fe 31: 1< 0 - - > 2< 126976 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901448:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000abc44530 00000080:00200000:1.0:1788201594.901450:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 32. 00000080:00200000:1.0:1788201594.901451:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 32 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901464:0:24470:0:(rw26.c:898:ll_write_end()) pos 131072, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901467:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002d6141bc[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 32] 00000080:00200000:1.0:1788201594.901469:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001058cb46 17ffffc0001001 3:0 ffff8bc148d87380 32 lru 00000080:00200000:1.0:1788201594.901474:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a3854580 32: 1< 0 - - > 2< 131072 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901476:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002d6141bc 00000080:00200000:1.0:1788201594.901477:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 33. 00000080:00200000:1.0:1788201594.901478:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 33 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901494:0:24470:0:(rw26.c:898:ll_write_end()) pos 135168, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901499:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000313d0a3f[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 33] 00000080:00200000:1.0:1788201594.901501:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007f16d567 17ffffc0001001 3:0 ffff8bc146054540 33 lru 00000080:00200000:1.0:1788201594.901506:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000068f40772 33: 1< 0 - - > 2< 135168 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901508:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000313d0a3f 00000080:00200000:1.0:1788201594.901509:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 34. 00000080:00200000:1.0:1788201594.901511:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 34 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901525:0:24470:0:(rw26.c:898:ll_write_end()) pos 139264, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901530:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000058f24f8[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 34] 00000080:00200000:1.0:1788201594.901533:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000929723ca 17ffffc0001001 3:0 ffff8bc146054a80 34 lru 00000080:00200000:1.0:1788201594.901538:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000066b48714 34: 1< 0 - - > 2< 139264 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901540:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000058f24f8 00000080:00200000:1.0:1788201594.901541:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 35. 00000080:00200000:1.0:1788201594.901543:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 35 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901560:0:24470:0:(rw26.c:898:ll_write_end()) pos 143360, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901565:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000092e91c1e[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 35] 00000080:00200000:1.0:1788201594.901567:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ffbb76e7 17ffffc0001001 3:0 ffff8bc146054c40 35 lru 00000080:00200000:1.0:1788201594.901572:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000855dc26c 35: 1< 0 - - > 2< 143360 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901575:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000092e91c1e 00000080:00200000:1.0:1788201594.901576:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 36. 00000080:00200000:1.0:1788201594.901578:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 36 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901594:0:24470:0:(rw26.c:898:ll_write_end()) pos 147456, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901598:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000033c240ff[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 36] 00000080:00200000:1.0:1788201594.901601:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003da0b784 17ffffc0001001 3:0 ffff8bc1460549a0 36 lru 00000080:00200000:1.0:1788201594.901606:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f81b3ade 36: 1< 0 - - > 2< 147456 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901608:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000033c240ff 00000080:00200000:1.0:1788201594.901609:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 37. 00000080:00200000:1.0:1788201594.901611:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 37 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901622:0:24470:0:(rw26.c:898:ll_write_end()) pos 151552, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901626:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000073842bab[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 37] 00000080:00200000:1.0:1788201594.901629:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000dfdd1a14 17ffffc0001001 3:0 ffff8bc146054380 37 lru 00000080:00200000:1.0:1788201594.901635:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b0fd6e20 37: 1< 0 - - > 2< 151552 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901637:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000073842bab 00000080:00200000:1.0:1788201594.901638:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 38. 00000080:00200000:1.0:1788201594.901639:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 38 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901651:0:24470:0:(rw26.c:898:ll_write_end()) pos 155648, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901655:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000895894af[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 38] 00000080:00200000:1.0:1788201594.901658:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a88bc450 17ffffc0001001 3:0 ffff8bc146054ee0 38 lru 00000080:00200000:1.0:1788201594.901663:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000092a6c8fa 38: 1< 0 - - > 2< 155648 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901665:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000895894af 00000080:00200000:1.0:1788201594.901666:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 39. 00000080:00200000:1.0:1788201594.901667:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 39 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901681:0:24470:0:(rw26.c:898:ll_write_end()) pos 159744, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901685:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000057ed04bb[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 39] 00000080:00200000:1.0:1788201594.901687:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005f4ef390 17ffffc0001001 3:0 ffff8bc146054620 39 lru 00000080:00200000:1.0:1788201594.901693:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000059093df2 39: 1< 0 - - > 2< 159744 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901695:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000057ed04bb 00000080:00200000:1.0:1788201594.901696:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 40. 00000080:00200000:1.0:1788201594.901697:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 40 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901707:0:24470:0:(rw26.c:898:ll_write_end()) pos 163840, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901711:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002b0bea6b[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 40] 00000080:00200000:1.0:1788201594.901713:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f8e5d7c6 17ffffc0001001 3:0 ffff8bc1460547e0 40 lru 00000080:00200000:1.0:1788201594.901719:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b697f079 40: 1< 0 - - > 2< 163840 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901721:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002b0bea6b 00000080:00200000:1.0:1788201594.901722:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 41. 00000080:00200000:1.0:1788201594.901724:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 41 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901733:0:24470:0:(rw26.c:898:ll_write_end()) pos 167936, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901737:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ecdc001e[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 41] 00000080:00200000:1.0:1788201594.901740:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ed7a778c 17ffffc0001001 3:0 ffff8bc146054700 41 lru 00000080:00200000:1.0:1788201594.901745:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000680d403a 41: 1< 0 - - > 2< 167936 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901747:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ecdc001e 00000080:00200000:1.0:1788201594.901748:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 42. 00000080:00200000:1.0:1788201594.901749:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 42 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901759:0:24470:0:(rw26.c:898:ll_write_end()) pos 172032, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901762:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004c929aba[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 42] 00000080:00200000:1.0:1788201594.901765:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000470c426b 17ffffc0001001 3:0 ffff8bc146054b60 42 lru 00000080:00200000:1.0:1788201594.901770:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006895f5ee 42: 1< 0 - - > 2< 172032 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901771:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004c929aba 00000080:00200000:1.0:1788201594.901772:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 43. 00000080:00200000:1.0:1788201594.901773:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 43 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901783:0:24470:0:(rw26.c:898:ll_write_end()) pos 176128, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901786:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d8b32fb4[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 43] 00000080:00200000:1.0:1788201594.901789:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000fd3186ab 17ffffc0001001 3:0 ffff8bc1460542a0 43 lru 00000080:00200000:1.0:1788201594.901820:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001def2168 43: 1< 0 - - > 2< 176128 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901821:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d8b32fb4 00000080:00200000:1.0:1788201594.901822:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 44. 00000080:00200000:1.0:1788201594.901824:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 44 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901841:0:24470:0:(rw26.c:898:ll_write_end()) pos 180224, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901844:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000003312dd[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 44] 00000080:00200000:1.0:1788201594.901847:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000cfc36300 17ffffc0001021 2:0 ffff8bc146054460 44 lru 00000080:00200000:1.0:1788201594.901852:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000066069426 44: 1< 0 - - > 2< 180224 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901853:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000003312dd 00000080:00200000:1.0:1788201594.901855:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 45. 00000080:00200000:1.0:1788201594.901857:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 45 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901877:0:24470:0:(rw26.c:898:ll_write_end()) pos 184320, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901882:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d3bb9895[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 45] 00000080:00200000:1.0:1788201594.901885:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006d6bf759 17ffffc0001001 3:0 ffff8bc146054d20 45 lru 00000080:00200000:1.0:1788201594.901890:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d95626b9 45: 1< 0 - - > 2< 184320 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901892:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d3bb9895 00000080:00200000:1.0:1788201594.901893:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 46. 00000080:00200000:1.0:1788201594.901895:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 46 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901908:0:24470:0:(rw26.c:898:ll_write_end()) pos 188416, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901912:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000044d68340[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 46] 00000080:00200000:1.0:1788201594.901914:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000095b6e296 17ffffc0001001 3:0 ffff8bc146054000 46 lru 00000080:00200000:1.0:1788201594.901920:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000bfd50a72 46: 1< 0 - - > 2< 188416 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901922:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000044d68340 00000080:00200000:1.0:1788201594.901923:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 47. 00000080:00200000:1.0:1788201594.901925:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 47 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901935:0:24470:0:(rw26.c:898:ll_write_end()) pos 192512, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901938:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000418cb426[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 47] 00000080:00200000:1.0:1788201594.901940:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000d42df9d 17ffffc0001001 3:0 ffff8bc1460541c0 47 lru 00000080:00200000:1.0:1788201594.901945:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c966ec24 47: 1< 0 - - > 2< 192512 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901947:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000418cb426 00000080:00200000:1.0:1788201594.901948:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 48. 00000080:00200000:1.0:1788201594.901950:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 48 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901959:0:24470:0:(rw26.c:898:ll_write_end()) pos 196608, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901962:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c62a102a[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 48] 00000080:00200000:1.0:1788201594.901965:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009eb30401 17ffffc0001001 3:0 ffff8bc1460540e0 48 lru 00000080:00200000:1.0:1788201594.901970:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005cb8b129 48: 1< 0 - - > 2< 196608 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901971:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c62a102a 00000080:00200000:1.0:1788201594.901972:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 49. 00000080:00200000:1.0:1788201594.901974:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 49 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.901984:0:24470:0:(rw26.c:898:ll_write_end()) pos 200704, len 4096, copied 4096 00000080:00200000:1.0:1788201594.901987:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000de860531[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 49] 00000080:00200000:1.0:1788201594.901990:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000fa1f85d1 17ffffc0001001 3:0 ffff8bc146054e00 49 lru 00000080:00200000:1.0:1788201594.901995:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000294f9ed6 49: 1< 0 - - > 2< 200704 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.901996:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000de860531 00000080:00200000:1.0:1788201594.901998:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 50. 00000080:00200000:1.0:1788201594.902000:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 50 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.902010:0:24470:0:(rw26.c:898:ll_write_end()) pos 204800, len 4096, copied 4096 00000080:00200000:1.0:1788201594.902014:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000047470f39[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 50] 00000080:00200000:1.0:1788201594.902017:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000019c50e35 17ffffc0001001 3:0 ffff8bc1460548c0 50 lru 00000080:00200000:1.0:1788201594.902022:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008f947db0 50: 1< 0 - - > 2< 204800 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.902024:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000047470f39 00000080:00200000:1.0:1788201594.902025:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 51. 00000080:00200000:1.0:1788201594.902027:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 51 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.902038:0:24470:0:(rw26.c:898:ll_write_end()) pos 208896, len 4096, copied 4096 00000080:00200000:1.0:1788201594.902041:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004328a1fd[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 51] 00000080:00200000:1.0:1788201594.902044:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e5ea6ba1 17ffffc0001001 3:0 ffff8bc1726389a0 51 lru 00000080:00200000:1.0:1788201594.902049:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009f007daa 51: 1< 0 - - > 2< 208896 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.902051:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004328a1fd 00000080:00200000:1.0:1788201594.902052:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 52. 00000080:00200000:1.0:1788201594.902054:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 52 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.902065:0:24470:0:(rw26.c:898:ll_write_end()) pos 212992, len 4096, copied 4096 00000080:00200000:1.0:1788201594.902068:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ffa626d9[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 52] 00000080:00200000:1.0:1788201594.902071:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002692f463 17ffffc0001001 3:0 ffff8bc172638c40 52 lru 00000080:00200000:1.0:1788201594.902076:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b51fcaf9 52: 1< 0 - - > 2< 212992 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.902078:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ffa626d9 00000080:00200000:1.0:1788201594.902079:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 53. 00000080:00200000:1.0:1788201594.902080:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 53 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.902092:0:24470:0:(rw26.c:898:ll_write_end()) pos 217088, len 4096, copied 4096 00000080:00200000:1.0:1788201594.902096:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000dded08fc[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 53] 00000080:00200000:1.0:1788201594.902098:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004a4db596 17ffffc0001001 3:0 ffff8bc172638a80 53 lru 00000080:00200000:1.0:1788201594.902104:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009f5e149e 53: 1< 0 - - > 2< 217088 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.902105:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000dded08fc 00000080:00200000:1.0:1788201594.902106:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 54. 00000080:00200000:1.0:1788201594.902108:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 54 of 0 to 4096 bytes 00000080:00200000:1.0:1788201594.902118:0:24470:0:(rw26.c:898:ll_write_end()) pos 221184, len 4096, copied 4096 00000080:00200000:1.0:1788201594.902122:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007618fbc9[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 54] 00000080:00200000:1.0:1788201594.902125:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000db2e5aae 17ffffc0001001 3:0 ffff8bc172638540 54 lru 00000080:00200000:1.0:1788201594.902130:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009d794c54 54: 1< 0 - - > 2< 221184 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.902132:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007618fbc9 00000080:00200000:1.0:1788201594.902133:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 55. 00000080:00200000:1.0:1788201594.902135:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 55 of 0 to 2236 bytes 00000080:00200000:1.0:1788201594.902153:0:24470:0:(rw26.c:898:ll_write_end()) pos 225280, len 2236, copied 2236 00000080:00200000:1.0:1788201594.902156:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000257b43b4[3 00000000e04b7c95 2 1 0000000032a1b70f 0 0 55] 00000080:00200000:1.0:1788201594.902159:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000017beb564 17ffffc0001001 3:0 ffff8bc1726388c0 55 lru 00000080:00200000:1.0:1788201594.902164:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000711b73a5 55: 1< 0 - - > 2< 225280 0 0 0x0 0x0 | 000000000ce25486 000000009f3a1400 > 3< 0 0 > 4< 0 0 8 6815744 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1788201594.902165:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000257b43b4 00000080:00200000:1.0:1788201594.902167:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 56. 00000080:00200000:1.0:1788201594.902170:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 56, from 0, to 2236 prio 0 00000008:00010000:1.0:1788201594.902201:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000781b57b3 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1788201594.902239:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459b12f8, count 15, dirtied 15 00000080:00200000:1.0:1788201594.902256:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459b12f8, count 15, dirtied 15 00000080:00200000:1.0:1788201594.902271:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459b12f8, count 15, dirtied 15 00000080:00200000:1.0:1788201594.902283:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459b12f8, count 11, dirtied 11 00000080:00200000:1.0:1788201594.902287:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 56 pages 227516 bytes, tot: 227516 00000080:00200000:1.0:1788201594.902290:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) sanityn.sh: write bytes 0, result: 227516 00000020:00010000:1.0:1788201594.902311:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c45d8 (ffff8bc148e3b5a8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201594.902314:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c45d8 (ffff8bc148e3b5a8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201594.902318:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4f30 (ffff8bc148e3b878/1) at cl_lock_cancel():142 00010000:00010000:1.0:1788201594.902327:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.902340:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1788201594.902376:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c45d8 (ffff8bc148e3b5a8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201594.902380:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4f30 (ffff8bc148e3b5a8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201594.902393:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 227516 bytes 00000080:00200000:1.0:1788201594.902402:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 55] 00000080:00200000:1.0:1788201594.902440:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19a:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201594.902444:0:24470:0:(file.c:2238:ll_file_io_generic()) sanityn.sh: 2 io complete with rc: 0, result: 227516, restart: 0 00000080:00200000:1.0:1788201594.902453:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x19a:0x0] updating i_size 227516 i_blocks 1 00000080:00200000:1.0:1788201594.902460:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 227516 00000080:00200008:1.0:1788201594.902522:0:24470:0:(file.c:479:ll_file_release()) START file sanityn.sh:[0x200000bd7:0x19a:0x0](ffff8bc1459b1148), flags 100001 00000002:00100000:1.0:1788201594.902606:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1727d7480 x1875064728016384/t8589937462(8589937462) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1788201594.902620:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1788201594.902627:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d4000 x1875064728017024/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1788201594.902657:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728017024:192.168.201.143@tcp:35:cp.0 00000100:00100000:1.0:1788201594.902766:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201594.904972:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728016768:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201594.907425:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728017024:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201594.907466:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1727d7480 x1875064728016384/t8589937462(8589937462) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201594.907571:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201594.907596:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.907620:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201594.907643:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201594.907653:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.907659:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201594.907664:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201594.907672:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201594.907676:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201594.907686:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201594.907705:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.907714:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201594.907722:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.907726:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanityn.sh, flags=8 00000080:00200008:1.0:1788201594.907735:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanityn.sh:[0x200000bd7:0x19a:0x0](ffff8bc1459b1148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201594.907741:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x19a:0x0](ffff8bc1459b1148),name=sanityn.sh 00000002:00010000:1.0:1788201594.907755:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x19a:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.907764:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098121 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201594.907772:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098121 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201594.907785:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.908008:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x19a:0x0](ffff8bc1459b1148) 00000080:00010000:1.0:1788201594.908012:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x19a:0x0](ffff8bc1459b1148) for lock 0xd138388016f6f794 00000080:00010000:1.0:1788201594.908017:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f794 from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201594.908021:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171098121 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201594.908031:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098121 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201594.908176:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19a:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201594.908189:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x19a:0x0] 00000008:00010000:2.0:1788201594.908223:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201594.908228:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d130, osc lock ffff8bc151fc0ab0, flags 0x400001002 00010000:00010000:2.0:1788201594.908250:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.908265:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:2.0:1788201594.908279:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1788201594.908283:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.908291:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1788201594.908303:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1788201594.908314:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x19a:0x0] updating i_size 227516 i_blocks 1 00000020:00010000:2.0:1788201594.908318:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc146006e40 (ffff8bc1469193f8/0) at cl_lock_release():245 00000020:00010000:2.0:1788201594.908321:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146006e40 (ffff8bc1469193f8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201594.908324:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d130 (ffff8bc146919bd8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201594.908329:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146006e40 (ffff8bc1469193f8/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201594.908332:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d130 (ffff8bc1469193f8/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201594.908374:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19a:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201594.908443:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201594.908456:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.908464:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201594.908472:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201594.908479:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.908483:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201594.908486:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201594.908490:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201594.908493:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201594.908500:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201594.908509:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.908515:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201594.908518:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.908545:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-pcc.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:2.0:1788201594.908550:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-pcc.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201594.908560:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-pcc.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201594.908618:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7a9 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.908626:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7a9 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.908638:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7a9 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.908665:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2d80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728017152:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201594.908858:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc15399fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201594.913632:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a2d80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728017152:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201594.913663:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7a9 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.913680:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7a9 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.913687:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7a9 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.913695:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7a9 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.913705:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7a9 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.913713:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1443b7800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:2.0:1788201594.913719:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7a9 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.913727:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7a9 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.913736:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7a9 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.913744:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201594.913752:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7a9 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.913760:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7a9 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201594.913783:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a2d80 x1875064728017152/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201594.914235:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1788201594.914266:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201594.914362:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201594.914381:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.914392:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201594.914406:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201594.914413:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.914419:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201594.914423:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201594.914429:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201594.914433:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201594.914448:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201594.914466:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.914475:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201594.914483:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.914499:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-pcc.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:2.0:1788201594.914503:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-pcc.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201594.914518:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-pcc.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201594.914587:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f7b0 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.914595:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f7b0 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.914607:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f7b0 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.914635:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2d80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728017280:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201594.914819:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc15399fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.918413:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a2d80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728017280:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201594.918444:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f7b0 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.918461:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f7b0 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.918469:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f7b0 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.918477:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f7b0 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.918487:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f7b0 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.918495:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1443b7400 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201594.918500:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f7b0 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.918508:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f7b0 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.918518:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f7b0 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.918589:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201594.918597:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f7b0 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.918605:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f7b0 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201594.918629:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a2d80 x1875064728017280/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201594.918646:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201594.918678:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201594.921982:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201594.922018:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.922040:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201594.922061:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201594.922075:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.922084:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201594.922088:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201594.922215:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:2.0:1788201594.922221:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201594.922231:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201594.922251:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.922261:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201594.922268:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.922282:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1788201594.922287:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sanity-pcc.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14c594c00, open_flags 80c1, mode 81ed opened 0 00000080:00200000:2.0:1788201594.922297:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-pcc.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:2.0:1788201594.922319:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-pcc.sh,[0x200000bd7:0x19b:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:2.0:1788201594.922390:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.922398:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1788201594.922412:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1788201594.922426:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a3800 x1875064728017536/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1788201594.922443:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.922471:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a3800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728017536:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201594.922766:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc15399fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.931997:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a3800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728017536:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201594.932037:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109817c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.932066:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109817c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.932075:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109817c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.932087:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109817c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.932262:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109817c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.932279:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109817c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.932288:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109817c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.932295:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109817c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201594.932308:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1724a3800 x1875064728017536/t8589937464(8589937464) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201594.932322:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a3800 x1875064728017536/t8589937464(8589937464) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201594.932338:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109817c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1788201594.932365:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109817c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.932380:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/411 (0 0) 00000080:00200000:0.0:1788201594.932389:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201594.932407:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=sanity-pcc.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:0.0:1788201594.932443:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x19b:0x0](ffff8bc1459b0908) 00000080:00200000:0.0:1788201594.932671:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x19b:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1788201594.932683:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x19b:0x0](ffff8bc1459b0908) 00000080:00010000:0.0:1788201594.932686:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x19b:0x0](ffff8bc1459b0908) for lock 0xd138388016f6f7b7 00000080:00010000:0.0:1788201594.932698:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x19b:0x0](ffff8bc1459b0908) 00000080:00200008:0.0:1788201594.932716:0:24470:0:(file.c:1090:ll_file_open()) START file sanity-pcc.sh:[0x200000bd7:0x19b:0x0](ffff8bc1459b0908), flags 100301 00000002:00100000:0.0:1788201594.932740:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a3800 x1875064728017536/t8589937464(8589937464) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1788201594.932969:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f7b7 from it ffff8bc150632ae0 00010000:00010000:0.0:1788201594.932976:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109817c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.932988:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109817c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201594.933043:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x19b:0x0](ffff8bc1459b0908), inode mode 81ed mask 40 00000080:00200008:0.0:1788201594.933083:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-pcc.sh:[0x200000bd7:0x19b:0x0](ffff8bc1459b0908), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201594.933531:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x19b:0x0](ffff8bc1459b0908),name=sanity-pcc.sh 00000002:00010000:0.0:1788201594.933561:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x19b:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.933577:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109817c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.933593:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109817c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201594.933602:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.933609:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x19b:0x0](ffff8bc1459b0908) 00000080:00010000:0.0:1788201594.933613:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x19b:0x0](ffff8bc1459b0908) for lock 0xd138388016f6f7b7 00000080:00010000:0.0:1788201594.933619:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f7b7 from it ffffadd1c7debcd8 00010000:00010000:0.0:1788201594.933623:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109817c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.933630:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109817c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201594.933664:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19b:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201594.933676:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x19b:0x0] 00000008:00010000:0.0:1788201594.933709:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201594.933713:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456730, osc lock ffff8bc145d358f0, flags 0x400001002 00010000:00010000:0.0:1788201594.933772:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f7be lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.933784:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f7be lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201594.933861:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1788201594.933980:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201594.934007:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17264bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728017664:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201594.937838:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f7be lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.937882:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f7be lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109818a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.937902:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f7be lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109818a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.937917:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f7be lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109818a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1788201594.937938:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f7be lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109818a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1788201594.937951:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:2.0:1788201594.937970:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f7be lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109818a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.937979:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f7be lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109818a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.937989:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f7be lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109818a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.937999:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f7be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e217109818a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1788201594.938024:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17264bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728017664:192.168.201.143@tcp:101:cp.0 00000080:00200000:0.0:1788201594.938150:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x19b:0x0] updating i_size 0 i_blocks 1 00000020:00010000:0.0:1788201594.938157:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449db090 (ffff8bc1499c4908/0) at cl_lock_release():245 00000020:00010000:0.0:1788201594.938161:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449db090 (ffff8bc1499c4908/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.938167:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456730 (ffff8bc1499c4b48/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.938172:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449db090 (ffff8bc1499c4908/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201594.938174:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456730 (ffff8bc1499c4908/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201594.938221:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19b:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1788201594.938401:0:24470:0:(file.c:2638:do_file_write_iter()) START file sanity-pcc.sh:[0x200000bd7:0x19b:0x0], ppos: 0, count: 159678 00000080:00200000:0.0:1788201594.938434:0:24470:0:(file.c:2090:ll_file_io_generic()) sanity-pcc.sh: write ppos: 0, bytes: 159678 00000080:00200000:0.0:1788201594.938442:0:24470:0:(file.c:1848:ll_io_set_mirror()) sanity-pcc.sh: desiginated mirror: 0 00000020:00200000:0.0:1788201594.938450:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000e53926fc[0x110, 1, [0x200000bd7:0x19b:0x0] hash] 00000020:00200000:0.0:1788201594.938453:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 159678) 0 0 00000080:00200000:0.0:1788201594.938458:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19b:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201594.938471:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 38] 00020000:00200000:0.0:1788201594.938481:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 159678) 159678, 159678 00020000:00200000:0.0:1788201594.938486:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201594.938518:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 38] 00000008:00010000:0.0:1788201594.938656:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1788201594.938663:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456730, osc lock ffff8bc145d358f0, flags 0x0 00010000:00010000:0.0:1788201594.938681:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/448 (0 159743) 00010000:00010000:0.0:1788201594.938729:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.938740:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.938753:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201594.938783:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17264ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728017792:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201594.940887:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc144ff8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.941649:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201594.941839:0:20877:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788201594.941867:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743487488 00000100:00100000:2.0:1788201594.941879:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743487488 00000100:00100000:2.0:1788201594.941951:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 813 00000100:00100000:2.0:1788201594.941964:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc141796850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21821:x1875064743487488:12345-192.168.201.143@tcp:104: 00010000:00010000:2.0:1788201594.941988:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f7be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109818a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.942092:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201594.942099:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc141796850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21821:x1875064743487488:12345-192.168.201.143@tcp:104: Request processed in 139us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201594.942107:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 813 00010000:00010000:1.0:1788201594.942319:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201594.942328:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f7be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109818a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.942339:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc146085400 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201594.942357:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f7be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e217109818a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201594.942423:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201594.942438:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201594.942517:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f7be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109818a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.942539:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201594.942577:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f7be lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109818a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.942587:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f7be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109818a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.942607:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201594.942609:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201594.942610:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201594.942656:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201594.942678:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728017920:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201594.945641:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201594.945833:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743487616 00000100:00100000:0.0:1788201594.945846:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743487616 00000100:00100000:0.0:1788201594.945915:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 814 00000100:00100000:0.0:1788201594.945927:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1726cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21005:x1875064743487616:12345-192.168.201.143@tcp:105: 00010000:00010000:0.0:1788201594.945947:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.945969:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.945980:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.945994:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.946004:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.946018:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.946040:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc146084e00) 00000100:00100000:0.0:1788201594.946109:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1726cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21005:x1875064743487616:12345-192.168.201.143@tcp:105: Request processed in 185us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201594.946117:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 814 00000100:00100000:3.0:1788201594.948665:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728017920:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201594.950516:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17264ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728017792:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201594.950569:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.950595:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201594.950612:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.950626:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.950636:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201594.950668:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) sanity-pcc.sh: write [0, 159678) append 0 append lockpos 0 00000080:00200000:0.0:1788201594.950692:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.950761:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:0.0:1788201594.950776:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000060bdc91[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 0] 00000080:00200000:0.0:1788201594.950780:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000090e4e082 17ffffc0001001 3:0 ffff8bc1726fde00 0 lru 00000080:00200000:0.0:1788201594.950847:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005b92c354 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.950850:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000060bdc91 00000080:00200000:0.0:1788201594.950852:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1788201594.950855:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.950889:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:0.0:1788201594.950894:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c32b27c5[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 1] 00000080:00200000:0.0:1788201594.950897:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006ec86609 17ffffc0001001 3:0 ffff8bc1726fd8c0 1 lru 00000080:00200000:0.0:1788201594.950902:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d810396a 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.950904:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c32b27c5 00000080:00200000:0.0:1788201594.950906:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:0.0:1788201594.950907:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.950926:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:0.0:1788201594.950931:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000006eadcda[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 2] 00000080:00200000:0.0:1788201594.950935:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d5cdcc7d 17ffffc0001001 3:0 ffff8bc1726fd540 2 lru 00000080:00200000:0.0:1788201594.950940:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ca5d7e1a 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.950942:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000006eadcda 00000080:00200000:0.0:1788201594.950943:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:0.0:1788201594.950945:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.950964:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:0.0:1788201594.950968:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000fa97c1a6[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 3] 00000080:00200000:0.0:1788201594.950971:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007ac48ea5 17ffffc0001001 3:0 ffff8bc1726fda80 3 lru 00000080:00200000:0.0:1788201594.950976:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006a45c168 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.950979:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000fa97c1a6 00000080:00200000:0.0:1788201594.950980:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:0.0:1788201594.950982:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.950997:0:24470:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951002:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d36fc98f[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 4] 00000080:00200000:0.0:1788201594.951005:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004aae54b2 17ffffc0001001 3:0 ffff8bc1726fdc40 4 lru 00000080:00200000:0.0:1788201594.951010:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005a441bf9 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951013:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d36fc98f 00000080:00200000:0.0:1788201594.951014:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:0.0:1788201594.951016:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951029:0:24470:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951034:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000be7d5681[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 5] 00000080:00200000:0.0:1788201594.951038:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f6fef7bf 17ffffc0001001 3:0 ffff8bc1726fd9a0 5 lru 00000080:00200000:0.0:1788201594.951044:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004c13a760 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951046:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000be7d5681 00000080:00200000:0.0:1788201594.951047:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:0.0:1788201594.951049:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951076:0:24470:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951081:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000076564cf[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 6] 00000080:00200000:0.0:1788201594.951084:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000072fc6928 17ffffc0001021 2:0 ffff8bc1726fd0e0 6 lru 00000080:00200000:0.0:1788201594.951089:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000fb83ae48 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951103:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000076564cf 00000080:00200000:0.0:1788201594.951105:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:0.0:1788201594.951107:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951123:0:24470:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951135:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000023d8fe[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 7] 00000080:00200000:0.0:1788201594.951139:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b7e84f15 17ffffc0001001 3:0 ffff8bc1726fd1c0 7 lru 00000080:00200000:0.0:1788201594.951145:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f2486b9b 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951147:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000023d8fe 00000080:00200000:0.0:1788201594.951149:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:0.0:1788201594.951151:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951165:0:24470:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951170:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000dd2c3a4b[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 8] 00000080:00200000:0.0:1788201594.951173:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e831a4d1 17ffffc0001001 3:0 ffff8bc1726fd380 8 lru 00000080:00200000:0.0:1788201594.951179:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000313f4c0f 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951181:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000dd2c3a4b 00000080:00200000:0.0:1788201594.951183:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:0.0:1788201594.951185:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951197:0:24470:0:(rw26.c:898:ll_write_end()) pos 36864, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951201:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003e64759d[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 9] 00000080:00200000:0.0:1788201594.951203:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001ee4a30e 17ffffc0001001 3:0 ffff8bc1726fd000 9 lru 00000080:00200000:0.0:1788201594.951207:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000fe962e7d 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951210:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003e64759d 00000080:00200000:0.0:1788201594.951211:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:0.0:1788201594.951213:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 10 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951224:0:24470:0:(rw26.c:898:ll_write_end()) pos 40960, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951228:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f1a03d7a[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 10] 00000080:00200000:0.0:1788201594.951231:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000abba02ab 17ffffc0001001 3:0 ffff8bc1726fdd20 10 lru 00000080:00200000:0.0:1788201594.951236:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000034fcfba1 10: 1< 0 - - > 2< 40960 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951239:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f1a03d7a 00000080:00200000:0.0:1788201594.951240:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 11. 00000080:00200000:0.0:1788201594.951242:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 11 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951255:0:24470:0:(rw26.c:898:ll_write_end()) pos 45056, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951260:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000af93b772[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 11] 00000080:00200000:0.0:1788201594.951262:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000654f28ae 17ffffc0001001 3:0 ffff8bc1726fd460 11 lru 00000080:00200000:0.0:1788201594.951269:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000519f7726 11: 1< 0 - - > 2< 45056 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951271:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000af93b772 00000080:00200000:0.0:1788201594.951272:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 12. 00000080:00200000:0.0:1788201594.951274:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 12 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951288:0:24470:0:(rw26.c:898:ll_write_end()) pos 49152, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951293:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009d4f587b[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 12] 00000080:00200000:0.0:1788201594.951296:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f4618d4f 17ffffc0001001 3:0 ffff8bc1506add20 12 lru 00000080:00200000:0.0:1788201594.951302:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000569f4c3e 12: 1< 0 - - > 2< 49152 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951304:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009d4f587b 00000080:00200000:0.0:1788201594.951305:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 13. 00000080:00200000:0.0:1788201594.951307:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 13 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951322:0:24470:0:(rw26.c:898:ll_write_end()) pos 53248, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951326:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000239b1c87[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 13] 00000080:00200000:0.0:1788201594.951328:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c9bf44ec 17ffffc0001001 3:0 ffff8bc1506ad460 13 lru 00000080:00200000:0.0:1788201594.951333:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000084bccf09 13: 1< 0 - - > 2< 53248 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951335:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000239b1c87 00000080:00200000:0.0:1788201594.951336:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 14. 00000080:00200000:0.0:1788201594.951338:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 14 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951362:0:24470:0:(rw26.c:898:ll_write_end()) pos 57344, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951367:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000014127fcd[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 14] 00000080:00200000:0.0:1788201594.951370:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000079e2d05d 17ffffc0001001 3:0 ffff8bc1506ad2a0 14 lru 00000080:00200000:0.0:1788201594.951376:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006b301395 14: 1< 0 - - > 2< 57344 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951379:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000014127fcd 00000080:00200000:0.0:1788201594.951380:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 15. 00000080:00200000:0.0:1788201594.951382:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 15 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951396:0:24470:0:(rw26.c:898:ll_write_end()) pos 61440, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951400:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000094558bf8[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 15] 00000080:00200000:0.0:1788201594.951403:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000025b53a49 17ffffc0001001 3:0 ffff8bc1506adb60 15 lru 00000080:00200000:0.0:1788201594.951408:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000edebd963 15: 1< 0 - - > 2< 61440 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951410:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000094558bf8 00000080:00200000:0.0:1788201594.951411:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 16. 00000080:00200000:0.0:1788201594.951414:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 16 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951427:0:24470:0:(rw26.c:898:ll_write_end()) pos 65536, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951431:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007d7f07f8[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 16] 00000080:00200000:0.0:1788201594.951433:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f018c733 17ffffc0001001 3:0 ffff8bc1506ad700 16 lru 00000080:00200000:0.0:1788201594.951438:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d3625b5c 16: 1< 0 - - > 2< 65536 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951440:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007d7f07f8 00000080:00200000:0.0:1788201594.951441:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 17. 00000080:00200000:0.0:1788201594.951443:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 17 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951458:0:24470:0:(rw26.c:898:ll_write_end()) pos 69632, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951462:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000097b8d7c[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 17] 00000080:00200000:0.0:1788201594.951465:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000058d9a7cc 17ffffc0001001 3:0 ffff8bc1506ad7e0 17 lru 00000080:00200000:0.0:1788201594.951470:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000014e51c93 17: 1< 0 - - > 2< 69632 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951472:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000097b8d7c 00000080:00200000:0.0:1788201594.951473:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 18. 00000080:00200000:0.0:1788201594.951475:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 18 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951492:0:24470:0:(rw26.c:898:ll_write_end()) pos 73728, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951496:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005b98bfb2[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 18] 00000080:00200000:0.0:1788201594.951499:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000097e7045c 17ffffc0001001 3:0 ffff8bc1506ad620 18 lru 00000080:00200000:0.0:1788201594.951504:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000040928068 18: 1< 0 - - > 2< 73728 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951506:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005b98bfb2 00000080:00200000:0.0:1788201594.951507:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 19. 00000080:00200000:0.0:1788201594.951509:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 19 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951523:0:24470:0:(rw26.c:898:ll_write_end()) pos 77824, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951527:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000fe43aac4[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 19] 00000080:00200000:0.0:1788201594.951530:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a1cd190c 17ffffc0001001 3:0 ffff8bc1506adee0 19 lru 00000080:00200000:0.0:1788201594.951535:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000765e9ed9 19: 1< 0 - - > 2< 77824 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951537:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000fe43aac4 00000080:00200000:0.0:1788201594.951539:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 20. 00000080:00200000:0.0:1788201594.951541:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 20 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951556:0:24470:0:(rw26.c:898:ll_write_end()) pos 81920, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951560:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b3d94210[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 20] 00000080:00200000:0.0:1788201594.951563:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003d96c357 17ffffc0001001 3:0 ffff8bc1506ade00 20 lru 00000080:00200000:0.0:1788201594.951569:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000442ad46e 20: 1< 0 - - > 2< 81920 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951572:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b3d94210 00000080:00200000:0.0:1788201594.951573:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 21. 00000080:00200000:0.0:1788201594.951575:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 21 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951594:0:24470:0:(rw26.c:898:ll_write_end()) pos 86016, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951598:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000031cd1a75[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 21] 00000080:00200000:0.0:1788201594.951601:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008846ff2f 17ffffc0001021 2:0 ffff8bc1506ad8c0 21 lru 00000080:00200000:0.0:1788201594.951606:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000edf76152 21: 1< 0 - - > 2< 86016 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951608:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000031cd1a75 00000080:00200000:0.0:1788201594.951609:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 22. 00000080:00200000:0.0:1788201594.951611:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 22 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951625:0:24470:0:(rw26.c:898:ll_write_end()) pos 90112, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951629:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001010d28e[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 22] 00000080:00200000:0.0:1788201594.951632:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005d1fab77 17ffffc0001001 3:0 ffff8bc1506ad540 22 lru 00000080:00200000:0.0:1788201594.951637:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ce8061bb 22: 1< 0 - - > 2< 90112 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951639:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001010d28e 00000080:00200000:0.0:1788201594.951640:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 23. 00000080:00200000:0.0:1788201594.951641:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 23 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951655:0:24470:0:(rw26.c:898:ll_write_end()) pos 94208, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951659:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000028ce6dc9[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 23] 00000080:00200000:0.0:1788201594.951661:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f0555e28 17ffffc0001001 3:0 ffff8bc1506ada80 23 lru 00000080:00200000:0.0:1788201594.951667:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000038d3dca6 23: 1< 0 - - > 2< 94208 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951669:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000028ce6dc9 00000080:00200000:0.0:1788201594.951670:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 24. 00000080:00200000:0.0:1788201594.951672:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 24 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951688:0:24470:0:(rw26.c:898:ll_write_end()) pos 98304, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951692:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008e10dcc2[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 24] 00000080:00200000:0.0:1788201594.951696:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ed97e56f 17ffffc0001001 3:0 ffff8bc1506adc40 24 lru 00000080:00200000:0.0:1788201594.951701:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001d039ace 24: 1< 0 - - > 2< 98304 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951703:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008e10dcc2 00000080:00200000:0.0:1788201594.951705:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 25. 00000080:00200000:0.0:1788201594.951707:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 25 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951722:0:24470:0:(rw26.c:898:ll_write_end()) pos 102400, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951726:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000ddeb8ef[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 25] 00000080:00200000:0.0:1788201594.951729:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000008610b44 17ffffc0001001 3:0 ffff8bc1506ad9a0 25 lru 00000080:00200000:0.0:1788201594.951735:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b007a1bb 25: 1< 0 - - > 2< 102400 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951737:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000ddeb8ef 00000080:00200000:0.0:1788201594.951738:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 26. 00000080:00200000:0.0:1788201594.951740:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 26 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951752:0:24470:0:(rw26.c:898:ll_write_end()) pos 106496, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951756:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d6a8446e[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 26] 00000080:00200000:0.0:1788201594.951759:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000009536eb4 17ffffc0001001 3:0 ffff8bc1506ad0e0 26 lru 00000080:00200000:0.0:1788201594.951764:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000936513a3 26: 1< 0 - - > 2< 106496 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951766:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d6a8446e 00000080:00200000:0.0:1788201594.951767:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 27. 00000080:00200000:0.0:1788201594.951769:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 27 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951785:0:24470:0:(rw26.c:898:ll_write_end()) pos 110592, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951821:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e991a5b6[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 27] 00000080:00200000:0.0:1788201594.951823:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004d5b3d27 17ffffc0001001 3:0 ffff8bc1506ad1c0 27 lru 00000080:00200000:0.0:1788201594.951828:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000069570d65 27: 1< 0 - - > 2< 110592 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951831:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e991a5b6 00000080:00200000:0.0:1788201594.951832:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 28. 00000080:00200000:0.0:1788201594.951834:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 28 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951850:0:24470:0:(rw26.c:898:ll_write_end()) pos 114688, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951855:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002ef9ead7[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 28] 00000080:00200000:0.0:1788201594.951858:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000da8ff23b 17ffffc0001001 3:0 ffff8bc1506ad380 28 lru 00000080:00200000:0.0:1788201594.951863:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000057f8b352 28: 1< 0 - - > 2< 114688 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951865:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002ef9ead7 00000080:00200000:0.0:1788201594.951866:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 29. 00000080:00200000:0.0:1788201594.951868:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 29 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951883:0:24470:0:(rw26.c:898:ll_write_end()) pos 118784, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951887:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000faa47fb5[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 29] 00000080:00200000:0.0:1788201594.951890:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b2e89ea8 17ffffc0001001 3:0 ffff8bc1506ad000 29 lru 00000080:00200000:0.0:1788201594.951897:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008ebbedf5 29: 1< 0 - - > 2< 118784 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951898:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000faa47fb5 00000080:00200000:0.0:1788201594.951899:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 30. 00000080:00200000:0.0:1788201594.951902:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 30 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951917:0:24470:0:(rw26.c:898:ll_write_end()) pos 122880, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951920:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006dafd4ee[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 30] 00000080:00200000:0.0:1788201594.951923:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008f3d56b1 17ffffc0001001 3:0 ffff8bc172557ee0 30 lru 00000080:00200000:0.0:1788201594.951927:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c2c25c38 30: 1< 0 - - > 2< 122880 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951930:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006dafd4ee 00000080:00200000:0.0:1788201594.951931:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 31. 00000080:00200000:0.0:1788201594.951934:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 31 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951948:0:24470:0:(rw26.c:898:ll_write_end()) pos 126976, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951952:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c6973e2a[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 31] 00000080:00200000:0.0:1788201594.951954:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005c6a8b92 17ffffc0001001 3:0 ffff8bc172557e00 31 lru 00000080:00200000:0.0:1788201594.951959:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f70decfa 31: 1< 0 - - > 2< 126976 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951961:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c6973e2a 00000080:00200000:0.0:1788201594.951962:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 32. 00000080:00200000:0.0:1788201594.951964:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 32 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.951978:0:24470:0:(rw26.c:898:ll_write_end()) pos 131072, len 4096, copied 4096 00000080:00200000:0.0:1788201594.951982:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d582f357[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 32] 00000080:00200000:0.0:1788201594.951984:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008e2b7c30 17ffffc0001001 3:0 ffff8bc1725578c0 32 lru 00000080:00200000:0.0:1788201594.951990:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000041d0892 32: 1< 0 - - > 2< 131072 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.951992:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d582f357 00000080:00200000:0.0:1788201594.951993:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 33. 00000080:00200000:0.0:1788201594.951995:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 33 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.952010:0:24470:0:(rw26.c:898:ll_write_end()) pos 135168, len 4096, copied 4096 00000080:00200000:0.0:1788201594.952015:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c7cd9b67[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 33] 00000080:00200000:0.0:1788201594.952018:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006a5041c1 17ffffc0001001 3:0 ffff8bc172557540 33 lru 00000080:00200000:0.0:1788201594.952023:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000891822b0 33: 1< 0 - - > 2< 135168 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.952025:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c7cd9b67 00000080:00200000:0.0:1788201594.952026:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 34. 00000080:00200000:0.0:1788201594.952028:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 34 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.952047:0:24470:0:(rw26.c:898:ll_write_end()) pos 139264, len 4096, copied 4096 00000080:00200000:0.0:1788201594.952051:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000060e89c8c[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 34] 00000080:00200000:0.0:1788201594.952054:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000598ff531 17ffffc0001001 3:0 ffff8bc172557a80 34 lru 00000080:00200000:0.0:1788201594.952059:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000032082b32 34: 1< 0 - - > 2< 139264 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.952061:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000060e89c8c 00000080:00200000:0.0:1788201594.952062:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 35. 00000080:00200000:0.0:1788201594.952064:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 35 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.952079:0:24470:0:(rw26.c:898:ll_write_end()) pos 143360, len 4096, copied 4096 00000080:00200000:0.0:1788201594.952084:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b756b1c6[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 35] 00000080:00200000:0.0:1788201594.952087:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003dcda9df 17ffffc0001001 3:0 ffff8bc172557c40 35 lru 00000080:00200000:0.0:1788201594.952093:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f5329694 35: 1< 0 - - > 2< 143360 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.952096:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b756b1c6 00000080:00200000:0.0:1788201594.952098:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 36. 00000080:00200000:0.0:1788201594.952100:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 36 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.952118:0:24470:0:(rw26.c:898:ll_write_end()) pos 147456, len 4096, copied 4096 00000080:00200000:0.0:1788201594.952122:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000a82abfe[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 36] 00000080:00200000:0.0:1788201594.952125:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e9b0d8cc 17ffffc0001021 2:0 ffff8bc1725579a0 36 lru 00000080:00200000:0.0:1788201594.952130:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005917d3c8 36: 1< 0 - - > 2< 147456 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.952132:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000a82abfe 00000080:00200000:0.0:1788201594.952133:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 37. 00000080:00200000:0.0:1788201594.952135:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 37 of 0 to 4096 bytes 00000080:00200000:0.0:1788201594.952151:0:24470:0:(rw26.c:898:ll_write_end()) pos 151552, len 4096, copied 4096 00000080:00200000:0.0:1788201594.952155:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000052e02f97[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 37] 00000080:00200000:0.0:1788201594.952158:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c9acc04a 17ffffc0001001 3:0 ffff8bc1725570e0 37 lru 00000080:00200000:0.0:1788201594.952164:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000078c74192 37: 1< 0 - - > 2< 151552 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.952166:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000052e02f97 00000080:00200000:0.0:1788201594.952167:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 38. 00000080:00200000:0.0:1788201594.952169:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 38 of 0 to 4030 bytes 00000080:00200000:0.0:1788201594.952197:0:24470:0:(rw26.c:898:ll_write_end()) pos 155648, len 4030, copied 4030 00000080:00200000:0.0:1788201594.952202:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000cfd44ef5[3 00000000949cad0d 2 1 000000006d5f23e0 0 0 38] 00000080:00200000:0.0:1788201594.952206:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005c63a7c3 17ffffc0001001 3:0 ffff8bc1725571c0 38 lru 00000080:00200000:0.0:1788201594.952211:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f30b2e33 38: 1< 0 - - > 2< 155648 0 0 0x0 0x0 | 000000008930e75a 000000000540fe23 > 3< 0 0 > 4< 0 0 8 17039360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201594.952213:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000cfd44ef5 00000080:00200000:0.0:1788201594.952215:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 39. 00000080:00200000:0.0:1788201594.952219:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 39, from 0, to 4030 prio 0 00000008:00010000:0.0:1788201594.952253:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000122197b3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201594.952289:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459b0ab8, count 15, dirtied 15 00000080:00200000:0.0:1788201594.952307:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459b0ab8, count 15, dirtied 15 00000080:00200000:0.0:1788201594.952319:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459b0ab8, count 9, dirtied 9 00000080:00200000:0.0:1788201594.952323:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 39 pages 159678 bytes, tot: 159678 00000080:00200000:0.0:1788201594.952327:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) sanity-pcc.sh: write bytes 0, result: 159678 00000020:00010000:0.0:1788201594.952365:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc148fb18a8 (ffff8bc1499c4908/0) at cl_lock_release():245 00000020:00010000:0.0:1788201594.952370:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc148fb18a8 (ffff8bc1499c4908/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201594.952374:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456730 (ffff8bc1499c4b48/1) at cl_lock_cancel():142 00010000:00010000:0.0:1788201594.952385:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.952398:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1788201594.952419:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc148fb18a8 (ffff8bc1499c4908/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201594.952422:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456730 (ffff8bc1499c4908/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201594.952435:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 159678 bytes 00000080:00200000:0.0:1788201594.952446:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 38] 00000080:00200000:0.0:1788201594.952496:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19b:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201594.952500:0:24470:0:(file.c:2238:ll_file_io_generic()) sanity-pcc.sh: 2 io complete with rc: 0, result: 159678, restart: 0 00000080:00200000:0.0:1788201594.952510:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x19b:0x0] updating i_size 159678 i_blocks 1 00000080:00200000:0.0:1788201594.952518:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 159678 00000080:00200008:0.0:1788201594.952586:0:24470:0:(file.c:479:ll_file_release()) START file sanity-pcc.sh:[0x200000bd7:0x19b:0x0](ffff8bc1459b0908), flags 100001 00000002:00100000:0.0:1788201594.952680:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1724a3800 x1875064728017536/t8589937464(8589937464) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1788201594.952697:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1788201594.952704:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc17264ad80 x1875064728018176/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1788201594.952739:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17264ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728018176:192.168.201.143@tcp:35:cp.0 00000100:00100000:0.0:1788201594.952897:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201594.956304:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17264ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728018176:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201594.956360:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1724a3800 x1875064728017536/t8589937464(8589937464) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201594.956466:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201594.956492:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.956517:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201594.956545:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201594.956555:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.956562:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201594.956568:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201594.956578:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201594.956582:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201594.956593:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201594.956614:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.956623:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201594.956630:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.956634:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-pcc.sh, flags=8 00000080:00200008:1.0:1788201594.956643:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-pcc.sh:[0x200000bd7:0x19b:0x0](ffff8bc1459b0908), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201594.956649:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x19b:0x0](ffff8bc1459b0908),name=sanity-pcc.sh 00000002:00010000:1.0:1788201594.956662:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x19b:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.956672:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109817c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201594.956680:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109817c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201594.956686:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.956690:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x19b:0x0](ffff8bc1459b0908) 00000080:00010000:1.0:1788201594.956692:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x19b:0x0](ffff8bc1459b0908) for lock 0xd138388016f6f7b7 00000080:00010000:1.0:1788201594.956696:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f7b7 from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201594.956698:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109817c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201594.956706:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109817c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201594.956763:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19b:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201594.956774:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x19b:0x0] 00000008:00010000:1.0:1788201594.956878:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201594.956884:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4f30, osc lock ffff8bc145d09a20, flags 0x400001002 00010000:00010000:1.0:1788201594.956905:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.956919:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201594.956933:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201594.956938:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.956947:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201594.956959:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201594.956971:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x19b:0x0] updating i_size 159678 i_blocks 1 00000020:00010000:1.0:1788201594.956975:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e24250 (ffff8bc148e3b5a8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201594.956978:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e24250 (ffff8bc148e3b5a8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201594.956981:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4f30 (ffff8bc148e3b878/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201594.956986:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e24250 (ffff8bc148e3b5a8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201594.956989:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4f30 (ffff8bc148e3b5a8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201594.957021:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19b:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201594.957082:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201594.957090:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201594.957097:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201594.957106:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201594.957112:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201594.957117:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201594.957120:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201594.957123:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201594.957197:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201594.957207:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201594.957218:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.957223:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201594.957226:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201594.957242:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-pfl.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201594.957246:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-pfl.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201594.957257:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-pfl.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201594.957313:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f7cc lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.957322:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f7cc lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.957333:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f7cc lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201594.957370:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728018304:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201594.957634:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.961629:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728018304:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201594.961660:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f7cc lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.961678:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f7cc lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.961685:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f7cc lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.961693:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f7cc lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.961704:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f7cc lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.961712:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17261f000 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201594.961718:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f7cc lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.961731:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f7cc lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.961739:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f7cc lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.961748:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201594.961756:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f7cc lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.961764:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f7cc lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201594.961787:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1727d6300 x1875064728018304/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201594.961976:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201594.962007:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201594.962088:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201594.962238:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.962250:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201594.962264:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201594.962271:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.962278:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201594.962282:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201594.962288:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201594.962293:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201594.962302:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201594.962320:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.962328:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201594.962335:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.962363:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-pfl.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:0.0:1788201594.962368:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-pfl.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201594.962382:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-pfl.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201594.962442:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f7d3 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.962451:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f7d3 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.962464:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f7d3 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201594.962492:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17264aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728018432:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201594.962714:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726213c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.965740:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17264aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728018432:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201594.965769:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f7d3 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.965787:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f7d3 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.968385:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f7d3 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.968397:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f7d3 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.968410:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f7d3 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.968418:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc146085400 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201594.968424:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f7d3 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.968432:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f7d3 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.968443:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f7d3 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.968453:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201594.968463:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f7d3 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.968471:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f7d3 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201594.968511:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc17264aa00 x1875064728018432/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201594.968662:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201594.968714:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201594.968984:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201594.969005:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.969018:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201594.969034:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201594.969041:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.969047:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201594.969053:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201594.969060:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:0.0:1788201594.969065:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201594.969074:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201594.969106:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.969116:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201594.969123:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201594.969214:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201594.969221:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sanity-pfl.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc152c97c80, open_flags 80c1, mode 81ed opened 0 00000080:00200000:0.0:1788201594.969231:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-pfl.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:0.0:1788201594.969259:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-pfl.sh,[0x200000bd7:0x19c:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:0.0:1788201594.969329:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.969355:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1788201594.969371:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1788201594.969381:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc17264aa00 x1875064728018688/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1788201594.969391:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201594.969419:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17264aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728018688:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201594.969936:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726213c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.975033:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17264aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728018688:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201594.975076:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710981d7 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.975122:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x19c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710981d7 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.975503:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710981d7 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.975519:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710981d7 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.975541:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710981d7 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.975565:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710981d7 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.975573:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710981d7 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.975581:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710981d7 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201594.975595:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc17264aa00 x1875064728018688/t8589937466(8589937466) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201594.975610:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc17264aa00 x1875064728018688/t8589937466(8589937466) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201594.975626:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710981d7 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1788201594.975641:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710981d7 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.975653:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/412 (0 0) 00000080:00200000:0.0:1788201594.975661:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201594.975679:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=sanity-pfl.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:0.0:1788201594.975716:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x19c:0x0](ffff8bc1459b5348) 00000080:00200000:0.0:1788201594.975992:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x19c:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1788201594.976003:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x19c:0x0](ffff8bc1459b5348) 00000080:00010000:0.0:1788201594.976007:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x19c:0x0](ffff8bc1459b5348) for lock 0xd138388016f6f7da 00000080:00010000:0.0:1788201594.976020:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x19c:0x0](ffff8bc1459b5348) 00000080:00200008:0.0:1788201594.976037:0:24470:0:(file.c:1090:ll_file_open()) START file sanity-pfl.sh:[0x200000bd7:0x19c:0x0](ffff8bc1459b5348), flags 100301 00000002:00100000:0.0:1788201594.976059:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc17264aa00 x1875064728018688/t8589937466(8589937466) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1788201594.976265:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f7da from it ffff8bc148c05780 00010000:00010000:0.0:1788201594.976271:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710981d7 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201594.976281:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710981d7 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201594.976311:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x19c:0x0](ffff8bc1459b5348), inode mode 81ed mask 40 00000080:00200008:0.0:1788201594.976357:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-pfl.sh:[0x200000bd7:0x19c:0x0](ffff8bc1459b5348), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201594.976364:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x19c:0x0](ffff8bc1459b5348),name=sanity-pfl.sh 00000002:00010000:0.0:1788201594.976386:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x19c:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201594.976398:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710981d7 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.976409:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710981d7 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201594.976416:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201594.976421:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x19c:0x0](ffff8bc1459b5348) 00000080:00010000:0.0:1788201594.976425:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x19c:0x0](ffff8bc1459b5348) for lock 0xd138388016f6f7da 00000080:00010000:0.0:1788201594.976428:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f7da from it ffffadd1c7debcd8 00010000:00010000:0.0:1788201594.976432:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710981d7 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201594.976440:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710981d7 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201594.976470:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19c:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201594.976480:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x19c:0x0] 00000008:00010000:0.0:1788201594.977365:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201594.977374:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456db0, osc lock ffff8bc145d358f0, flags 0x400001002 00010000:00010000:1.0:1788201594.977618:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f7e1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.977633:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f7e1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201594.977685:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1788201594.977740:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728018816:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201594.980654:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f7e1 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.980688:0:10054:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f7e1 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710981e5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.980707:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f7e1 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710981e5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.980721:0:10054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f7e1 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710981e5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201594.980740:0:10054:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f7e1 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710981e5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201594.980753:0:10054:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1788201594.980771:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f7e1 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710981e5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.980780:0:10054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f7e1 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710981e5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.980812:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f7e1 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710981e5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201594.980822:0:10054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f7e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e21710981e5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201594.980848:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728018816:192.168.201.143@tcp:101:cp.0 00000080:00200000:2.0:1788201594.980946:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x19c:0x0] updating i_size 0 i_blocks 1 00000020:00010000:2.0:1788201594.980953:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449db090 (ffff8bc1499c4908/0) at cl_lock_release():245 00000020:00010000:2.0:1788201594.980957:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449db090 (ffff8bc1499c4908/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201594.980963:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456db0 (ffff8bc1499c4b48/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201594.980968:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449db090 (ffff8bc1499c4908/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201594.980972:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456db0 (ffff8bc1499c4908/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201594.981018:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19c:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1788201594.981598:0:24470:0:(file.c:2638:do_file_write_iter()) START file sanity-pfl.sh:[0x200000bd7:0x19c:0x0], ppos: 0, count: 88087 00000080:00200000:2.0:1788201594.981641:0:24470:0:(file.c:2090:ll_file_io_generic()) sanity-pfl.sh: write ppos: 0, bytes: 88087 00000080:00200000:2.0:1788201594.981648:0:24470:0:(file.c:1848:ll_io_set_mirror()) sanity-pfl.sh: desiginated mirror: 0 00000020:00200000:2.0:1788201594.981654:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000965042ac[0x110, 1, [0x200000bd7:0x19c:0x0] hash] 00000020:00200000:2.0:1788201594.981657:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 88087) 0 0 00000080:00200000:2.0:1788201594.981662:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19c:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201594.981676:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 21] 00020000:00200000:2.0:1788201594.981684:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 88087) 88087, 88087 00020000:00200000:2.0:1788201594.981688:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201594.981717:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 21] 00000008:00010000:2.0:1788201594.981731:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1788201594.981737:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d130, osc lock ffff8bc151fc0ab0, flags 0x0 00010000:00010000:2.0:1788201594.981755:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/448 (0 90111) 00010000:00010000:2.0:1788201594.981839:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.981851:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->90111] (req 0->90111) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.981862:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->90111] (req 0->90111) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.981888:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2d80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728018944:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201594.981988:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc15399fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201594.984254:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201594.984408:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743487744 00000100:00100000:2.0:1788201594.984420:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743487744 00000100:00100000:2.0:1788201594.984525:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 815 00000100:00100000:2.0:1788201594.984547:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23131:x1875064743487744:12345-192.168.201.143@tcp:104: 00010000:00010000:2.0:1788201594.984569:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f7e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710981e5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.984666:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201594.984674:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23131:x1875064743487744:12345-192.168.201.143@tcp:104: Request processed in 131us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201594.984683:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 815 00010000:00010000:1.0:1788201594.985040:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201594.985050:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f7e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710981e5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.985061:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17261e600 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201594.985068:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f7e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e21710981e5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201594.985140:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201594.985155:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201594.985233:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f7e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710981e5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.985242:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201594.985283:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f7e1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710981e5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.985298:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f7e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710981e5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201594.985318:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201594.985320:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201594.985322:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201594.985331:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201594.985359:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728019072:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201594.988068:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201594.988761:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743487872 00000100:00100000:3.0:1788201594.988774:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743487872 00000100:00100000:3.0:1788201594.988859:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 816 00000100:00100000:3.0:1788201594.988871:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17264b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743487872:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201594.988891:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->90111] (req 0->90111) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.988907:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->90111] (req 0->90111) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.988919:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.988932:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.988942:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.988955:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.988975:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1443b6400) 00000100:00100000:3.0:1788201594.989042:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17264b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743487872:12345-192.168.201.143@tcp:105: Request processed in 173us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201594.989049:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 816 00000100:00100000:3.0:1788201594.990500:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a2d80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728018944:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201594.991156:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.991183:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201594.991199:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.991214:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.991222:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201594.991255:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) sanity-pfl.sh: write [0, 88087) append 0 append lockpos 0 00000080:00200000:3.0:1788201594.991278:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.991340:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:3.0:1788201594.991363:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000870da107[3 0000000082b944f8 2 1 00000000c3444ba1 0 0 0] 00000080:00200000:3.0:1788201594.991368:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000057b5e203 17ffffc0001001 3:0 ffff8bc1727c18c0 0 lru 00000080:00200000:3.0:1788201594.991376:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000015e8f89 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 000000002f37b093 > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.991379:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000870da107 00000080:00200000:3.0:1788201594.991380:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201594.991384:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.991412:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:3.0:1788201594.991417:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000e198c03[3 0000000082b944f8 2 1 00000000c3444ba1 0 0 1] 00000080:00200000:3.0:1788201594.991421:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ec4f5abe 17ffffc0001001 3:0 ffff8bc1727c1a80 1 lru 00000080:00200000:3.0:1788201594.991426:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000dbc0af9d 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 000000002f37b093 > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.991429:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000e198c03 00000080:00200000:3.0:1788201594.991430:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:3.0:1788201594.991432:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.991459:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:3.0:1788201594.991464:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000008b9d539[3 0000000082b944f8 2 1 00000000c3444ba1 0 0 2] 00000080:00200000:3.0:1788201594.991467:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000021f3235c 17ffffc0001021 2:0 ffff8bc1727c1000 2 lru 00000080:00200000:3.0:1788201594.991472:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000df83fc72 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000000ce25486 000000002f37b093 > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.991475:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000008b9d539 00000080:00200000:3.0:1788201594.991476:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:3.0:1788201594.991478:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.991497:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:3.0:1788201594.991501:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ffb594ba[3 0000000082b944f8 2 1 00000000c3444ba1 0 0 3] 00000080:00200000:3.0:1788201594.991504:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000212d5244 17ffffc0001001 3:0 ffff8bc1506cca80 3 lru 00000080:00200000:3.0:1788201594.991510:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000718f13da 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000000ce25486 000000002f37b093 > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.991512:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ffb594ba 00000080:00200000:3.0:1788201594.991513:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:3.0:1788201594.991516:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.991543:0:24470:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:3.0:1788201594.991549:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000db1296d4[3 0000000082b944f8 2 1 00000000c3444ba1 0 0 4] 00000080:00200000:3.0:1788201594.991552:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004d279c01 17ffffc0001001 3:0 ffff8bc1506cc540 4 lru 00000080:00200000:3.0:1788201594.991556:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000002aa0c42a 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000000ce25486 000000002f37b093 > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.991558:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000db1296d4 00000080:00200000:3.0:1788201594.991559:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:3.0:1788201594.991561:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.991578:0:24470:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:3.0:1788201594.991582:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000889182dc[3 0000000082b944f8 2 1 00000000c3444ba1 0 0 5] 00000080:00200000:3.0:1788201594.991585:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a23d70b1 17ffffc0001001 3:0 ffff8bc1506cc1c0 5 lru 00000080:00200000:3.0:1788201594.991589:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c8849e92 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000000ce25486 000000002f37b093 > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.991591:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000889182dc 00000080:00200000:3.0:1788201594.991592:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:3.0:1788201594.991594:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.991606:0:24470:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:3.0:1788201594.991609:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000079fcba7b[3 0000000082b944f8 2 1 00000000c3444ba1 0 0 6] 00000080:00200000:3.0:1788201594.991611:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002ff5b9a6 17ffffc0001001 3:0 ffff8bc1506cc380 6 lru 00000080:00200000:3.0:1788201594.991616:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000294de251 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000000ce25486 000000002f37b093 > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.991618:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000079fcba7b 00000080:00200000:3.0:1788201594.991619:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:3.0:1788201594.991621:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.991634:0:24470:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:3.0:1788201594.991637:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000bfe89afe[3 0000000082b944f8 2 1 00000000c3444ba1 0 0 7] 00000080:00200000:3.0:1788201594.991640:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000000f632d4 17ffffc0001001 3:0 ffff8bc1506ccd20 7 lru 00000080:00200000:3.0:1788201594.991644:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e44d3ea4 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000000ce25486 000000002f37b093 > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.991646:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000bfe89afe 00000080:00200000:3.0:1788201594.991647:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:3.0:1788201594.991649:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.991662:0:24470:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:3.0:1788201594.991666:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c8feff6b[3 0000000082b944f8 2 1 00000000c3444ba1 0 0 8] 00000080:00200000:3.0:1788201594.991669:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ea8ff753 17ffffc0001001 3:0 ffff8bc1506ccb60 8 lru 00000080:00200000:3.0:1788201594.991674:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000060b21d03 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000000ce25486 000000002f37b093 > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.991676:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c8feff6b 00000080:00200000:3.0:1788201594.991677:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:3.0:1788201594.991679:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.991697:0:24470:0:(rw26.c:898:ll_write_end()) pos 36864, len 4096, copied 4096 00000080:00200000:3.0:1788201594.991701:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000062ec86ff[3 0000000082b944f8 2 1 00000000c3444ba1 0 0 9] 00000080:00200000:3.0:1788201594.991704:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000007dfaea3 17ffffc0001001 3:0 ffff8bc1506cc700 9 lru 00000080:00200000:3.0:1788201594.991709:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006f258138 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000000ce25486 000000002f37b093 > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.991712:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000062ec86ff 00000080:00200000:3.0:1788201594.991713:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:3.0:1788201594.991715:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 10 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.991730:0:24470:0:(rw26.c:898:ll_write_end()) pos 40960, len 4096, copied 4096 00000080:00200000:3.0:1788201594.991735:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006ae21ea3[3 0000000082b944f8 2 1 00000000c3444ba1 0 0 10] 00000080:00200000:3.0:1788201594.991738:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004e686e67 17ffffc0001001 3:0 ffff8bc1506cc460 10 lru 00000080:00200000:3.0:1788201594.991744:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000084987d1b 10: 1< 0 - - > 2< 40960 0 0 0x0 0x0 | 000000000ce25486 000000002f37b093 > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.991746:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006ae21ea3 00000080:00200000:3.0:1788201594.991748:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 11. 00000080:00200000:3.0:1788201594.991749:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 11 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.991762:0:24470:0:(rw26.c:898:ll_write_end()) pos 45056, len 4096, copied 4096 00000080:00200000:3.0:1788201594.991766:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000556f0fe8[3 0000000082b944f8 2 1 00000000c3444ba1 0 0 11] 00000080:00200000:3.0:1788201594.991769:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000045e7850b 17ffffc0001001 3:0 ffff8bc1506cc2a0 11 lru 00000080:00200000:3.0:1788201594.991774:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000045dda935 11: 1< 0 - - > 2< 45056 0 0 0x0 0x0 | 000000000ce25486 000000002f37b093 > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.991776:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000556f0fe8 00000080:00200000:3.0:1788201594.991778:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 12. 00000080:00200000:3.0:1788201594.991779:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 12 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.991821:0:24470:0:(rw26.c:898:ll_write_end()) pos 49152, len 4096, copied 4096 00000080:00200000:3.0:1788201594.991827:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000060397496[3 0000000082b944f8 2 1 00000000c3444ba1 0 0 12] 00000080:00200000:3.0:1788201594.991830:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e5bf8cbd 17ffffc0001001 3:0 ffff8bc1506cc0e0 12 lru 00000080:00200000:3.0:1788201594.991836:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b6db996a 12: 1< 0 - - > 2< 49152 0 0 0x0 0x0 | 000000000ce25486 000000002f37b093 > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.991838:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000060397496 00000080:00200000:3.0:1788201594.991839:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 13. 00000080:00200000:3.0:1788201594.991841:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 13 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.991857:0:24470:0:(rw26.c:898:ll_write_end()) pos 53248, len 4096, copied 4096 00000080:00200000:3.0:1788201594.991861:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000033543ca4[3 0000000082b944f8 2 1 00000000c3444ba1 0 0 13] 00000080:00200000:3.0:1788201594.991864:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c4ce9287 17ffffc0001001 3:0 ffff8bc1506cc7e0 13 lru 00000080:00200000:3.0:1788201594.991869:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f5854e63 13: 1< 0 - - > 2< 53248 0 0 0x0 0x0 | 000000000ce25486 000000002f37b093 > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.991872:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000033543ca4 00000080:00200000:3.0:1788201594.991873:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 14. 00000080:00200000:3.0:1788201594.991875:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 14 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.991890:0:24470:0:(rw26.c:898:ll_write_end()) pos 57344, len 4096, copied 4096 00000080:00200000:3.0:1788201594.991894:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a7b55a29[3 0000000082b944f8 2 1 00000000c3444ba1 0 0 14] 00000080:00200000:3.0:1788201594.991897:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000580660ac 17ffffc0001001 3:0 ffff8bc1506cc620 14 lru 00000080:00200000:3.0:1788201594.991903:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000024184c2d 14: 1< 0 - - > 2< 57344 0 0 0x0 0x0 | 000000000ce25486 000000002f37b093 > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.991905:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a7b55a29 00000080:00200000:3.0:1788201594.991906:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 15. 00000080:00200000:3.0:1788201594.991908:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 15 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.991925:0:24470:0:(rw26.c:898:ll_write_end()) pos 61440, len 4096, copied 4096 00000080:00200000:3.0:1788201594.991929:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000eaded81d[3 0000000082b944f8 2 1 00000000c3444ba1 0 0 15] 00000080:00200000:3.0:1788201594.991932:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c6e4a291 17ffffc0001001 3:0 ffff8bc1506ccee0 15 lru 00000080:00200000:3.0:1788201594.991937:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b722778e 15: 1< 0 - - > 2< 61440 0 0 0x0 0x0 | 000000000ce25486 000000002f37b093 > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.991940:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000eaded81d 00000080:00200000:3.0:1788201594.991941:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 16. 00000080:00200000:3.0:1788201594.991943:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 16 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.991960:0:24470:0:(rw26.c:898:ll_write_end()) pos 65536, len 4096, copied 4096 00000080:00200000:3.0:1788201594.991965:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f9cd48d1[3 0000000082b944f8 2 1 00000000c3444ba1 0 0 16] 00000080:00200000:3.0:1788201594.991968:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000af9e2ac7 17ffffc0001001 3:0 ffff8bc1506cce00 16 lru 00000080:00200000:3.0:1788201594.991973:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008dd08365 16: 1< 0 - - > 2< 65536 0 0 0x0 0x0 | 000000000ce25486 000000002f37b093 > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.991975:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f9cd48d1 00000080:00200000:3.0:1788201594.991976:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 17. 00000080:00200000:3.0:1788201594.991978:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 17 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.991998:0:24470:0:(rw26.c:898:ll_write_end()) pos 69632, len 4096, copied 4096 00000080:00200000:3.0:1788201594.992002:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000da6f0a83[3 0000000082b944f8 2 1 00000000c3444ba1 0 0 17] 00000080:00200000:3.0:1788201594.992006:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000cc0dcab1 17ffffc0001021 2:0 ffff8bc1506cc8c0 17 lru 00000080:00200000:3.0:1788201594.992012:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b46c31cd 17: 1< 0 - - > 2< 69632 0 0 0x0 0x0 | 000000000ce25486 000000002f37b093 > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.992014:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000da6f0a83 00000080:00200000:3.0:1788201594.992016:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 18. 00000080:00200000:3.0:1788201594.992018:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 18 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.992030:0:24470:0:(rw26.c:898:ll_write_end()) pos 73728, len 4096, copied 4096 00000080:00200000:3.0:1788201594.992034:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003cb1bdd0[3 0000000082b944f8 2 1 00000000c3444ba1 0 0 18] 00000080:00200000:3.0:1788201594.992037:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ef192e0f 17ffffc0001001 3:0 ffff8bc1506cc9a0 18 lru 00000080:00200000:3.0:1788201594.992043:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001b404991 18: 1< 0 - - > 2< 73728 0 0 0x0 0x0 | 000000000ce25486 000000002f37b093 > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.992045:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003cb1bdd0 00000080:00200000:3.0:1788201594.992046:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 19. 00000080:00200000:3.0:1788201594.992048:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 19 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.992060:0:24470:0:(rw26.c:898:ll_write_end()) pos 77824, len 4096, copied 4096 00000080:00200000:3.0:1788201594.992065:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003c88775f[3 0000000082b944f8 2 1 00000000c3444ba1 0 0 19] 00000080:00200000:3.0:1788201594.992068:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b070ca59 17ffffc0001001 3:0 ffff8bc1506ccc40 19 lru 00000080:00200000:3.0:1788201594.992073:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d604fcc4 19: 1< 0 - - > 2< 77824 0 0 0x0 0x0 | 000000000ce25486 000000002f37b093 > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.992076:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003c88775f 00000080:00200000:3.0:1788201594.992077:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 20. 00000080:00200000:3.0:1788201594.992079:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 20 of 0 to 4096 bytes 00000080:00200000:3.0:1788201594.992106:0:24470:0:(rw26.c:898:ll_write_end()) pos 81920, len 4096, copied 4096 00000080:00200000:3.0:1788201594.992112:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d36a526f[3 0000000082b944f8 2 1 00000000c3444ba1 0 0 20] 00000080:00200000:3.0:1788201594.992115:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006171f755 17ffffc0001001 3:0 ffff8bc1506cc000 20 lru 00000080:00200000:3.0:1788201594.992121:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000048d855a4 20: 1< 0 - - > 2< 81920 0 0 0x0 0x0 | 000000000ce25486 000000002f37b093 > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.992123:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d36a526f 00000080:00200000:3.0:1788201594.992124:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 21. 00000080:00200000:3.0:1788201594.992126:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 21 of 0 to 2071 bytes 00000080:00200000:3.0:1788201594.992150:0:24470:0:(rw26.c:898:ll_write_end()) pos 86016, len 2071, copied 2071 00000080:00200000:3.0:1788201594.992155:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004f778072[3 0000000082b944f8 2 1 00000000c3444ba1 0 0 21] 00000080:00200000:3.0:1788201594.992158:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b50c81a3 17ffffc0001001 3:0 ffff8bc144e411c0 21 lru 00000080:00200000:3.0:1788201594.992164:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f6a25614 21: 1< 0 - - > 2< 86016 0 0 0x0 0x0 | 000000000ce25486 000000002f37b093 > 3< 0 0 > 4< 0 0 8 5111808 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201594.992166:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004f778072 00000080:00200000:3.0:1788201594.992168:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 22. 00000080:00200000:3.0:1788201594.992171:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 22, from 0, to 2071 prio 0 00000008:00010000:3.0:1788201594.992201:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000c5f1d161 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201594.992234:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459b54f8, count 15, dirtied 15 00000080:00200000:3.0:1788201594.992245:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459b54f8, count 7, dirtied 7 00000080:00200000:3.0:1788201594.992249:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 22 pages 88087 bytes, tot: 88087 00000080:00200000:3.0:1788201594.992252:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) sanity-pfl.sh: write bytes 0, result: 88087 00000020:00010000:3.0:1788201594.992271:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc149844038 (ffff8bc1469193f8/0) at cl_lock_release():245 00000020:00010000:3.0:1788201594.992275:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149844038 (ffff8bc1469193f8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201594.992278:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d130 (ffff8bc146919bd8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1788201594.992285:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201594.992305:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1788201594.992325:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149844038 (ffff8bc1469193f8/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201594.992328:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d130 (ffff8bc1469193f8/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201594.992338:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 88087 bytes 00000080:00200000:3.0:1788201594.992358:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 21] 00000080:00200000:3.0:1788201594.992399:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19c:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201594.992403:0:24470:0:(file.c:2238:ll_file_io_generic()) sanity-pfl.sh: 2 io complete with rc: 0, result: 88087, restart: 0 00000080:00200000:3.0:1788201594.992412:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x19c:0x0] updating i_size 88087 i_blocks 1 00000080:00200000:3.0:1788201594.992419:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 88087 00000080:00200008:3.0:1788201594.992477:0:24470:0:(file.c:479:ll_file_release()) START file sanity-pfl.sh:[0x200000bd7:0x19c:0x0](ffff8bc1459b5348), flags 100001 00000002:00100000:3.0:1788201594.992545:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc17264aa00 x1875064728018688/t8589937466(8589937466) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1788201594.992559:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1788201594.992565:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1726cca80 x1875064728019328/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1788201594.992591:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728019328:192.168.201.143@tcp:35:cp.0 00000100:00100000:2.0:1788201594.993716:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201594.993847:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728019072:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788201594.996436:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728019328:192.168.201.143@tcp:35:cp.0 00000002:00100000:2.0:1788201594.996482:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc17264aa00 x1875064728018688/t8589937466(8589937466) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201594.996587:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201594.996609:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.996632:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201594.996647:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201594.996655:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.996661:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201594.996666:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201594.996674:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201594.996678:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201594.996694:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201594.996711:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.996719:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201594.996725:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.996730:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-pfl.sh, flags=8 00000080:00200008:2.0:1788201594.996738:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-pfl.sh:[0x200000bd7:0x19c:0x0](ffff8bc1459b5348), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1788201594.996744:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x19c:0x0](ffff8bc1459b5348),name=sanity-pfl.sh 00000002:00010000:2.0:1788201594.996757:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x19c:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.996766:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710981d7 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201594.996775:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710981d7 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1788201594.996782:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.996786:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x19c:0x0](ffff8bc1459b5348) 00000080:00010000:2.0:1788201594.996846:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x19c:0x0](ffff8bc1459b5348) for lock 0xd138388016f6f7da 00000080:00010000:2.0:1788201594.996851:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f7da from it ffffadd1c7debcb8 00010000:00010000:2.0:1788201594.996855:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710981d7 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201594.996864:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710981d7 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201594.996922:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19c:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201594.996932:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x19c:0x0] 00000008:00010000:2.0:1788201594.996965:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201594.996969:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d3b0, osc lock ffff8bc151fc18f0, flags 0x400001002 00010000:00010000:2.0:1788201594.996989:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.997003:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:2.0:1788201594.997017:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1788201594.997022:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201594.997029:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1788201594.997041:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1788201594.997051:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x19c:0x0] updating i_size 88087 i_blocks 1 00000020:00010000:2.0:1788201594.997055:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc146005280 (ffff8bc146919248/0) at cl_lock_release():245 00000020:00010000:2.0:1788201594.997058:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146005280 (ffff8bc146919248/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201594.997061:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d3b0 (ffff8bc146919008/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201594.997065:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146005280 (ffff8bc146919248/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201594.997068:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d3b0 (ffff8bc146919248/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201594.997101:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19c:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201594.997161:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201594.997169:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201594.997176:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201594.997184:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201594.997191:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201594.997196:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201594.997198:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201594.997203:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201594.997206:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201594.997213:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201594.997222:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.997226:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201594.997229:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201594.997244:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-quota.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:2.0:1788201594.997248:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-quota.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201594.997259:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-quota.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201594.997307:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6000/0xd138388016f6f7ef lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.997316:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6000/0xd138388016f6f7ef lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201594.997330:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6000/0xd138388016f6f7ef lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201594.997370:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728019456:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201594.997460:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc142710600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.000576:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728019456:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201595.000604:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6000/0xd138388016f6f7ef lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.000620:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6000/0xd138388016f6f7ef lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.000628:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6000/0xd138388016f6f7ef lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.000636:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6000/0xd138388016f6f7ef lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.000646:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6000/0xd138388016f6f7ef lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.000653:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1443b6000 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:2.0:1788201595.000659:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6000/0xd138388016f6f7ef lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.000667:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6000/0xd138388016f6f7ef lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.000675:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6000/0xd138388016f6f7ef lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.000685:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201595.000692:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6000/0xd138388016f6f7ef lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.000700:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6000/0xd138388016f6f7ef lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201595.000723:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a1f80 x1875064728019456/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201610 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201595.000740:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1788201595.000769:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201595.000870:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.000886:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.000897:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.000910:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.000917:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.000923:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.000927:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.000932:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201595.000936:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.000946:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.000963:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.000971:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201595.000978:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.000994:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-quota.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:2.0:1788201595.000999:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-quota.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201595.001012:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-quota.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201595.001054:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f7f6 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.001062:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f7f6 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.001073:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f7f6 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.001109:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728019584:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201595.001381:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc142710600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.007378:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728019584:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201595.007409:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f7f6 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.007425:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f7f6 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.007433:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f7f6 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.007441:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f7f6 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.007453:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f7f6 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.007461:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1443b7a00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:2.0:1788201595.007466:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f7f6 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.007473:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f7f6 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.007482:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f7f6 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.007490:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201595.007497:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f7f6 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.007504:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f7f6 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201595.007534:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1724a1f80 x1875064728019584/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201595.007553:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1788201595.007581:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201595.007700:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.007716:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.007726:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.007744:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.007752:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.007757:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.007761:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.007767:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:2.0:1788201595.007771:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.007780:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.007837:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.007846:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201595.007852:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.007866:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.007871:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sanity-quota.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14c594180, open_flags 80c1, mode 81ed opened 0 00000080:00200000:2.0:1788201595.007881:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-quota.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:2.0:1788201595.007902:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-quota.sh,[0x200000bd7:0x19d:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:2.0:1788201595.007958:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.007966:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1788201595.007983:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1788201595.007991:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1724a1f80 x1875064728019840/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1788201595.008002:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.008027:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a1f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728019840:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201595.008164:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc142710600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.011828:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a1f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728019840:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201595.011861:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098232 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.011886:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098232 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.011897:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098232 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.011909:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098232 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.011921:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098232 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.011936:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098232 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.011952:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098232 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.011960:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098232 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201595.011972:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1724a1f80 x1875064728019840/t8589937468(8589937468) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1788201595.011986:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a1f80 x1875064728019840/t8589937468(8589937468) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1788201595.012001:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098232 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1788201595.012014:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098232 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.012026:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/413 (0 0) 00000080:00200000:2.0:1788201595.012033:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1788201595.012048:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=sanity-quota.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:2.0:1788201595.012085:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x19d:0x0](ffff8bc145986c08) 00000080:00200000:2.0:1788201595.012235:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x19d:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1788201595.012244:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x19d:0x0](ffff8bc145986c08) 00000080:00010000:2.0:1788201595.012247:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x19d:0x0](ffff8bc145986c08) for lock 0xd138388016f6f7fd 00000080:00010000:2.0:1788201595.012259:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x19d:0x0](ffff8bc145986c08) 00000080:00200008:2.0:1788201595.012275:0:24470:0:(file.c:1090:ll_file_open()) START file sanity-quota.sh:[0x200000bd7:0x19d:0x0](ffff8bc145986c08), flags 100301 00000002:00100000:2.0:1788201595.012295:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1724a1f80 x1875064728019840/t8589937468(8589937468) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1788201595.012353:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f7fd from it ffff8bc1506323c0 00010000:00010000:2.0:1788201595.012359:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171098232 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.012369:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098232 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201595.012396:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x19d:0x0](ffff8bc145986c08), inode mode 81ed mask 40 00000080:00200008:2.0:1788201595.012429:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-quota.sh:[0x200000bd7:0x19d:0x0](ffff8bc145986c08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1788201595.012434:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x19d:0x0](ffff8bc145986c08),name=sanity-quota.sh 00000002:00010000:2.0:1788201595.012454:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x19d:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.012464:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098232 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.012476:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098232 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201595.012483:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.012487:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x19d:0x0](ffff8bc145986c08) 00000080:00010000:2.0:1788201595.012490:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x19d:0x0](ffff8bc145986c08) for lock 0xd138388016f6f7fd 00000080:00010000:2.0:1788201595.012494:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f7fd from it ffffadd1c7debcd8 00010000:00010000:2.0:1788201595.012497:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171098232 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.012505:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098232 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1788201595.012542:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19d:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201595.012553:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x19d:0x0] 00000008:00010000:2.0:1788201595.012581:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201595.012585:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d830, osc lock ffff8bc151fc18f0, flags 0x400001002 00010000:00010000:2.0:1788201595.012637:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003a5753e8/0xd138388016f6f804 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.012649:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003a5753e8/0xd138388016f6f804 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1788201595.012692:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1788201595.013069:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201595.013092:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728019968:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201595.016576:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003a5753e8/0xd138388016f6f804 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.016609:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003a5753e8/0xd138388016f6f804 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098240 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.016626:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003a5753e8/0xd138388016f6f804 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098240 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.016641:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003a5753e8/0xd138388016f6f804 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098240 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201595.016660:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003a5753e8/0xd138388016f6f804 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171098240 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201595.016679:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201595.016732:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003a5753e8/0xd138388016f6f804 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171098240 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.016742:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003a5753e8/0xd138388016f6f804 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171098240 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.016750:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003a5753e8/0xd138388016f6f804 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171098240 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.016760:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003a5753e8/0xd138388016f6f804 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171098240 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201595.016785:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728019968:192.168.201.143@tcp:101:cp.0 00000080:00200000:2.0:1788201595.017277:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x19d:0x0] updating i_size 0 i_blocks 1 00000020:00010000:2.0:1788201595.017285:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc146005280 (ffff8bc146919248/0) at cl_lock_release():245 00000020:00010000:2.0:1788201595.017289:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146005280 (ffff8bc146919248/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.017294:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d830 (ffff8bc146919008/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.017299:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146005280 (ffff8bc146919248/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201595.017302:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d830 (ffff8bc146919248/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201595.017355:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19d:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1788201595.017629:0:24470:0:(file.c:2638:do_file_write_iter()) START file sanity-quota.sh:[0x200000bd7:0x19d:0x0], ppos: 0, count: 254129 00000080:00200000:2.0:1788201595.017666:0:24470:0:(file.c:2090:ll_file_io_generic()) sanity-quota.sh: write ppos: 0, bytes: 254129 00000080:00200000:2.0:1788201595.017673:0:24470:0:(file.c:1848:ll_io_set_mirror()) sanity-quota.sh: desiginated mirror: 0 00000020:00200000:2.0:1788201595.017679:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000315fff1f[0x110, 1, [0x200000bd7:0x19d:0x0] hash] 00000020:00200000:2.0:1788201595.017682:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 254129) 0 0 00000080:00200000:2.0:1788201595.017686:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19d:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201595.017701:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 62] 00020000:00200000:2.0:1788201595.017711:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 254129) 254129, 254129 00020000:00200000:2.0:1788201595.017715:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201595.017749:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 62] 00000008:00010000:2.0:1788201595.017763:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1788201595.017770:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d830, osc lock ffff8bc151fc18f0, flags 0x0 00010000:00010000:2.0:1788201595.017788:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/449 (0 258047) 00010000:00010000:2.0:1788201595.017870:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.017881:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->258047] (req 0->258047) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.017892:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->258047] (req 0->258047) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.017919:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1724a2d80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728020096:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201595.018113:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.021035:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201595.021368:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743488000 00000100:00100000:3.0:1788201595.021381:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743488000 00000100:00100000:3.0:1788201595.021452:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 817 00000100:00100000:3.0:1788201595.021465:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17275bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23415:x1875064743488000:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201595.021492:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003a5753e8/0xd138388016f6f804 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171098240 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201595.021672:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201595.021680:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17275bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23415:x1875064743488000:12345-192.168.201.143@tcp:104: Request processed in 217us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201595.021688:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 817 00010000:00010000:0.0:1788201595.022454:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201595.022465:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003a5753e8/0xd138388016f6f804 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171098240 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.022477:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1443b7e00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201595.022485:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003a5753e8/0xd138388016f6f804 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171098240 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201595.022566:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201595.022582:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1788201595.022667:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003a5753e8/0xd138388016f6f804 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171098240 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.022676:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201595.022720:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003a5753e8/0xd138388016f6f804 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171098240 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.022729:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003a5753e8/0xd138388016f6f804 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171098240 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.022746:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201595.022748:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201595.022750:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201595.022848:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201595.022870:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17264bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728020224:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788201595.027037:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201595.027180:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1724a2d80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728020096:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201595.027217:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->258047] (req 0->258047) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.027235:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->258047] (req 0->258047) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.027245:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->258047] (req 0->258047) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201595.027565:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743488128 00000100:00100000:1.0:1788201595.027574:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743488128 00000100:00100000:1.0:1788201595.027643:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 818 00000100:00100000:1.0:1788201595.027654:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23418:x1875064743488128:12345-192.168.201.143@tcp:105: 00010000:00010000:1.0:1788201595.027668:0:20877:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->258047] (req 0->258047) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.027679:0:20877:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->258047] (req 0->258047) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.027689:0:20877:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.027706:0:20877:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.027717:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.027726:0:20877:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.027756:0:20877:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1443b6000) 00000100:00100000:1.0:1788201595.027871:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23418:x1875064743488128:12345-192.168.201.143@tcp:105: Request processed in 218us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201595.027879:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 818 00010000:00010000:0.0:1788201595.028471:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.028491:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.028512:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201595.028537:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.028552:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.028563:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201595.028601:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) sanity-quota.sh: write [0, 254129) append 0 append lockpos 0 00000080:00200000:0.0:1788201595.028624:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.028693:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:0.0:1788201595.028707:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009b0eef6c[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 0] 00000080:00200000:0.0:1788201595.028711:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000af6213c 17ffffc0001001 3:0 ffff8bc172557380 0 lru 00000080:00200000:0.0:1788201595.028720:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000da8ac468 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.028722:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009b0eef6c 00000080:00200000:0.0:1788201595.028724:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1788201595.028731:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.028763:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:0.0:1788201595.028767:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ab43a442[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 1] 00000080:00200000:0.0:1788201595.028772:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009de72374 17ffffc0001001 3:0 ffff8bc172557000 1 lru 00000080:00200000:0.0:1788201595.028778:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009e229aaf 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.028780:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ab43a442 00000080:00200000:0.0:1788201595.028782:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:0.0:1788201595.028784:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.028837:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:0.0:1788201595.028843:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a4a435b2[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 2] 00000080:00200000:0.0:1788201595.028845:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000035f89a27 17ffffc0001001 3:0 ffff8bc172557d20 2 lru 00000080:00200000:0.0:1788201595.028851:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000abcf1ddd 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.028853:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a4a435b2 00000080:00200000:0.0:1788201595.028855:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:0.0:1788201595.028857:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.028874:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:0.0:1788201595.028879:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000fbd232b8[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 3] 00000080:00200000:0.0:1788201595.028882:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000086451e10 17ffffc0001001 3:0 ffff8bc172557460 3 lru 00000080:00200000:0.0:1788201595.028887:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000013fda66c 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.028889:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000fbd232b8 00000080:00200000:0.0:1788201595.028891:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:0.0:1788201595.028893:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.028907:0:24470:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:0.0:1788201595.028911:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d4c92cec[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 4] 00000080:00200000:0.0:1788201595.028914:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a84452c9 17ffffc0001001 3:0 ffff8bc1725572a0 4 lru 00000080:00200000:0.0:1788201595.028919:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008080b67b 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.028921:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d4c92cec 00000080:00200000:0.0:1788201595.028922:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:0.0:1788201595.028924:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.028937:0:24470:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:0.0:1788201595.028941:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a393baf2[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 5] 00000080:00200000:0.0:1788201595.028944:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005922f1b4 17ffffc0001001 3:0 ffff8bc172557b60 5 lru 00000080:00200000:0.0:1788201595.028949:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003734fdff 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.028952:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a393baf2 00000080:00200000:0.0:1788201595.028953:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:0.0:1788201595.028955:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.028967:0:24470:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:0.0:1788201595.028972:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002fe0d8c1[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 6] 00000080:00200000:0.0:1788201595.028975:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000fb371513 17ffffc0001001 3:0 ffff8bc172557700 6 lru 00000080:00200000:0.0:1788201595.028980:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ef2fc23c 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.028982:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002fe0d8c1 00000080:00200000:0.0:1788201595.028983:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:0.0:1788201595.028985:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.028998:0:24470:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:0.0:1788201595.029002:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b00a185b[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 7] 00000080:00200000:0.0:1788201595.029006:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000444e7346 17ffffc0001001 3:0 ffff8bc1725577e0 7 lru 00000080:00200000:0.0:1788201595.029011:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a95d595c 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.029013:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b00a185b 00000080:00200000:0.0:1788201595.029015:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:0.0:1788201595.029016:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.029032:0:24470:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:0.0:1788201595.029035:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000083db2941[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 8] 00000080:00200000:0.0:1788201595.029039:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000deeab87 17ffffc0001001 3:0 ffff8bc172557620 8 lru 00000080:00200000:0.0:1788201595.029044:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000032cbbeda 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.029046:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000083db2941 00000080:00200000:0.0:1788201595.029048:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:0.0:1788201595.029050:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.029066:0:24470:0:(rw26.c:898:ll_write_end()) pos 36864, len 4096, copied 4096 00000080:00200000:0.0:1788201595.029070:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000036314acb[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 9] 00000080:00200000:0.0:1788201595.029073:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000fa8d2c5d 17ffffc0001001 3:0 ffff8bc1507e0460 9 lru 00000080:00200000:0.0:1788201595.029079:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000003465e35 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.029082:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000036314acb 00000080:00200000:0.0:1788201595.029083:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:0.0:1788201595.029085:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 10 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.029111:0:24470:0:(rw26.c:898:ll_write_end()) pos 40960, len 4096, copied 4096 00000080:00200000:0.0:1788201595.029116:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000009aa57d[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 10] 00000080:00200000:0.0:1788201595.029118:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c40ea0eb 17ffffc0001001 3:0 ffff8bc1507e02a0 10 lru 00000080:00200000:0.0:1788201595.029124:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000002ba105d7 10: 1< 0 - - > 2< 40960 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.029272:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000009aa57d 00000080:00200000:0.0:1788201595.029274:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 11. 00000080:00200000:0.0:1788201595.029277:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 11 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.029294:0:24470:0:(rw26.c:898:ll_write_end()) pos 45056, len 4096, copied 4096 00000080:00200000:0.0:1788201595.029299:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001bd380de[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 11] 00000080:00200000:0.0:1788201595.029302:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000effcb865 17ffffc0001001 3:0 ffff8bc1507e0b60 11 lru 00000080:00200000:0.0:1788201595.029308:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007aa07e64 11: 1< 0 - - > 2< 45056 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.029310:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001bd380de 00000080:00200000:0.0:1788201595.029311:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 12. 00000080:00200000:0.0:1788201595.029313:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 12 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.029335:0:24470:0:(rw26.c:898:ll_write_end()) pos 49152, len 4096, copied 4096 00000080:00200000:0.0:1788201595.029340:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000aadfce5d[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 12] 00000080:00200000:0.0:1788201595.029355:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004d1aba57 17ffffc0001021 2:0 ffff8bc1507e0700 12 lru 00000080:00200000:0.0:1788201595.029361:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000862383f0 12: 1< 0 - - > 2< 49152 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.029363:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000aadfce5d 00000080:00200000:0.0:1788201595.029365:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 13. 00000080:00200000:0.0:1788201595.029367:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 13 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.029382:0:24470:0:(rw26.c:898:ll_write_end()) pos 53248, len 4096, copied 4096 00000080:00200000:0.0:1788201595.029386:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ba5150af[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 13] 00000080:00200000:0.0:1788201595.029390:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000fce738cf 17ffffc0001001 3:0 ffff8bc1507e07e0 13 lru 00000080:00200000:0.0:1788201595.029396:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a1bd96ac 13: 1< 0 - - > 2< 53248 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.029398:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ba5150af 00000080:00200000:0.0:1788201595.029399:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 14. 00000080:00200000:0.0:1788201595.029401:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 14 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.029414:0:24470:0:(rw26.c:898:ll_write_end()) pos 57344, len 4096, copied 4096 00000080:00200000:0.0:1788201595.029418:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d3cd4081[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 14] 00000080:00200000:0.0:1788201595.029421:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000da7905a 17ffffc0001001 3:0 ffff8bc1507e0620 14 lru 00000080:00200000:0.0:1788201595.029426:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a48a2c7f 14: 1< 0 - - > 2< 57344 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.029429:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d3cd4081 00000080:00200000:0.0:1788201595.029430:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 15. 00000080:00200000:0.0:1788201595.029432:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 15 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.029447:0:24470:0:(rw26.c:898:ll_write_end()) pos 61440, len 4096, copied 4096 00000080:00200000:0.0:1788201595.029452:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b998c91c[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 15] 00000080:00200000:0.0:1788201595.029455:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d39ad1ca 17ffffc0001001 3:0 ffff8bc1507e0ee0 15 lru 00000080:00200000:0.0:1788201595.029460:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000077dde804 15: 1< 0 - - > 2< 61440 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.029462:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b998c91c 00000080:00200000:0.0:1788201595.029463:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 16. 00000080:00200000:0.0:1788201595.029465:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 16 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.029481:0:24470:0:(rw26.c:898:ll_write_end()) pos 65536, len 4096, copied 4096 00000080:00200000:0.0:1788201595.029485:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000092fe71c6[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 16] 00000080:00200000:0.0:1788201595.029488:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001788747d 17ffffc0001001 3:0 ffff8bc1507e0e00 16 lru 00000080:00200000:0.0:1788201595.029493:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006d5ea8ec 16: 1< 0 - - > 2< 65536 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.029495:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000092fe71c6 00000080:00200000:0.0:1788201595.029496:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 17. 00000080:00200000:0.0:1788201595.029498:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 17 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.029513:0:24470:0:(rw26.c:898:ll_write_end()) pos 69632, len 4096, copied 4096 00000080:00200000:0.0:1788201595.029529:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000997150f4[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 17] 00000080:00200000:0.0:1788201595.029532:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d6663188 17ffffc0001001 3:0 ffff8bc1507e08c0 17 lru 00000080:00200000:0.0:1788201595.029538:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000e5aa074 17: 1< 0 - - > 2< 69632 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.029541:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000997150f4 00000080:00200000:0.0:1788201595.029542:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 18. 00000080:00200000:0.0:1788201595.029544:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 18 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.029562:0:24470:0:(rw26.c:898:ll_write_end()) pos 73728, len 4096, copied 4096 00000080:00200000:0.0:1788201595.029567:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000007f94139[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 18] 00000080:00200000:0.0:1788201595.029569:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c52df127 17ffffc0001001 3:0 ffff8bc1507e0540 18 lru 00000080:00200000:0.0:1788201595.029575:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000350831e3 18: 1< 0 - - > 2< 73728 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.029577:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000007f94139 00000080:00200000:0.0:1788201595.029578:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 19. 00000080:00200000:0.0:1788201595.029580:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 19 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.029593:0:24470:0:(rw26.c:898:ll_write_end()) pos 77824, len 4096, copied 4096 00000080:00200000:0.0:1788201595.029598:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c79361fb[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 19] 00000080:00200000:0.0:1788201595.029600:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000523c8b2 17ffffc0001001 3:0 ffff8bc1507e0a80 19 lru 00000080:00200000:0.0:1788201595.029606:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003dd833a7 19: 1< 0 - - > 2< 77824 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.029608:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c79361fb 00000080:00200000:0.0:1788201595.029609:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 20. 00000080:00200000:0.0:1788201595.029612:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 20 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.029626:0:24470:0:(rw26.c:898:ll_write_end()) pos 81920, len 4096, copied 4096 00000080:00200000:0.0:1788201595.029630:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b8f79b67[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 20] 00000080:00200000:0.0:1788201595.029633:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b0739a8d 17ffffc0001001 3:0 ffff8bc1507e0c40 20 lru 00000080:00200000:0.0:1788201595.029638:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f43139e4 20: 1< 0 - - > 2< 81920 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.029640:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b8f79b67 00000080:00200000:0.0:1788201595.029641:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 21. 00000080:00200000:0.0:1788201595.029642:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 21 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.029656:0:24470:0:(rw26.c:898:ll_write_end()) pos 86016, len 4096, copied 4096 00000080:00200000:0.0:1788201595.029660:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004c4a805a[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 21] 00000080:00200000:0.0:1788201595.029663:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000789f7d98 17ffffc0001001 3:0 ffff8bc1507e09a0 21 lru 00000080:00200000:0.0:1788201595.029668:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000049d99268 21: 1< 0 - - > 2< 86016 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.029670:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004c4a805a 00000080:00200000:0.0:1788201595.029671:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 22. 00000080:00200000:0.0:1788201595.029673:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 22 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.029688:0:24470:0:(rw26.c:898:ll_write_end()) pos 90112, len 4096, copied 4096 00000080:00200000:0.0:1788201595.029692:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009ebd6b7e[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 22] 00000080:00200000:0.0:1788201595.029695:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000070c7644c 17ffffc0001001 3:0 ffff8bc1507e00e0 22 lru 00000080:00200000:0.0:1788201595.029701:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001fd53a74 22: 1< 0 - - > 2< 90112 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.029703:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009ebd6b7e 00000080:00200000:0.0:1788201595.029704:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 23. 00000080:00200000:0.0:1788201595.029706:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 23 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.029723:0:24470:0:(rw26.c:898:ll_write_end()) pos 94208, len 4096, copied 4096 00000080:00200000:0.0:1788201595.029727:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000784d3b2[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 23] 00000080:00200000:0.0:1788201595.029729:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001de2b78c 17ffffc0001001 3:0 ffff8bc1507e01c0 23 lru 00000080:00200000:0.0:1788201595.029734:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000076eb78e0 23: 1< 0 - - > 2< 94208 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.029737:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000784d3b2 00000080:00200000:0.0:1788201595.029738:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 24. 00000080:00200000:0.0:1788201595.029741:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 24 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.029756:0:24470:0:(rw26.c:898:ll_write_end()) pos 98304, len 4096, copied 4096 00000080:00200000:0.0:1788201595.029760:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006bb4510a[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 24] 00000080:00200000:0.0:1788201595.029763:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009b5b308f 17ffffc0001001 3:0 ffff8bc1507e0380 24 lru 00000080:00200000:0.0:1788201595.029768:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000da96b4c2 24: 1< 0 - - > 2< 98304 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.029771:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006bb4510a 00000080:00200000:0.0:1788201595.029772:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 25. 00000080:00200000:0.0:1788201595.029774:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 25 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.029836:0:24470:0:(rw26.c:898:ll_write_end()) pos 102400, len 4096, copied 4096 00000080:00200000:0.0:1788201595.029842:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000317b2aa9[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 25] 00000080:00200000:0.0:1788201595.029845:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d7c6df79 17ffffc0001001 3:0 ffff8bc1507e0000 25 lru 00000080:00200000:0.0:1788201595.029850:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e0dc2e9c 25: 1< 0 - - > 2< 102400 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.029853:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000317b2aa9 00000080:00200000:0.0:1788201595.029854:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 26. 00000080:00200000:0.0:1788201595.029857:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 26 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.029874:0:24470:0:(rw26.c:898:ll_write_end()) pos 106496, len 4096, copied 4096 00000080:00200000:0.0:1788201595.029880:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001e99bc8c[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 26] 00000080:00200000:0.0:1788201595.029883:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000019546e2e 17ffffc0001001 3:0 ffff8bc1507e0d20 26 lru 00000080:00200000:0.0:1788201595.029888:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000dd28ba4f 26: 1< 0 - - > 2< 106496 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.029891:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001e99bc8c 00000080:00200000:0.0:1788201595.029892:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 27. 00000080:00200000:0.0:1788201595.029894:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 27 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.029916:0:24470:0:(rw26.c:898:ll_write_end()) pos 110592, len 4096, copied 4096 00000080:00200000:0.0:1788201595.029921:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000fa9d6c2f[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 27] 00000080:00200000:0.0:1788201595.029924:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c68eda28 17ffffc0001021 2:0 ffff8bc17252e7e0 27 lru 00000080:00200000:0.0:1788201595.029929:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d8b67ced 27: 1< 0 - - > 2< 110592 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.029931:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000fa9d6c2f 00000080:00200000:0.0:1788201595.029932:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 28. 00000080:00200000:0.0:1788201595.029934:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 28 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.029947:0:24470:0:(rw26.c:898:ll_write_end()) pos 114688, len 4096, copied 4096 00000080:00200000:0.0:1788201595.029952:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003c378561[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 28] 00000080:00200000:0.0:1788201595.029954:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e2146ac2 17ffffc0001001 3:0 ffff8bc17252e620 28 lru 00000080:00200000:0.0:1788201595.029959:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000864d1703 28: 1< 0 - - > 2< 114688 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.029962:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003c378561 00000080:00200000:0.0:1788201595.029963:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 29. 00000080:00200000:0.0:1788201595.029964:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 29 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.029979:0:24470:0:(rw26.c:898:ll_write_end()) pos 118784, len 4096, copied 4096 00000080:00200000:0.0:1788201595.029983:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a5463613[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 29] 00000080:00200000:0.0:1788201595.029985:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002a8b2616 17ffffc0001001 3:0 ffff8bc17252eee0 29 lru 00000080:00200000:0.0:1788201595.029990:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000db607ec6 29: 1< 0 - - > 2< 118784 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.029993:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a5463613 00000080:00200000:0.0:1788201595.029994:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 30. 00000080:00200000:0.0:1788201595.029995:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 30 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.030012:0:24470:0:(rw26.c:898:ll_write_end()) pos 122880, len 4096, copied 4096 00000080:00200000:0.0:1788201595.030015:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000cc1452d2[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 30] 00000080:00200000:0.0:1788201595.030017:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b3f111dd 17ffffc0001001 3:0 ffff8bc17252ee00 30 lru 00000080:00200000:0.0:1788201595.030022:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c4060cf8 30: 1< 0 - - > 2< 122880 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.030024:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000cc1452d2 00000080:00200000:0.0:1788201595.030026:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 31. 00000080:00200000:0.0:1788201595.030027:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 31 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.030041:0:24470:0:(rw26.c:898:ll_write_end()) pos 126976, len 4096, copied 4096 00000080:00200000:0.0:1788201595.030044:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004a0d3543[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 31] 00000080:00200000:0.0:1788201595.030047:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f0a6bb0a 17ffffc0001001 3:0 ffff8bc17252e8c0 31 lru 00000080:00200000:0.0:1788201595.030052:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004e217a44 31: 1< 0 - - > 2< 126976 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.030054:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004a0d3543 00000080:00200000:0.0:1788201595.030056:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 32. 00000080:00200000:0.0:1788201595.030057:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 32 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.030070:0:24470:0:(rw26.c:898:ll_write_end()) pos 131072, len 4096, copied 4096 00000080:00200000:0.0:1788201595.030073:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000037deb9[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 32] 00000080:00200000:0.0:1788201595.030076:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000303ef17b 17ffffc0001001 3:0 ffff8bc17252e540 32 lru 00000080:00200000:0.0:1788201595.030080:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000fe59d29a 32: 1< 0 - - > 2< 131072 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.030083:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000037deb9 00000080:00200000:0.0:1788201595.030084:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 33. 00000080:00200000:0.0:1788201595.030086:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 33 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.030569:0:24470:0:(rw26.c:898:ll_write_end()) pos 135168, len 4096, copied 4096 00000080:00200000:0.0:1788201595.030577:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000039f46b13[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 33] 00000080:00200000:0.0:1788201595.030581:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006f09b962 17ffffc0001001 3:0 ffff8bc17252ea80 33 lru 00000080:00200000:0.0:1788201595.030587:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000fde78139 33: 1< 0 - - > 2< 135168 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.030589:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000039f46b13 00000080:00200000:0.0:1788201595.030591:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 34. 00000080:00200000:0.0:1788201595.030593:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 34 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.030611:0:24470:0:(rw26.c:898:ll_write_end()) pos 139264, len 4096, copied 4096 00000080:00200000:0.0:1788201595.030616:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000051e3b2d9[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 34] 00000080:00200000:0.0:1788201595.030619:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000eea38cc0 17ffffc0001001 3:0 ffff8bc17252ec40 34 lru 00000080:00200000:0.0:1788201595.030625:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000cb29285d 34: 1< 0 - - > 2< 139264 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.030627:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000051e3b2d9 00000080:00200000:0.0:1788201595.030628:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 35. 00000080:00200000:0.0:1788201595.030630:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 35 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.030643:0:24470:0:(rw26.c:898:ll_write_end()) pos 143360, len 4096, copied 4096 00000080:00200000:0.0:1788201595.030647:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006169d309[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 35] 00000080:00200000:0.0:1788201595.030650:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000bb481051 17ffffc0001001 3:0 ffff8bc17252e9a0 35 lru 00000080:00200000:0.0:1788201595.030655:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000237c6097 35: 1< 0 - - > 2< 143360 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.030657:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006169d309 00000080:00200000:0.0:1788201595.030659:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 36. 00000080:00200000:0.0:1788201595.030660:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 36 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.030675:0:24470:0:(rw26.c:898:ll_write_end()) pos 147456, len 4096, copied 4096 00000080:00200000:0.0:1788201595.030679:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e3d347d2[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 36] 00000080:00200000:0.0:1788201595.030682:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ffc7cd48 17ffffc0001001 3:0 ffff8bc17252e0e0 36 lru 00000080:00200000:0.0:1788201595.030686:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007b3ac522 36: 1< 0 - - > 2< 147456 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.030688:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e3d347d2 00000080:00200000:0.0:1788201595.030689:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 37. 00000080:00200000:0.0:1788201595.030691:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 37 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.030708:0:24470:0:(rw26.c:898:ll_write_end()) pos 151552, len 4096, copied 4096 00000080:00200000:0.0:1788201595.030713:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000843c1766[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 37] 00000080:00200000:0.0:1788201595.030716:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000085490260 17ffffc0001001 3:0 ffff8bc17252e1c0 37 lru 00000080:00200000:0.0:1788201595.030722:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006d287028 37: 1< 0 - - > 2< 151552 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.030724:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000843c1766 00000080:00200000:0.0:1788201595.030725:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 38. 00000080:00200000:0.0:1788201595.030727:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 38 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.030742:0:24470:0:(rw26.c:898:ll_write_end()) pos 155648, len 4096, copied 4096 00000080:00200000:0.0:1788201595.030747:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b2580c4a[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 38] 00000080:00200000:0.0:1788201595.030750:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000cb15462 17ffffc0001001 3:0 ffff8bc17252e380 38 lru 00000080:00200000:0.0:1788201595.030756:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005acf6429 38: 1< 0 - - > 2< 155648 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.030758:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b2580c4a 00000080:00200000:0.0:1788201595.030760:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 39. 00000080:00200000:0.0:1788201595.030762:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 39 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.030775:0:24470:0:(rw26.c:898:ll_write_end()) pos 159744, len 4096, copied 4096 00000080:00200000:0.0:1788201595.030780:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004cb66e18[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 39] 00000080:00200000:0.0:1788201595.030783:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c209563a 17ffffc0001001 3:0 ffff8bc17252e000 39 lru 00000080:00200000:0.0:1788201595.030788:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000acbf80a9 39: 1< 0 - - > 2< 159744 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.030819:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004cb66e18 00000080:00200000:0.0:1788201595.030820:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 40. 00000080:00200000:0.0:1788201595.030823:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 40 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.030839:0:24470:0:(rw26.c:898:ll_write_end()) pos 163840, len 4096, copied 4096 00000080:00200000:0.0:1788201595.030843:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000327d5197[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 40] 00000080:00200000:0.0:1788201595.030846:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004b04c009 17ffffc0001001 3:0 ffff8bc17252ed20 40 lru 00000080:00200000:0.0:1788201595.030851:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d270e457 40: 1< 0 - - > 2< 163840 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.030853:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000327d5197 00000080:00200000:0.0:1788201595.030855:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 41. 00000080:00200000:0.0:1788201595.030857:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 41 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.030872:0:24470:0:(rw26.c:898:ll_write_end()) pos 167936, len 4096, copied 4096 00000080:00200000:0.0:1788201595.030876:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a1d812ad[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 41] 00000080:00200000:0.0:1788201595.030879:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000020338563 17ffffc0001001 3:0 ffff8bc17252e460 41 lru 00000080:00200000:0.0:1788201595.030884:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000cdd965ed 41: 1< 0 - - > 2< 167936 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.030886:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a1d812ad 00000080:00200000:0.0:1788201595.030888:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 42. 00000080:00200000:0.0:1788201595.030889:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 42 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.030910:0:24470:0:(rw26.c:898:ll_write_end()) pos 172032, len 4096, copied 4096 00000080:00200000:0.0:1788201595.030915:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a8b8ee77[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 42] 00000080:00200000:0.0:1788201595.030918:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000041a0d842 17ffffc0001021 2:0 ffff8bc17252e2a0 42 lru 00000080:00200000:0.0:1788201595.030923:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000db00a393 42: 1< 0 - - > 2< 172032 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.030926:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a8b8ee77 00000080:00200000:0.0:1788201595.030927:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 43. 00000080:00200000:0.0:1788201595.030929:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 43 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.030944:0:24470:0:(rw26.c:898:ll_write_end()) pos 176128, len 4096, copied 4096 00000080:00200000:0.0:1788201595.030948:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000031b7ff20[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 43] 00000080:00200000:0.0:1788201595.030951:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e8c6e50c 17ffffc0001001 3:0 ffff8bc17252eb60 43 lru 00000080:00200000:0.0:1788201595.030956:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000dfb3d118 43: 1< 0 - - > 2< 176128 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.030958:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000031b7ff20 00000080:00200000:0.0:1788201595.030959:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 44. 00000080:00200000:0.0:1788201595.030961:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 44 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.030977:0:24470:0:(rw26.c:898:ll_write_end()) pos 180224, len 4096, copied 4096 00000080:00200000:0.0:1788201595.030981:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000bbb2503[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 44] 00000080:00200000:0.0:1788201595.030984:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006c3c8c64 17ffffc0001001 3:0 ffff8bc17252e700 44 lru 00000080:00200000:0.0:1788201595.030989:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000725b101f 44: 1< 0 - - > 2< 180224 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.030991:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000bbb2503 00000080:00200000:0.0:1788201595.030992:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 45. 00000080:00200000:0.0:1788201595.030994:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 45 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.031009:0:24470:0:(rw26.c:898:ll_write_end()) pos 184320, len 4096, copied 4096 00000080:00200000:0.0:1788201595.031013:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008d8f7f9a[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 45] 00000080:00200000:0.0:1788201595.031017:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000570e3ec0 17ffffc0001001 3:0 ffff8bc172640e00 45 lru 00000080:00200000:0.0:1788201595.031022:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f02aadf4 45: 1< 0 - - > 2< 184320 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.031024:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008d8f7f9a 00000080:00200000:0.0:1788201595.031025:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 46. 00000080:00200000:0.0:1788201595.031027:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 46 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.031043:0:24470:0:(rw26.c:898:ll_write_end()) pos 188416, len 4096, copied 4096 00000080:00200000:0.0:1788201595.031047:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d33da283[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 46] 00000080:00200000:0.0:1788201595.031051:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002b29c6a5 17ffffc0001001 3:0 ffff8bc1726408c0 46 lru 00000080:00200000:0.0:1788201595.031055:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009099746b 46: 1< 0 - - > 2< 188416 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.031057:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d33da283 00000080:00200000:0.0:1788201595.031058:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 47. 00000080:00200000:0.0:1788201595.031060:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 47 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.031076:0:24470:0:(rw26.c:898:ll_write_end()) pos 192512, len 4096, copied 4096 00000080:00200000:0.0:1788201595.031080:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000fc3fc5d8[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 47] 00000080:00200000:0.0:1788201595.031083:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004bb7e530 17ffffc0001001 3:0 ffff8bc172640540 47 lru 00000080:00200000:0.0:1788201595.031088:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000798824d8 47: 1< 0 - - > 2< 192512 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.031090:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000fc3fc5d8 00000080:00200000:0.0:1788201595.031289:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 48. 00000080:00200000:0.0:1788201595.031293:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 48 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.031311:0:24470:0:(rw26.c:898:ll_write_end()) pos 196608, len 4096, copied 4096 00000080:00200000:0.0:1788201595.031316:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007024cc95[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 48] 00000080:00200000:0.0:1788201595.031319:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008b151d24 17ffffc0001001 3:0 ffff8bc172640a80 48 lru 00000080:00200000:0.0:1788201595.031324:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000001b8620e 48: 1< 0 - - > 2< 196608 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.031327:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007024cc95 00000080:00200000:0.0:1788201595.031328:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 49. 00000080:00200000:0.0:1788201595.031330:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 49 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.031360:0:24470:0:(rw26.c:898:ll_write_end()) pos 200704, len 4096, copied 4096 00000080:00200000:0.0:1788201595.031366:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c4af652f[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 49] 00000080:00200000:0.0:1788201595.031369:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f4f0710e 17ffffc0001001 3:0 ffff8bc172640c40 49 lru 00000080:00200000:0.0:1788201595.031374:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001b09fa39 49: 1< 0 - - > 2< 200704 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.031376:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c4af652f 00000080:00200000:0.0:1788201595.031378:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 50. 00000080:00200000:0.0:1788201595.031380:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 50 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.031395:0:24470:0:(rw26.c:898:ll_write_end()) pos 204800, len 4096, copied 4096 00000080:00200000:0.0:1788201595.031399:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f5b8058b[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 50] 00000080:00200000:0.0:1788201595.031402:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c0f8d17b 17ffffc0001001 3:0 ffff8bc1726409a0 50 lru 00000080:00200000:0.0:1788201595.031408:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f0e71429 50: 1< 0 - - > 2< 204800 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.031410:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f5b8058b 00000080:00200000:0.0:1788201595.031412:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 51. 00000080:00200000:0.0:1788201595.031414:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 51 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.031429:0:24470:0:(rw26.c:898:ll_write_end()) pos 208896, len 4096, copied 4096 00000080:00200000:0.0:1788201595.031433:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003eff42c9[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 51] 00000080:00200000:0.0:1788201595.031436:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000bb63e1bb 17ffffc0001001 3:0 ffff8bc1726400e0 51 lru 00000080:00200000:0.0:1788201595.031441:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003e39adeb 51: 1< 0 - - > 2< 208896 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.031443:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003eff42c9 00000080:00200000:0.0:1788201595.031445:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 52. 00000080:00200000:0.0:1788201595.031447:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 52 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.031460:0:24470:0:(rw26.c:898:ll_write_end()) pos 212992, len 4096, copied 4096 00000080:00200000:0.0:1788201595.031464:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006611c1c9[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 52] 00000080:00200000:0.0:1788201595.031466:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000028e7052f 17ffffc0001001 3:0 ffff8bc1726401c0 52 lru 00000080:00200000:0.0:1788201595.031471:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005444e7ac 52: 1< 0 - - > 2< 212992 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.031474:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006611c1c9 00000080:00200000:0.0:1788201595.031475:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 53. 00000080:00200000:0.0:1788201595.031477:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 53 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.031493:0:24470:0:(rw26.c:898:ll_write_end()) pos 217088, len 4096, copied 4096 00000080:00200000:0.0:1788201595.031498:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007e279a40[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 53] 00000080:00200000:0.0:1788201595.031501:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000026abac72 17ffffc0001001 3:0 ffff8bc172640380 53 lru 00000080:00200000:0.0:1788201595.031506:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000fea7f2e8 53: 1< 0 - - > 2< 217088 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.031508:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007e279a40 00000080:00200000:0.0:1788201595.031509:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 54. 00000080:00200000:0.0:1788201595.031511:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 54 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.031678:0:24470:0:(rw26.c:898:ll_write_end()) pos 221184, len 4096, copied 4096 00000080:00200000:0.0:1788201595.031684:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002fd161e6[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 54] 00000080:00200000:0.0:1788201595.031686:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001ba5d675 17ffffc0001001 3:0 ffff8bc172640000 54 lru 00000080:00200000:0.0:1788201595.031692:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000dd7783dd 54: 1< 0 - - > 2< 221184 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.031694:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002fd161e6 00000080:00200000:0.0:1788201595.031695:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 55. 00000080:00200000:0.0:1788201595.031697:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 55 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.031713:0:24470:0:(rw26.c:898:ll_write_end()) pos 225280, len 4096, copied 4096 00000080:00200000:0.0:1788201595.031717:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b33935eb[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 55] 00000080:00200000:0.0:1788201595.031721:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000091d4f110 17ffffc0001001 3:0 ffff8bc172640d20 55 lru 00000080:00200000:0.0:1788201595.031726:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a3ce6d2e 55: 1< 0 - - > 2< 225280 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.031728:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b33935eb 00000080:00200000:0.0:1788201595.031729:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 56. 00000080:00200000:0.0:1788201595.031732:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 56 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.031747:0:24470:0:(rw26.c:898:ll_write_end()) pos 229376, len 4096, copied 4096 00000080:00200000:0.0:1788201595.031752:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007f10673e[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 56] 00000080:00200000:0.0:1788201595.031755:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001ef3a892 17ffffc0001001 3:0 ffff8bc172640460 56 lru 00000080:00200000:0.0:1788201595.031760:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d1b831d1 56: 1< 0 - - > 2< 229376 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.031762:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007f10673e 00000080:00200000:0.0:1788201595.031764:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 57. 00000080:00200000:0.0:1788201595.031766:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 57 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.031784:0:24470:0:(rw26.c:898:ll_write_end()) pos 233472, len 4096, copied 4096 00000080:00200000:0.0:1788201595.031812:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000be46e073[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 57] 00000080:00200000:0.0:1788201595.031817:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009ba43355 17ffffc0001021 2:0 ffff8bc1726402a0 57 lru 00000080:00200000:0.0:1788201595.031823:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000bacfcb45 57: 1< 0 - - > 2< 233472 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.031825:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000be46e073 00000080:00200000:0.0:1788201595.031827:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 58. 00000080:00200000:0.0:1788201595.031829:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 58 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.031846:0:24470:0:(rw26.c:898:ll_write_end()) pos 237568, len 4096, copied 4096 00000080:00200000:0.0:1788201595.031850:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000065ec94c6[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 58] 00000080:00200000:0.0:1788201595.031853:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000994400fb 17ffffc0001001 3:0 ffff8bc172640b60 58 lru 00000080:00200000:0.0:1788201595.031859:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007c9b15e9 58: 1< 0 - - > 2< 237568 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.031861:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000065ec94c6 00000080:00200000:0.0:1788201595.031863:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 59. 00000080:00200000:0.0:1788201595.031864:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 59 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.031882:0:24470:0:(rw26.c:898:ll_write_end()) pos 241664, len 4096, copied 4096 00000080:00200000:0.0:1788201595.031886:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002bf1fa77[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 59] 00000080:00200000:0.0:1788201595.031889:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b1630f8b 17ffffc0001001 3:0 ffff8bc172640700 59 lru 00000080:00200000:0.0:1788201595.031893:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009ce3e77b 59: 1< 0 - - > 2< 241664 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.031895:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002bf1fa77 00000080:00200000:0.0:1788201595.031897:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 60. 00000080:00200000:0.0:1788201595.031898:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 60 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.031911:0:24470:0:(rw26.c:898:ll_write_end()) pos 245760, len 4096, copied 4096 00000080:00200000:0.0:1788201595.031915:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007cb8b2f1[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 60] 00000080:00200000:0.0:1788201595.031918:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009baffdb5 17ffffc0001001 3:0 ffff8bc1726407e0 60 lru 00000080:00200000:0.0:1788201595.031922:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000660ddfd2 60: 1< 0 - - > 2< 245760 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.031924:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007cb8b2f1 00000080:00200000:0.0:1788201595.031925:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 61. 00000080:00200000:0.0:1788201595.031927:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 61 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.031943:0:24470:0:(rw26.c:898:ll_write_end()) pos 249856, len 4096, copied 4096 00000080:00200000:0.0:1788201595.031947:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004c44e75b[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 61] 00000080:00200000:0.0:1788201595.031950:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000880aa868 17ffffc0001001 3:0 ffff8bc172640620 61 lru 00000080:00200000:0.0:1788201595.031954:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a61ea5f8 61: 1< 0 - - > 2< 249856 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.031956:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004c44e75b 00000080:00200000:0.0:1788201595.031958:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 62. 00000080:00200000:0.0:1788201595.031959:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 62 of 0 to 177 bytes 00000080:00200000:0.0:1788201595.031981:0:24470:0:(rw26.c:898:ll_write_end()) pos 253952, len 177, copied 177 00000080:00200000:0.0:1788201595.031985:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b0d55a97[3 0000000010681cc2 2 1 00000000424d3a4c 0 0 62] 00000080:00200000:0.0:1788201595.031988:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000048fd0c53 17ffffc0001001 3:0 ffff8bc172640ee0 62 lru 00000080:00200000:0.0:1788201595.031992:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000cd2e84c1 62: 1< 0 - - > 2< 253952 0 0 0x0 0x0 | 000000008930e75a 00000000832b260a > 3< 0 0 > 4< 0 0 8 15335424 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.031994:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b0d55a97 00000080:00200000:0.0:1788201595.031996:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 63. 00000080:00200000:0.0:1788201595.032000:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 63, from 0, to 177 prio 0 00000008:00010000:0.0:1788201595.032038:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000c88bdffc ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201595.032080:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145986db8, count 15, dirtied 15 00000080:00200000:0.0:1788201595.032423:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145986db8, count 15, dirtied 15 00000080:00200000:0.0:1788201595.032441:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145986db8, count 15, dirtied 15 00000080:00200000:0.0:1788201595.032456:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145986db8, count 15, dirtied 15 00000080:00200000:0.0:1788201595.032463:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145986db8, count 3, dirtied 3 00000080:00200000:0.0:1788201595.032467:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 63 pages 254129 bytes, tot: 254129 00000080:00200000:0.0:1788201595.032472:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) sanity-quota.sh: write bytes 0, result: 254129 00000020:00010000:0.0:1788201595.032496:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1498445d8 (ffff8bc146919248/0) at cl_lock_release():245 00000020:00010000:0.0:1788201595.032500:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1498445d8 (ffff8bc146919248/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201595.032504:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d830 (ffff8bc146919008/1) at cl_lock_cancel():142 00010000:00010000:0.0:1788201595.032514:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.032595:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1788201595.032617:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1498445d8 (ffff8bc146919248/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201595.032621:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d830 (ffff8bc146919248/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201595.032635:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 254129 bytes 00000080:00200000:0.0:1788201595.032644:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 62] 00000080:00200000:0.0:1788201595.032687:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19d:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201595.032692:0:24470:0:(file.c:2238:ll_file_io_generic()) sanity-quota.sh: 2 io complete with rc: 0, result: 254129, restart: 0 00000080:00200000:0.0:1788201595.032701:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x19d:0x0] updating i_size 254129 i_blocks 1 00000080:00200000:0.0:1788201595.032708:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 254129 00000080:00200008:0.0:1788201595.032768:0:24470:0:(file.c:479:ll_file_release()) START file sanity-quota.sh:[0x200000bd7:0x19d:0x0](ffff8bc145986c08), flags 100001 00000002:00100000:0.0:1788201595.032869:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1724a1f80 x1875064728019840/t8589937468(8589937468) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201611 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1788201595.032883:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1788201595.032889:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc17264a300 x1875064728020480/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1788201595.032917:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17264a300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728020480:192.168.201.143@tcp:35:cp.0 00000100:00100000:0.0:1788201595.033217:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.035651:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17264bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728020224:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.038373:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17264a300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728020480:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201595.038418:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1724a1f80 x1875064728019840/t8589937468(8589937468) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201595.038509:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201595.038543:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.038570:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.038587:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.038597:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.038604:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201595.038608:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201595.038617:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201595.038622:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.038632:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.038651:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.038659:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201595.038665:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.038669:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-quota.sh, flags=8 00000080:00200008:1.0:1788201595.038679:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-quota.sh:[0x200000bd7:0x19d:0x0](ffff8bc145986c08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201595.038684:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x19d:0x0](ffff8bc145986c08),name=sanity-quota.sh 00000002:00010000:1.0:1788201595.038698:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x19d:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.038705:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098232 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201595.038713:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098232 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201595.038719:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.038723:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x19d:0x0](ffff8bc145986c08) 00000080:00010000:1.0:1788201595.038725:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x19d:0x0](ffff8bc145986c08) for lock 0xd138388016f6f7fd 00000080:00010000:1.0:1788201595.038730:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f7fd from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201595.038733:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171098232 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201595.038742:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098232 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201595.038853:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19d:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201595.038865:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x19d:0x0] 00000008:00010000:1.0:1788201595.038901:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201595.038904:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4f30, osc lock ffff8bc145d09a20, flags 0x400001002 00010000:00010000:1.0:1788201595.038923:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201595.038937:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201595.038952:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201595.038956:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201595.038964:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201595.038975:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201595.038985:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x19d:0x0] updating i_size 254129 i_blocks 1 00000020:00010000:1.0:1788201595.038990:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e24250 (ffff8bc148e3b5a8/0) at cl_lock_release():245 00000020:00010000:1.0:1788201595.038994:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e24250 (ffff8bc148e3b5a8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201595.038997:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4f30 (ffff8bc148e3b878/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201595.039002:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e24250 (ffff8bc148e3b5a8/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201595.039005:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4f30 (ffff8bc148e3b5a8/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201595.039035:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19d:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201595.039096:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201595.039104:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.039111:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.039120:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.039140:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.039144:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201595.039147:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201595.039151:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201595.039154:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.039163:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.039173:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.039178:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201595.039182:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.039196:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-scrub.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201595.039201:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-scrub.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201595.039211:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-scrub.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201595.039262:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f812 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.039270:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f812 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.039281:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f812 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201595.039306:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728020608:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201595.039426:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.042303:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728020608:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201595.042331:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f812 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.042358:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f812 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.042365:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f812 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.042372:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f812 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.042383:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f812 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.042390:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17261f000 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201595.042395:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f812 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.042408:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f812 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.042416:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f812 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.042425:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201595.042433:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f812 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.042441:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f812 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201595.042471:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1727d5500 x1875064728020608/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201595.042493:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201595.042542:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201595.042627:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201595.042646:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.042659:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.042672:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.042679:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.042685:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201595.042690:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201595.042696:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201595.042700:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.042708:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.042726:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.042733:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201595.042740:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.042757:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-scrub.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:1.0:1788201595.042762:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-scrub.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201595.042775:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-scrub.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201595.042861:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f819 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.042869:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f819 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.042881:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f819 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201595.042907:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728020736:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201595.043003:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.045738:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728020736:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201595.045766:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f819 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.045783:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f819 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.045867:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f819 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.045876:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f819 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.045887:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f819 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.045896:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17261e600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201595.045901:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f819 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.045909:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f819 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.045917:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f819 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.045926:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201595.045935:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f819 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.045942:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f819 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201595.045967:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1727d5500 x1875064728020736/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201595.045986:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201595.046015:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201595.046199:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201595.046217:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.046229:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.046241:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.046248:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.046254:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201595.046258:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201595.046264:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:1.0:1788201595.046269:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.046277:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.046293:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.046302:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201595.046308:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.046324:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.046330:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sanity-scrub.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14304b200, open_flags 80c1, mode 81ed opened 0 00000080:00200000:1.0:1788201595.046340:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-scrub.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:1.0:1788201595.046377:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-scrub.sh,[0x200000bd7:0x19e:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201595.046433:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.046446:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201595.046459:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201595.046465:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d5500 x1875064728020992/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201595.046476:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201595.046504:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728020992:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201595.046894:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201595.051493:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728020992:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201595.051541:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109828d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.051570:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109828d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.051580:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109828d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.051593:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109828d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.051607:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109828d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.051625:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109828d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.051634:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109828d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.051644:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109828d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201595.051659:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1727d5500 x1875064728020992/t8589937470(8589937470) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201595.051673:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1727d5500 x1875064728020992/t8589937470(8589937470) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201595.051689:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109828d expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1788201595.051705:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109828d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.051717:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/414 (0 0) 00000080:00200000:0.0:1788201595.051725:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201595.051741:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=sanity-scrub.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:0.0:1788201595.051774:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x19e:0x0](ffff8bc1459b6c08) 00000080:00200000:0.0:1788201595.052331:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x19e:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1788201595.052359:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x19e:0x0](ffff8bc1459b6c08) 00000080:00010000:0.0:1788201595.052363:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x19e:0x0](ffff8bc1459b6c08) for lock 0xd138388016f6f820 00000080:00010000:0.0:1788201595.052375:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x19e:0x0](ffff8bc1459b6c08) 00000080:00200008:0.0:1788201595.052395:0:24470:0:(file.c:1090:ll_file_open()) START file sanity-scrub.sh:[0x200000bd7:0x19e:0x0](ffff8bc1459b6c08), flags 100301 00000002:00100000:0.0:1788201595.052421:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1727d5500 x1875064728020992/t8589937470(8589937470) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1788201595.052479:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f820 from it ffff8bc1466cdf60 00010000:00010000:0.0:1788201595.052485:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109828d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.052496:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109828d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201595.052587:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x19e:0x0](ffff8bc1459b6c08), inode mode 81ed mask 40 00000080:00200008:0.0:1788201595.052631:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-scrub.sh:[0x200000bd7:0x19e:0x0](ffff8bc1459b6c08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201595.052640:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x19e:0x0](ffff8bc1459b6c08),name=sanity-scrub.sh 00000002:00010000:0.0:1788201595.052663:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x19e:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201595.052676:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109828d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.052691:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109828d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201595.052700:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201595.052705:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x19e:0x0](ffff8bc1459b6c08) 00000080:00010000:0.0:1788201595.052709:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x19e:0x0](ffff8bc1459b6c08) for lock 0xd138388016f6f820 00000080:00010000:0.0:1788201595.052713:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f820 from it ffffadd1c7debcd8 00010000:00010000:0.0:1788201595.052717:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109828d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.052724:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109828d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201595.052752:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19e:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201595.052762:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x19e:0x0] 00000008:00010000:0.0:1788201595.053290:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201595.053296:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456bb0, osc lock ffff8bc145d34e40, flags 0x400001002 00010000:00010000:0.0:1788201595.053369:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f827 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.053381:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f827 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201595.053457:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728021120:192.168.201.143@tcp:101:cp.0 00000020:00200000:0.0:1788201595.053651:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1788201595.056655:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f827 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.056691:0:10054:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f827 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109829b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.056710:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f827 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109829b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.056725:0:10054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f827 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109829b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1788201595.056748:0:10054:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f827 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109829b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1788201595.056760:0:10054:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:2.0:1788201595.061075:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f827 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109829b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.061116:0:10054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f827 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109829b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.061133:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f827 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109829b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.061144:0:10054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f827 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e217109829b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1788201595.061177:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728021120:192.168.201.143@tcp:101:cp.0 00000080:00200000:0.0:1788201595.061509:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x19e:0x0] updating i_size 0 i_blocks 1 00000020:00010000:0.0:1788201595.061517:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449dae40 (ffff8bc1499c4c68/0) at cl_lock_release():245 00000020:00010000:0.0:1788201595.061622:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449dae40 (ffff8bc1499c4c68/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201595.061628:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456bb0 (ffff8bc1499c4638/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201595.061634:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449dae40 (ffff8bc1499c4c68/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201595.061637:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456bb0 (ffff8bc1499c4c68/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201595.061683:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19e:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1788201595.061907:0:24470:0:(file.c:2638:do_file_write_iter()) START file sanity-scrub.sh:[0x200000bd7:0x19e:0x0], ppos: 0, count: 42517 00000080:00200000:1.0:1788201595.062033:0:24470:0:(file.c:2090:ll_file_io_generic()) sanity-scrub.sh: write ppos: 0, bytes: 42517 00000080:00200000:1.0:1788201595.062041:0:24470:0:(file.c:1848:ll_io_set_mirror()) sanity-scrub.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201595.062047:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b6c3fab8[0x110, 1, [0x200000bd7:0x19e:0x0] hash] 00000020:00200000:1.0:1788201595.062050:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 42517) 0 0 00000080:00200000:1.0:1788201595.062055:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19e:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201595.062070:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 10] 00020000:00200000:1.0:1788201595.062079:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 42517) 42517, 42517 00020000:00200000:1.0:1788201595.062083:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201595.062254:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 10] 00000008:00010000:1.0:1788201595.062271:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201595.062278:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4f30, osc lock ffff8bc145d09a20, flags 0x0 00010000:00010000:1.0:1788201595.062297:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/449 (0 45055) 00010000:00010000:1.0:1788201595.062375:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.062387:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.062400:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201595.062430:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728021248:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201595.062634:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc143d43a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.066554:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201595.066858:0:20876:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788201595.066885:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743488256 00000100:00100000:1.0:1788201595.066897:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743488256 00000100:00100000:1.0:1788201595.066973:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 819 00000100:00100000:1.0:1788201595.066986:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc14742f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23408:x1875064743488256:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201595.067008:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f827 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109829b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201595.067114:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201595.067122:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc14742f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23408:x1875064743488256:12345-192.168.201.143@tcp:104: Request processed in 140us (584us total) trans 0 rc 0/0 00010000:00010000:0.0:1788201595.067236:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201595.067246:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f827 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109829b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.067257:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc146085400 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201595.067264:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f827 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e217109829b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201595.067332:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201595.067359:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1788201595.067444:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f827 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109829b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.067452:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201595.067487:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f827 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109829b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.067503:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000899ce92a/0xd138388016f6f827 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109829b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.067587:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201595.067590:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201595.067592:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201595.067616:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728021376:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.068450:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 819 00000100:00100000:1.0:1788201595.070873:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728021248:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201595.070925:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.070944:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.070955:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.073202:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201595.073291:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743488384 00000100:00100000:3.0:1788201595.073304:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743488384 00000100:00100000:3.0:1788201595.073384:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 820 00000100:00100000:3.0:1788201595.073397:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1725f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21005:x1875064743488384:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201595.073421:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.073440:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.073452:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.073468:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.073480:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.073500:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.073554:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1460bc400) 00000100:00100000:3.0:1788201595.073642:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1725f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21005:x1875064743488384:12345-192.168.201.143@tcp:105: Request processed in 246us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201595.073650:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 820 00010000:00010000:2.0:1788201595.074064:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.074079:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.074105:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1788201595.074121:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.074136:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.074144:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1788201595.074181:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) sanity-scrub.sh: write [0, 42517) append 0 append lockpos 0 00000080:00200000:2.0:1788201595.074204:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.074286:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:2.0:1788201595.074301:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a58521c3[3 00000000ff90811a 2 1 0000000032a1b70f 0 0 0] 00000080:00200000:2.0:1788201595.074304:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000658a1f40 17ffffc0001021 2:0 ffff8bc1725b89a0 0 lru 00000080:00200000:2.0:1788201595.074313:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ec3db5a5 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000f3b37ce8 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.074316:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a58521c3 00000080:00200000:2.0:1788201595.074317:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1788201595.074321:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.074359:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:2.0:1788201595.074364:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d3969f7a[3 00000000ff90811a 2 1 0000000032a1b70f 0 0 1] 00000080:00200000:2.0:1788201595.074367:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000cb58689b 17ffffc0001001 3:0 ffff8bc1725b8c40 1 lru 00000080:00200000:2.0:1788201595.074373:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000073969341 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 00000000f3b37ce8 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.074375:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d3969f7a 00000080:00200000:2.0:1788201595.074377:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:2.0:1788201595.074379:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.074406:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:2.0:1788201595.074410:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000da64c34b[3 00000000ff90811a 2 1 0000000032a1b70f 0 0 2] 00000080:00200000:2.0:1788201595.074413:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d9673616 17ffffc0001001 3:0 ffff8bc1725b8a80 2 lru 00000080:00200000:2.0:1788201595.074419:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006567e054 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000000ce25486 00000000f3b37ce8 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.074421:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000da64c34b 00000080:00200000:2.0:1788201595.074422:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:2.0:1788201595.074424:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.074440:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:2.0:1788201595.074444:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003b2e3d08[3 00000000ff90811a 2 1 0000000032a1b70f 0 0 3] 00000080:00200000:2.0:1788201595.074447:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002f7a4fcf 17ffffc0001001 3:0 ffff8bc1725b8540 3 lru 00000080:00200000:2.0:1788201595.074453:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000044276537 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000000ce25486 00000000f3b37ce8 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.074455:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003b2e3d08 00000080:00200000:2.0:1788201595.074457:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:2.0:1788201595.074459:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.074476:0:24470:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:2.0:1788201595.074480:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f3e53dab[3 00000000ff90811a 2 1 0000000032a1b70f 0 0 4] 00000080:00200000:2.0:1788201595.074483:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c7a6674c 17ffffc0001001 3:0 ffff8bc1725b88c0 4 lru 00000080:00200000:2.0:1788201595.074488:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001ed42b88 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000000ce25486 00000000f3b37ce8 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.074490:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f3e53dab 00000080:00200000:2.0:1788201595.074491:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:2.0:1788201595.074493:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.074532:0:24470:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:2.0:1788201595.074537:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000250db9e8[3 00000000ff90811a 2 1 0000000032a1b70f 0 0 5] 00000080:00200000:2.0:1788201595.074540:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b3f98d6e 17ffffc0001001 3:0 ffff8bc149e940e0 5 lru 00000080:00200000:2.0:1788201595.074546:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000054b80f14 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000000ce25486 00000000f3b37ce8 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.074548:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000250db9e8 00000080:00200000:2.0:1788201595.074549:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:2.0:1788201595.074551:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.074568:0:24470:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:2.0:1788201595.074572:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000214dce4a[3 00000000ff90811a 2 1 0000000032a1b70f 0 0 6] 00000080:00200000:2.0:1788201595.074575:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005891410c 17ffffc0001001 3:0 ffff8bc149e949a0 6 lru 00000080:00200000:2.0:1788201595.074581:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000070b38e16 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000000ce25486 00000000f3b37ce8 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.074583:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000214dce4a 00000080:00200000:2.0:1788201595.074584:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:2.0:1788201595.074586:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.074604:0:24470:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:2.0:1788201595.074608:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e3f71af0[3 00000000ff90811a 2 1 0000000032a1b70f 0 0 7] 00000080:00200000:2.0:1788201595.074611:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000df9ed4c6 17ffffc0001001 3:0 ffff8bc149e94c40 7 lru 00000080:00200000:2.0:1788201595.074616:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005f4180a6 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000000ce25486 00000000f3b37ce8 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.074618:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e3f71af0 00000080:00200000:2.0:1788201595.074620:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:2.0:1788201595.074622:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.074639:0:24470:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:2.0:1788201595.074642:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ec06b672[3 00000000ff90811a 2 1 0000000032a1b70f 0 0 8] 00000080:00200000:2.0:1788201595.074645:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f6875b17 17ffffc0001001 3:0 ffff8bc149e94a80 8 lru 00000080:00200000:2.0:1788201595.074650:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d0773db6 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000000ce25486 00000000f3b37ce8 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.074652:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ec06b672 00000080:00200000:2.0:1788201595.074654:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:2.0:1788201595.074655:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.074672:0:24470:0:(rw26.c:898:ll_write_end()) pos 36864, len 4096, copied 4096 00000080:00200000:2.0:1788201595.074677:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000046554d8c[3 00000000ff90811a 2 1 0000000032a1b70f 0 0 9] 00000080:00200000:2.0:1788201595.074680:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004e8095c6 17ffffc0001001 3:0 ffff8bc149e94540 9 lru 00000080:00200000:2.0:1788201595.074685:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003b0c6f5f 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000000ce25486 00000000f3b37ce8 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.074687:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000046554d8c 00000080:00200000:2.0:1788201595.074688:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:2.0:1788201595.074690:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 10 of 0 to 1557 bytes 00000080:00200000:2.0:1788201595.074712:0:24470:0:(rw26.c:898:ll_write_end()) pos 40960, len 1557, copied 1557 00000080:00200000:2.0:1788201595.074717:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e908a722[3 00000000ff90811a 2 1 0000000032a1b70f 0 0 10] 00000080:00200000:2.0:1788201595.074720:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000008379c6c 17ffffc0001001 3:0 ffff8bc149e948c0 10 lru 00000080:00200000:2.0:1788201595.074727:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007df46ef5 10: 1< 0 - - > 2< 40960 0 0 0x0 0x0 | 000000000ce25486 00000000f3b37ce8 > 3< 0 0 > 4< 0 0 8 3407872 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.074729:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e908a722 00000080:00200000:2.0:1788201595.074730:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 11. 00000080:00200000:2.0:1788201595.074735:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 11, from 0, to 1557 prio 0 00000008:00010000:2.0:1788201595.074763:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 000000009abf31be ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1788201595.074845:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459b6db8, count 11, dirtied 11 00000080:00200000:2.0:1788201595.074853:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 11 pages 42517 bytes, tot: 42517 00000080:00200000:2.0:1788201595.074856:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) sanity-scrub.sh: write bytes 0, result: 42517 00000020:00010000:2.0:1788201595.074877:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c45d8 (ffff8bc148e3b5a8/0) at cl_lock_release():245 00000020:00010000:2.0:1788201595.074880:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c45d8 (ffff8bc148e3b5a8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.074884:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4f30 (ffff8bc148e3b878/1) at cl_lock_cancel():142 00010000:00010000:2.0:1788201595.074889:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.074899:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1788201595.074918:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c45d8 (ffff8bc148e3b5a8/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201595.074921:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4f30 (ffff8bc148e3b5a8/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201595.074932:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 42517 bytes 00000080:00200000:2.0:1788201595.074941:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 10] 00000080:00200000:2.0:1788201595.074978:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19e:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201595.074982:0:24470:0:(file.c:2238:ll_file_io_generic()) sanity-scrub.sh: 2 io complete with rc: 0, result: 42517, restart: 0 00000080:00200000:2.0:1788201595.074991:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x19e:0x0] updating i_size 42517 i_blocks 1 00000080:00200000:2.0:1788201595.074997:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 42517 00000080:00200008:2.0:1788201595.075054:0:24470:0:(file.c:479:ll_file_release()) START file sanity-scrub.sh:[0x200000bd7:0x19e:0x0](ffff8bc1459b6c08), flags 100001 00000002:00100000:2.0:1788201595.075122:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1727d5500 x1875064728020992/t8589937470(8589937470) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201611 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1788201595.075135:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1788201595.075142:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725f5f80 x1875064728021632/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1788201595.075169:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f5f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728021632:192.168.201.143@tcp:35:cp.0 00000100:00100000:2.0:1788201595.075253:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201595.079845:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728021376:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.080400:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f5f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728021632:192.168.201.143@tcp:35:cp.0 00000002:00100000:1.0:1788201595.080441:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1727d5500 x1875064728020992/t8589937470(8589937470) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201595.080608:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201595.080633:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.080658:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.080675:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.080684:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.080691:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201595.080695:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201595.080705:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201595.080710:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.080720:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.080740:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.080748:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201595.080755:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.080759:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-scrub.sh, flags=8 00000080:00200008:1.0:1788201595.080769:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-scrub.sh:[0x200000bd7:0x19e:0x0](ffff8bc1459b6c08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201595.080775:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x19e:0x0](ffff8bc1459b6c08),name=sanity-scrub.sh 00000002:00010000:1.0:1788201595.080787:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x19e:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.080935:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109828d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201595.080946:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109828d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201595.080952:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.080957:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x19e:0x0](ffff8bc1459b6c08) 00000080:00010000:1.0:1788201595.080959:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x19e:0x0](ffff8bc1459b6c08) for lock 0xd138388016f6f820 00000080:00010000:1.0:1788201595.080963:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f820 from it ffffadd1c7debcb8 00010000:00010000:1.0:1788201595.080966:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109828d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201595.080974:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109828d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1788201595.081029:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19e:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201595.081041:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x19e:0x0] 00000008:00010000:1.0:1788201595.081079:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201595.081084:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4130, osc lock ffff8bc145d09a20, flags 0x400001002 00010000:00010000:1.0:1788201595.081116:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201595.081136:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1788201595.081155:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201595.081160:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201595.081168:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1788201595.081180:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1788201595.081192:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x19e:0x0] updating i_size 42517 i_blocks 1 00000020:00010000:1.0:1788201595.081196:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e26060 (ffff8bc148e3b008/0) at cl_lock_release():245 00000020:00010000:1.0:1788201595.081199:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e26060 (ffff8bc148e3b008/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201595.081203:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4130 (ffff8bc148e3b488/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201595.081208:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e26060 (ffff8bc148e3b008/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201595.081211:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4130 (ffff8bc148e3b008/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201595.081245:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19e:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1788201595.081315:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201595.081323:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.081331:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.081352:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.081360:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.081365:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201595.081368:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201595.081372:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201595.081376:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.081383:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.081393:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.081398:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201595.081401:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.081418:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-sec.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:1.0:1788201595.081423:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-sec.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201595.081434:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-sec.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201595.081491:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f835 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.081500:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f835 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.081512:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f835 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201595.081617:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728021760:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201595.081740:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1455599c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.085072:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728021760:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201595.085105:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f835 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.085123:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f835 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.085145:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f835 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.085153:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f835 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.085165:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f835 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.085173:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17261e600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201595.085178:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f835 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.085187:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f835 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.085196:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f835 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.085205:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201595.085214:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f835 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.085222:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e600/0xd138388016f6f835 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201595.085247:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1727d6680 x1875064728021760/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201595.085265:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201595.085298:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201595.085406:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201595.085426:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.085438:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.085451:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.085459:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.085464:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201595.085469:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201595.085475:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:1.0:1788201595.085480:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.085490:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.085509:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.085517:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201595.085532:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.085548:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-sec.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:1.0:1788201595.085553:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-sec.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:1.0:1788201595.085569:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-sec.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:1.0:1788201595.085618:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f83c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.085626:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f83c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.085637:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f83c lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201595.085660:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728021888:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201595.085754:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1455599c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.089678:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728021888:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201595.089706:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f83c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.089723:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f83c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.089731:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f83c lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.089740:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f83c lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.089750:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f83c lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.089757:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17261f000 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:1.0:1788201595.089762:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f83c lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.089771:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f83c lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.089779:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f83c lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.089788:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201595.089828:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f83c lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.089836:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f000/0xd138388016f6f83c lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201595.089858:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1727d6680 x1875064728021888/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1788201595.089876:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201595.089908:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201595.090035:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201595.090051:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.090061:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.090073:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.090080:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.090085:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201595.090089:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201595.090106:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:1.0:1788201595.090110:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.090120:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.090147:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.090157:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201595.090164:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.090178:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.090184:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sanity-sec.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14304b200, open_flags 80c1, mode 81ed opened 0 00000080:00200000:1.0:1788201595.090193:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-sec.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:1.0:1788201595.090217:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-sec.sh,[0x200000bd7:0x19f:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201595.090278:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.090286:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201595.090299:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201595.090307:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d6680 x1875064728022144/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201595.090317:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201595.090352:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728022144:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201595.090514:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1455599c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.096360:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728022144:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201595.096398:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710982e8 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.096429:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710982e8 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.096440:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710982e8 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.096453:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710982e8 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.096466:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710982e8 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.096483:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710982e8 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.096492:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710982e8 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.096499:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710982e8 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201595.096513:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1727d6680 x1875064728022144/t8589937472(8589937472) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1788201595.096541:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1727d6680 x1875064728022144/t8589937472(8589937472) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201595.096556:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710982e8 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1788201595.096569:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710982e8 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.096582:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/415 (0 0) 00000080:00200000:1.0:1788201595.096590:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201595.096608:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=sanity-sec.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:1.0:1788201595.096648:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x19f:0x0](ffff8bc1459280c8) 00000080:00200000:1.0:1788201595.096829:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x19f:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1788201595.096842:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x19f:0x0](ffff8bc1459280c8) 00000080:00010000:1.0:1788201595.096845:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x19f:0x0](ffff8bc1459280c8) for lock 0xd138388016f6f843 00000080:00010000:1.0:1788201595.096857:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x19f:0x0](ffff8bc1459280c8) 00000080:00200008:1.0:1788201595.096874:0:24470:0:(file.c:1090:ll_file_open()) START file sanity-sec.sh:[0x200000bd7:0x19f:0x0](ffff8bc1459280c8), flags 100301 00000002:00100000:1.0:1788201595.096898:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1727d6680 x1875064728022144/t8589937472(8589937472) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1788201595.096948:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f843 from it ffff8bc1466cdba0 00010000:00010000:1.0:1788201595.096953:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710982e8 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.096963:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710982e8 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201595.096989:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x19f:0x0](ffff8bc1459280c8), inode mode 81ed mask 40 00000080:00200008:1.0:1788201595.097024:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-sec.sh:[0x200000bd7:0x19f:0x0](ffff8bc1459280c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1788201595.097031:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x19f:0x0](ffff8bc1459280c8),name=sanity-sec.sh 00000002:00010000:1.0:1788201595.097052:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x19f:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.097063:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710982e8 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201595.097081:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710982e8 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201595.097302:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.097310:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x19f:0x0](ffff8bc1459280c8) 00000080:00010000:1.0:1788201595.097314:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x19f:0x0](ffff8bc1459280c8) for lock 0xd138388016f6f843 00000080:00010000:1.0:1788201595.097318:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f843 from it ffffadd1c7debcd8 00010000:00010000:1.0:1788201595.097321:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710982e8 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201595.097329:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710982e8 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1788201595.097369:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19f:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1788201595.097380:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x19f:0x0] 00000008:00010000:1.0:1788201595.097410:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1788201595.097414:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4730, osc lock ffff8bc145d09a20, flags 0x400001002 00010000:00010000:1.0:1788201595.097468:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f84a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.097481:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f84a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201595.097629:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728022272:192.168.201.143@tcp:101:cp.0 00000020:00200000:1.0:1788201595.097782:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1788201595.103702:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f84a lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.103740:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f84a lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710982f6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.103759:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f84a lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710982f6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.103775:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f84a lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710982f6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1788201595.103916:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f84a lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710982f6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1788201595.103932:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:2.0:1788201595.103949:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f84a lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710982f6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.103959:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f84a lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710982f6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.103968:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f84a lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710982f6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.103979:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f84a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e21710982f6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1788201595.104004:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728022272:192.168.201.143@tcp:101:cp.0 00000080:00200000:1.0:1788201595.104086:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x19f:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201595.104103:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151e26060 (ffff8bc148e3b008/0) at cl_lock_release():245 00000020:00010000:1.0:1788201595.104107:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151e26060 (ffff8bc148e3b008/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201595.104114:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4730 (ffff8bc148e3b488/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201595.104119:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151e26060 (ffff8bc148e3b008/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201595.104122:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4730 (ffff8bc148e3b008/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201595.104175:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19f:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1788201595.104653:0:24470:0:(file.c:2638:do_file_write_iter()) START file sanity-sec.sh:[0x200000bd7:0x19f:0x0], ppos: 0, count: 429670 00000080:00200000:1.0:1788201595.104690:0:24470:0:(file.c:2090:ll_file_io_generic()) sanity-sec.sh: write ppos: 0, bytes: 429670 00000080:00200000:1.0:1788201595.104698:0:24470:0:(file.c:1848:ll_io_set_mirror()) sanity-sec.sh: desiginated mirror: 0 00000020:00200000:1.0:1788201595.104705:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@000000004f6128e0[0x110, 1, [0x200000bd7:0x19f:0x0] hash] 00000020:00200000:1.0:1788201595.104708:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 429670) 0 0 00000080:00200000:1.0:1788201595.104712:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19f:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201595.104727:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 104] 00020000:00200000:1.0:1788201595.104735:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 429670) 429670, 429670 00020000:00200000:1.0:1788201595.104739:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1788201595.104769:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 104] 00000008:00010000:1.0:1788201595.104783:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1788201595.104788:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1725d4730, osc lock ffff8bc145d09a20, flags 0x0 00010000:00010000:1.0:1788201595.104835:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/450 (0 430079) 00010000:00010000:1.0:1788201595.104905:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.104916:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->430079] (req 0->430079) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.104928:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->430079] (req 0->430079) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201595.104955:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728022400:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201595.105073:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145559780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201595.107919:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201595.108053:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743488512 00000100:00100000:1.0:1788201595.108066:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743488512 00000100:00100000:1.0:1788201595.108182:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 821 00000100:00100000:1.0:1788201595.108196:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17264b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23413:x1875064743488512:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201595.108220:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f84a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710982f6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201595.108307:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201595.108314:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17264b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23413:x1875064743488512:12345-192.168.201.143@tcp:104: Request processed in 123us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201595.108322:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 821 00010000:00010000:2.0:1788201595.109535:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201595.109548:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f84a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710982f6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.109561:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17261e600 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:2.0:1788201595.109569:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f84a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e21710982f6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201595.109634:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201595.109648:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:2.0:1788201595.109740:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f84a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710982f6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.109748:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201595.109788:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f84a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710982f6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.109811:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000892156c5/0xd138388016f6f84a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710982f6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.109835:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201595.109837:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201595.109839:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201595.109886:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201595.109911:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728022528:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.113907:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728022400:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201595.113951:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->430079] (req 0->430079) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.113969:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->430079] (req 0->430079) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.113979:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->430079] (req 0->430079) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201595.115327:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201595.115433:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743488640 00000100:00100000:1.0:1788201595.115446:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743488640 00000100:00100000:1.0:1788201595.115514:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 822 00000100:00100000:1.0:1788201595.115535:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17264b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21003:x1875064743488640:12345-192.168.201.143@tcp:105: 00010000:00010000:1.0:1788201595.115556:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->430079] (req 0->430079) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.115576:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->430079] (req 0->430079) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.115587:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.115600:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.115611:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.115624:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.115660:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc144020400) 00000100:00100000:1.0:1788201595.115740:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17264b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21003:x1875064743488640:12345-192.168.201.143@tcp:105: Request processed in 207us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201595.115750:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 822 00010000:00010000:2.0:1788201595.115852:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.115866:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.115889:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1788201595.115904:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.115918:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.115928:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1788201595.115966:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) sanity-sec.sh: write [0, 429670) append 0 append lockpos 0 00000080:00200000:2.0:1788201595.115988:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116052:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116066:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007276ef6b[3 000000003f8b7858 2 1 0000000021c92966 0 0 0] 00000080:00200000:2.0:1788201595.116070:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000094d5f337 17ffffc0001001 3:0 ffff8bc149e94e00 0 lru 00000080:00200000:2.0:1788201595.116078:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000042174778 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116081:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007276ef6b 00000080:00200000:2.0:1788201595.116082:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1788201595.116086:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116111:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116115:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000081adac34[3 000000003f8b7858 2 1 0000000021c92966 0 0 1] 00000080:00200000:2.0:1788201595.116117:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000071bdf233 17ffffc0001001 3:0 ffff8bc149e94ee0 1 lru 00000080:00200000:2.0:1788201595.116122:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ed81aacc 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116138:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000081adac34 00000080:00200000:2.0:1788201595.116140:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:2.0:1788201595.116142:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116158:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116163:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002ea6ce3b[3 000000003f8b7858 2 1 0000000021c92966 0 0 2] 00000080:00200000:2.0:1788201595.116166:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b435cf5c 17ffffc0001001 3:0 ffff8bc149e94620 2 lru 00000080:00200000:2.0:1788201595.116172:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008b72e7a4 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116174:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002ea6ce3b 00000080:00200000:2.0:1788201595.116176:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:2.0:1788201595.116177:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116191:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116195:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000044eab196[3 000000003f8b7858 2 1 0000000021c92966 0 0 3] 00000080:00200000:2.0:1788201595.116198:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000dec7eafc 17ffffc0001001 3:0 ffff8bc149e947e0 3 lru 00000080:00200000:2.0:1788201595.116203:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000db1585be 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116206:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000044eab196 00000080:00200000:2.0:1788201595.116207:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:2.0:1788201595.116209:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116232:0:24470:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116237:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000768faae0[3 000000003f8b7858 2 1 0000000021c92966 0 0 4] 00000080:00200000:2.0:1788201595.116240:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c9707813 17ffffc0001021 2:0 ffff8bc149e94700 4 lru 00000080:00200000:2.0:1788201595.116246:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001329d854 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116248:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000768faae0 00000080:00200000:2.0:1788201595.116249:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:2.0:1788201595.116252:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116267:0:24470:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116272:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000cbe95220[3 000000003f8b7858 2 1 0000000021c92966 0 0 5] 00000080:00200000:2.0:1788201595.116275:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ca93a085 17ffffc0001001 3:0 ffff8bc149e94b60 5 lru 00000080:00200000:2.0:1788201595.116281:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000fd77e970 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116283:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000cbe95220 00000080:00200000:2.0:1788201595.116284:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:2.0:1788201595.116286:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116300:0:24470:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116305:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e30a5056[3 000000003f8b7858 2 1 0000000021c92966 0 0 6] 00000080:00200000:2.0:1788201595.116308:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e62bd495 17ffffc0001001 3:0 ffff8bc149e942a0 6 lru 00000080:00200000:2.0:1788201595.116314:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a7d8971e 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116316:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e30a5056 00000080:00200000:2.0:1788201595.116317:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:2.0:1788201595.116319:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116331:0:24470:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116335:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007c740fe7[3 000000003f8b7858 2 1 0000000021c92966 0 0 7] 00000080:00200000:2.0:1788201595.116338:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004b7cd8b0 17ffffc0001001 3:0 ffff8bc149e94460 7 lru 00000080:00200000:2.0:1788201595.116356:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000bdef776d 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116359:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007c740fe7 00000080:00200000:2.0:1788201595.116360:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:2.0:1788201595.116362:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116379:0:24470:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116383:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001d75fb50[3 000000003f8b7858 2 1 0000000021c92966 0 0 8] 00000080:00200000:2.0:1788201595.116386:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d314f908 17ffffc0001001 3:0 ffff8bc149e94d20 8 lru 00000080:00200000:2.0:1788201595.116391:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009d222d42 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116394:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001d75fb50 00000080:00200000:2.0:1788201595.116395:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:2.0:1788201595.116397:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116411:0:24470:0:(rw26.c:898:ll_write_end()) pos 36864, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116415:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f882bb6d[3 000000003f8b7858 2 1 0000000021c92966 0 0 9] 00000080:00200000:2.0:1788201595.116417:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000acd9cb70 17ffffc0001001 3:0 ffff8bc149e94000 9 lru 00000080:00200000:2.0:1788201595.116423:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a0668c71 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116426:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f882bb6d 00000080:00200000:2.0:1788201595.116427:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:2.0:1788201595.116429:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 10 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116443:0:24470:0:(rw26.c:898:ll_write_end()) pos 40960, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116447:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000bd13c835[3 000000003f8b7858 2 1 0000000021c92966 0 0 10] 00000080:00200000:2.0:1788201595.116450:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006311b779 17ffffc0001001 3:0 ffff8bc149e94380 10 lru 00000080:00200000:2.0:1788201595.116455:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000881066b4 10: 1< 0 - - > 2< 40960 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116457:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000bd13c835 00000080:00200000:2.0:1788201595.116459:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 11. 00000080:00200000:2.0:1788201595.116460:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 11 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116473:0:24470:0:(rw26.c:898:ll_write_end()) pos 45056, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116477:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a2b6e843[3 000000003f8b7858 2 1 0000000021c92966 0 0 11] 00000080:00200000:2.0:1788201595.116480:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000bb35d5b9 17ffffc0001001 3:0 ffff8bc149e941c0 11 lru 00000080:00200000:2.0:1788201595.116484:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ac3c8352 11: 1< 0 - - > 2< 45056 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116487:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a2b6e843 00000080:00200000:2.0:1788201595.116488:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 12. 00000080:00200000:2.0:1788201595.116490:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 12 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116519:0:24470:0:(rw26.c:898:ll_write_end()) pos 49152, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116524:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000092b6081[3 000000003f8b7858 2 1 0000000021c92966 0 0 12] 00000080:00200000:2.0:1788201595.116527:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007a26423b 17ffffc0001001 3:0 ffff8bc166447460 12 lru 00000080:00200000:2.0:1788201595.116532:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000288b8f63 12: 1< 0 - - > 2< 49152 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116534:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000092b6081 00000080:00200000:2.0:1788201595.116536:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 13. 00000080:00200000:2.0:1788201595.116538:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 13 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116551:0:24470:0:(rw26.c:898:ll_write_end()) pos 53248, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116555:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000024cc7450[3 000000003f8b7858 2 1 0000000021c92966 0 0 13] 00000080:00200000:2.0:1788201595.116558:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005afc95e5 17ffffc0001001 3:0 ffff8bc166447d20 13 lru 00000080:00200000:2.0:1788201595.116563:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000bd9f2bdd 13: 1< 0 - - > 2< 53248 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116565:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000024cc7450 00000080:00200000:2.0:1788201595.116566:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 14. 00000080:00200000:2.0:1788201595.116569:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 14 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116582:0:24470:0:(rw26.c:898:ll_write_end()) pos 57344, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116587:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000054615b20[3 000000003f8b7858 2 1 0000000021c92966 0 0 14] 00000080:00200000:2.0:1788201595.116589:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f8ae21bc 17ffffc0001001 3:0 ffff8bc166447000 14 lru 00000080:00200000:2.0:1788201595.116595:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a43c2ef5 14: 1< 0 - - > 2< 57344 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116597:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000054615b20 00000080:00200000:2.0:1788201595.116598:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 15. 00000080:00200000:2.0:1788201595.116600:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 15 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116613:0:24470:0:(rw26.c:898:ll_write_end()) pos 61440, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116617:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000995a9b05[3 000000003f8b7858 2 1 0000000021c92966 0 0 15] 00000080:00200000:2.0:1788201595.116620:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003db54fa4 17ffffc0001001 3:0 ffff8bc166447380 15 lru 00000080:00200000:2.0:1788201595.116625:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000015e0b086 15: 1< 0 - - > 2< 61440 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116627:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000995a9b05 00000080:00200000:2.0:1788201595.116628:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 16. 00000080:00200000:2.0:1788201595.116630:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 16 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116643:0:24470:0:(rw26.c:898:ll_write_end()) pos 65536, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116647:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005a2e3d86[3 000000003f8b7858 2 1 0000000021c92966 0 0 16] 00000080:00200000:2.0:1788201595.116650:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000027c24d8d 17ffffc0001001 3:0 ffff8bc1664471c0 16 lru 00000080:00200000:2.0:1788201595.116655:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ba6caae1 16: 1< 0 - - > 2< 65536 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116658:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005a2e3d86 00000080:00200000:2.0:1788201595.116659:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 17. 00000080:00200000:2.0:1788201595.116661:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 17 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116673:0:24470:0:(rw26.c:898:ll_write_end()) pos 69632, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116678:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004cda7087[3 000000003f8b7858 2 1 0000000021c92966 0 0 17] 00000080:00200000:2.0:1788201595.116681:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001930a57f 17ffffc0001001 3:0 ffff8bc1664470e0 17 lru 00000080:00200000:2.0:1788201595.116686:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000297f52a3 17: 1< 0 - - > 2< 69632 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116688:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004cda7087 00000080:00200000:2.0:1788201595.116690:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 18. 00000080:00200000:2.0:1788201595.116691:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 18 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116704:0:24470:0:(rw26.c:898:ll_write_end()) pos 73728, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116708:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000dbde5228[3 000000003f8b7858 2 1 0000000021c92966 0 0 18] 00000080:00200000:2.0:1788201595.116711:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001ae2db46 17ffffc0001001 3:0 ffff8bc1664479a0 18 lru 00000080:00200000:2.0:1788201595.116717:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008665cb00 18: 1< 0 - - > 2< 73728 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116719:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000dbde5228 00000080:00200000:2.0:1788201595.116720:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 19. 00000080:00200000:2.0:1788201595.116723:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 19 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116741:0:24470:0:(rw26.c:898:ll_write_end()) pos 77824, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116746:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ec3efc63[3 000000003f8b7858 2 1 0000000021c92966 0 0 19] 00000080:00200000:2.0:1788201595.116749:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000675a4163 17ffffc0001021 2:0 ffff8bc166447c40 19 lru 00000080:00200000:2.0:1788201595.116754:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d9f75539 19: 1< 0 - - > 2< 77824 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116757:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ec3efc63 00000080:00200000:2.0:1788201595.116758:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 20. 00000080:00200000:2.0:1788201595.116760:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 20 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116773:0:24470:0:(rw26.c:898:ll_write_end()) pos 81920, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116778:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d6ef7404[3 000000003f8b7858 2 1 0000000021c92966 0 0 20] 00000080:00200000:2.0:1788201595.116781:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000069f9023b 17ffffc0001001 3:0 ffff8bc166447a80 20 lru 00000080:00200000:2.0:1788201595.116786:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001e5901a7 20: 1< 0 - - > 2< 81920 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116788:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d6ef7404 00000080:00200000:2.0:1788201595.116831:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 21. 00000080:00200000:2.0:1788201595.116834:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 21 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116850:0:24470:0:(rw26.c:898:ll_write_end()) pos 86016, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116854:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004481f9ae[3 000000003f8b7858 2 1 0000000021c92966 0 0 21] 00000080:00200000:2.0:1788201595.116857:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000027b41bdd 17ffffc0001001 3:0 ffff8bc166447540 21 lru 00000080:00200000:2.0:1788201595.116863:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008b3b4ec6 21: 1< 0 - - > 2< 86016 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116866:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004481f9ae 00000080:00200000:2.0:1788201595.116867:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 22. 00000080:00200000:2.0:1788201595.116869:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 22 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116885:0:24470:0:(rw26.c:898:ll_write_end()) pos 90112, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116889:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001c61492b[3 000000003f8b7858 2 1 0000000021c92966 0 0 22] 00000080:00200000:2.0:1788201595.116892:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003cc96e8e 17ffffc0001001 3:0 ffff8bc1664478c0 22 lru 00000080:00200000:2.0:1788201595.116898:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000077198cf0 22: 1< 0 - - > 2< 90112 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116901:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001c61492b 00000080:00200000:2.0:1788201595.116902:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 23. 00000080:00200000:2.0:1788201595.116904:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 23 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116918:0:24470:0:(rw26.c:898:ll_write_end()) pos 94208, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116922:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e62af133[3 000000003f8b7858 2 1 0000000021c92966 0 0 23] 00000080:00200000:2.0:1788201595.116925:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000805e594c 17ffffc0001001 3:0 ffff8bc166447e00 23 lru 00000080:00200000:2.0:1788201595.116930:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d42125bc 23: 1< 0 - - > 2< 94208 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116932:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e62af133 00000080:00200000:2.0:1788201595.116933:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 24. 00000080:00200000:2.0:1788201595.116935:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 24 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116949:0:24470:0:(rw26.c:898:ll_write_end()) pos 98304, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116953:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000090bee092[3 000000003f8b7858 2 1 0000000021c92966 0 0 24] 00000080:00200000:2.0:1788201595.116955:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000091d81602 17ffffc0001001 3:0 ffff8bc166447ee0 24 lru 00000080:00200000:2.0:1788201595.116960:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e4336897 24: 1< 0 - - > 2< 98304 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116962:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000090bee092 00000080:00200000:2.0:1788201595.116963:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 25. 00000080:00200000:2.0:1788201595.116965:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 25 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.116978:0:24470:0:(rw26.c:898:ll_write_end()) pos 102400, len 4096, copied 4096 00000080:00200000:2.0:1788201595.116981:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000020c4924a[3 000000003f8b7858 2 1 0000000021c92966 0 0 25] 00000080:00200000:2.0:1788201595.116984:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004a4ba346 17ffffc0001001 3:0 ffff8bc166447620 25 lru 00000080:00200000:2.0:1788201595.116989:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f88f7eb9 25: 1< 0 - - > 2< 102400 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.116991:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000020c4924a 00000080:00200000:2.0:1788201595.116992:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 26. 00000080:00200000:2.0:1788201595.116993:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 26 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117008:0:24470:0:(rw26.c:898:ll_write_end()) pos 106496, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117012:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009003bc70[3 000000003f8b7858 2 1 0000000021c92966 0 0 26] 00000080:00200000:2.0:1788201595.117015:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005b869938 17ffffc0001001 3:0 ffff8bc1664477e0 26 lru 00000080:00200000:2.0:1788201595.117020:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005b5cfb55 26: 1< 0 - - > 2< 106496 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117022:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009003bc70 00000080:00200000:2.0:1788201595.117023:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 27. 00000080:00200000:2.0:1788201595.117025:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 27 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117038:0:24470:0:(rw26.c:898:ll_write_end()) pos 110592, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117042:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002d0b346a[3 000000003f8b7858 2 1 0000000021c92966 0 0 27] 00000080:00200000:2.0:1788201595.117044:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000001b612e7 17ffffc0001001 3:0 ffff8bc166447700 27 lru 00000080:00200000:2.0:1788201595.117050:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007950e17c 27: 1< 0 - - > 2< 110592 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117052:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002d0b346a 00000080:00200000:2.0:1788201595.117053:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 28. 00000080:00200000:2.0:1788201595.117055:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 28 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117069:0:24470:0:(rw26.c:898:ll_write_end()) pos 114688, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117073:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001fdc8f03[3 000000003f8b7858 2 1 0000000021c92966 0 0 28] 00000080:00200000:2.0:1788201595.117076:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e2454186 17ffffc0001001 3:0 ffff8bc166447b60 28 lru 00000080:00200000:2.0:1788201595.117081:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000fd0bbe02 28: 1< 0 - - > 2< 114688 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117083:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001fdc8f03 00000080:00200000:2.0:1788201595.117085:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 29. 00000080:00200000:2.0:1788201595.117087:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 29 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117118:0:24470:0:(rw26.c:898:ll_write_end()) pos 118784, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117122:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005a0fc802[3 000000003f8b7858 2 1 0000000021c92966 0 0 29] 00000080:00200000:2.0:1788201595.117125:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000023856d76 17ffffc0001001 3:0 ffff8bc1664472a0 29 lru 00000080:00200000:2.0:1788201595.117130:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c9cfa48f 29: 1< 0 - - > 2< 118784 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117132:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005a0fc802 00000080:00200000:2.0:1788201595.117133:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 30. 00000080:00200000:2.0:1788201595.117135:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 30 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117158:0:24470:0:(rw26.c:898:ll_write_end()) pos 122880, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117163:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000082124a81[3 000000003f8b7858 2 1 0000000021c92966 0 0 30] 00000080:00200000:2.0:1788201595.117167:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f753cf73 17ffffc0001001 3:0 ffff8bc146d34000 30 lru 00000080:00200000:2.0:1788201595.117172:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b618da3e 30: 1< 0 - - > 2< 122880 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117174:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000082124a81 00000080:00200000:2.0:1788201595.117175:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 31. 00000080:00200000:2.0:1788201595.117177:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 31 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117193:0:24470:0:(rw26.c:898:ll_write_end()) pos 126976, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117197:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c96299e8[3 000000003f8b7858 2 1 0000000021c92966 0 0 31] 00000080:00200000:2.0:1788201595.117200:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c5e2ee5b 17ffffc0001001 3:0 ffff8bc146d34380 31 lru 00000080:00200000:2.0:1788201595.117205:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d7c94e0b 31: 1< 0 - - > 2< 126976 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117208:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c96299e8 00000080:00200000:2.0:1788201595.117209:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 32. 00000080:00200000:2.0:1788201595.117211:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 32 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117223:0:24470:0:(rw26.c:898:ll_write_end()) pos 131072, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117228:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000090385016[3 000000003f8b7858 2 1 0000000021c92966 0 0 32] 00000080:00200000:2.0:1788201595.117231:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000411543ca 17ffffc0001001 3:0 ffff8bc146d341c0 32 lru 00000080:00200000:2.0:1788201595.117236:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d60b76fa 32: 1< 0 - - > 2< 131072 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117238:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000090385016 00000080:00200000:2.0:1788201595.117240:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 33. 00000080:00200000:2.0:1788201595.117242:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 33 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117258:0:24470:0:(rw26.c:898:ll_write_end()) pos 135168, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117262:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d1258f41[3 000000003f8b7858 2 1 0000000021c92966 0 0 33] 00000080:00200000:2.0:1788201595.117266:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003e545a9e 17ffffc0001001 3:0 ffff8bc146d340e0 33 lru 00000080:00200000:2.0:1788201595.117271:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c8b67bd0 33: 1< 0 - - > 2< 135168 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117274:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d1258f41 00000080:00200000:2.0:1788201595.117275:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 34. 00000080:00200000:2.0:1788201595.117277:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 34 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117297:0:24470:0:(rw26.c:898:ll_write_end()) pos 139264, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117301:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001846ce72[3 000000003f8b7858 2 1 0000000021c92966 0 0 34] 00000080:00200000:2.0:1788201595.117304:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c27f034c 17ffffc0001021 2:0 ffff8bc146d349a0 34 lru 00000080:00200000:2.0:1788201595.117309:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000fd602ed 34: 1< 0 - - > 2< 139264 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117311:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001846ce72 00000080:00200000:2.0:1788201595.117313:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 35. 00000080:00200000:2.0:1788201595.117315:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 35 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117329:0:24470:0:(rw26.c:898:ll_write_end()) pos 143360, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117334:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d801ba73[3 000000003f8b7858 2 1 0000000021c92966 0 0 35] 00000080:00200000:2.0:1788201595.117337:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000920b5c02 17ffffc0001001 3:0 ffff8bc146d34c40 35 lru 00000080:00200000:2.0:1788201595.117353:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001d605ea3 35: 1< 0 - - > 2< 143360 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117356:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d801ba73 00000080:00200000:2.0:1788201595.117358:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 36. 00000080:00200000:2.0:1788201595.117360:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 36 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117375:0:24470:0:(rw26.c:898:ll_write_end()) pos 147456, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117379:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004c053c52[3 000000003f8b7858 2 1 0000000021c92966 0 0 36] 00000080:00200000:2.0:1788201595.117383:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d52ea973 17ffffc0001001 3:0 ffff8bc146d34a80 36 lru 00000080:00200000:2.0:1788201595.117389:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007b38b66a 36: 1< 0 - - > 2< 147456 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117391:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004c053c52 00000080:00200000:2.0:1788201595.117393:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 37. 00000080:00200000:2.0:1788201595.117395:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 37 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117409:0:24470:0:(rw26.c:898:ll_write_end()) pos 151552, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117414:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000088ecdb79[3 000000003f8b7858 2 1 0000000021c92966 0 0 37] 00000080:00200000:2.0:1788201595.117417:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000468efae4 17ffffc0001001 3:0 ffff8bc146d34540 37 lru 00000080:00200000:2.0:1788201595.117425:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000735ee451 37: 1< 0 - - > 2< 151552 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117427:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000088ecdb79 00000080:00200000:2.0:1788201595.117429:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 38. 00000080:00200000:2.0:1788201595.117431:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 38 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117445:0:24470:0:(rw26.c:898:ll_write_end()) pos 155648, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117449:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a4c0c594[3 000000003f8b7858 2 1 0000000021c92966 0 0 38] 00000080:00200000:2.0:1788201595.117452:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000005ac8565 17ffffc0001001 3:0 ffff8bc146d348c0 38 lru 00000080:00200000:2.0:1788201595.117458:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000fc03d38a 38: 1< 0 - - > 2< 155648 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117460:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a4c0c594 00000080:00200000:2.0:1788201595.117461:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 39. 00000080:00200000:2.0:1788201595.117463:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 39 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117477:0:24470:0:(rw26.c:898:ll_write_end()) pos 159744, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117481:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009ab306f4[3 000000003f8b7858 2 1 0000000021c92966 0 0 39] 00000080:00200000:2.0:1788201595.117484:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f5c258ab 17ffffc0001001 3:0 ffff8bc146d34e00 39 lru 00000080:00200000:2.0:1788201595.117490:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000fafd994e 39: 1< 0 - - > 2< 159744 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117492:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009ab306f4 00000080:00200000:2.0:1788201595.117493:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 40. 00000080:00200000:2.0:1788201595.117495:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 40 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117511:0:24470:0:(rw26.c:898:ll_write_end()) pos 163840, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117515:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000870bf190[3 000000003f8b7858 2 1 0000000021c92966 0 0 40] 00000080:00200000:2.0:1788201595.117518:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b4ea9f77 17ffffc0001001 3:0 ffff8bc146d34ee0 40 lru 00000080:00200000:2.0:1788201595.117523:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d798cc74 40: 1< 0 - - > 2< 163840 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117526:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000870bf190 00000080:00200000:2.0:1788201595.117527:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 41. 00000080:00200000:2.0:1788201595.117529:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 41 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117543:0:24470:0:(rw26.c:898:ll_write_end()) pos 167936, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117547:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b174b22d[3 000000003f8b7858 2 1 0000000021c92966 0 0 41] 00000080:00200000:2.0:1788201595.117551:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b7fe831c 17ffffc0001001 3:0 ffff8bc146d34620 41 lru 00000080:00200000:2.0:1788201595.117556:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000426051ec 41: 1< 0 - - > 2< 167936 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117558:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b174b22d 00000080:00200000:2.0:1788201595.117559:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 42. 00000080:00200000:2.0:1788201595.117561:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 42 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117574:0:24470:0:(rw26.c:898:ll_write_end()) pos 172032, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117579:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d0d77a2d[3 000000003f8b7858 2 1 0000000021c92966 0 0 42] 00000080:00200000:2.0:1788201595.117582:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000014979c03 17ffffc0001001 3:0 ffff8bc146d347e0 42 lru 00000080:00200000:2.0:1788201595.117587:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b4861270 42: 1< 0 - - > 2< 172032 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117589:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d0d77a2d 00000080:00200000:2.0:1788201595.117590:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 43. 00000080:00200000:2.0:1788201595.117592:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 43 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117605:0:24470:0:(rw26.c:898:ll_write_end()) pos 176128, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117610:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000081ace4fa[3 000000003f8b7858 2 1 0000000021c92966 0 0 43] 00000080:00200000:2.0:1788201595.117613:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d4253519 17ffffc0001001 3:0 ffff8bc146d34700 43 lru 00000080:00200000:2.0:1788201595.117619:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000012318ddf 43: 1< 0 - - > 2< 176128 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117621:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000081ace4fa 00000080:00200000:2.0:1788201595.117622:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 44. 00000080:00200000:2.0:1788201595.117624:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 44 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117637:0:24470:0:(rw26.c:898:ll_write_end()) pos 180224, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117641:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000833ca3d7[3 000000003f8b7858 2 1 0000000021c92966 0 0 44] 00000080:00200000:2.0:1788201595.117644:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000041f871c6 17ffffc0001001 3:0 ffff8bc146d34b60 44 lru 00000080:00200000:2.0:1788201595.117650:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003877159c 44: 1< 0 - - > 2< 180224 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117652:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000833ca3d7 00000080:00200000:2.0:1788201595.117654:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 45. 00000080:00200000:2.0:1788201595.117656:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 45 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117667:0:24470:0:(rw26.c:898:ll_write_end()) pos 184320, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117672:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000087636226[3 000000003f8b7858 2 1 0000000021c92966 0 0 45] 00000080:00200000:2.0:1788201595.117675:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000371eed99 17ffffc0001001 3:0 ffff8bc146d342a0 45 lru 00000080:00200000:2.0:1788201595.117681:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f651c280 45: 1< 0 - - > 2< 184320 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117683:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000087636226 00000080:00200000:2.0:1788201595.117684:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 46. 00000080:00200000:2.0:1788201595.117686:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 46 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117699:0:24470:0:(rw26.c:898:ll_write_end()) pos 188416, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117702:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000084e4a2e0[3 000000003f8b7858 2 1 0000000021c92966 0 0 46] 00000080:00200000:2.0:1788201595.117706:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000802d1866 17ffffc0001001 3:0 ffff8bc146d34460 46 lru 00000080:00200000:2.0:1788201595.117711:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009abc59a4 46: 1< 0 - - > 2< 188416 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117714:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000084e4a2e0 00000080:00200000:2.0:1788201595.117715:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 47. 00000080:00200000:2.0:1788201595.117717:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 47 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117731:0:24470:0:(rw26.c:898:ll_write_end()) pos 192512, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117735:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f224c0a0[3 000000003f8b7858 2 1 0000000021c92966 0 0 47] 00000080:00200000:2.0:1788201595.117739:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b57ffe2d 17ffffc0001001 3:0 ffff8bc146d34d20 47 lru 00000080:00200000:2.0:1788201595.117744:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000bbd8df0f 47: 1< 0 - - > 2< 192512 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117747:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f224c0a0 00000080:00200000:2.0:1788201595.117748:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 48. 00000080:00200000:2.0:1788201595.117749:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 48 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117770:0:24470:0:(rw26.c:898:ll_write_end()) pos 196608, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117774:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ad0713fc[3 000000003f8b7858 2 1 0000000021c92966 0 0 48] 00000080:00200000:2.0:1788201595.117777:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b3fd99e6 17ffffc0001001 3:0 ffff8bc172785000 48 lru 00000080:00200000:2.0:1788201595.117783:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c7e00894 48: 1< 0 - - > 2< 196608 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117785:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ad0713fc 00000080:00200000:2.0:1788201595.117786:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 49. 00000080:00200000:2.0:1788201595.117788:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 49 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117842:0:24470:0:(rw26.c:898:ll_write_end()) pos 200704, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117846:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000388e7435[3 000000003f8b7858 2 1 0000000021c92966 0 0 49] 00000080:00200000:2.0:1788201595.117849:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d5610c1b 17ffffc0001021 2:0 ffff8bc172785380 49 lru 00000080:00200000:2.0:1788201595.117855:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c706e77b 49: 1< 0 - - > 2< 200704 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117857:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000388e7435 00000080:00200000:2.0:1788201595.117859:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 50. 00000080:00200000:2.0:1788201595.117861:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 50 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117876:0:24470:0:(rw26.c:898:ll_write_end()) pos 204800, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117881:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000aacb7a41[3 000000003f8b7858 2 1 0000000021c92966 0 0 50] 00000080:00200000:2.0:1788201595.117884:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004ccee8d6 17ffffc0001001 3:0 ffff8bc1727851c0 50 lru 00000080:00200000:2.0:1788201595.117890:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000027cc0da1 50: 1< 0 - - > 2< 204800 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117892:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000aacb7a41 00000080:00200000:2.0:1788201595.117893:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 51. 00000080:00200000:2.0:1788201595.117895:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 51 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117907:0:24470:0:(rw26.c:898:ll_write_end()) pos 208896, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117911:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f79d3cdc[3 000000003f8b7858 2 1 0000000021c92966 0 0 51] 00000080:00200000:2.0:1788201595.117914:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e1cfe543 17ffffc0001001 3:0 ffff8bc1727850e0 51 lru 00000080:00200000:2.0:1788201595.117920:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007d847d75 51: 1< 0 - - > 2< 208896 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117922:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f79d3cdc 00000080:00200000:2.0:1788201595.117923:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 52. 00000080:00200000:2.0:1788201595.117925:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 52 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117942:0:24470:0:(rw26.c:898:ll_write_end()) pos 212992, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117946:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000af128e98[3 000000003f8b7858 2 1 0000000021c92966 0 0 52] 00000080:00200000:2.0:1788201595.117950:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000045a6693f 17ffffc0001001 3:0 ffff8bc1727859a0 52 lru 00000080:00200000:2.0:1788201595.117956:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005a498e86 52: 1< 0 - - > 2< 212992 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117958:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000af128e98 00000080:00200000:2.0:1788201595.117959:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 53. 00000080:00200000:2.0:1788201595.117961:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 53 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.117973:0:24470:0:(rw26.c:898:ll_write_end()) pos 217088, len 4096, copied 4096 00000080:00200000:2.0:1788201595.117977:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000062760eb6[3 000000003f8b7858 2 1 0000000021c92966 0 0 53] 00000080:00200000:2.0:1788201595.117980:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ba53d3d4 17ffffc0001001 3:0 ffff8bc172785c40 53 lru 00000080:00200000:2.0:1788201595.117985:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005897a96a 53: 1< 0 - - > 2< 217088 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.117987:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000062760eb6 00000080:00200000:2.0:1788201595.117989:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 54. 00000080:00200000:2.0:1788201595.117990:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 54 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118005:0:24470:0:(rw26.c:898:ll_write_end()) pos 221184, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118009:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b137d253[3 000000003f8b7858 2 1 0000000021c92966 0 0 54] 00000080:00200000:2.0:1788201595.118013:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000fa5cffe5 17ffffc0001001 3:0 ffff8bc172785a80 54 lru 00000080:00200000:2.0:1788201595.118019:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001c08303d 54: 1< 0 - - > 2< 221184 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118021:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b137d253 00000080:00200000:2.0:1788201595.118022:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 55. 00000080:00200000:2.0:1788201595.118024:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 55 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118036:0:24470:0:(rw26.c:898:ll_write_end()) pos 225280, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118041:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009f61a909[3 000000003f8b7858 2 1 0000000021c92966 0 0 55] 00000080:00200000:2.0:1788201595.118044:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000343edd45 17ffffc0001001 3:0 ffff8bc172785540 55 lru 00000080:00200000:2.0:1788201595.118050:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000db3b3791 55: 1< 0 - - > 2< 225280 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118052:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009f61a909 00000080:00200000:2.0:1788201595.118053:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 56. 00000080:00200000:2.0:1788201595.118055:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 56 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118067:0:24470:0:(rw26.c:898:ll_write_end()) pos 229376, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118071:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000414a2eae[3 000000003f8b7858 2 1 0000000021c92966 0 0 56] 00000080:00200000:2.0:1788201595.118074:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000844c4c30 17ffffc0001001 3:0 ffff8bc1727858c0 56 lru 00000080:00200000:2.0:1788201595.118080:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000054380844 56: 1< 0 - - > 2< 229376 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118082:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000414a2eae 00000080:00200000:2.0:1788201595.118083:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 57. 00000080:00200000:2.0:1788201595.118084:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 57 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118096:0:24470:0:(rw26.c:898:ll_write_end()) pos 233472, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118101:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000004aa49ce[3 000000003f8b7858 2 1 0000000021c92966 0 0 57] 00000080:00200000:2.0:1788201595.118103:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ff6105f5 17ffffc0001001 3:0 ffff8bc172785e00 57 lru 00000080:00200000:2.0:1788201595.118109:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c91893b5 57: 1< 0 - - > 2< 233472 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118111:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000004aa49ce 00000080:00200000:2.0:1788201595.118113:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 58. 00000080:00200000:2.0:1788201595.118114:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 58 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118127:0:24470:0:(rw26.c:898:ll_write_end()) pos 237568, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118131:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002fb11064[3 000000003f8b7858 2 1 0000000021c92966 0 0 58] 00000080:00200000:2.0:1788201595.118134:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000077d0d407 17ffffc0001001 3:0 ffff8bc172785ee0 58 lru 00000080:00200000:2.0:1788201595.118139:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000032b60640 58: 1< 0 - - > 2< 237568 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118141:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002fb11064 00000080:00200000:2.0:1788201595.118143:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 59. 00000080:00200000:2.0:1788201595.118145:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 59 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118157:0:24470:0:(rw26.c:898:ll_write_end()) pos 241664, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118161:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000080d3cf77[3 000000003f8b7858 2 1 0000000021c92966 0 0 59] 00000080:00200000:2.0:1788201595.118164:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e36a5109 17ffffc0001001 3:0 ffff8bc172785620 59 lru 00000080:00200000:2.0:1788201595.118169:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c90f0f2c 59: 1< 0 - - > 2< 241664 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118172:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000080d3cf77 00000080:00200000:2.0:1788201595.118173:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 60. 00000080:00200000:2.0:1788201595.118175:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 60 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118187:0:24470:0:(rw26.c:898:ll_write_end()) pos 245760, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118191:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000405d5cb7[3 000000003f8b7858 2 1 0000000021c92966 0 0 60] 00000080:00200000:2.0:1788201595.118195:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000011f38130 17ffffc0001001 3:0 ffff8bc1727857e0 60 lru 00000080:00200000:2.0:1788201595.118201:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a101c826 60: 1< 0 - - > 2< 245760 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118203:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000405d5cb7 00000080:00200000:2.0:1788201595.118204:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 61. 00000080:00200000:2.0:1788201595.118206:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 61 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118219:0:24470:0:(rw26.c:898:ll_write_end()) pos 249856, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118223:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001f6c1360[3 000000003f8b7858 2 1 0000000021c92966 0 0 61] 00000080:00200000:2.0:1788201595.118226:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ad01694a 17ffffc0001001 3:0 ffff8bc172785700 61 lru 00000080:00200000:2.0:1788201595.118231:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000050586171 61: 1< 0 - - > 2< 249856 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118233:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001f6c1360 00000080:00200000:2.0:1788201595.118235:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 62. 00000080:00200000:2.0:1788201595.118236:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 62 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118250:0:24470:0:(rw26.c:898:ll_write_end()) pos 253952, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118254:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002a591d78[3 000000003f8b7858 2 1 0000000021c92966 0 0 62] 00000080:00200000:2.0:1788201595.118257:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000019dda51 17ffffc0001001 3:0 ffff8bc172785b60 62 lru 00000080:00200000:2.0:1788201595.118262:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000fbdd0329 62: 1< 0 - - > 2< 253952 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118264:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002a591d78 00000080:00200000:2.0:1788201595.118265:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 63. 00000080:00200000:2.0:1788201595.118266:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 63 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118280:0:24470:0:(rw26.c:898:ll_write_end()) pos 258048, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118284:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c592a6a2[3 000000003f8b7858 2 1 0000000021c92966 0 0 63] 00000080:00200000:2.0:1788201595.118288:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000cbfb0ad 17ffffc0001001 3:0 ffff8bc1727852a0 63 lru 00000080:00200000:2.0:1788201595.118293:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000012226082 63: 1< 0 - - > 2< 258048 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118295:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c592a6a2 00000080:00200000:2.0:1788201595.118296:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 64. 00000080:00200000:2.0:1788201595.118298:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 64 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118330:0:24470:0:(rw26.c:898:ll_write_end()) pos 262144, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118334:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000c405730[3 000000003f8b7858 2 1 0000000021c92966 0 0 64] 00000080:00200000:2.0:1788201595.118337:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c21f21fe 17ffffc0001021 2:0 ffff8bc172785460 64 lru 00000080:00200000:2.0:1788201595.118355:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ebbd31df 64: 1< 0 - - > 2< 262144 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118357:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000c405730 00000080:00200000:2.0:1788201595.118358:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 65. 00000080:00200000:2.0:1788201595.118360:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 65 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118376:0:24470:0:(rw26.c:898:ll_write_end()) pos 266240, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118381:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005fb41811[3 000000003f8b7858 2 1 0000000021c92966 0 0 65] 00000080:00200000:2.0:1788201595.118384:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000084448394 17ffffc0001001 3:0 ffff8bc172785d20 65 lru 00000080:00200000:2.0:1788201595.118389:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ba8a423f 65: 1< 0 - - > 2< 266240 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118391:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005fb41811 00000080:00200000:2.0:1788201595.118393:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 66. 00000080:00200000:2.0:1788201595.118394:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 66 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118421:0:24470:0:(rw26.c:898:ll_write_end()) pos 270336, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118426:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007a28baf3[3 000000003f8b7858 2 1 0000000021c92966 0 0 66] 00000080:00200000:2.0:1788201595.118429:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000049f1bcca 17ffffc0001001 3:0 ffff8bc143454000 66 lru 00000080:00200000:2.0:1788201595.118434:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000509ae787 66: 1< 0 - - > 2< 270336 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118437:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007a28baf3 00000080:00200000:2.0:1788201595.118438:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 67. 00000080:00200000:2.0:1788201595.118440:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 67 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118455:0:24470:0:(rw26.c:898:ll_write_end()) pos 274432, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118460:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000564f4c9d[3 000000003f8b7858 2 1 0000000021c92966 0 0 67] 00000080:00200000:2.0:1788201595.118463:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b6216ad6 17ffffc0001001 3:0 ffff8bc143454380 67 lru 00000080:00200000:2.0:1788201595.118468:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b9490294 67: 1< 0 - - > 2< 274432 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118470:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000564f4c9d 00000080:00200000:2.0:1788201595.118471:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 68. 00000080:00200000:2.0:1788201595.118472:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 68 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118489:0:24470:0:(rw26.c:898:ll_write_end()) pos 278528, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118494:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000000cd18bc[3 000000003f8b7858 2 1 0000000021c92966 0 0 68] 00000080:00200000:2.0:1788201595.118497:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006c426ecc 17ffffc0001001 3:0 ffff8bc1434541c0 68 lru 00000080:00200000:2.0:1788201595.118502:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f6020570 68: 1< 0 - - > 2< 278528 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118504:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000000cd18bc 00000080:00200000:2.0:1788201595.118505:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 69. 00000080:00200000:2.0:1788201595.118506:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 69 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118524:0:24470:0:(rw26.c:898:ll_write_end()) pos 282624, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118529:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a22cf3ea[3 000000003f8b7858 2 1 0000000021c92966 0 0 69] 00000080:00200000:2.0:1788201595.118532:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d129dd9f 17ffffc0001001 3:0 ffff8bc1434540e0 69 lru 00000080:00200000:2.0:1788201595.118537:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a2387c50 69: 1< 0 - - > 2< 282624 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118539:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a22cf3ea 00000080:00200000:2.0:1788201595.118540:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 70. 00000080:00200000:2.0:1788201595.118542:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 70 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118556:0:24470:0:(rw26.c:898:ll_write_end()) pos 286720, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118560:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000c359398[3 000000003f8b7858 2 1 0000000021c92966 0 0 70] 00000080:00200000:2.0:1788201595.118563:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b81dbc73 17ffffc0001001 3:0 ffff8bc1434549a0 70 lru 00000080:00200000:2.0:1788201595.118568:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000dc1f760d 70: 1< 0 - - > 2< 286720 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118571:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000c359398 00000080:00200000:2.0:1788201595.118572:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 71. 00000080:00200000:2.0:1788201595.118574:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 71 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118589:0:24470:0:(rw26.c:898:ll_write_end()) pos 290816, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118594:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e2714a6f[3 000000003f8b7858 2 1 0000000021c92966 0 0 71] 00000080:00200000:2.0:1788201595.118597:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006fc45386 17ffffc0001001 3:0 ffff8bc143454c40 71 lru 00000080:00200000:2.0:1788201595.118605:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000504732e7 71: 1< 0 - - > 2< 290816 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118607:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e2714a6f 00000080:00200000:2.0:1788201595.118608:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 72. 00000080:00200000:2.0:1788201595.118610:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 72 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118624:0:24470:0:(rw26.c:898:ll_write_end()) pos 294912, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118627:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f5c28289[3 000000003f8b7858 2 1 0000000021c92966 0 0 72] 00000080:00200000:2.0:1788201595.118631:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000045dab9d0 17ffffc0001001 3:0 ffff8bc143454a80 72 lru 00000080:00200000:2.0:1788201595.118635:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000008aa6ec4 72: 1< 0 - - > 2< 294912 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118637:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f5c28289 00000080:00200000:2.0:1788201595.118638:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 73. 00000080:00200000:2.0:1788201595.118640:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 73 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118653:0:24470:0:(rw26.c:898:ll_write_end()) pos 299008, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118657:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000136e1a4[3 000000003f8b7858 2 1 0000000021c92966 0 0 73] 00000080:00200000:2.0:1788201595.118660:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000028769bb2 17ffffc0001001 3:0 ffff8bc143454540 73 lru 00000080:00200000:2.0:1788201595.118664:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004d315eb1 73: 1< 0 - - > 2< 299008 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118666:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000136e1a4 00000080:00200000:2.0:1788201595.118667:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 74. 00000080:00200000:2.0:1788201595.118669:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 74 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118682:0:24470:0:(rw26.c:898:ll_write_end()) pos 303104, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118686:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b2f78d68[3 000000003f8b7858 2 1 0000000021c92966 0 0 74] 00000080:00200000:2.0:1788201595.118689:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000e89e12c 17ffffc0001001 3:0 ffff8bc1434548c0 74 lru 00000080:00200000:2.0:1788201595.118694:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ec76d36d 74: 1< 0 - - > 2< 303104 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118697:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b2f78d68 00000080:00200000:2.0:1788201595.118698:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 75. 00000080:00200000:2.0:1788201595.118699:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 75 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118716:0:24470:0:(rw26.c:898:ll_write_end()) pos 307200, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118721:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000924d1673[3 000000003f8b7858 2 1 0000000021c92966 0 0 75] 00000080:00200000:2.0:1788201595.118724:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000043ff4c05 17ffffc0001001 3:0 ffff8bc143454e00 75 lru 00000080:00200000:2.0:1788201595.118729:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008ff1c604 75: 1< 0 - - > 2< 307200 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118731:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000924d1673 00000080:00200000:2.0:1788201595.118732:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 76. 00000080:00200000:2.0:1788201595.118734:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 76 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118749:0:24470:0:(rw26.c:898:ll_write_end()) pos 311296, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118753:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000957213a2[3 000000003f8b7858 2 1 0000000021c92966 0 0 76] 00000080:00200000:2.0:1788201595.118755:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000045becd56 17ffffc0001001 3:0 ffff8bc143454ee0 76 lru 00000080:00200000:2.0:1788201595.118760:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000af8c634c 76: 1< 0 - - > 2< 311296 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118762:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000957213a2 00000080:00200000:2.0:1788201595.118764:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 77. 00000080:00200000:2.0:1788201595.118765:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 77 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118779:0:24470:0:(rw26.c:898:ll_write_end()) pos 315392, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118783:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002455af4d[3 000000003f8b7858 2 1 0000000021c92966 0 0 77] 00000080:00200000:2.0:1788201595.118785:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e658fc00 17ffffc0001001 3:0 ffff8bc143454620 77 lru 00000080:00200000:2.0:1788201595.118840:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000cd7de13b 77: 1< 0 - - > 2< 315392 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118843:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002455af4d 00000080:00200000:2.0:1788201595.118844:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 78. 00000080:00200000:2.0:1788201595.118846:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 78 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118863:0:24470:0:(rw26.c:898:ll_write_end()) pos 319488, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118868:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008db98599[3 000000003f8b7858 2 1 0000000021c92966 0 0 78] 00000080:00200000:2.0:1788201595.118871:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a5ab1076 17ffffc0001001 3:0 ffff8bc1434547e0 78 lru 00000080:00200000:2.0:1788201595.118875:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f8568a55 78: 1< 0 - - > 2< 319488 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118878:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008db98599 00000080:00200000:2.0:1788201595.118879:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 79. 00000080:00200000:2.0:1788201595.118881:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 79 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118900:0:24470:0:(rw26.c:898:ll_write_end()) pos 323584, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118905:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d7aed330[3 000000003f8b7858 2 1 0000000021c92966 0 0 79] 00000080:00200000:2.0:1788201595.118908:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000bee1071f 17ffffc0001021 2:0 ffff8bc143454700 79 lru 00000080:00200000:2.0:1788201595.118913:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000017900d9d 79: 1< 0 - - > 2< 323584 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118915:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d7aed330 00000080:00200000:2.0:1788201595.118916:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 80. 00000080:00200000:2.0:1788201595.118918:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 80 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118935:0:24470:0:(rw26.c:898:ll_write_end()) pos 327680, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118939:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000601c38a2[3 000000003f8b7858 2 1 0000000021c92966 0 0 80] 00000080:00200000:2.0:1788201595.118942:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003eca3dfd 17ffffc0001001 3:0 ffff8bc143454b60 80 lru 00000080:00200000:2.0:1788201595.118947:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008d9760c6 80: 1< 0 - - > 2< 327680 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118949:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000601c38a2 00000080:00200000:2.0:1788201595.118951:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 81. 00000080:00200000:2.0:1788201595.118953:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 81 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.118968:0:24470:0:(rw26.c:898:ll_write_end()) pos 331776, len 4096, copied 4096 00000080:00200000:2.0:1788201595.118972:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000387ee3a9[3 000000003f8b7858 2 1 0000000021c92966 0 0 81] 00000080:00200000:2.0:1788201595.118975:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000076d23fd6 17ffffc0001001 3:0 ffff8bc1434542a0 81 lru 00000080:00200000:2.0:1788201595.118980:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006856faf9 81: 1< 0 - - > 2< 331776 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.118982:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000387ee3a9 00000080:00200000:2.0:1788201595.118983:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 82. 00000080:00200000:2.0:1788201595.118985:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 82 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.119000:0:24470:0:(rw26.c:898:ll_write_end()) pos 335872, len 4096, copied 4096 00000080:00200000:2.0:1788201595.119005:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000061a55ebe[3 000000003f8b7858 2 1 0000000021c92966 0 0 82] 00000080:00200000:2.0:1788201595.119008:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000059247254 17ffffc0001001 3:0 ffff8bc143454460 82 lru 00000080:00200000:2.0:1788201595.119013:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000024947e93 82: 1< 0 - - > 2< 335872 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.119015:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000061a55ebe 00000080:00200000:2.0:1788201595.119016:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 83. 00000080:00200000:2.0:1788201595.119018:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 83 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.119034:0:24470:0:(rw26.c:898:ll_write_end()) pos 339968, len 4096, copied 4096 00000080:00200000:2.0:1788201595.119038:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000220fbe76[3 000000003f8b7858 2 1 0000000021c92966 0 0 83] 00000080:00200000:2.0:1788201595.119041:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f50153d0 17ffffc0001001 3:0 ffff8bc143454d20 83 lru 00000080:00200000:2.0:1788201595.119047:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000074fe7ec9 83: 1< 0 - - > 2< 339968 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.119049:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000220fbe76 00000080:00200000:2.0:1788201595.119050:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 84. 00000080:00200000:2.0:1788201595.119052:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 84 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.119077:0:24470:0:(rw26.c:898:ll_write_end()) pos 344064, len 4096, copied 4096 00000080:00200000:2.0:1788201595.119082:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006424f82c[3 000000003f8b7858 2 1 0000000021c92966 0 0 84] 00000080:00200000:2.0:1788201595.119085:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e49d669d 17ffffc0001001 3:0 ffff8bc153b07a80 84 lru 00000080:00200000:2.0:1788201595.119090:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a5d0b029 84: 1< 0 - - > 2< 344064 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.119092:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006424f82c 00000080:00200000:2.0:1788201595.119093:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 85. 00000080:00200000:2.0:1788201595.119095:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 85 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.119111:0:24470:0:(rw26.c:898:ll_write_end()) pos 348160, len 4096, copied 4096 00000080:00200000:2.0:1788201595.119115:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d9eeba24[3 000000003f8b7858 2 1 0000000021c92966 0 0 85] 00000080:00200000:2.0:1788201595.119118:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007162e517 17ffffc0001001 3:0 ffff8bc153b07540 85 lru 00000080:00200000:2.0:1788201595.119123:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000cc0c93b5 85: 1< 0 - - > 2< 348160 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.119125:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d9eeba24 00000080:00200000:2.0:1788201595.119127:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 86. 00000080:00200000:2.0:1788201595.119129:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 86 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.119143:0:24470:0:(rw26.c:898:ll_write_end()) pos 352256, len 4096, copied 4096 00000080:00200000:2.0:1788201595.119147:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ad4f7583[3 000000003f8b7858 2 1 0000000021c92966 0 0 86] 00000080:00200000:2.0:1788201595.119150:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e8ea8437 17ffffc0001001 3:0 ffff8bc153b078c0 86 lru 00000080:00200000:2.0:1788201595.119154:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f70c31b8 86: 1< 0 - - > 2< 352256 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.119156:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ad4f7583 00000080:00200000:2.0:1788201595.119157:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 87. 00000080:00200000:2.0:1788201595.119159:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 87 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.119172:0:24470:0:(rw26.c:898:ll_write_end()) pos 356352, len 4096, copied 4096 00000080:00200000:2.0:1788201595.119177:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008e8e6ecb[3 000000003f8b7858 2 1 0000000021c92966 0 0 87] 00000080:00200000:2.0:1788201595.119180:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000df57267f 17ffffc0001001 3:0 ffff8bc153b07e00 87 lru 00000080:00200000:2.0:1788201595.119185:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000185d69a 87: 1< 0 - - > 2< 356352 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.119187:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008e8e6ecb 00000080:00200000:2.0:1788201595.119188:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 88. 00000080:00200000:2.0:1788201595.119190:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 88 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.119206:0:24470:0:(rw26.c:898:ll_write_end()) pos 360448, len 4096, copied 4096 00000080:00200000:2.0:1788201595.119210:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007c6598c8[3 000000003f8b7858 2 1 0000000021c92966 0 0 88] 00000080:00200000:2.0:1788201595.119213:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ae3237ad 17ffffc0001001 3:0 ffff8bc153b07ee0 88 lru 00000080:00200000:2.0:1788201595.119218:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b6539b32 88: 1< 0 - - > 2< 360448 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.119220:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007c6598c8 00000080:00200000:2.0:1788201595.119221:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 89. 00000080:00200000:2.0:1788201595.119223:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 89 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.119235:0:24470:0:(rw26.c:898:ll_write_end()) pos 364544, len 4096, copied 4096 00000080:00200000:2.0:1788201595.119239:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000049f0e87a[3 000000003f8b7858 2 1 0000000021c92966 0 0 89] 00000080:00200000:2.0:1788201595.119241:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006436d040 17ffffc0001001 3:0 ffff8bc153b07620 89 lru 00000080:00200000:2.0:1788201595.119246:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001efcb8e9 89: 1< 0 - - > 2< 364544 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.119248:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000049f0e87a 00000080:00200000:2.0:1788201595.119250:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 90. 00000080:00200000:2.0:1788201595.119251:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 90 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.119261:0:24470:0:(rw26.c:898:ll_write_end()) pos 368640, len 4096, copied 4096 00000080:00200000:2.0:1788201595.119264:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007afea692[3 000000003f8b7858 2 1 0000000021c92966 0 0 90] 00000080:00200000:2.0:1788201595.119268:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001226bd40 17ffffc0001001 3:0 ffff8bc153b077e0 90 lru 00000080:00200000:2.0:1788201595.119273:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000035ee91b8 90: 1< 0 - - > 2< 368640 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.119275:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007afea692 00000080:00200000:2.0:1788201595.119276:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 91. 00000080:00200000:2.0:1788201595.119278:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 91 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.119287:0:24470:0:(rw26.c:898:ll_write_end()) pos 372736, len 4096, copied 4096 00000080:00200000:2.0:1788201595.119291:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000dfc655ad[3 000000003f8b7858 2 1 0000000021c92966 0 0 91] 00000080:00200000:2.0:1788201595.119293:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000048496936 17ffffc0001001 3:0 ffff8bc153b07700 91 lru 00000080:00200000:2.0:1788201595.119298:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000003979853 91: 1< 0 - - > 2< 372736 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.119301:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000dfc655ad 00000080:00200000:2.0:1788201595.119302:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 92. 00000080:00200000:2.0:1788201595.119303:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 92 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.119313:0:24470:0:(rw26.c:898:ll_write_end()) pos 376832, len 4096, copied 4096 00000080:00200000:2.0:1788201595.119317:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002a543899[3 000000003f8b7858 2 1 0000000021c92966 0 0 92] 00000080:00200000:2.0:1788201595.119320:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006afc61e6 17ffffc0001001 3:0 ffff8bc153b07b60 92 lru 00000080:00200000:2.0:1788201595.119325:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c8443eb8 92: 1< 0 - - > 2< 376832 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.119326:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002a543899 00000080:00200000:2.0:1788201595.119327:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 93. 00000080:00200000:2.0:1788201595.119329:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 93 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.119338:0:24470:0:(rw26.c:898:ll_write_end()) pos 380928, len 4096, copied 4096 00000100:00100000:0.0:1788201595.121896:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728022528:192.168.201.143@tcp:103:ldlm_bl.0 00000080:00200000:2.0:1788201595.122251:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000056c6e7b3[3 000000003f8b7858 2 1 0000000021c92966 0 0 93] 00000080:00200000:2.0:1788201595.122257:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000097d9a7ea 17ffffc0001001 3:0 ffff8bc153b072a0 93 lru 00000080:00200000:2.0:1788201595.122267:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000809ae17 93: 1< 0 - - > 2< 380928 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.122270:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000056c6e7b3 00000080:00200000:2.0:1788201595.122272:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 94. 00000080:00200000:2.0:1788201595.122278:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 94 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.123078:0:24470:0:(rw26.c:898:ll_write_end()) pos 385024, len 4096, copied 4096 00000080:00200000:2.0:1788201595.123088:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000064953d42[3 000000003f8b7858 2 1 0000000021c92966 0 0 94] 00000080:00200000:2.0:1788201595.123225:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006feaf69d 17ffffc0001021 2:0 ffff8bc153b07460 94 lru 00000080:00200000:2.0:1788201595.123232:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000087fde517 94: 1< 0 - - > 2< 385024 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.123234:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000064953d42 00000080:00200000:2.0:1788201595.123236:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 95. 00000080:00200000:2.0:1788201595.123240:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 95 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.123262:0:24470:0:(rw26.c:898:ll_write_end()) pos 389120, len 4096, copied 4096 00000080:00200000:2.0:1788201595.123267:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d81f4a3f[3 000000003f8b7858 2 1 0000000021c92966 0 0 95] 00000080:00200000:2.0:1788201595.123269:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000391db314 17ffffc0001001 3:0 ffff8bc153b07d20 95 lru 00000080:00200000:2.0:1788201595.123274:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008b7bb150 95: 1< 0 - - > 2< 389120 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.123276:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d81f4a3f 00000080:00200000:2.0:1788201595.123277:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 96. 00000080:00200000:2.0:1788201595.123279:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 96 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.123296:0:24470:0:(rw26.c:898:ll_write_end()) pos 393216, len 4096, copied 4096 00000080:00200000:2.0:1788201595.123300:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000fd6fcd2f[3 000000003f8b7858 2 1 0000000021c92966 0 0 96] 00000080:00200000:2.0:1788201595.123303:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e98333fd 17ffffc0001001 3:0 ffff8bc153b07000 96 lru 00000080:00200000:2.0:1788201595.123309:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009af71711 96: 1< 0 - - > 2< 393216 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.123311:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000fd6fcd2f 00000080:00200000:2.0:1788201595.123312:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 97. 00000080:00200000:2.0:1788201595.123314:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 97 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.123330:0:24470:0:(rw26.c:898:ll_write_end()) pos 397312, len 4096, copied 4096 00000080:00200000:2.0:1788201595.123335:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e8e3895b[3 000000003f8b7858 2 1 0000000021c92966 0 0 97] 00000080:00200000:2.0:1788201595.123338:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000bbddd4c2 17ffffc0001001 3:0 ffff8bc153b07380 97 lru 00000080:00200000:2.0:1788201595.123354:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000459d743b 97: 1< 0 - - > 2< 397312 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.123357:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e8e3895b 00000080:00200000:2.0:1788201595.123358:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 98. 00000080:00200000:2.0:1788201595.123360:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 98 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.123377:0:24470:0:(rw26.c:898:ll_write_end()) pos 401408, len 4096, copied 4096 00000080:00200000:2.0:1788201595.123382:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000671abd92[3 000000003f8b7858 2 1 0000000021c92966 0 0 98] 00000080:00200000:2.0:1788201595.123384:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009d9b0ed5 17ffffc0001001 3:0 ffff8bc153b071c0 98 lru 00000080:00200000:2.0:1788201595.123389:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000915ebcc7 98: 1< 0 - - > 2< 401408 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.123391:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000671abd92 00000080:00200000:2.0:1788201595.123393:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 99. 00000080:00200000:2.0:1788201595.123395:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 99 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.123410:0:24470:0:(rw26.c:898:ll_write_end()) pos 405504, len 4096, copied 4096 00000080:00200000:2.0:1788201595.123415:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c8751fa5[3 000000003f8b7858 2 1 0000000021c92966 0 0 99] 00000080:00200000:2.0:1788201595.123417:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001cefaa47 17ffffc0001001 3:0 ffff8bc153b070e0 99 lru 00000080:00200000:2.0:1788201595.123422:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ab6444fc 99: 1< 0 - - > 2< 405504 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.123424:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c8751fa5 00000080:00200000:2.0:1788201595.123425:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 100. 00000080:00200000:2.0:1788201595.123427:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 100 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.123441:0:24470:0:(rw26.c:898:ll_write_end()) pos 409600, len 4096, copied 4096 00000080:00200000:2.0:1788201595.123446:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000098b7f44[3 000000003f8b7858 2 1 0000000021c92966 0 0 100] 00000080:00200000:2.0:1788201595.123449:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006f90ecb3 17ffffc0001001 3:0 ffff8bc153b079a0 100 lru 00000080:00200000:2.0:1788201595.123454:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000acfdd56c 100: 1< 0 - - > 2< 409600 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.123457:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000098b7f44 00000080:00200000:2.0:1788201595.123458:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 101. 00000080:00200000:2.0:1788201595.123460:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 101 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.123476:0:24470:0:(rw26.c:898:ll_write_end()) pos 413696, len 4096, copied 4096 00000080:00200000:2.0:1788201595.123480:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000096897e24[3 000000003f8b7858 2 1 0000000021c92966 0 0 101] 00000080:00200000:2.0:1788201595.123483:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004c4b22fa 17ffffc0001001 3:0 ffff8bc153b07c40 101 lru 00000080:00200000:2.0:1788201595.123489:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000010ae3f02 101: 1< 0 - - > 2< 413696 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.123492:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000096897e24 00000080:00200000:2.0:1788201595.123493:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 102. 00000080:00200000:2.0:1788201595.123495:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 102 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.123584:0:24470:0:(rw26.c:898:ll_write_end()) pos 417792, len 4096, copied 4096 00000080:00200000:2.0:1788201595.123590:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e0483728[3 000000003f8b7858 2 1 0000000021c92966 0 0 102] 00000080:00200000:2.0:1788201595.123593:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000018e4bf1f 17ffffc0001001 3:0 ffff8bc172538380 102 lru 00000080:00200000:2.0:1788201595.123598:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000da7b216f 102: 1< 0 - - > 2< 417792 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.123601:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e0483728 00000080:00200000:2.0:1788201595.123602:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 103. 00000080:00200000:2.0:1788201595.123603:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 103 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.123622:0:24470:0:(rw26.c:898:ll_write_end()) pos 421888, len 4096, copied 4096 00000080:00200000:2.0:1788201595.123626:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000085765e45[3 000000003f8b7858 2 1 0000000021c92966 0 0 103] 00000080:00200000:2.0:1788201595.123629:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000008b178a2 17ffffc0001001 3:0 ffff8bc1725381c0 103 lru 00000080:00200000:2.0:1788201595.123635:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003b9ec0ee 103: 1< 0 - - > 2< 421888 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.123639:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000085765e45 00000080:00200000:2.0:1788201595.123640:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 104. 00000080:00200000:2.0:1788201595.123642:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 104 of 0 to 3686 bytes 00000080:00200000:2.0:1788201595.123669:0:24470:0:(rw26.c:898:ll_write_end()) pos 425984, len 3686, copied 3686 00000080:00200000:2.0:1788201595.123674:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f958bbbe[3 000000003f8b7858 2 1 0000000021c92966 0 0 104] 00000080:00200000:2.0:1788201595.123677:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005fa1b5db 17ffffc0001001 3:0 ffff8bc1725380e0 104 lru 00000080:00200000:2.0:1788201595.123682:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ce715008 104: 1< 0 - - > 2< 425984 0 0 0x0 0x0 | 000000008930e75a 00000000beafa31c > 3< 0 0 > 4< 0 0 8 13631488 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.123683:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f958bbbe 00000080:00200000:2.0:1788201595.123685:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 105. 00000080:00200000:2.0:1788201595.123689:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 105, from 0, to 3686 prio 0 00000008:00010000:2.0:1788201595.123740:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000b2e36bf7 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1788201595.123781:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145928278, count 15, dirtied 15 00000080:00200000:2.0:1788201595.123904:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145928278, count 15, dirtied 15 00000080:00200000:2.0:1788201595.123921:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145928278, count 15, dirtied 15 00000080:00200000:2.0:1788201595.123937:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145928278, count 15, dirtied 15 00000080:00200000:2.0:1788201595.123952:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145928278, count 15, dirtied 15 00000080:00200000:2.0:1788201595.123967:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145928278, count 15, dirtied 15 00000080:00200000:2.0:1788201595.123981:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145928278, count 15, dirtied 15 00000080:00200000:2.0:1788201595.123986:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 105 pages 429670 bytes, tot: 429670 00000080:00200000:2.0:1788201595.123990:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) sanity-sec.sh: write bytes 0, result: 429670 00000020:00010000:2.0:1788201595.124012:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460c4b78 (ffff8bc148e3b008/0) at cl_lock_release():245 00000020:00010000:2.0:1788201595.124016:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460c4b78 (ffff8bc148e3b008/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.124020:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1725d4730 (ffff8bc148e3b488/1) at cl_lock_cancel():142 00010000:00010000:2.0:1788201595.124029:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.124044:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1788201595.124072:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460c4b78 (ffff8bc148e3b008/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201595.124075:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1725d4730 (ffff8bc148e3b008/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201595.124088:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 429670 bytes 00000080:00200000:2.0:1788201595.124297:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 104] 00000080:00200000:2.0:1788201595.124335:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19f:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201595.124340:0:24470:0:(file.c:2238:ll_file_io_generic()) sanity-sec.sh: 2 io complete with rc: 0, result: 429670, restart: 0 00000080:00200000:2.0:1788201595.124359:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x19f:0x0] updating i_size 429670 i_blocks 1 00000080:00200000:2.0:1788201595.124366:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 429670 00000080:00200008:2.0:1788201595.124424:0:24470:0:(file.c:479:ll_file_release()) START file sanity-sec.sh:[0x200000bd7:0x19f:0x0](ffff8bc1459280c8), flags 100001 00000002:00100000:2.0:1788201595.124503:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1727d6680 x1875064728022144/t8589937472(8589937472) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201611 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1788201595.124517:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1788201595.124596:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1725f4700 x1875064728022784/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1788201595.124627:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1725f4700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728022784:192.168.201.143@tcp:35:cp.0 00000100:00100000:2.0:1788201595.124842:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.127567:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1725f4700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728022784:192.168.201.143@tcp:35:cp.0 00000002:00100000:2.0:1788201595.127612:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1727d6680 x1875064728022144/t8589937472(8589937472) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201595.127708:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.127735:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.127760:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.127784:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.127848:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.127855:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.127860:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.127869:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201595.127874:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.127883:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.127903:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.127910:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201595.127918:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.127922:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-sec.sh, flags=8 00000080:00200008:2.0:1788201595.127930:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-sec.sh:[0x200000bd7:0x19f:0x0](ffff8bc1459280c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1788201595.127936:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x19f:0x0](ffff8bc1459280c8),name=sanity-sec.sh 00000002:00010000:2.0:1788201595.127949:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x19f:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.127959:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710982e8 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201595.127969:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710982e8 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1788201595.127981:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.127985:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x19f:0x0](ffff8bc1459280c8) 00000080:00010000:2.0:1788201595.127987:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x19f:0x0](ffff8bc1459280c8) for lock 0xd138388016f6f843 00000080:00010000:2.0:1788201595.127992:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f843 from it ffffadd1c7debcb8 00010000:00010000:2.0:1788201595.127995:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710982e8 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201595.128003:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710982e8 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201595.128054:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19f:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201595.128066:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x19f:0x0] 00000008:00010000:2.0:1788201595.128095:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201595.128098:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d730, osc lock ffff8bc151fc0e40, flags 0x400001002 00010000:00010000:2.0:1788201595.128118:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.128132:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:2.0:1788201595.128146:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1788201595.128151:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.128159:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1788201595.128177:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1788201595.128187:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x19f:0x0] updating i_size 429670 i_blocks 1 00000020:00010000:2.0:1788201595.128192:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460079d0 (ffff8bc146919d88/0) at cl_lock_release():245 00000020:00010000:2.0:1788201595.128195:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460079d0 (ffff8bc146919d88/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.128198:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d730 (ffff8bc146919128/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.128203:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460079d0 (ffff8bc146919d88/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201595.128206:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d730 (ffff8bc146919d88/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201595.128240:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19f:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201595.128300:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.128308:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.128315:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.128324:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.128330:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.128334:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.128337:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.128355:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201595.128359:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.128366:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.128382:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.128386:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201595.128389:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.128407:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-selinux.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:2.0:1788201595.128411:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-selinux.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201595.128422:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-selinux.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201595.128479:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6800/0xd138388016f6f858 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.128489:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6800/0xd138388016f6f858 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.128501:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6800/0xd138388016f6f858 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.128527:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e89c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728022912:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201595.128630:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.132079:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e89c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728022912:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201595.132107:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6800/0xd138388016f6f858 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.132123:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6800/0xd138388016f6f858 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.132143:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6800/0xd138388016f6f858 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.132150:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6800/0xd138388016f6f858 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.132162:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6800/0xd138388016f6f858 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.132169:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1443b6800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:2.0:1788201595.132174:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6800/0xd138388016f6f858 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.132181:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6800/0xd138388016f6f858 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.132188:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6800/0xd138388016f6f858 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.132196:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201595.132204:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6800/0xd138388016f6f858 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.132210:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6800/0xd138388016f6f858 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201595.132233:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc145e89c00 x1875064728022912/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201595.132249:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1788201595.132278:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201595.132361:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.132381:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.132391:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.132408:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.132415:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.132421:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.132425:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.132431:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201595.132435:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.132445:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.132462:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.132471:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201595.132477:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.132492:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-selinux.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:2.0:1788201595.132496:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-selinux.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201595.132509:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-selinux.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201595.132572:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f85f lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.132579:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f85f lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.132590:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f85f lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.132622:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e89c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728023040:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201595.132731:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.136156:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e89c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728023040:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201595.136185:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f85f lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.136202:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f85f lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.136209:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f85f lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.136217:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f85f lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.136227:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f85f lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.136234:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1443b6200 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:2.0:1788201595.136240:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f85f lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.136248:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f85f lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.136257:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f85f lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.136264:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201595.136272:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f85f lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.136280:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6200/0xd138388016f6f85f lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201595.136302:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc145e89c00 x1875064728023040/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201595.136321:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1788201595.136369:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201595.136556:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.136574:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.136585:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.136598:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.136605:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.136611:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.136615:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.136621:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:2.0:1788201595.136626:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.136635:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.136653:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.136663:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201595.136670:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.136685:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.136690:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sanity-selinux.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14c595500, open_flags 80c1, mode 81ed opened 0 00000080:00200000:2.0:1788201595.136699:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-selinux.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:2.0:1788201595.136722:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-selinux.sh,[0x200000bd7:0x1a0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:2.0:1788201595.136785:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.136825:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1788201595.136841:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1788201595.136848:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc145e89c00 x1875064728023296/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1788201595.136859:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.136884:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e89c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728023296:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201595.137037:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.142689:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e89c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728023296:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201595.142724:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098343 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.142753:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098343 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.142766:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098343 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.142779:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098343 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.142822:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098343 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.142839:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098343 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.142849:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098343 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.142859:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098343 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201595.142873:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc145e89c00 x1875064728023296/t8589937474(8589937474) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1788201595.142887:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc145e89c00 x1875064728023296/t8589937474(8589937474) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1788201595.142903:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098343 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1788201595.142917:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098343 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.142929:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/416 (0 0) 00000080:00200000:2.0:1788201595.142937:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1788201595.142955:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=sanity-selinux.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:2.0:1788201595.142992:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1a0:0x0](ffff8bc145983a88) 00000080:00200000:2.0:1788201595.143169:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x1a0:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1788201595.143179:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x1a0:0x0](ffff8bc145983a88) 00000080:00010000:2.0:1788201595.143183:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a0:0x0](ffff8bc145983a88) for lock 0xd138388016f6f866 00000080:00010000:2.0:1788201595.143195:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a0:0x0](ffff8bc145983a88) 00000080:00200008:2.0:1788201595.143215:0:24470:0:(file.c:1090:ll_file_open()) START file sanity-selinux.sh:[0x200000bd7:0x1a0:0x0](ffff8bc145983a88), flags 100301 00000002:00100000:2.0:1788201595.143237:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc145e89c00 x1875064728023296/t8589937474(8589937474) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1788201595.143288:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f866 from it ffff8bc150632e40 00010000:00010000:2.0:1788201595.143293:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171098343 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.143302:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098343 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201595.143329:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1a0:0x0](ffff8bc145983a88), inode mode 81ed mask 40 00000080:00200008:2.0:1788201595.143373:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-selinux.sh:[0x200000bd7:0x1a0:0x0](ffff8bc145983a88), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1788201595.143380:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x1a0:0x0](ffff8bc145983a88),name=sanity-selinux.sh 00000002:00010000:2.0:1788201595.143401:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x1a0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.143413:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098343 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.143431:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098343 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201595.143438:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.143443:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a0:0x0](ffff8bc145983a88) 00000080:00010000:2.0:1788201595.143446:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a0:0x0](ffff8bc145983a88) for lock 0xd138388016f6f866 00000080:00010000:2.0:1788201595.143449:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f866 from it ffffadd1c7debcd8 00010000:00010000:2.0:1788201595.143452:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171098343 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.143459:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098343 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1788201595.143488:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a0:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201595.143501:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x1a0:0x0] 00000008:00010000:2.0:1788201595.143528:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201595.143532:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d8b0, osc lock ffff8bc151fc0e40, flags 0x400001002 00010000:00010000:2.0:1788201595.143587:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f86d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.143599:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f86d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201595.143699:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000020:00200000:2.0:1788201595.143877:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1788201595.144624:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728023424:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201595.147845:0:10055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f86d lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.147890:0:10055:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f86d lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098351 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.147910:0:10055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f86d lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098351 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.147926:0:10055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f86d lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098351 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201595.147947:0:10055:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f86d lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171098351 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201595.147960:0:10055:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1788201595.147975:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f86d lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171098351 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.147984:0:10055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f86d lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171098351 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.147992:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f86d lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171098351 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.148000:0:10055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f86d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171098351 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201595.148024:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728023424:192.168.201.143@tcp:101:cp.0 00000080:00200000:2.0:1788201595.148402:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a0:0x0] updating i_size 0 i_blocks 1 00000020:00010000:2.0:1788201595.148410:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460079d0 (ffff8bc146919d88/0) at cl_lock_release():245 00000020:00010000:2.0:1788201595.148413:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460079d0 (ffff8bc146919d88/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.148419:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d8b0 (ffff8bc146919128/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.148426:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460079d0 (ffff8bc146919d88/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201595.148428:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d8b0 (ffff8bc146919d88/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201595.148477:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a0:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1788201595.148589:0:24470:0:(file.c:2638:do_file_write_iter()) START file sanity-selinux.sh:[0x200000bd7:0x1a0:0x0], ppos: 0, count: 26716 00000080:00200000:2.0:1788201595.148622:0:24470:0:(file.c:2090:ll_file_io_generic()) sanity-selinux.sh: write ppos: 0, bytes: 26716 00000080:00200000:2.0:1788201595.148631:0:24470:0:(file.c:1848:ll_io_set_mirror()) sanity-selinux.sh: desiginated mirror: 0 00000020:00200000:2.0:1788201595.148637:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@0000000020ca022d[0x110, 1, [0x200000bd7:0x1a0:0x0] hash] 00000020:00200000:2.0:1788201595.148640:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 26716) 0 0 00000080:00200000:2.0:1788201595.148645:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a0:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201595.148659:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 6] 00020000:00200000:2.0:1788201595.148668:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 26716) 26716, 26716 00020000:00200000:2.0:1788201595.148672:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201595.148704:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 6] 00000008:00010000:2.0:1788201595.148718:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1788201595.148724:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d8b0, osc lock ffff8bc151fc0e40, flags 0x0 00010000:00010000:2.0:1788201595.148743:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/450 (0 28671) 00010000:00010000:2.0:1788201595.148817:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.148828:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.148840:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.148868:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e8ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728023552:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201595.148986:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201595.151329:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201595.151456:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743488768 00000100:00100000:1.0:1788201595.151468:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743488768 00000100:00100000:1.0:1788201595.151548:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 823 00000100:00100000:1.0:1788201595.151561:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172649180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21821:x1875064743488768:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201595.151585:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f86d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171098351 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201595.151689:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201595.151697:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172649180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21821:x1875064743488768:12345-192.168.201.143@tcp:104: Request processed in 139us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201595.151705:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 823 00010000:00010000:2.0:1788201595.152277:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201595.152289:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f86d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171098351 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.152301:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1443b6200 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:2.0:1788201595.152309:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f86d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171098351 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201595.152387:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201595.152402:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:2.0:1788201595.152488:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f86d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171098351 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.152496:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201595.152543:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f86d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171098351 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.152552:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f86d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171098351 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.152571:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201595.152573:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201595.152575:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201595.152675:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201595.152695:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728023680:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201595.158450:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201595.158837:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e8ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728023552:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201595.158879:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.158897:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.158907:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201595.159018:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743488896 00000100:00100000:3.0:1788201595.159029:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743488896 00000100:00100000:0.0:1788201595.159657:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 824 00000100:00100000:0.0:1788201595.159670:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172648700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23418:x1875064743488896:12345-192.168.201.143@tcp:105: 00010000:00010000:0.0:1788201595.159686:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.159698:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.159709:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.159722:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.159732:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.159743:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.159777:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1443b6800) 00000100:00100000:0.0:1788201595.159888:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172648700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23418:x1875064743488896:12345-192.168.201.143@tcp:105: Request processed in 221us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201595.159896:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 824 00010000:00010000:2.0:1788201595.159965:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.159976:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.159996:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1788201595.160010:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.160025:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.160032:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1788201595.160075:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) sanity-selinux.sh: write [0, 26716) append 0 append lockpos 0 00000080:00200000:2.0:1788201595.160111:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.160188:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:2.0:1788201595.160202:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000366b74f3[3 00000000701cac46 2 1 0000000044063476 0 0 0] 00000080:00200000:2.0:1788201595.160206:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d3a85f46 17ffffc0001001 3:0 ffff8bc1725389a0 0 lru 00000080:00200000:2.0:1788201595.160216:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000be96f9f 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000be46d9ed > 3< 0 0 > 4< 0 0 8 1703936 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.160218:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000366b74f3 00000080:00200000:2.0:1788201595.160219:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1788201595.160225:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.160260:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:2.0:1788201595.160265:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a6dcb5f8[3 00000000701cac46 2 1 0000000044063476 0 0 1] 00000080:00200000:2.0:1788201595.160268:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009a7ab9ad 17ffffc0001001 3:0 ffff8bc172538c40 1 lru 00000080:00200000:2.0:1788201595.160273:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000732bc212 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 00000000be46d9ed > 3< 0 0 > 4< 0 0 8 1703936 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.160275:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a6dcb5f8 00000080:00200000:2.0:1788201595.160276:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:2.0:1788201595.160278:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.160294:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:2.0:1788201595.160298:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d1dd7d04[3 00000000701cac46 2 1 0000000044063476 0 0 2] 00000080:00200000:2.0:1788201595.160301:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000648f86af 17ffffc0001001 3:0 ffff8bc172538a80 2 lru 00000080:00200000:2.0:1788201595.160306:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b62ac4e2 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000000ce25486 00000000be46d9ed > 3< 0 0 > 4< 0 0 8 1703936 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.160307:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d1dd7d04 00000080:00200000:2.0:1788201595.160308:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:2.0:1788201595.160310:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.160328:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:2.0:1788201595.160333:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000190a5274[3 00000000701cac46 2 1 0000000044063476 0 0 3] 00000080:00200000:2.0:1788201595.160335:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b7618e26 17ffffc0001001 3:0 ffff8bc172538540 3 lru 00000080:00200000:2.0:1788201595.160353:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c516d10f 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000000ce25486 00000000be46d9ed > 3< 0 0 > 4< 0 0 8 1703936 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.160355:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000190a5274 00000080:00200000:2.0:1788201595.160356:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:2.0:1788201595.160358:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.160385:0:24470:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:2.0:1788201595.160389:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000011648d1a[3 00000000701cac46 2 1 0000000044063476 0 0 4] 00000080:00200000:2.0:1788201595.160392:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000101012a1 17ffffc0001021 2:0 ffff8bc1725388c0 4 lru 00000080:00200000:2.0:1788201595.160397:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000048b1374f 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000000ce25486 00000000be46d9ed > 3< 0 0 > 4< 0 0 8 1703936 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.160399:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000011648d1a 00000080:00200000:2.0:1788201595.160401:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:2.0:1788201595.160403:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.160418:0:24470:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:2.0:1788201595.160422:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a4f893a5[3 00000000701cac46 2 1 0000000044063476 0 0 5] 00000080:00200000:2.0:1788201595.160425:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000534b9f16 17ffffc0001001 3:0 ffff8bc172538e00 5 lru 00000080:00200000:2.0:1788201595.160430:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000002a68e928 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000000ce25486 00000000be46d9ed > 3< 0 0 > 4< 0 0 8 1703936 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.160432:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a4f893a5 00000080:00200000:2.0:1788201595.160434:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:2.0:1788201595.160435:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 2140 bytes 00000080:00200000:2.0:1788201595.160457:0:24470:0:(rw26.c:898:ll_write_end()) pos 24576, len 2140, copied 2140 00000080:00200000:2.0:1788201595.160461:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000737bb25f[3 00000000701cac46 2 1 0000000044063476 0 0 6] 00000080:00200000:2.0:1788201595.160463:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c8b874f2 17ffffc0001001 3:0 ffff8bc172538ee0 6 lru 00000080:00200000:2.0:1788201595.160469:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000dee151c1 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000000ce25486 00000000be46d9ed > 3< 0 0 > 4< 0 0 8 1703936 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.160471:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000737bb25f 00000080:00200000:2.0:1788201595.160472:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:2.0:1788201595.160476:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 7, from 0, to 2140 prio 0 00000008:00010000:2.0:1788201595.160503:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000ac77a73d ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1788201595.160543:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145983c38, count 7, dirtied 7 00000080:00200000:2.0:1788201595.160549:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 7 pages 26716 bytes, tot: 26716 00000080:00200000:2.0:1788201595.160553:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) sanity-selinux.sh: write bytes 0, result: 26716 00000020:00010000:2.0:1788201595.160573:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc149844c68 (ffff8bc146919d88/0) at cl_lock_release():245 00000020:00010000:2.0:1788201595.160576:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149844c68 (ffff8bc146919d88/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.160580:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d8b0 (ffff8bc146919128/1) at cl_lock_cancel():142 00010000:00010000:2.0:1788201595.160586:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.160598:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1788201595.160622:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149844c68 (ffff8bc146919d88/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201595.160625:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d8b0 (ffff8bc146919d88/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201595.160633:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 26716 bytes 00000080:00200000:2.0:1788201595.160641:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 6] 00000080:00200000:2.0:1788201595.160685:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a0:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201595.160690:0:24470:0:(file.c:2238:ll_file_io_generic()) sanity-selinux.sh: 2 io complete with rc: 0, result: 26716, restart: 0 00000080:00200000:2.0:1788201595.160700:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a0:0x0] updating i_size 26716 i_blocks 1 00000080:00200000:2.0:1788201595.160706:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 26716 00000080:00200008:2.0:1788201595.160764:0:24470:0:(file.c:479:ll_file_release()) START file sanity-selinux.sh:[0x200000bd7:0x1a0:0x0](ffff8bc145983a88), flags 100001 00000002:00100000:2.0:1788201595.160857:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc145e89c00 x1875064728023296/t8589937474(8589937474) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201611 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1788201595.160872:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1788201595.160878:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc145e8ad80 x1875064728023936/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1788201595.160904:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e8ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728023936:192.168.201.143@tcp:35:cp.0 00000100:00100000:2.0:1788201595.160988:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.163985:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e8ad80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728023936:192.168.201.143@tcp:35:cp.0 00000002:00100000:2.0:1788201595.164028:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc145e89c00 x1875064728023296/t8589937474(8589937474) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201595.164120:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.164155:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.164179:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.164200:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.164209:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.164216:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.164221:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.164230:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201595.164234:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.164243:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.164261:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.164269:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201595.164276:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.164279:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity-selinux.sh, flags=8 00000080:00200008:2.0:1788201595.164288:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity-selinux.sh:[0x200000bd7:0x1a0:0x0](ffff8bc145983a88), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1788201595.164293:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x1a0:0x0](ffff8bc145983a88),name=sanity-selinux.sh 00000002:00010000:2.0:1788201595.164305:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x1a0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.164314:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098343 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201595.164323:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098343 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1788201595.164336:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.164351:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a0:0x0](ffff8bc145983a88) 00000080:00010000:2.0:1788201595.164354:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a0:0x0](ffff8bc145983a88) for lock 0xd138388016f6f866 00000080:00010000:2.0:1788201595.164359:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f866 from it ffffadd1c7debcb8 00010000:00010000:2.0:1788201595.164362:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171098343 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201595.164370:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098343 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201595.164426:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a0:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201595.164436:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x1a0:0x0] 00000008:00010000:2.0:1788201595.164465:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201595.164470:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d8b0, osc lock ffff8bc151fc0e40, flags 0x400001002 00010000:00010000:2.0:1788201595.164488:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.164501:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:2.0:1788201595.164515:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1788201595.164636:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728023680:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201595.165070:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.165080:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1788201595.165100:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1788201595.165110:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a0:0x0] updating i_size 26716 i_blocks 1 00000020:00010000:2.0:1788201595.165115:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460079d0 (ffff8bc146919d88/0) at cl_lock_release():245 00000020:00010000:2.0:1788201595.165118:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460079d0 (ffff8bc146919d88/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.165234:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d8b0 (ffff8bc146919128/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.165241:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460079d0 (ffff8bc146919d88/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201595.165244:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d8b0 (ffff8bc146919d88/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201595.165281:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a0:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201595.165362:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.165375:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.165385:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.165395:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.165403:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.165408:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.165412:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.165416:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201595.165420:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.165429:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.165444:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.165449:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201595.165453:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.165470:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:2.0:1788201595.165475:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201595.165484:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201595.165762:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6a00/0xd138388016f6f87b lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.165770:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6a00/0xd138388016f6f87b lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.165782:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6a00/0xd138388016f6f87b lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.165922:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e8aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728024064:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201595.166037:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201595.169194:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e8aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728024064:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201595.169225:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6a00/0xd138388016f6f87b lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.169241:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6a00/0xd138388016f6f87b lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.169250:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6a00/0xd138388016f6f87b lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.169258:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6a00/0xd138388016f6f87b lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.169275:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6a00/0xd138388016f6f87b lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.169283:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1443b6a00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201595.169288:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6a00/0xd138388016f6f87b lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.169297:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6a00/0xd138388016f6f87b lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.169306:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6a00/0xd138388016f6f87b lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.169314:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201595.169322:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6a00/0xd138388016f6f87b lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.169329:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6a00/0xd138388016f6f87b lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201595.169363:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc145e8aa00 x1875064728024064/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201595.169380:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201595.169410:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201595.169488:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201595.169507:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201595.169529:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201595.169548:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201595.169556:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201595.169563:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201595.169567:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201595.169573:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201595.169577:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201595.169586:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201595.169602:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.169610:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201595.169616:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.169631:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:0.0:1788201595.169636:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201595.169649:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201595.169700:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f882 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.169708:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f882 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.169720:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f882 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201595.169750:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172649500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728024192:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201595.169971:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201595.173973:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172649500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728024192:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201595.174002:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f882 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.174017:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f882 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.174025:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f882 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.174032:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f882 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.174042:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f882 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.174048:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc146085400 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201595.174052:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f882 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.174059:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f882 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.174066:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f882 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.174075:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201595.174084:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f882 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.174102:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085400/0xd138388016f6f882 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201595.174266:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc172649500 x1875064728024192/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201595.174286:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1788201595.174394:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:1.0:1788201595.174547:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201595.174566:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.174578:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.174592:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.174599:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.174607:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201595.174611:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201595.174618:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:1.0:1788201595.174621:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.174636:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.174654:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.174663:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:1.0:1788201595.174670:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.174684:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.174689:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14304b200, open_flags 80c1, mode 81ed opened 0 00000080:00200000:1.0:1788201595.174697:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:1.0:1788201595.174722:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity.sh,[0x200000bd7:0x1a1:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:1.0:1788201595.174787:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.174836:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1788201595.174851:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1788201595.174860:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d5180 x1875064728024448/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1788201595.174871:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201595.174898:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728024448:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201595.175070:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145559cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201595.179927:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728024448:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201595.179965:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109839e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.179993:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109839e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.180002:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109839e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.180020:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109839e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.180033:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109839e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.180049:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109839e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.180058:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109839e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.180065:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109839e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201595.180078:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1727d5180 x1875064728024448/t8589937476(8589937476) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1788201595.180093:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1727d5180 x1875064728024448/t8589937476(8589937476) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201595.180109:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109839e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1788201595.180122:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109839e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.180134:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/417 (0 0) 00000080:00200000:3.0:1788201595.180142:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1788201595.180158:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=sanity.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:3.0:1788201595.180196:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1a1:0x0](ffff8bc1459d5b88) 00000080:00200000:3.0:1788201595.180356:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x1a1:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1788201595.180368:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x1a1:0x0](ffff8bc1459d5b88) 00000080:00010000:3.0:1788201595.180372:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a1:0x0](ffff8bc1459d5b88) for lock 0xd138388016f6f889 00000080:00010000:3.0:1788201595.180384:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a1:0x0](ffff8bc1459d5b88) 00000080:00200008:3.0:1788201595.180404:0:24470:0:(file.c:1090:ll_file_open()) START file sanity.sh:[0x200000bd7:0x1a1:0x0](ffff8bc1459d5b88), flags 100301 00000002:00100000:3.0:1788201595.180428:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1727d5180 x1875064728024448/t8589937476(8589937476) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1788201595.180479:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f889 from it ffff8bc1466cdcc0 00010000:00010000:3.0:1788201595.180483:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109839e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.180494:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109839e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201595.181349:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1a1:0x0](ffff8bc1459d5b88), inode mode 81ed mask 40 00000080:00200008:3.0:1788201595.181389:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity.sh:[0x200000bd7:0x1a1:0x0](ffff8bc1459d5b88), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201595.181397:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x1a1:0x0](ffff8bc1459d5b88),name=sanity.sh 00000002:00010000:3.0:1788201595.181423:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x1a1:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201595.181440:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109839e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201595.181454:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109839e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201595.181469:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201595.181477:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a1:0x0](ffff8bc1459d5b88) 00000080:00010000:3.0:1788201595.181480:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a1:0x0](ffff8bc1459d5b88) for lock 0xd138388016f6f889 00000080:00010000:3.0:1788201595.181486:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f889 from it ffffadd1c7debcd8 00010000:00010000:3.0:1788201595.181490:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109839e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201595.181500:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109839e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201595.181992:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a1:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201595.182005:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x1a1:0x0] 00000008:00010000:3.0:1788201595.182040:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201595.182045:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149fecab0, osc lock ffff8bc14691aab0, flags 0x400001002 00010000:00010000:3.0:1788201595.182110:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6f890 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.182134:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6f890 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201595.182177:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1788201595.182251:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201595.182277:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728024576:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201595.192955:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6f890 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.192992:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6f890 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710983ac expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.193010:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6f890 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710983ac expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.193025:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6f890 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710983ac expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201595.193043:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6f890 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710983ac expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201595.193057:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201595.193135:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6f890 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710983ac expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.193146:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6f890 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710983ac expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.193154:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6f890 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710983ac expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.193164:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6f890 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e21710983ac expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201595.193189:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728024576:192.168.201.143@tcp:101:cp.0 00000080:00200000:2.0:1788201595.193614:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a1:0x0] updating i_size 0 i_blocks 1 00000020:00010000:2.0:1788201595.193622:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc6500 (ffff8bc1460e9a28/0) at cl_lock_release():245 00000020:00010000:2.0:1788201595.193626:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc6500 (ffff8bc1460e9a28/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.193631:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149fecab0 (ffff8bc1460e9878/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.193637:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc6500 (ffff8bc1460e9a28/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201595.193640:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149fecab0 (ffff8bc1460e9a28/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201595.193683:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a1:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1788201595.198025:0:24470:0:(file.c:2638:do_file_write_iter()) START file sanity.sh:[0x200000bd7:0x1a1:0x0], ppos: 0, count: 1181558 00000080:00200000:3.0:1788201595.198092:0:24470:0:(file.c:2090:ll_file_io_generic()) sanity.sh: write ppos: 0, bytes: 1181558 00000080:00200000:3.0:1788201595.198099:0:24470:0:(file.c:1848:ll_io_set_mirror()) sanity.sh: desiginated mirror: 0 00000020:00200000:3.0:1788201595.198109:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@0000000057021da4[0x110, 1, [0x200000bd7:0x1a1:0x0] hash] 00000020:00200000:3.0:1788201595.198113:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 1181558) 0 0 00000080:00200000:3.0:1788201595.198118:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a1:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201595.198212:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 288] 00020000:00200000:3.0:1788201595.198221:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 1181558) 1181558, 1181558 00020000:00200000:3.0:1788201595.198226:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1788201595.198263:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 288] 00000008:00010000:3.0:1788201595.198279:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1788201595.198286:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149fec330, osc lock ffff8bc14691aab0, flags 0x0 00010000:00010000:3.0:1788201595.198308:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/451 (0 1183743) 00010000:00010000:3.0:1788201595.198383:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.198395:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->1183743] (req 0->1183743) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.198407:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->1183743] (req 0->1183743) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201595.198438:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728024704:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201595.198699:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.201259:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201595.201367:0:20876:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201595.201388:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743489024 00000100:00100000:3.0:1788201595.201398:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743489024 00000100:00100000:3.0:1788201595.201459:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 825 00000100:00100000:3.0:1788201595.201470:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc149f1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23131:x1875064743489024:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201595.201491:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6f890 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710983ac expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201595.202505:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201595.202526:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc149f1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23131:x1875064743489024:12345-192.168.201.143@tcp:104: Request processed in 1046us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201595.202539:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 825 00010000:00010000:0.0:1788201595.202655:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201595.202665:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6f890 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710983ac expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.202677:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1725a1000 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201595.202684:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6f890 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e21710983ac expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201595.202747:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201595.202760:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1788201595.202852:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6f890 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710983ac expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.202865:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788201595.202928:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728024832:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201595.203024:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6f890 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710983ac expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.203034:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ad0d217b/0xd138388016f6f890 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710983ac expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.203051:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201595.203053:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201595.203055:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201595.205860:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201595.206358:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201595.206637:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728024704:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201595.206675:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->1183743] (req 0->1183743) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.206692:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->1183743] (req 0->1183743) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.206701:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->1183743] (req 0->1183743) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.206753:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743489152 00000100:00100000:2.0:1788201595.206762:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743489152 00000100:00100000:2.0:1788201595.206938:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 826 00000100:00100000:2.0:1788201595.206950:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17264b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21005:x1875064743489152:12345-192.168.201.143@tcp:105: 00010000:00010000:2.0:1788201595.206963:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->1183743] (req 0->1183743) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.206973:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->1183743] (req 0->1183743) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.206982:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.206993:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.207003:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.207012:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.207043:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1725a0c00) 00000100:00100000:2.0:1788201595.207137:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17264b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21005:x1875064743489152:12345-192.168.201.143@tcp:105: Request processed in 189us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201595.207145:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 826 00010000:00010000:3.0:1788201595.208824:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.208846:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.208866:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201595.208881:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.208895:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.208911:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201595.208947:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) sanity.sh: write [0, 1181558) append 0 append lockpos 0 00000080:00200000:3.0:1788201595.208968:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.209024:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:3.0:1788201595.209035:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005b1f1cea[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 0] 00000080:00200000:3.0:1788201595.209039:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002d0b0279 17ffffc0001001 3:0 ffff8bc144e412a0 0 lru 00000080:00200000:3.0:1788201595.209046:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a061546a 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.209049:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005b1f1cea 00000080:00200000:3.0:1788201595.209050:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201595.209054:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.209076:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:3.0:1788201595.209080:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000dfeeba6b[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 1] 00000080:00200000:3.0:1788201595.209083:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000741133ce 17ffffc0001001 3:0 ffff8bc144e41b60 1 lru 00000080:00200000:3.0:1788201595.209089:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000bb8feca9 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.209107:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000dfeeba6b 00000080:00200000:3.0:1788201595.209108:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:3.0:1788201595.209110:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.209131:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:3.0:1788201595.209135:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000019352ad7[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 2] 00000080:00200000:3.0:1788201595.209138:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000306553ab 17ffffc0001001 3:0 ffff8bc144e41700 2 lru 00000080:00200000:3.0:1788201595.209144:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b271604a 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.209146:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000019352ad7 00000080:00200000:3.0:1788201595.209148:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:3.0:1788201595.209150:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.209161:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:3.0:1788201595.209164:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b881867a[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 3] 00000080:00200000:3.0:1788201595.209167:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000216aa13f 17ffffc0001001 3:0 ffff8bc144e417e0 3 lru 00000080:00200000:3.0:1788201595.209173:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000bd209dd3 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.209176:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b881867a 00000080:00200000:3.0:1788201595.209177:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:3.0:1788201595.209179:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.209189:0:24470:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:3.0:1788201595.209193:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000fa3750df[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 4] 00000080:00200000:3.0:1788201595.209195:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d4a2dec1 17ffffc0001001 3:0 ffff8bc144e41620 4 lru 00000080:00200000:3.0:1788201595.209201:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b28ef659 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.209203:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000fa3750df 00000080:00200000:3.0:1788201595.209204:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:3.0:1788201595.209206:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.209216:0:24470:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:3.0:1788201595.209219:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000fb2118f6[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 5] 00000080:00200000:3.0:1788201595.209222:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000088b1da4c 17ffffc0001001 3:0 ffff8bc144e41ee0 5 lru 00000080:00200000:3.0:1788201595.209227:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009b0ceaaa 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.209229:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000fb2118f6 00000080:00200000:3.0:1788201595.209231:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:3.0:1788201595.209232:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.209248:0:24470:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:3.0:1788201595.209252:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002c39eb96[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 6] 00000080:00200000:3.0:1788201595.209254:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000093a6b2ef 17ffffc0001001 3:0 ffff8bc144e418c0 6 lru 00000080:00200000:3.0:1788201595.209260:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006a59ed48 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.209262:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002c39eb96 00000080:00200000:3.0:1788201595.209263:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:3.0:1788201595.209265:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.209274:0:24470:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:3.0:1788201595.209277:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b8e9bfe7[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 7] 00000080:00200000:3.0:1788201595.209279:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002dd2762c 17ffffc0001001 3:0 ffff8bc144e41540 7 lru 00000080:00200000:3.0:1788201595.209285:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b9590384 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.209287:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b8e9bfe7 00000080:00200000:3.0:1788201595.209288:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:3.0:1788201595.209290:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.209302:0:24470:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:3.0:1788201595.209306:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e4f55302[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 8] 00000080:00200000:3.0:1788201595.209309:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c1d3f797 17ffffc0001001 3:0 ffff8bc144e41a80 8 lru 00000080:00200000:3.0:1788201595.209314:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003a48fb1b 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.209317:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e4f55302 00000080:00200000:3.0:1788201595.209318:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:3.0:1788201595.209319:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.209329:0:24470:0:(rw26.c:898:ll_write_end()) pos 36864, len 4096, copied 4096 00000080:00200000:3.0:1788201595.209333:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000bd1eb0b4[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 9] 00000080:00200000:3.0:1788201595.209335:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000beebea94 17ffffc0001001 3:0 ffff8bc144e41c40 9 lru 00000080:00200000:3.0:1788201595.209350:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000487e280 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.209352:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000bd1eb0b4 00000080:00200000:3.0:1788201595.209353:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:3.0:1788201595.209355:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 10 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.209367:0:24470:0:(rw26.c:898:ll_write_end()) pos 40960, len 4096, copied 4096 00000080:00200000:3.0:1788201595.209372:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000271dab17[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 10] 00000080:00200000:3.0:1788201595.209375:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d327517c 17ffffc0001001 3:0 ffff8bc144e419a0 10 lru 00000080:00200000:3.0:1788201595.209381:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006820223d 10: 1< 0 - - > 2< 40960 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.209383:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000271dab17 00000080:00200000:3.0:1788201595.209384:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 11. 00000080:00200000:3.0:1788201595.209386:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 11 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.209396:0:24470:0:(rw26.c:898:ll_write_end()) pos 45056, len 4096, copied 4096 00000080:00200000:3.0:1788201595.209400:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001fea53e0[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 11] 00000080:00200000:3.0:1788201595.209403:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000073801197 17ffffc0001001 3:0 ffff8bc144e410e0 11 lru 00000080:00200000:3.0:1788201595.209408:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000051ecba12 11: 1< 0 - - > 2< 45056 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.209410:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001fea53e0 00000080:00200000:3.0:1788201595.209411:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 12. 00000080:00200000:3.0:1788201595.209412:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 12 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.209422:0:24470:0:(rw26.c:898:ll_write_end()) pos 49152, len 4096, copied 4096 00000080:00200000:3.0:1788201595.209425:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000979c3ad[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 12] 00000080:00200000:3.0:1788201595.209428:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000383e6427 17ffffc0001001 3:0 ffff8bc144e41460 12 lru 00000080:00200000:3.0:1788201595.209434:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003279146a 12: 1< 0 - - > 2< 49152 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.209436:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000979c3ad 00000080:00200000:3.0:1788201595.209438:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 13. 00000080:00200000:3.0:1788201595.209439:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 13 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.209449:0:24470:0:(rw26.c:898:ll_write_end()) pos 53248, len 4096, copied 4096 00000080:00200000:3.0:1788201595.209453:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ae9d0aed[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 13] 00000080:00200000:3.0:1788201595.209455:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d72b4af0 17ffffc0001001 3:0 ffff8bc144e41d20 13 lru 00000080:00200000:3.0:1788201595.209461:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000002504fe7f 13: 1< 0 - - > 2< 53248 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.209463:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ae9d0aed 00000080:00200000:3.0:1788201595.209464:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 14. 00000080:00200000:3.0:1788201595.209466:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 14 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.209490:0:24470:0:(rw26.c:898:ll_write_end()) pos 57344, len 4096, copied 4096 00000080:00200000:3.0:1788201595.209495:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000acb75770[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 14] 00000080:00200000:3.0:1788201595.209497:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000fa357058 17ffffc0001021 2:0 ffff8bc144e41000 14 lru 00000080:00200000:3.0:1788201595.209503:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000cbd03e5c 14: 1< 0 - - > 2< 57344 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.209505:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000acb75770 00000080:00200000:3.0:1788201595.209506:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 15. 00000080:00200000:3.0:1788201595.209508:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 15 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.209775:0:24470:0:(rw26.c:898:ll_write_end()) pos 61440, len 4096, copied 4096 00000080:00200000:3.0:1788201595.209782:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000adb9066c[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 15] 00000080:00200000:3.0:1788201595.209786:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000049e1c24b 17ffffc0001001 3:0 ffff8bc144e41380 15 lru 00000080:00200000:3.0:1788201595.209819:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ef289877 15: 1< 0 - - > 2< 61440 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.209822:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000adb9066c 00000080:00200000:3.0:1788201595.209824:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 16. 00000080:00200000:3.0:1788201595.209826:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 16 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.209844:0:24470:0:(rw26.c:898:ll_write_end()) pos 65536, len 4096, copied 4096 00000080:00200000:3.0:1788201595.209849:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a98c06ff[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 16] 00000080:00200000:3.0:1788201595.209851:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000290de626 17ffffc0001001 3:0 ffff8bc144e41e00 16 lru 00000080:00200000:3.0:1788201595.209857:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000b5098f6 16: 1< 0 - - > 2< 65536 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.209860:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a98c06ff 00000080:00200000:3.0:1788201595.209861:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 17. 00000080:00200000:3.0:1788201595.209864:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 17 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.209894:0:24470:0:(rw26.c:898:ll_write_end()) pos 69632, len 4096, copied 4096 00000080:00200000:3.0:1788201595.209899:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004c75c57e[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 17] 00000080:00200000:3.0:1788201595.209902:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001599ffab 17ffffc0001001 3:0 ffff8bc15069f380 17 lru 00000080:00200000:3.0:1788201595.209908:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b27def8a 17: 1< 0 - - > 2< 69632 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.209910:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004c75c57e 00000080:00200000:3.0:1788201595.209911:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 18. 00000080:00200000:3.0:1788201595.209914:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 18 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.209926:0:24470:0:(rw26.c:898:ll_write_end()) pos 73728, len 4096, copied 4096 00000080:00200000:3.0:1788201595.209930:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f5cf38e6[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 18] 00000080:00200000:3.0:1788201595.209933:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000531355a5 17ffffc0001001 3:0 ffff8bc15069f1c0 18 lru 00000080:00200000:3.0:1788201595.209939:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f647ed8c 18: 1< 0 - - > 2< 73728 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.209941:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f5cf38e6 00000080:00200000:3.0:1788201595.209942:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 19. 00000080:00200000:3.0:1788201595.209944:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 19 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.209957:0:24470:0:(rw26.c:898:ll_write_end()) pos 77824, len 4096, copied 4096 00000080:00200000:3.0:1788201595.209961:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000dc760b59[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 19] 00000080:00200000:3.0:1788201595.209964:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003a9663e2 17ffffc0001001 3:0 ffff8bc15069f0e0 19 lru 00000080:00200000:3.0:1788201595.209969:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007f3e236d 19: 1< 0 - - > 2< 77824 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.209972:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000dc760b59 00000080:00200000:3.0:1788201595.209973:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 20. 00000080:00200000:3.0:1788201595.209975:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 20 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.209988:0:24470:0:(rw26.c:898:ll_write_end()) pos 81920, len 4096, copied 4096 00000080:00200000:3.0:1788201595.209992:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000ce42e9f[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 20] 00000080:00200000:3.0:1788201595.209995:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000018de6d6d 17ffffc0001001 3:0 ffff8bc15069f9a0 20 lru 00000080:00200000:3.0:1788201595.210000:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ea914793 20: 1< 0 - - > 2< 81920 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.210002:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000ce42e9f 00000080:00200000:3.0:1788201595.210004:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 21. 00000080:00200000:3.0:1788201595.210006:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 21 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.210018:0:24470:0:(rw26.c:898:ll_write_end()) pos 86016, len 4096, copied 4096 00000080:00200000:3.0:1788201595.210022:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ca0c5822[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 21] 00000080:00200000:3.0:1788201595.210024:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b75f0570 17ffffc0001001 3:0 ffff8bc15069fc40 21 lru 00000080:00200000:3.0:1788201595.210029:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c27b343c 21: 1< 0 - - > 2< 86016 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.210031:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ca0c5822 00000080:00200000:3.0:1788201595.210033:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 22. 00000080:00200000:3.0:1788201595.210034:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 22 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.210050:0:24470:0:(rw26.c:898:ll_write_end()) pos 90112, len 4096, copied 4096 00000080:00200000:3.0:1788201595.210053:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d8eefc95[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 22] 00000080:00200000:3.0:1788201595.210056:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004387ea16 17ffffc0001001 3:0 ffff8bc15069fa80 22 lru 00000080:00200000:3.0:1788201595.210061:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006d3ba9eb 22: 1< 0 - - > 2< 90112 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.210063:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d8eefc95 00000080:00200000:3.0:1788201595.210065:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 23. 00000080:00200000:3.0:1788201595.210067:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 23 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.210079:0:24470:0:(rw26.c:898:ll_write_end()) pos 94208, len 4096, copied 4096 00000080:00200000:3.0:1788201595.210083:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f425eca2[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 23] 00000080:00200000:3.0:1788201595.210086:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000015a0e0b8 17ffffc0001001 3:0 ffff8bc15069f540 23 lru 00000080:00200000:3.0:1788201595.210104:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000083639981 23: 1< 0 - - > 2< 94208 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.210106:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f425eca2 00000080:00200000:3.0:1788201595.210108:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 24. 00000080:00200000:3.0:1788201595.210110:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 24 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.210430:0:24470:0:(rw26.c:898:ll_write_end()) pos 98304, len 4096, copied 4096 00000080:00200000:3.0:1788201595.210436:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000087a967e1[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 24] 00000080:00200000:3.0:1788201595.210439:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003cce5d71 17ffffc0001001 3:0 ffff8bc15069f8c0 24 lru 00000080:00200000:3.0:1788201595.210445:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004a5dcf0f 24: 1< 0 - - > 2< 98304 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.210447:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000087a967e1 00000080:00200000:3.0:1788201595.210449:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 25. 00000080:00200000:3.0:1788201595.210451:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 25 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.210468:0:24470:0:(rw26.c:898:ll_write_end()) pos 102400, len 4096, copied 4096 00000080:00200000:3.0:1788201595.210472:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d1428f24[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 25] 00000080:00200000:3.0:1788201595.210475:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b6819ab8 17ffffc0001001 3:0 ffff8bc15069fe00 25 lru 00000080:00200000:3.0:1788201595.210480:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000df977bc1 25: 1< 0 - - > 2< 102400 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.210483:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d1428f24 00000080:00200000:3.0:1788201595.210484:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 26. 00000080:00200000:3.0:1788201595.210486:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 26 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.210501:0:24470:0:(rw26.c:898:ll_write_end()) pos 106496, len 4096, copied 4096 00000080:00200000:3.0:1788201595.210505:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c252d52d[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 26] 00000080:00200000:3.0:1788201595.210507:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ccaa535a 17ffffc0001001 3:0 ffff8bc15069fee0 26 lru 00000080:00200000:3.0:1788201595.210512:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000cb4919b7 26: 1< 0 - - > 2< 106496 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.210515:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c252d52d 00000080:00200000:3.0:1788201595.210515:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 27. 00000080:00200000:3.0:1788201595.210591:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 27 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.210608:0:24470:0:(rw26.c:898:ll_write_end()) pos 110592, len 4096, copied 4096 00000080:00200000:3.0:1788201595.210612:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000089bc3d7d[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 27] 00000080:00200000:3.0:1788201595.210615:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000120eec0f 17ffffc0001001 3:0 ffff8bc15069f620 27 lru 00000080:00200000:3.0:1788201595.210619:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000101cb306 27: 1< 0 - - > 2< 110592 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.210622:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000089bc3d7d 00000080:00200000:3.0:1788201595.210623:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 28. 00000080:00200000:3.0:1788201595.210624:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 28 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.210638:0:24470:0:(rw26.c:898:ll_write_end()) pos 114688, len 4096, copied 4096 00000080:00200000:3.0:1788201595.210642:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006acadc46[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 28] 00000080:00200000:3.0:1788201595.210645:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000027493183 17ffffc0001001 3:0 ffff8bc15069f7e0 28 lru 00000080:00200000:3.0:1788201595.210650:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ff9b3824 28: 1< 0 - - > 2< 114688 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.210652:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006acadc46 00000080:00200000:3.0:1788201595.210653:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 29. 00000080:00200000:3.0:1788201595.210655:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 29 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.210679:0:24470:0:(rw26.c:898:ll_write_end()) pos 118784, len 4096, copied 4096 00000080:00200000:3.0:1788201595.210683:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003229ef40[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 29] 00000080:00200000:3.0:1788201595.210686:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000018221dc8 17ffffc0001021 2:0 ffff8bc15069f700 29 lru 00000080:00200000:3.0:1788201595.210692:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000078c04c89 29: 1< 0 - - > 2< 118784 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.210694:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003229ef40 00000080:00200000:3.0:1788201595.210695:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 30. 00000080:00200000:3.0:1788201595.210696:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 30 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.210711:0:24470:0:(rw26.c:898:ll_write_end()) pos 122880, len 4096, copied 4096 00000080:00200000:3.0:1788201595.210715:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000012d9684b[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 30] 00000080:00200000:3.0:1788201595.210718:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f54345c7 17ffffc0001001 3:0 ffff8bc15069fb60 30 lru 00000080:00200000:3.0:1788201595.210724:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006a6afe71 30: 1< 0 - - > 2< 122880 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.210726:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000012d9684b 00000080:00200000:3.0:1788201595.210727:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 31. 00000080:00200000:3.0:1788201595.210729:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 31 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.210743:0:24470:0:(rw26.c:898:ll_write_end()) pos 126976, len 4096, copied 4096 00000080:00200000:3.0:1788201595.210747:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e0a1e6bd[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 31] 00000080:00200000:3.0:1788201595.210750:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000059305da 17ffffc0001001 3:0 ffff8bc15069f2a0 31 lru 00000080:00200000:3.0:1788201595.210755:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000014741b61 31: 1< 0 - - > 2< 126976 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.210757:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e0a1e6bd 00000080:00200000:3.0:1788201595.210758:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 32. 00000080:00200000:3.0:1788201595.210760:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 32 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.210774:0:24470:0:(rw26.c:898:ll_write_end()) pos 131072, len 4096, copied 4096 00000080:00200000:3.0:1788201595.210778:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002cf06537[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 32] 00000080:00200000:3.0:1788201595.210781:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000dfafdcc2 17ffffc0001001 3:0 ffff8bc15069f460 32 lru 00000080:00200000:3.0:1788201595.210786:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007a8c784a 32: 1< 0 - - > 2< 131072 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000100:00100000:0.0:1788201595.210918:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728024832:192.168.201.143@tcp:103:ldlm_bl.0 00000080:00200000:3.0:1788201595.210996:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002cf06537 00000080:00200000:3.0:1788201595.210998:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 33. 00000080:00200000:3.0:1788201595.211001:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 33 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.211020:0:24470:0:(rw26.c:898:ll_write_end()) pos 135168, len 4096, copied 4096 00000080:00200000:3.0:1788201595.211024:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006b9416b5[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 33] 00000080:00200000:3.0:1788201595.211027:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000584ecad 17ffffc0001001 3:0 ffff8bc15069fd20 33 lru 00000080:00200000:3.0:1788201595.211033:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d737d5d0 33: 1< 0 - - > 2< 135168 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.211036:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006b9416b5 00000080:00200000:3.0:1788201595.211037:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 34. 00000080:00200000:3.0:1788201595.211039:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 34 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.211056:0:24470:0:(rw26.c:898:ll_write_end()) pos 139264, len 4096, copied 4096 00000080:00200000:3.0:1788201595.211060:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000eb1a61b6[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 34] 00000080:00200000:3.0:1788201595.211062:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008e579860 17ffffc0001001 3:0 ffff8bc15069f000 34 lru 00000080:00200000:3.0:1788201595.211067:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000088f8e070 34: 1< 0 - - > 2< 139264 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.211069:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000eb1a61b6 00000080:00200000:3.0:1788201595.211071:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 35. 00000080:00200000:3.0:1788201595.211073:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 35 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.211100:0:24470:0:(rw26.c:898:ll_write_end()) pos 143360, len 4096, copied 4096 00000080:00200000:3.0:1788201595.211104:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000094d2540d[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 35] 00000080:00200000:3.0:1788201595.211107:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007f1920f2 17ffffc0001001 3:0 ffff8bc1507811c0 35 lru 00000080:00200000:3.0:1788201595.211112:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000012b1c143 35: 1< 0 - - > 2< 143360 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.211114:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000094d2540d 00000080:00200000:3.0:1788201595.211115:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 36. 00000080:00200000:3.0:1788201595.211117:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 36 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.211208:0:24470:0:(rw26.c:898:ll_write_end()) pos 147456, len 4096, copied 4096 00000080:00200000:3.0:1788201595.211213:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000075ae17d9[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 36] 00000080:00200000:3.0:1788201595.211216:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e3c6754f 17ffffc0001001 3:0 ffff8bc1507810e0 36 lru 00000080:00200000:3.0:1788201595.211221:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000004706ab3 36: 1< 0 - - > 2< 147456 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.211223:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000075ae17d9 00000080:00200000:3.0:1788201595.211224:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 37. 00000080:00200000:3.0:1788201595.211226:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 37 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.211240:0:24470:0:(rw26.c:898:ll_write_end()) pos 151552, len 4096, copied 4096 00000080:00200000:3.0:1788201595.211245:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000a459f3d[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 37] 00000080:00200000:3.0:1788201595.211248:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000afb7787 17ffffc0001001 3:0 ffff8bc1507819a0 37 lru 00000080:00200000:3.0:1788201595.211253:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000086dbda1c 37: 1< 0 - - > 2< 151552 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.211255:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000a459f3d 00000080:00200000:3.0:1788201595.211256:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 38. 00000080:00200000:3.0:1788201595.211258:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 38 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.211271:0:24470:0:(rw26.c:898:ll_write_end()) pos 155648, len 4096, copied 4096 00000080:00200000:3.0:1788201595.211276:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d1e1267f[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 38] 00000080:00200000:3.0:1788201595.211278:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b222af37 17ffffc0001001 3:0 ffff8bc150781c40 38 lru 00000080:00200000:3.0:1788201595.211284:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000034f317b1 38: 1< 0 - - > 2< 155648 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.211286:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d1e1267f 00000080:00200000:3.0:1788201595.211287:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 39. 00000080:00200000:3.0:1788201595.211288:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 39 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.211303:0:24470:0:(rw26.c:898:ll_write_end()) pos 159744, len 4096, copied 4096 00000080:00200000:3.0:1788201595.211308:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000993b78db[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 39] 00000080:00200000:3.0:1788201595.211311:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009ff1c908 17ffffc0001001 3:0 ffff8bc150781a80 39 lru 00000080:00200000:3.0:1788201595.211316:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e254a4e0 39: 1< 0 - - > 2< 159744 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.211318:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000993b78db 00000080:00200000:3.0:1788201595.211319:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 40. 00000080:00200000:3.0:1788201595.211321:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 40 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.211337:0:24470:0:(rw26.c:898:ll_write_end()) pos 163840, len 4096, copied 4096 00000080:00200000:3.0:1788201595.211351:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002498ed85[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 40] 00000080:00200000:3.0:1788201595.211354:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000533e34b1 17ffffc0001001 3:0 ffff8bc150781540 40 lru 00000080:00200000:3.0:1788201595.211359:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001b806467 40: 1< 0 - - > 2< 163840 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.211362:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002498ed85 00000080:00200000:3.0:1788201595.211363:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 41. 00000080:00200000:3.0:1788201595.211365:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 41 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.211381:0:24470:0:(rw26.c:898:ll_write_end()) pos 167936, len 4096, copied 4096 00000080:00200000:3.0:1788201595.211385:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000040bd9843[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 41] 00000080:00200000:3.0:1788201595.211388:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006f12067e 17ffffc0001001 3:0 ffff8bc1507818c0 41 lru 00000080:00200000:3.0:1788201595.211394:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000fb982c99 41: 1< 0 - - > 2< 167936 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.211396:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000040bd9843 00000080:00200000:3.0:1788201595.211397:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 42. 00000080:00200000:3.0:1788201595.211399:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 42 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.211415:0:24470:0:(rw26.c:898:ll_write_end()) pos 172032, len 4096, copied 4096 00000080:00200000:3.0:1788201595.211420:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007162cc88[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 42] 00000080:00200000:3.0:1788201595.211423:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d676e1f4 17ffffc0001001 3:0 ffff8bc150781e00 42 lru 00000080:00200000:3.0:1788201595.211428:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004c957e69 42: 1< 0 - - > 2< 172032 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.211430:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007162cc88 00000080:00200000:3.0:1788201595.211431:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 43. 00000080:00200000:3.0:1788201595.211433:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 43 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.211450:0:24470:0:(rw26.c:898:ll_write_end()) pos 176128, len 4096, copied 4096 00000080:00200000:3.0:1788201595.211454:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008cc96e7a[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 43] 00000080:00200000:3.0:1788201595.211457:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003316f45a 17ffffc0001001 3:0 ffff8bc150781ee0 43 lru 00000080:00200000:3.0:1788201595.211462:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006a76fe91 43: 1< 0 - - > 2< 176128 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.211464:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008cc96e7a 00000080:00200000:3.0:1788201595.211465:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 44. 00000080:00200000:3.0:1788201595.211467:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 44 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.211487:0:24470:0:(rw26.c:898:ll_write_end()) pos 180224, len 4096, copied 4096 00000080:00200000:3.0:1788201595.211492:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003eb7e386[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 44] 00000080:00200000:3.0:1788201595.211496:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000006f8afd3 17ffffc0001021 2:0 ffff8bc150781620 44 lru 00000080:00200000:3.0:1788201595.211500:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ab85cdde 44: 1< 0 - - > 2< 180224 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.211503:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003eb7e386 00000080:00200000:3.0:1788201595.211504:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 45. 00000080:00200000:3.0:1788201595.211506:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 45 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.211693:0:24470:0:(rw26.c:898:ll_write_end()) pos 184320, len 4096, copied 4096 00000080:00200000:3.0:1788201595.211700:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000073a0c1d7[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 45] 00000080:00200000:3.0:1788201595.211703:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000af23b6b6 17ffffc0001001 3:0 ffff8bc1507817e0 45 lru 00000080:00200000:3.0:1788201595.211708:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009e54993c 45: 1< 0 - - > 2< 184320 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.211711:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000073a0c1d7 00000080:00200000:3.0:1788201595.211712:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 46. 00000080:00200000:3.0:1788201595.211715:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 46 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.211732:0:24470:0:(rw26.c:898:ll_write_end()) pos 188416, len 4096, copied 4096 00000080:00200000:3.0:1788201595.211737:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a5162c69[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 46] 00000080:00200000:3.0:1788201595.211740:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000684357d7 17ffffc0001001 3:0 ffff8bc150781700 46 lru 00000080:00200000:3.0:1788201595.211746:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b8334aab 46: 1< 0 - - > 2< 188416 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.211748:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a5162c69 00000080:00200000:3.0:1788201595.211749:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 47. 00000080:00200000:3.0:1788201595.211751:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 47 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.211765:0:24470:0:(rw26.c:898:ll_write_end()) pos 192512, len 4096, copied 4096 00000080:00200000:3.0:1788201595.211770:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d3ff7fb8[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 47] 00000080:00200000:3.0:1788201595.211773:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002a3adf3a 17ffffc0001001 3:0 ffff8bc150781b60 47 lru 00000080:00200000:3.0:1788201595.211778:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000fc6ab62e 47: 1< 0 - - > 2< 192512 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.211780:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d3ff7fb8 00000080:00200000:3.0:1788201595.211781:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 48. 00000080:00200000:3.0:1788201595.211783:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 48 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.211818:0:24470:0:(rw26.c:898:ll_write_end()) pos 196608, len 4096, copied 4096 00000080:00200000:3.0:1788201595.211823:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000016974e2f[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 48] 00000080:00200000:3.0:1788201595.211826:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000058e0920 17ffffc0001001 3:0 ffff8bc1507812a0 48 lru 00000080:00200000:3.0:1788201595.211832:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a3c3e48f 48: 1< 0 - - > 2< 196608 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.211834:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000016974e2f 00000080:00200000:3.0:1788201595.211835:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 49. 00000080:00200000:3.0:1788201595.211837:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 49 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.211852:0:24470:0:(rw26.c:898:ll_write_end()) pos 200704, len 4096, copied 4096 00000080:00200000:3.0:1788201595.211856:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009ea7aa76[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 49] 00000080:00200000:3.0:1788201595.211859:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000045abef2a 17ffffc0001001 3:0 ffff8bc150781460 49 lru 00000080:00200000:3.0:1788201595.211864:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b03f419e 49: 1< 0 - - > 2< 200704 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.211867:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009ea7aa76 00000080:00200000:3.0:1788201595.211868:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 50. 00000080:00200000:3.0:1788201595.211870:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 50 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.211888:0:24470:0:(rw26.c:898:ll_write_end()) pos 204800, len 4096, copied 4096 00000080:00200000:3.0:1788201595.211892:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000388c4655[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 50] 00000080:00200000:3.0:1788201595.211895:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000000aa9b6f 17ffffc0001001 3:0 ffff8bc150781d20 50 lru 00000080:00200000:3.0:1788201595.211900:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000fe76ccb3 50: 1< 0 - - > 2< 204800 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.211902:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000388c4655 00000080:00200000:3.0:1788201595.211903:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 51. 00000080:00200000:3.0:1788201595.211905:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 51 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.211919:0:24470:0:(rw26.c:898:ll_write_end()) pos 208896, len 4096, copied 4096 00000080:00200000:3.0:1788201595.211923:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000057fbfbc8[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 51] 00000080:00200000:3.0:1788201595.211926:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000007450227 17ffffc0001001 3:0 ffff8bc150781000 51 lru 00000080:00200000:3.0:1788201595.211931:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000073b2547e 51: 1< 0 - - > 2< 208896 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.211934:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000057fbfbc8 00000080:00200000:3.0:1788201595.211935:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 52. 00000080:00200000:3.0:1788201595.211937:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 52 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.211954:0:24470:0:(rw26.c:898:ll_write_end()) pos 212992, len 4096, copied 4096 00000080:00200000:3.0:1788201595.211958:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000cb9e8d05[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 52] 00000080:00200000:3.0:1788201595.211961:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006ea5cf9b 17ffffc0001001 3:0 ffff8bc150781380 52 lru 00000080:00200000:3.0:1788201595.211966:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a44790cd 52: 1< 0 - - > 2< 212992 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.211968:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000cb9e8d05 00000080:00200000:3.0:1788201595.211970:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 53. 00000080:00200000:3.0:1788201595.211972:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 53 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.211997:0:24470:0:(rw26.c:898:ll_write_end()) pos 217088, len 4096, copied 4096 00000080:00200000:3.0:1788201595.212002:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000adf46a09[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 53] 00000080:00200000:3.0:1788201595.212005:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000afbe4711 17ffffc0001001 3:0 ffff8bc144e3c8c0 53 lru 00000080:00200000:3.0:1788201595.212010:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000082dc38f6 53: 1< 0 - - > 2< 217088 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.212012:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000adf46a09 00000080:00200000:3.0:1788201595.212013:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 54. 00000080:00200000:3.0:1788201595.212015:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 54 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.212031:0:24470:0:(rw26.c:898:ll_write_end()) pos 221184, len 4096, copied 4096 00000080:00200000:3.0:1788201595.212035:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000df533996[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 54] 00000080:00200000:3.0:1788201595.212038:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002a487c8c 17ffffc0001001 3:0 ffff8bc144e3ce00 54 lru 00000080:00200000:3.0:1788201595.212043:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000030c001f2 54: 1< 0 - - > 2< 221184 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.212045:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000df533996 00000080:00200000:3.0:1788201595.212047:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 55. 00000080:00200000:3.0:1788201595.212048:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 55 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.212061:0:24470:0:(rw26.c:898:ll_write_end()) pos 225280, len 4096, copied 4096 00000080:00200000:3.0:1788201595.212065:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000042ebd3cb[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 55] 00000080:00200000:3.0:1788201595.212068:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000297f2f8e 17ffffc0001001 3:0 ffff8bc144e3cee0 55 lru 00000080:00200000:3.0:1788201595.212074:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003cbe5bd9 55: 1< 0 - - > 2< 225280 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.212076:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000042ebd3cb 00000080:00200000:3.0:1788201595.212077:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 56. 00000080:00200000:3.0:1788201595.212079:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 56 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.212094:0:24470:0:(rw26.c:898:ll_write_end()) pos 229376, len 4096, copied 4096 00000080:00200000:3.0:1788201595.212098:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004ed21ee7[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 56] 00000080:00200000:3.0:1788201595.212101:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b3661ffe 17ffffc0001001 3:0 ffff8bc144e3c620 56 lru 00000080:00200000:3.0:1788201595.212106:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b27f80b4 56: 1< 0 - - > 2< 229376 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.212108:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004ed21ee7 00000080:00200000:3.0:1788201595.212109:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 57. 00000080:00200000:3.0:1788201595.212111:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 57 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.212259:0:24470:0:(rw26.c:898:ll_write_end()) pos 233472, len 4096, copied 4096 00000080:00200000:3.0:1788201595.212265:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000082a33a0c[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 57] 00000080:00200000:3.0:1788201595.212270:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006d32c697 17ffffc0001001 3:0 ffff8bc144e3c7e0 57 lru 00000080:00200000:3.0:1788201595.212274:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000083676fb4 57: 1< 0 - - > 2< 233472 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.212277:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000082a33a0c 00000080:00200000:3.0:1788201595.212278:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 58. 00000080:00200000:3.0:1788201595.212280:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 58 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.212297:0:24470:0:(rw26.c:898:ll_write_end()) pos 237568, len 4096, copied 4096 00000080:00200000:3.0:1788201595.212301:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f61fe509[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 58] 00000080:00200000:3.0:1788201595.212305:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000012f8ab6c 17ffffc0001001 3:0 ffff8bc144e3c700 58 lru 00000080:00200000:3.0:1788201595.212311:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a774f0a4 58: 1< 0 - - > 2< 237568 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.212313:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f61fe509 00000080:00200000:3.0:1788201595.212314:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 59. 00000080:00200000:3.0:1788201595.212316:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 59 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.212333:0:24470:0:(rw26.c:898:ll_write_end()) pos 241664, len 4096, copied 4096 00000080:00200000:3.0:1788201595.212338:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a298902c[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 59] 00000080:00200000:3.0:1788201595.212352:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005ace0981 17ffffc0001021 2:0 ffff8bc144e3cb60 59 lru 00000080:00200000:3.0:1788201595.212358:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d3d45002 59: 1< 0 - - > 2< 241664 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.212360:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a298902c 00000080:00200000:3.0:1788201595.212362:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 60. 00000080:00200000:3.0:1788201595.212364:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 60 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.212379:0:24470:0:(rw26.c:898:ll_write_end()) pos 245760, len 4096, copied 4096 00000080:00200000:3.0:1788201595.212384:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000c7702f7[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 60] 00000080:00200000:3.0:1788201595.212386:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c6d182eb 17ffffc0001001 3:0 ffff8bc144e3c2a0 60 lru 00000080:00200000:3.0:1788201595.212392:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008f35ee36 60: 1< 0 - - > 2< 245760 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.212394:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000c7702f7 00000080:00200000:3.0:1788201595.212395:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 61. 00000080:00200000:3.0:1788201595.212397:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 61 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.212409:0:24470:0:(rw26.c:898:ll_write_end()) pos 249856, len 4096, copied 4096 00000080:00200000:3.0:1788201595.212413:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000026ed2221[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 61] 00000080:00200000:3.0:1788201595.212416:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007ccfa488 17ffffc0001001 3:0 ffff8bc144e3c460 61 lru 00000080:00200000:3.0:1788201595.212421:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000071f5c6bc 61: 1< 0 - - > 2< 249856 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.212423:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000026ed2221 00000080:00200000:3.0:1788201595.212425:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 62. 00000080:00200000:3.0:1788201595.212426:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 62 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.212441:0:24470:0:(rw26.c:898:ll_write_end()) pos 253952, len 4096, copied 4096 00000080:00200000:3.0:1788201595.212445:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000249f5c0b[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 62] 00000080:00200000:3.0:1788201595.212448:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000da2413a3 17ffffc0001001 3:0 ffff8bc144e3cd20 62 lru 00000080:00200000:3.0:1788201595.212453:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d2218164 62: 1< 0 - - > 2< 253952 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.212455:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000249f5c0b 00000080:00200000:3.0:1788201595.212456:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 63. 00000080:00200000:3.0:1788201595.212458:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 63 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.212472:0:24470:0:(rw26.c:898:ll_write_end()) pos 258048, len 4096, copied 4096 00000080:00200000:3.0:1788201595.212476:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000031155973[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 63] 00000080:00200000:3.0:1788201595.212479:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000022878323 17ffffc0001001 3:0 ffff8bc144e3c000 63 lru 00000080:00200000:3.0:1788201595.212484:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a81715b4 63: 1< 0 - - > 2< 258048 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.212487:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000031155973 00000080:00200000:3.0:1788201595.212488:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 64. 00000080:00200000:3.0:1788201595.212490:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 64 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.212658:0:24470:0:(rw26.c:898:ll_write_end()) pos 262144, len 4096, copied 4096 00000080:00200000:3.0:1788201595.212665:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004097ce52[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 64] 00000080:00200000:3.0:1788201595.212669:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e874217b 17ffffc0001001 3:0 ffff8bc144e3c380 64 lru 00000080:00200000:3.0:1788201595.212674:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006204cbcb 64: 1< 0 - - > 2< 262144 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.212676:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004097ce52 00000080:00200000:3.0:1788201595.212677:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 65. 00000080:00200000:3.0:1788201595.212679:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 65 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.212696:0:24470:0:(rw26.c:898:ll_write_end()) pos 266240, len 4096, copied 4096 00000080:00200000:3.0:1788201595.212701:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d43dff41[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 65] 00000080:00200000:3.0:1788201595.212705:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f19658f9 17ffffc0001001 3:0 ffff8bc144e3c1c0 65 lru 00000080:00200000:3.0:1788201595.212711:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000038fd324f 65: 1< 0 - - > 2< 266240 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.212713:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d43dff41 00000080:00200000:3.0:1788201595.212714:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 66. 00000080:00200000:3.0:1788201595.212716:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 66 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.212732:0:24470:0:(rw26.c:898:ll_write_end()) pos 270336, len 4096, copied 4096 00000080:00200000:3.0:1788201595.212737:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ac4b2eef[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 66] 00000080:00200000:3.0:1788201595.212740:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000247e539a 17ffffc0001001 3:0 ffff8bc144e3c0e0 66 lru 00000080:00200000:3.0:1788201595.212745:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a7afe467 66: 1< 0 - - > 2< 270336 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.212748:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ac4b2eef 00000080:00200000:3.0:1788201595.212749:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 67. 00000080:00200000:3.0:1788201595.212751:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 67 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.212765:0:24470:0:(rw26.c:898:ll_write_end()) pos 274432, len 4096, copied 4096 00000080:00200000:3.0:1788201595.212770:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000cf1c04e3[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 67] 00000080:00200000:3.0:1788201595.212773:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009043cccf 17ffffc0001001 3:0 ffff8bc144e3c9a0 67 lru 00000080:00200000:3.0:1788201595.212778:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003ed100bf 67: 1< 0 - - > 2< 274432 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.212780:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000cf1c04e3 00000080:00200000:3.0:1788201595.212782:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 68. 00000080:00200000:3.0:1788201595.212784:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 68 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.212815:0:24470:0:(rw26.c:898:ll_write_end()) pos 278528, len 4096, copied 4096 00000080:00200000:3.0:1788201595.212820:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002c84b8df[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 68] 00000080:00200000:3.0:1788201595.212823:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c7a32672 17ffffc0001001 3:0 ffff8bc144e3cc40 68 lru 00000080:00200000:3.0:1788201595.212829:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000710baa00 68: 1< 0 - - > 2< 278528 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.212831:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002c84b8df 00000080:00200000:3.0:1788201595.212832:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 69. 00000080:00200000:3.0:1788201595.212834:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 69 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.212851:0:24470:0:(rw26.c:898:ll_write_end()) pos 282624, len 4096, copied 4096 00000080:00200000:3.0:1788201595.212856:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003d226871[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 69] 00000080:00200000:3.0:1788201595.212859:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008a8d9408 17ffffc0001001 3:0 ffff8bc144e3ca80 69 lru 00000080:00200000:3.0:1788201595.212864:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000002a1895df 69: 1< 0 - - > 2< 282624 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.212866:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003d226871 00000080:00200000:3.0:1788201595.212868:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 70. 00000080:00200000:3.0:1788201595.212870:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 70 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.212889:0:24470:0:(rw26.c:898:ll_write_end()) pos 286720, len 4096, copied 4096 00000080:00200000:3.0:1788201595.212893:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000223f22c3[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 70] 00000080:00200000:3.0:1788201595.212896:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000881c9021 17ffffc0001001 3:0 ffff8bc144e3c540 70 lru 00000080:00200000:3.0:1788201595.212901:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000000061a8f 70: 1< 0 - - > 2< 286720 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.212903:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000223f22c3 00000080:00200000:3.0:1788201595.212904:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 71. 00000080:00200000:3.0:1788201595.212906:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 71 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.212932:0:24470:0:(rw26.c:898:ll_write_end()) pos 290816, len 4096, copied 4096 00000080:00200000:3.0:1788201595.212937:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007b5a6996[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 71] 00000080:00200000:3.0:1788201595.212939:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c4e00d9f 17ffffc0001001 3:0 ffff8bc150bb5e00 71 lru 00000080:00200000:3.0:1788201595.212945:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b049a3fb 71: 1< 0 - - > 2< 290816 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.212947:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007b5a6996 00000080:00200000:3.0:1788201595.212948:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 72. 00000080:00200000:3.0:1788201595.212950:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 72 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.212964:0:24470:0:(rw26.c:898:ll_write_end()) pos 294912, len 4096, copied 4096 00000080:00200000:3.0:1788201595.212969:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000019f1f616[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 72] 00000080:00200000:3.0:1788201595.212972:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009468431b 17ffffc0001001 3:0 ffff8bc150bb5ee0 72 lru 00000080:00200000:3.0:1788201595.212978:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006d052ee8 72: 1< 0 - - > 2< 294912 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.212980:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000019f1f616 00000080:00200000:3.0:1788201595.212981:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 73. 00000080:00200000:3.0:1788201595.212983:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 73 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.212997:0:24470:0:(rw26.c:898:ll_write_end()) pos 299008, len 4096, copied 4096 00000080:00200000:3.0:1788201595.213002:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f3b92c21[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 73] 00000080:00200000:3.0:1788201595.213005:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000018186917 17ffffc0001001 3:0 ffff8bc150bb5620 73 lru 00000080:00200000:3.0:1788201595.213011:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a950e6a4 73: 1< 0 - - > 2< 299008 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.213014:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f3b92c21 00000080:00200000:3.0:1788201595.213015:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 74. 00000080:00200000:3.0:1788201595.213017:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 74 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.213034:0:24470:0:(rw26.c:898:ll_write_end()) pos 303104, len 4096, copied 4096 00000080:00200000:3.0:1788201595.213038:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000027683984[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 74] 00000080:00200000:3.0:1788201595.213042:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006db3298c 17ffffc0001021 2:0 ffff8bc150bb57e0 74 lru 00000080:00200000:3.0:1788201595.213048:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003f6eeb99 74: 1< 0 - - > 2< 303104 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.213050:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000027683984 00000080:00200000:3.0:1788201595.213051:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 75. 00000080:00200000:3.0:1788201595.213053:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 75 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.213066:0:24470:0:(rw26.c:898:ll_write_end()) pos 307200, len 4096, copied 4096 00000080:00200000:3.0:1788201595.213070:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c4f0499e[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 75] 00000080:00200000:3.0:1788201595.213073:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e0082982 17ffffc0001001 3:0 ffff8bc150bb5700 75 lru 00000080:00200000:3.0:1788201595.213079:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003b39821c 75: 1< 0 - - > 2< 307200 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.213081:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c4f0499e 00000080:00200000:3.0:1788201595.213083:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 76. 00000080:00200000:3.0:1788201595.213084:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 76 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.213098:0:24470:0:(rw26.c:898:ll_write_end()) pos 311296, len 4096, copied 4096 00000080:00200000:3.0:1788201595.213102:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000eda02fa8[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 76] 00000080:00200000:3.0:1788201595.213105:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ef6a1d23 17ffffc0001001 3:0 ffff8bc150bb5b60 76 lru 00000080:00200000:3.0:1788201595.213110:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000db6686eb 76: 1< 0 - - > 2< 311296 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.213113:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000eda02fa8 00000080:00200000:3.0:1788201595.213114:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 77. 00000080:00200000:3.0:1788201595.213116:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 77 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.213206:0:24470:0:(rw26.c:898:ll_write_end()) pos 315392, len 4096, copied 4096 00000080:00200000:3.0:1788201595.213211:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a4c5e4ef[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 77] 00000080:00200000:3.0:1788201595.213214:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000bfed3589 17ffffc0001001 3:0 ffff8bc150bb52a0 77 lru 00000080:00200000:3.0:1788201595.213220:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000075911f24 77: 1< 0 - - > 2< 315392 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.213222:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a4c5e4ef 00000080:00200000:3.0:1788201595.213223:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 78. 00000080:00200000:3.0:1788201595.213226:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 78 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.213244:0:24470:0:(rw26.c:898:ll_write_end()) pos 319488, len 4096, copied 4096 00000080:00200000:3.0:1788201595.213248:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000016d9113f[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 78] 00000080:00200000:3.0:1788201595.213251:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e6b570db 17ffffc0001001 3:0 ffff8bc150bb5460 78 lru 00000080:00200000:3.0:1788201595.213257:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003348d45a 78: 1< 0 - - > 2< 319488 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.213259:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000016d9113f 00000080:00200000:3.0:1788201595.213260:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 79. 00000080:00200000:3.0:1788201595.213262:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 79 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.213275:0:24470:0:(rw26.c:898:ll_write_end()) pos 323584, len 4096, copied 4096 00000080:00200000:3.0:1788201595.213279:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000342c1e81[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 79] 00000080:00200000:3.0:1788201595.213282:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000939e4fc9 17ffffc0001001 3:0 ffff8bc150bb5d20 79 lru 00000080:00200000:3.0:1788201595.213288:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000091936077 79: 1< 0 - - > 2< 323584 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.213290:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000342c1e81 00000080:00200000:3.0:1788201595.213292:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 80. 00000080:00200000:3.0:1788201595.213293:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 80 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.213306:0:24470:0:(rw26.c:898:ll_write_end()) pos 327680, len 4096, copied 4096 00000080:00200000:3.0:1788201595.213311:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003c76efb7[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 80] 00000080:00200000:3.0:1788201595.213313:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003940bdef 17ffffc0001001 3:0 ffff8bc150bb5000 80 lru 00000080:00200000:3.0:1788201595.213319:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000180ea6cb 80: 1< 0 - - > 2< 327680 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.213321:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003c76efb7 00000080:00200000:3.0:1788201595.213323:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 81. 00000080:00200000:3.0:1788201595.213324:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 81 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.213337:0:24470:0:(rw26.c:898:ll_write_end()) pos 331776, len 4096, copied 4096 00000080:00200000:3.0:1788201595.213353:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006e5c9dea[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 81] 00000080:00200000:3.0:1788201595.213357:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007af6d34f 17ffffc0001001 3:0 ffff8bc150bb5380 81 lru 00000080:00200000:3.0:1788201595.213363:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000158ce366 81: 1< 0 - - > 2< 331776 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.213365:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006e5c9dea 00000080:00200000:3.0:1788201595.213366:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 82. 00000080:00200000:3.0:1788201595.213369:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 82 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.213384:0:24470:0:(rw26.c:898:ll_write_end()) pos 335872, len 4096, copied 4096 00000080:00200000:3.0:1788201595.213388:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d5d944fb[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 82] 00000080:00200000:3.0:1788201595.213392:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000010550f96 17ffffc0001001 3:0 ffff8bc150bb51c0 82 lru 00000080:00200000:3.0:1788201595.213397:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000eae35452 82: 1< 0 - - > 2< 335872 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.213400:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d5d944fb 00000080:00200000:3.0:1788201595.213401:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 83. 00000080:00200000:3.0:1788201595.213403:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 83 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.213416:0:24470:0:(rw26.c:898:ll_write_end()) pos 339968, len 4096, copied 4096 00000080:00200000:3.0:1788201595.213420:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000dedf75ab[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 83] 00000080:00200000:3.0:1788201595.213423:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000057f901cd 17ffffc0001001 3:0 ffff8bc150bb50e0 83 lru 00000080:00200000:3.0:1788201595.213429:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b4420498 83: 1< 0 - - > 2< 339968 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.213431:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000dedf75ab 00000080:00200000:3.0:1788201595.213433:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 84. 00000080:00200000:3.0:1788201595.213435:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 84 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.213446:0:24470:0:(rw26.c:898:ll_write_end()) pos 344064, len 4096, copied 4096 00000080:00200000:3.0:1788201595.213450:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009a49e725[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 84] 00000080:00200000:3.0:1788201595.213454:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c4e14cca 17ffffc0001001 3:0 ffff8bc150bb59a0 84 lru 00000080:00200000:3.0:1788201595.213459:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a912a4a5 84: 1< 0 - - > 2< 344064 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.213462:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009a49e725 00000080:00200000:3.0:1788201595.213463:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 85. 00000080:00200000:3.0:1788201595.213465:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 85 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.213479:0:24470:0:(rw26.c:898:ll_write_end()) pos 348160, len 4096, copied 4096 00000080:00200000:3.0:1788201595.213484:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000272fb017[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 85] 00000080:00200000:3.0:1788201595.213487:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000098e67a7a 17ffffc0001001 3:0 ffff8bc150bb5c40 85 lru 00000080:00200000:3.0:1788201595.213491:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000af5ee730 85: 1< 0 - - > 2< 348160 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.213493:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000272fb017 00000080:00200000:3.0:1788201595.213494:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 86. 00000080:00200000:3.0:1788201595.213496:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 86 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.213511:0:24470:0:(rw26.c:898:ll_write_end()) pos 352256, len 4096, copied 4096 00000080:00200000:3.0:1788201595.213515:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000bebe3620[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 86] 00000080:00200000:3.0:1788201595.213592:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f32b3bf1 17ffffc0001001 3:0 ffff8bc150bb5a80 86 lru 00000080:00200000:3.0:1788201595.213598:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b72d1f6d 86: 1< 0 - - > 2< 352256 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.213600:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000bebe3620 00000080:00200000:3.0:1788201595.213601:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 87. 00000080:00200000:3.0:1788201595.213604:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 87 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.213620:0:24470:0:(rw26.c:898:ll_write_end()) pos 356352, len 4096, copied 4096 00000080:00200000:3.0:1788201595.213625:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b327182a[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 87] 00000080:00200000:3.0:1788201595.213628:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000cfeba9c2 17ffffc0001001 3:0 ffff8bc150bb5540 87 lru 00000080:00200000:3.0:1788201595.213634:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000693672a8 87: 1< 0 - - > 2< 356352 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.213636:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b327182a 00000080:00200000:3.0:1788201595.213637:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 88. 00000080:00200000:3.0:1788201595.213639:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 88 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.213652:0:24470:0:(rw26.c:898:ll_write_end()) pos 360448, len 4096, copied 4096 00000080:00200000:3.0:1788201595.213655:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ae38759a[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 88] 00000080:00200000:3.0:1788201595.213659:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000018c611ce 17ffffc0001001 3:0 ffff8bc150bb58c0 88 lru 00000080:00200000:3.0:1788201595.213664:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000544c7372 88: 1< 0 - - > 2< 360448 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.213666:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ae38759a 00000080:00200000:3.0:1788201595.213668:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 89. 00000080:00200000:3.0:1788201595.213670:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 89 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.213697:0:24470:0:(rw26.c:898:ll_write_end()) pos 364544, len 4096, copied 4096 00000080:00200000:3.0:1788201595.213702:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000fb6fda5e[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 89] 00000080:00200000:3.0:1788201595.213705:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006c76879e 17ffffc0001021 2:0 ffff8bc15c04a540 89 lru 00000080:00200000:3.0:1788201595.213711:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f8e40a7d 89: 1< 0 - - > 2< 364544 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.213713:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000fb6fda5e 00000080:00200000:3.0:1788201595.213715:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 90. 00000080:00200000:3.0:1788201595.213717:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 90 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.213732:0:24470:0:(rw26.c:898:ll_write_end()) pos 368640, len 4096, copied 4096 00000080:00200000:3.0:1788201595.213737:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005dd44292[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 90] 00000080:00200000:3.0:1788201595.213740:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008c9ccdf8 17ffffc0001001 3:0 ffff8bc15c04a8c0 90 lru 00000080:00200000:3.0:1788201595.213745:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009c70290c 90: 1< 0 - - > 2< 368640 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.213747:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005dd44292 00000080:00200000:3.0:1788201595.213748:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 91. 00000080:00200000:3.0:1788201595.213750:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 91 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.213765:0:24470:0:(rw26.c:898:ll_write_end()) pos 372736, len 4096, copied 4096 00000080:00200000:3.0:1788201595.213769:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000008b092db[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 91] 00000080:00200000:3.0:1788201595.213772:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006472b746 17ffffc0001001 3:0 ffff8bc15c04ae00 91 lru 00000080:00200000:3.0:1788201595.213777:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005b483e0b 91: 1< 0 - - > 2< 372736 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.213778:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000008b092db 00000080:00200000:3.0:1788201595.213779:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 92. 00000080:00200000:3.0:1788201595.213782:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 92 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.213825:0:24470:0:(rw26.c:898:ll_write_end()) pos 376832, len 4096, copied 4096 00000080:00200000:3.0:1788201595.213830:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000dbaae0ac[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 92] 00000080:00200000:3.0:1788201595.213834:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e8515d4d 17ffffc0001001 3:0 ffff8bc15c04aee0 92 lru 00000080:00200000:3.0:1788201595.213839:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a16c91e4 92: 1< 0 - - > 2< 376832 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.213841:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000dbaae0ac 00000080:00200000:3.0:1788201595.213842:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 93. 00000080:00200000:3.0:1788201595.213844:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 93 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.213860:0:24470:0:(rw26.c:898:ll_write_end()) pos 380928, len 4096, copied 4096 00000080:00200000:3.0:1788201595.213865:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f444d88c[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 93] 00000080:00200000:3.0:1788201595.213868:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005848d979 17ffffc0001001 3:0 ffff8bc15c04a620 93 lru 00000080:00200000:3.0:1788201595.213873:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007a02fda6 93: 1< 0 - - > 2< 380928 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.213875:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f444d88c 00000080:00200000:3.0:1788201595.213877:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 94. 00000080:00200000:3.0:1788201595.213878:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 94 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.213894:0:24470:0:(rw26.c:898:ll_write_end()) pos 385024, len 4096, copied 4096 00000080:00200000:3.0:1788201595.213898:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002d52581b[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 94] 00000080:00200000:3.0:1788201595.213901:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000211bfbd8 17ffffc0001001 3:0 ffff8bc15c04a7e0 94 lru 00000080:00200000:3.0:1788201595.213907:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009a97782b 94: 1< 0 - - > 2< 385024 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.213908:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002d52581b 00000080:00200000:3.0:1788201595.213910:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 95. 00000080:00200000:3.0:1788201595.213912:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 95 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.213928:0:24470:0:(rw26.c:898:ll_write_end()) pos 389120, len 4096, copied 4096 00000080:00200000:3.0:1788201595.213932:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001ac004bb[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 95] 00000080:00200000:3.0:1788201595.213935:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000082c9417d 17ffffc0001001 3:0 ffff8bc15c04a700 95 lru 00000080:00200000:3.0:1788201595.213941:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000051ce6773 95: 1< 0 - - > 2< 389120 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.213943:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001ac004bb 00000080:00200000:3.0:1788201595.213945:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 96. 00000080:00200000:3.0:1788201595.213947:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 96 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.213963:0:24470:0:(rw26.c:898:ll_write_end()) pos 393216, len 4096, copied 4096 00000080:00200000:3.0:1788201595.213968:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c762c61d[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 96] 00000080:00200000:3.0:1788201595.213971:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000077fa7ead 17ffffc0001001 3:0 ffff8bc15c04ab60 96 lru 00000080:00200000:3.0:1788201595.213976:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000015f76c3a 96: 1< 0 - - > 2< 393216 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.213979:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c762c61d 00000080:00200000:3.0:1788201595.213980:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 97. 00000080:00200000:3.0:1788201595.213981:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 97 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.213998:0:24470:0:(rw26.c:898:ll_write_end()) pos 397312, len 4096, copied 4096 00000080:00200000:3.0:1788201595.214003:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a1a21d94[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 97] 00000080:00200000:3.0:1788201595.214005:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000012520e9a 17ffffc0001001 3:0 ffff8bc15c04a2a0 97 lru 00000080:00200000:3.0:1788201595.214010:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b77fe8f5 97: 1< 0 - - > 2< 397312 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.214012:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a1a21d94 00000080:00200000:3.0:1788201595.214014:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 98. 00000080:00200000:3.0:1788201595.214016:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 98 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.214028:0:24470:0:(rw26.c:898:ll_write_end()) pos 401408, len 4096, copied 4096 00000080:00200000:3.0:1788201595.214032:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000fa209baf[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 98] 00000080:00200000:3.0:1788201595.214035:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002260657a 17ffffc0001001 3:0 ffff8bc15c04a460 98 lru 00000080:00200000:3.0:1788201595.214040:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004acdb02e 98: 1< 0 - - > 2< 401408 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.214043:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000fa209baf 00000080:00200000:3.0:1788201595.214044:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 99. 00000080:00200000:3.0:1788201595.214046:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 99 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.214057:0:24470:0:(rw26.c:898:ll_write_end()) pos 405504, len 4096, copied 4096 00000080:00200000:3.0:1788201595.214060:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000fa526922[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 99] 00000080:00200000:3.0:1788201595.214063:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a183d1fd 17ffffc0001001 3:0 ffff8bc15c04ad20 99 lru 00000080:00200000:3.0:1788201595.214068:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004cc5ef56 99: 1< 0 - - > 2< 405504 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.214070:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000fa526922 00000080:00200000:3.0:1788201595.214072:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 100. 00000080:00200000:3.0:1788201595.214073:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 100 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.214083:0:24470:0:(rw26.c:898:ll_write_end()) pos 409600, len 4096, copied 4096 00000080:00200000:3.0:1788201595.214086:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ac0e7f74[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 100] 00000080:00200000:3.0:1788201595.214089:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000089e9c1ba 17ffffc0001001 3:0 ffff8bc15c04a000 100 lru 00000080:00200000:3.0:1788201595.214094:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005adc5b7b 100: 1< 0 - - > 2< 409600 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.214097:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ac0e7f74 00000080:00200000:3.0:1788201595.214098:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 101. 00000080:00200000:3.0:1788201595.214100:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 101 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.214109:0:24470:0:(rw26.c:898:ll_write_end()) pos 413696, len 4096, copied 4096 00000080:00200000:3.0:1788201595.214113:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009c14619b[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 101] 00000080:00200000:3.0:1788201595.214115:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003f59343f 17ffffc0001001 3:0 ffff8bc15c04a380 101 lru 00000080:00200000:3.0:1788201595.214120:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003a4bac89 101: 1< 0 - - > 2< 413696 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.214122:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009c14619b 00000080:00200000:3.0:1788201595.214377:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 102. 00000080:00200000:3.0:1788201595.214380:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 102 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.214396:0:24470:0:(rw26.c:898:ll_write_end()) pos 417792, len 4096, copied 4096 00000080:00200000:3.0:1788201595.214401:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d8895f28[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 102] 00000080:00200000:3.0:1788201595.214404:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006c408bfd 17ffffc0001001 3:0 ffff8bc15c04a1c0 102 lru 00000080:00200000:3.0:1788201595.214410:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000002d05e8a7 102: 1< 0 - - > 2< 417792 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.214412:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d8895f28 00000080:00200000:3.0:1788201595.214414:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 103. 00000080:00200000:3.0:1788201595.214415:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 103 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.214425:0:24470:0:(rw26.c:898:ll_write_end()) pos 421888, len 4096, copied 4096 00000080:00200000:3.0:1788201595.214429:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000009ea77c9[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 103] 00000080:00200000:3.0:1788201595.214431:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b77b3ded 17ffffc0001001 3:0 ffff8bc15c04a0e0 103 lru 00000080:00200000:3.0:1788201595.214436:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004af30c8e 103: 1< 0 - - > 2< 421888 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.214439:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000009ea77c9 00000080:00200000:3.0:1788201595.214440:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 104. 00000080:00200000:3.0:1788201595.214441:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 104 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.214456:0:24470:0:(rw26.c:898:ll_write_end()) pos 425984, len 4096, copied 4096 00000080:00200000:3.0:1788201595.214460:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d9212d32[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 104] 00000080:00200000:3.0:1788201595.214462:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000bade144c 17ffffc0001021 2:0 ffff8bc15c04a9a0 104 lru 00000080:00200000:3.0:1788201595.214467:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000505fab83 104: 1< 0 - - > 2< 425984 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.214470:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d9212d32 00000080:00200000:3.0:1788201595.214471:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 105. 00000080:00200000:3.0:1788201595.214473:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 105 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.214487:0:24470:0:(rw26.c:898:ll_write_end()) pos 430080, len 4096, copied 4096 00000080:00200000:3.0:1788201595.214491:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000cf77ebfb[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 105] 00000080:00200000:3.0:1788201595.214494:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ecf8f0a9 17ffffc0001001 3:0 ffff8bc15c04ac40 105 lru 00000080:00200000:3.0:1788201595.214498:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000cfc9e506 105: 1< 0 - - > 2< 430080 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.214501:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000cf77ebfb 00000080:00200000:3.0:1788201595.214502:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 106. 00000080:00200000:3.0:1788201595.214504:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 106 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.214530:0:24470:0:(rw26.c:898:ll_write_end()) pos 434176, len 4096, copied 4096 00000080:00200000:3.0:1788201595.214536:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002a244adb[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 106] 00000080:00200000:3.0:1788201595.214539:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000088b76070 17ffffc0001001 3:0 ffff8bc15c04aa80 106 lru 00000080:00200000:3.0:1788201595.214545:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c74c462c 106: 1< 0 - - > 2< 434176 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.214549:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002a244adb 00000080:00200000:3.0:1788201595.214550:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 107. 00000080:00200000:3.0:1788201595.214552:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 107 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.214573:0:24470:0:(rw26.c:898:ll_write_end()) pos 438272, len 4096, copied 4096 00000080:00200000:3.0:1788201595.214577:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000682a0ed6[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 107] 00000080:00200000:3.0:1788201595.214580:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000046ce6ced 17ffffc0001001 3:0 ffff8bc1724dc620 107 lru 00000080:00200000:3.0:1788201595.214586:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000987d1cd9 107: 1< 0 - - > 2< 438272 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.214588:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000682a0ed6 00000080:00200000:3.0:1788201595.214589:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 108. 00000080:00200000:3.0:1788201595.214590:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 108 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.214600:0:24470:0:(rw26.c:898:ll_write_end()) pos 442368, len 4096, copied 4096 00000080:00200000:3.0:1788201595.214604:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000de4d567[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 108] 00000080:00200000:3.0:1788201595.214606:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002458de66 17ffffc0001001 3:0 ffff8bc1724dc7e0 108 lru 00000080:00200000:3.0:1788201595.214612:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a8e8fef6 108: 1< 0 - - > 2< 442368 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.214614:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000de4d567 00000080:00200000:3.0:1788201595.214615:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 109. 00000080:00200000:3.0:1788201595.214617:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 109 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.214626:0:24470:0:(rw26.c:898:ll_write_end()) pos 446464, len 4096, copied 4096 00000080:00200000:3.0:1788201595.214629:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e854cb86[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 109] 00000080:00200000:3.0:1788201595.214632:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ed863542 17ffffc0001001 3:0 ffff8bc1724dc700 109 lru 00000080:00200000:3.0:1788201595.214637:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005ef04b01 109: 1< 0 - - > 2< 446464 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.214639:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e854cb86 00000080:00200000:3.0:1788201595.214640:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 110. 00000080:00200000:3.0:1788201595.214641:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 110 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.214652:0:24470:0:(rw26.c:898:ll_write_end()) pos 450560, len 4096, copied 4096 00000080:00200000:3.0:1788201595.214655:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000255a17a7[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 110] 00000080:00200000:3.0:1788201595.214658:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002e54b6ef 17ffffc0001001 3:0 ffff8bc1724dcb60 110 lru 00000080:00200000:3.0:1788201595.214663:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001c5d731b 110: 1< 0 - - > 2< 450560 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.214664:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000255a17a7 00000080:00200000:3.0:1788201595.214665:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 111. 00000080:00200000:3.0:1788201595.214667:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 111 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.214682:0:24470:0:(rw26.c:898:ll_write_end()) pos 454656, len 4096, copied 4096 00000080:00200000:3.0:1788201595.214686:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000132c17a9[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 111] 00000080:00200000:3.0:1788201595.214688:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000073a21102 17ffffc0001001 3:0 ffff8bc1724dc2a0 111 lru 00000080:00200000:3.0:1788201595.214694:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d7cb9e74 111: 1< 0 - - > 2< 454656 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.214696:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000132c17a9 00000080:00200000:3.0:1788201595.214697:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 112. 00000080:00200000:3.0:1788201595.214699:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 112 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.214712:0:24470:0:(rw26.c:898:ll_write_end()) pos 458752, len 4096, copied 4096 00000080:00200000:3.0:1788201595.214717:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e5615661[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 112] 00000080:00200000:3.0:1788201595.214719:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c4898a68 17ffffc0001001 3:0 ffff8bc1724dc460 112 lru 00000080:00200000:3.0:1788201595.214725:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000127f16af 112: 1< 0 - - > 2< 458752 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.214727:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e5615661 00000080:00200000:3.0:1788201595.214728:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 113. 00000080:00200000:3.0:1788201595.214730:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 113 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.214744:0:24470:0:(rw26.c:898:ll_write_end()) pos 462848, len 4096, copied 4096 00000080:00200000:3.0:1788201595.214748:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000037470f6f[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 113] 00000080:00200000:3.0:1788201595.214751:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009e9f436b 17ffffc0001001 3:0 ffff8bc1724dcd20 113 lru 00000080:00200000:3.0:1788201595.214756:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000df845d39 113: 1< 0 - - > 2< 462848 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.214758:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000037470f6f 00000080:00200000:3.0:1788201595.214759:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 114. 00000080:00200000:3.0:1788201595.214760:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 114 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.214770:0:24470:0:(rw26.c:898:ll_write_end()) pos 466944, len 4096, copied 4096 00000080:00200000:3.0:1788201595.214773:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ee75cc05[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 114] 00000080:00200000:3.0:1788201595.214776:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004a47b265 17ffffc0001001 3:0 ffff8bc1724dc000 114 lru 00000080:00200000:3.0:1788201595.214781:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001aab27ba 114: 1< 0 - - > 2< 466944 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.214782:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ee75cc05 00000080:00200000:3.0:1788201595.214784:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 115. 00000080:00200000:3.0:1788201595.214785:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 115 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.214817:0:24470:0:(rw26.c:898:ll_write_end()) pos 471040, len 4096, copied 4096 00000080:00200000:3.0:1788201595.214821:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000cdd906da[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 115] 00000080:00200000:3.0:1788201595.214824:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000034f5048a 17ffffc0001001 3:0 ffff8bc1724dc380 115 lru 00000080:00200000:3.0:1788201595.214829:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000002d1c080b 115: 1< 0 - - > 2< 471040 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.214832:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000cdd906da 00000080:00200000:3.0:1788201595.214833:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 116. 00000080:00200000:3.0:1788201595.214835:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 116 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.214846:0:24470:0:(rw26.c:898:ll_write_end()) pos 475136, len 4096, copied 4096 00000080:00200000:3.0:1788201595.214849:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000004d69def[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 116] 00000080:00200000:3.0:1788201595.214852:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000029a036f5 17ffffc0001001 3:0 ffff8bc1724dc1c0 116 lru 00000080:00200000:3.0:1788201595.214857:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000043d7ddcc 116: 1< 0 - - > 2< 475136 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.214859:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000004d69def 00000080:00200000:3.0:1788201595.214860:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 117. 00000080:00200000:3.0:1788201595.214862:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 117 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.214878:0:24470:0:(rw26.c:898:ll_write_end()) pos 479232, len 4096, copied 4096 00000080:00200000:3.0:1788201595.214883:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000083bf2c85[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 117] 00000080:00200000:3.0:1788201595.214885:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ee4f4dc4 17ffffc0001001 3:0 ffff8bc1724dc0e0 117 lru 00000080:00200000:3.0:1788201595.214891:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008926deee 117: 1< 0 - - > 2< 479232 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.214893:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000083bf2c85 00000080:00200000:3.0:1788201595.214894:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 118. 00000080:00200000:3.0:1788201595.214896:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 118 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.214911:0:24470:0:(rw26.c:898:ll_write_end()) pos 483328, len 4096, copied 4096 00000080:00200000:3.0:1788201595.214915:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a15fabfc[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 118] 00000080:00200000:3.0:1788201595.214918:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ae0e5c02 17ffffc0001001 3:0 ffff8bc1724dc9a0 118 lru 00000080:00200000:3.0:1788201595.214923:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d7b17c56 118: 1< 0 - - > 2< 483328 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.214925:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a15fabfc 00000080:00200000:3.0:1788201595.214926:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 119. 00000080:00200000:3.0:1788201595.214928:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 119 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.214946:0:24470:0:(rw26.c:898:ll_write_end()) pos 487424, len 4096, copied 4096 00000080:00200000:3.0:1788201595.214951:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e48a3489[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 119] 00000080:00200000:3.0:1788201595.214954:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000082ec851f 17ffffc0001021 2:0 ffff8bc1724dcc40 119 lru 00000080:00200000:3.0:1788201595.214959:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000387dc7dd 119: 1< 0 - - > 2< 487424 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.214961:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e48a3489 00000080:00200000:3.0:1788201595.214963:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 120. 00000080:00200000:3.0:1788201595.214965:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 120 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.214983:0:24470:0:(rw26.c:898:ll_write_end()) pos 491520, len 4096, copied 4096 00000080:00200000:3.0:1788201595.214987:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000099b69b4d[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 120] 00000080:00200000:3.0:1788201595.214990:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003e430524 17ffffc0001001 3:0 ffff8bc1724dca80 120 lru 00000080:00200000:3.0:1788201595.214995:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008a9924d1 120: 1< 0 - - > 2< 491520 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.214998:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000099b69b4d 00000080:00200000:3.0:1788201595.214999:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 121. 00000080:00200000:3.0:1788201595.215001:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 121 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215015:0:24470:0:(rw26.c:898:ll_write_end()) pos 495616, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215020:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c0e0d8ff[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 121] 00000080:00200000:3.0:1788201595.215022:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002da6a02e 17ffffc0001001 3:0 ffff8bc1724dc540 121 lru 00000080:00200000:3.0:1788201595.215026:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000069071dcc 121: 1< 0 - - > 2< 495616 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215029:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c0e0d8ff 00000080:00200000:3.0:1788201595.215030:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 122. 00000080:00200000:3.0:1788201595.215032:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 122 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215045:0:24470:0:(rw26.c:898:ll_write_end()) pos 499712, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215048:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009935aadd[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 122] 00000080:00200000:3.0:1788201595.215051:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000f19a17c 17ffffc0001001 3:0 ffff8bc1724dc8c0 122 lru 00000080:00200000:3.0:1788201595.215056:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000cb08373e 122: 1< 0 - - > 2< 499712 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215059:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009935aadd 00000080:00200000:3.0:1788201595.215060:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 123. 00000080:00200000:3.0:1788201595.215062:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 123 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215076:0:24470:0:(rw26.c:898:ll_write_end()) pos 503808, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215080:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005068ae20[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 123] 00000080:00200000:3.0:1788201595.215083:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005d7a0e4f 17ffffc0001001 3:0 ffff8bc1724dce00 123 lru 00000080:00200000:3.0:1788201595.215088:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ad46ad3a 123: 1< 0 - - > 2< 503808 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215091:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005068ae20 00000080:00200000:3.0:1788201595.215092:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 124. 00000080:00200000:3.0:1788201595.215094:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 124 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215104:0:24470:0:(rw26.c:898:ll_write_end()) pos 507904, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215107:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009aef5c92[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 124] 00000080:00200000:3.0:1788201595.215110:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005d7b5df6 17ffffc0001001 3:0 ffff8bc1724dcee0 124 lru 00000080:00200000:3.0:1788201595.215115:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000040d2125d 124: 1< 0 - - > 2< 507904 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215117:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009aef5c92 00000080:00200000:3.0:1788201595.215118:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 125. 00000080:00200000:3.0:1788201595.215120:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 125 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215149:0:24470:0:(rw26.c:898:ll_write_end()) pos 512000, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215154:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009b8691f5[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 125] 00000080:00200000:3.0:1788201595.215156:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002d0b0733 17ffffc0001001 3:0 ffff8bc17275cd20 125 lru 00000080:00200000:3.0:1788201595.215162:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009352b00c 125: 1< 0 - - > 2< 512000 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215164:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009b8691f5 00000080:00200000:3.0:1788201595.215166:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 126. 00000080:00200000:3.0:1788201595.215167:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 126 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215177:0:24470:0:(rw26.c:898:ll_write_end()) pos 516096, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215181:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000069335e5e[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 126] 00000080:00200000:3.0:1788201595.215183:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000dcac71c8 17ffffc0001001 3:0 ffff8bc17275c000 126 lru 00000080:00200000:3.0:1788201595.215188:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ca4d337b 126: 1< 0 - - > 2< 516096 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215190:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000069335e5e 00000080:00200000:3.0:1788201595.215192:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 127. 00000080:00200000:3.0:1788201595.215193:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 127 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215205:0:24470:0:(rw26.c:898:ll_write_end()) pos 520192, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215209:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f95c05e9[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 127] 00000080:00200000:3.0:1788201595.215212:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000099b3cbc9 17ffffc0001001 3:0 ffff8bc17275c380 127 lru 00000080:00200000:3.0:1788201595.215217:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001d11de3d 127: 1< 0 - - > 2< 520192 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215219:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f95c05e9 00000080:00200000:3.0:1788201595.215220:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 128. 00000080:00200000:3.0:1788201595.215222:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 128 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215242:0:24470:0:(rw26.c:898:ll_write_end()) pos 524288, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215245:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003b703fb9[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 128] 00000080:00200000:3.0:1788201595.215248:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000062019df1 17ffffc0001001 3:0 ffff8bc17275c1c0 128 lru 00000080:00200000:3.0:1788201595.215252:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000759e7ca6 128: 1< 0 - - > 2< 524288 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215255:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003b703fb9 00000080:00200000:3.0:1788201595.215256:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 129. 00000080:00200000:3.0:1788201595.215257:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 129 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215268:0:24470:0:(rw26.c:898:ll_write_end()) pos 528384, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215272:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000015ff0ea6[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 129] 00000080:00200000:3.0:1788201595.215275:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005dd5cf91 17ffffc0001001 3:0 ffff8bc17275c0e0 129 lru 00000080:00200000:3.0:1788201595.215280:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006cb43937 129: 1< 0 - - > 2< 528384 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215283:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000015ff0ea6 00000080:00200000:3.0:1788201595.215284:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 130. 00000080:00200000:3.0:1788201595.215285:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 130 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215294:0:24470:0:(rw26.c:898:ll_write_end()) pos 532480, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215298:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c4dd1682[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 130] 00000080:00200000:3.0:1788201595.215301:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007020182e 17ffffc0001001 3:0 ffff8bc17275c9a0 130 lru 00000080:00200000:3.0:1788201595.215306:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000bf7596f5 130: 1< 0 - - > 2< 532480 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215307:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c4dd1682 00000080:00200000:3.0:1788201595.215309:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 131. 00000080:00200000:3.0:1788201595.215310:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 131 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215319:0:24470:0:(rw26.c:898:ll_write_end()) pos 536576, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215323:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000bdcc3922[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 131] 00000080:00200000:3.0:1788201595.215325:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000de156e1a 17ffffc0001001 3:0 ffff8bc17275cc40 131 lru 00000080:00200000:3.0:1788201595.215330:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000555924dd 131: 1< 0 - - > 2< 536576 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215332:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000bdcc3922 00000080:00200000:3.0:1788201595.215333:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 132. 00000080:00200000:3.0:1788201595.215335:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 132 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215355:0:24470:0:(rw26.c:898:ll_write_end()) pos 540672, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215359:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ce3cd94a[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 132] 00000080:00200000:3.0:1788201595.215361:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ecaa3523 17ffffc0001001 3:0 ffff8bc17275ca80 132 lru 00000080:00200000:3.0:1788201595.215367:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000351216ce 132: 1< 0 - - > 2< 540672 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215368:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ce3cd94a 00000080:00200000:3.0:1788201595.215369:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 133. 00000080:00200000:3.0:1788201595.215371:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 133 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215383:0:24470:0:(rw26.c:898:ll_write_end()) pos 544768, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215387:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003afdb635[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 133] 00000080:00200000:3.0:1788201595.215389:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000759e2e31 17ffffc0001001 3:0 ffff8bc17275c540 133 lru 00000080:00200000:3.0:1788201595.215395:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007a48286b 133: 1< 0 - - > 2< 544768 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215398:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003afdb635 00000080:00200000:3.0:1788201595.215399:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 134. 00000080:00200000:3.0:1788201595.215401:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 134 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215416:0:24470:0:(rw26.c:898:ll_write_end()) pos 548864, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215419:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000037b5b54e[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 134] 00000080:00200000:3.0:1788201595.215422:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000022caaabd 17ffffc0001021 2:0 ffff8bc17275c8c0 134 lru 00000080:00200000:3.0:1788201595.215428:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004f67d247 134: 1< 0 - - > 2< 548864 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215430:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000037b5b54e 00000080:00200000:3.0:1788201595.215431:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 135. 00000080:00200000:3.0:1788201595.215432:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 135 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215442:0:24470:0:(rw26.c:898:ll_write_end()) pos 552960, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215445:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000cbd3dc81[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 135] 00000080:00200000:3.0:1788201595.215448:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ffe76061 17ffffc0001001 3:0 ffff8bc17275ce00 135 lru 00000080:00200000:3.0:1788201595.215453:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000029316791 135: 1< 0 - - > 2< 552960 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215454:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000cbd3dc81 00000080:00200000:3.0:1788201595.215456:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 136. 00000080:00200000:3.0:1788201595.215457:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 136 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215467:0:24470:0:(rw26.c:898:ll_write_end()) pos 557056, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215471:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f5a30bdd[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 136] 00000080:00200000:3.0:1788201595.215474:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000bf3bc047 17ffffc0001001 3:0 ffff8bc17275cee0 136 lru 00000080:00200000:3.0:1788201595.215479:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000bb2aae61 136: 1< 0 - - > 2< 557056 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215481:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f5a30bdd 00000080:00200000:3.0:1788201595.215482:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 137. 00000080:00200000:3.0:1788201595.215484:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 137 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215500:0:24470:0:(rw26.c:898:ll_write_end()) pos 561152, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215504:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007ff3815b[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 137] 00000080:00200000:3.0:1788201595.215507:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000bb693161 17ffffc0001001 3:0 ffff8bc17275c620 137 lru 00000080:00200000:3.0:1788201595.215512:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000789ca6e7 137: 1< 0 - - > 2< 561152 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215514:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007ff3815b 00000080:00200000:3.0:1788201595.215515:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 138. 00000080:00200000:3.0:1788201595.215517:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 138 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215531:0:24470:0:(rw26.c:898:ll_write_end()) pos 565248, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215536:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000056954e2[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 138] 00000080:00200000:3.0:1788201595.215538:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000461de0f7 17ffffc0001001 3:0 ffff8bc17275c7e0 138 lru 00000080:00200000:3.0:1788201595.215543:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000098f042e3 138: 1< 0 - - > 2< 565248 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215545:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000056954e2 00000080:00200000:3.0:1788201595.215546:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 139. 00000080:00200000:3.0:1788201595.215548:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 139 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215562:0:24470:0:(rw26.c:898:ll_write_end()) pos 569344, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215567:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000521b68db[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 139] 00000080:00200000:3.0:1788201595.215569:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e537a28c 17ffffc0001001 3:0 ffff8bc17275c700 139 lru 00000080:00200000:3.0:1788201595.215574:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000012124269 139: 1< 0 - - > 2< 569344 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215576:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000521b68db 00000080:00200000:3.0:1788201595.215577:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 140. 00000080:00200000:3.0:1788201595.215579:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 140 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215593:0:24470:0:(rw26.c:898:ll_write_end()) pos 573440, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215597:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ccb2ce8c[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 140] 00000080:00200000:3.0:1788201595.215601:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a33acf15 17ffffc0001001 3:0 ffff8bc17275cb60 140 lru 00000080:00200000:3.0:1788201595.215605:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000052b6f7e9 140: 1< 0 - - > 2< 573440 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215608:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ccb2ce8c 00000080:00200000:3.0:1788201595.215609:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 141. 00000080:00200000:3.0:1788201595.215610:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 141 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215626:0:24470:0:(rw26.c:898:ll_write_end()) pos 577536, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215630:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b26e7252[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 141] 00000080:00200000:3.0:1788201595.215632:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d4498749 17ffffc0001001 3:0 ffff8bc17275c2a0 141 lru 00000080:00200000:3.0:1788201595.215638:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000356e0a37 141: 1< 0 - - > 2< 577536 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215640:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b26e7252 00000080:00200000:3.0:1788201595.215641:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 142. 00000080:00200000:3.0:1788201595.215643:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 142 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215656:0:24470:0:(rw26.c:898:ll_write_end()) pos 581632, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215659:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000059dc14d4[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 142] 00000080:00200000:3.0:1788201595.215662:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004a887f15 17ffffc0001001 3:0 ffff8bc17275c460 142 lru 00000080:00200000:3.0:1788201595.215668:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000079baf1fb 142: 1< 0 - - > 2< 581632 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215670:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000059dc14d4 00000080:00200000:3.0:1788201595.215672:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 143. 00000080:00200000:3.0:1788201595.215673:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 143 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215697:0:24470:0:(rw26.c:898:ll_write_end()) pos 585728, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215701:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000010cdd912[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 143] 00000080:00200000:3.0:1788201595.215704:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009e452b52 17ffffc0001001 3:0 ffff8bc150a7b620 143 lru 00000080:00200000:3.0:1788201595.215710:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000026d0b8ce 143: 1< 0 - - > 2< 585728 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215712:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000010cdd912 00000080:00200000:3.0:1788201595.215713:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 144. 00000080:00200000:3.0:1788201595.215715:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 144 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215732:0:24470:0:(rw26.c:898:ll_write_end()) pos 589824, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215736:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a4262734[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 144] 00000080:00200000:3.0:1788201595.215739:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000042601ebc 17ffffc0001001 3:0 ffff8bc150a7b7e0 144 lru 00000080:00200000:3.0:1788201595.215744:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000078f4b643 144: 1< 0 - - > 2< 589824 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215746:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a4262734 00000080:00200000:3.0:1788201595.215747:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 145. 00000080:00200000:3.0:1788201595.215749:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 145 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215762:0:24470:0:(rw26.c:898:ll_write_end()) pos 593920, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215765:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c5d2d8a0[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 145] 00000080:00200000:3.0:1788201595.215768:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a9533329 17ffffc0001001 3:0 ffff8bc150a7b700 145 lru 00000080:00200000:3.0:1788201595.215772:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000bcd2814d 145: 1< 0 - - > 2< 593920 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215774:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c5d2d8a0 00000080:00200000:3.0:1788201595.215775:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 146. 00000080:00200000:3.0:1788201595.215777:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 146 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215817:0:24470:0:(rw26.c:898:ll_write_end()) pos 598016, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215822:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d0a1e680[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 146] 00000080:00200000:3.0:1788201595.215826:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000099c47756 17ffffc0001001 3:0 ffff8bc150a7bb60 146 lru 00000080:00200000:3.0:1788201595.215831:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000049323b60 146: 1< 0 - - > 2< 598016 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215833:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d0a1e680 00000080:00200000:3.0:1788201595.215835:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 147. 00000080:00200000:3.0:1788201595.215837:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 147 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215853:0:24470:0:(rw26.c:898:ll_write_end()) pos 602112, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215858:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000cbcff82b[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 147] 00000080:00200000:3.0:1788201595.215861:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000817b98bb 17ffffc0001001 3:0 ffff8bc150a7b2a0 147 lru 00000080:00200000:3.0:1788201595.215866:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008fc03891 147: 1< 0 - - > 2< 602112 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215868:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000cbcff82b 00000080:00200000:3.0:1788201595.215869:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 148. 00000080:00200000:3.0:1788201595.215871:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 148 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215887:0:24470:0:(rw26.c:898:ll_write_end()) pos 606208, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215891:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000943b04b3[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 148] 00000080:00200000:3.0:1788201595.215894:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009c177a4d 17ffffc0001001 3:0 ffff8bc150a7b460 148 lru 00000080:00200000:3.0:1788201595.215899:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000098a83c8a 148: 1< 0 - - > 2< 606208 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215901:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000943b04b3 00000080:00200000:3.0:1788201595.215902:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 149. 00000080:00200000:3.0:1788201595.215903:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 149 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215921:0:24470:0:(rw26.c:898:ll_write_end()) pos 610304, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215926:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000968a6034[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 149] 00000080:00200000:3.0:1788201595.215929:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003aefa8de 17ffffc0001021 2:0 ffff8bc150a7bd20 149 lru 00000080:00200000:3.0:1788201595.215934:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000dfbda052 149: 1< 0 - - > 2< 610304 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215936:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000968a6034 00000080:00200000:3.0:1788201595.215937:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 150. 00000080:00200000:3.0:1788201595.215939:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 150 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215956:0:24470:0:(rw26.c:898:ll_write_end()) pos 614400, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215960:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008c46f579[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 150] 00000080:00200000:3.0:1788201595.215963:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000151614dd 17ffffc0001001 3:0 ffff8bc150a7b000 150 lru 00000080:00200000:3.0:1788201595.215968:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005c828fbf 150: 1< 0 - - > 2< 614400 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.215970:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008c46f579 00000080:00200000:3.0:1788201595.215971:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 151. 00000080:00200000:3.0:1788201595.215973:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 151 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.215992:0:24470:0:(rw26.c:898:ll_write_end()) pos 618496, len 4096, copied 4096 00000080:00200000:3.0:1788201595.215997:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009853a640[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 151] 00000080:00200000:3.0:1788201595.215999:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002853a108 17ffffc0001001 3:0 ffff8bc150a7b380 151 lru 00000080:00200000:3.0:1788201595.216004:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000e53a5a8 151: 1< 0 - - > 2< 618496 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.216006:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009853a640 00000080:00200000:3.0:1788201595.216007:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 152. 00000080:00200000:3.0:1788201595.216009:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 152 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.216022:0:24470:0:(rw26.c:898:ll_write_end()) pos 622592, len 4096, copied 4096 00000080:00200000:3.0:1788201595.216025:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e1f8094d[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 152] 00000080:00200000:3.0:1788201595.216028:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ea4b294c 17ffffc0001001 3:0 ffff8bc150a7b1c0 152 lru 00000080:00200000:3.0:1788201595.216033:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000fd3201c6 152: 1< 0 - - > 2< 622592 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.216035:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e1f8094d 00000080:00200000:3.0:1788201595.216036:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 153. 00000080:00200000:3.0:1788201595.216037:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 153 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.216048:0:24470:0:(rw26.c:898:ll_write_end()) pos 626688, len 4096, copied 4096 00000080:00200000:3.0:1788201595.216052:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009ca9fc8b[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 153] 00000080:00200000:3.0:1788201595.216054:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000cb52c2cf 17ffffc0001001 3:0 ffff8bc150a7b0e0 153 lru 00000080:00200000:3.0:1788201595.216059:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000bf1bc908 153: 1< 0 - - > 2< 626688 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.216060:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009ca9fc8b 00000080:00200000:3.0:1788201595.216062:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 154. 00000080:00200000:3.0:1788201595.216064:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 154 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.216078:0:24470:0:(rw26.c:898:ll_write_end()) pos 630784, len 4096, copied 4096 00000080:00200000:3.0:1788201595.216082:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000fc4a5309[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 154] 00000080:00200000:3.0:1788201595.216085:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000062843da2 17ffffc0001001 3:0 ffff8bc150a7b9a0 154 lru 00000080:00200000:3.0:1788201595.216090:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000027e0e7e 154: 1< 0 - - > 2< 630784 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.216093:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000fc4a5309 00000080:00200000:3.0:1788201595.216094:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 155. 00000080:00200000:3.0:1788201595.216096:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 155 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.216113:0:24470:0:(rw26.c:898:ll_write_end()) pos 634880, len 4096, copied 4096 00000080:00200000:3.0:1788201595.216117:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002e2c71d9[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 155] 00000080:00200000:3.0:1788201595.216120:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b1691476 17ffffc0001001 3:0 ffff8bc150a7bc40 155 lru 00000080:00200000:3.0:1788201595.216125:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000792e6b31 155: 1< 0 - - > 2< 634880 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.216127:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002e2c71d9 00000080:00200000:3.0:1788201595.216128:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 156. 00000080:00200000:3.0:1788201595.216130:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 156 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.216144:0:24470:0:(rw26.c:898:ll_write_end()) pos 638976, len 4096, copied 4096 00000080:00200000:3.0:1788201595.216149:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000071e35d78[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 156] 00000080:00200000:3.0:1788201595.216152:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f69f3470 17ffffc0001001 3:0 ffff8bc150a7ba80 156 lru 00000080:00200000:3.0:1788201595.216157:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000083793f89 156: 1< 0 - - > 2< 638976 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.216160:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000071e35d78 00000080:00200000:3.0:1788201595.216160:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 157. 00000080:00200000:3.0:1788201595.216162:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 157 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.216176:0:24470:0:(rw26.c:898:ll_write_end()) pos 643072, len 4096, copied 4096 00000080:00200000:3.0:1788201595.216181:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b646219e[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 157] 00000080:00200000:3.0:1788201595.216183:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c15fcec4 17ffffc0001001 3:0 ffff8bc150a7b540 157 lru 00000080:00200000:3.0:1788201595.216188:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e58629ad 157: 1< 0 - - > 2< 643072 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.216191:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b646219e 00000080:00200000:3.0:1788201595.216192:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 158. 00000080:00200000:3.0:1788201595.216194:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 158 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.216209:0:24470:0:(rw26.c:898:ll_write_end()) pos 647168, len 4096, copied 4096 00000080:00200000:3.0:1788201595.216213:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d6fbd26c[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 158] 00000080:00200000:3.0:1788201595.216216:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002a57404b 17ffffc0001001 3:0 ffff8bc150a7b8c0 158 lru 00000080:00200000:3.0:1788201595.216221:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007bdbc08f 158: 1< 0 - - > 2< 647168 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.216223:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d6fbd26c 00000080:00200000:3.0:1788201595.216224:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 159. 00000080:00200000:3.0:1788201595.216225:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 159 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.216238:0:24470:0:(rw26.c:898:ll_write_end()) pos 651264, len 4096, copied 4096 00000080:00200000:3.0:1788201595.216242:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c8c714a3[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 159] 00000080:00200000:3.0:1788201595.216245:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000091b15224 17ffffc0001001 3:0 ffff8bc150a7be00 159 lru 00000080:00200000:3.0:1788201595.216250:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e5bfab07 159: 1< 0 - - > 2< 651264 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.216253:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c8c714a3 00000080:00200000:3.0:1788201595.216254:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 160. 00000080:00200000:3.0:1788201595.216255:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 160 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.216269:0:24470:0:(rw26.c:898:ll_write_end()) pos 655360, len 4096, copied 4096 00000080:00200000:3.0:1788201595.216273:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e621e3be[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 160] 00000080:00200000:3.0:1788201595.216277:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000039d8388f 17ffffc0001001 3:0 ffff8bc150a7bee0 160 lru 00000080:00200000:3.0:1788201595.216283:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b275c239 160: 1< 0 - - > 2< 655360 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.216286:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e621e3be 00000080:00200000:3.0:1788201595.216287:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 161. 00000080:00200000:3.0:1788201595.216289:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 161 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.216314:0:24470:0:(rw26.c:898:ll_write_end()) pos 659456, len 4096, copied 4096 00000080:00200000:3.0:1788201595.216318:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000453525a6[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 161] 00000080:00200000:3.0:1788201595.216321:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000042a036 17ffffc0001001 3:0 ffff8bc149f982a0 161 lru 00000080:00200000:3.0:1788201595.216326:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000044d82111 161: 1< 0 - - > 2< 659456 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.216328:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000453525a6 00000080:00200000:3.0:1788201595.216329:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 162. 00000080:00200000:3.0:1788201595.216332:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 162 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.216848:0:24470:0:(rw26.c:898:ll_write_end()) pos 663552, len 4096, copied 4096 00000080:00200000:3.0:1788201595.216856:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000065103851[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 162] 00000080:00200000:3.0:1788201595.216859:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ec7b8997 17ffffc0001001 3:0 ffff8bc149f98460 162 lru 00000080:00200000:3.0:1788201595.216865:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a3cca90a 162: 1< 0 - - > 2< 663552 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.216868:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000065103851 00000080:00200000:3.0:1788201595.216869:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 163. 00000080:00200000:3.0:1788201595.216871:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 163 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.216889:0:24470:0:(rw26.c:898:ll_write_end()) pos 667648, len 4096, copied 4096 00000080:00200000:3.0:1788201595.216894:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002a7ab851[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 163] 00000080:00200000:3.0:1788201595.216897:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006003e548 17ffffc0001001 3:0 ffff8bc149f98d20 163 lru 00000080:00200000:3.0:1788201595.216902:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000322beba1 163: 1< 0 - - > 2< 667648 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.216905:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002a7ab851 00000080:00200000:3.0:1788201595.216906:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 164. 00000080:00200000:3.0:1788201595.216908:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 164 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.216927:0:24470:0:(rw26.c:898:ll_write_end()) pos 671744, len 4096, copied 4096 00000080:00200000:3.0:1788201595.216931:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002daaee4b[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 164] 00000080:00200000:3.0:1788201595.216935:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000c316d3f 17ffffc0001021 2:0 ffff8bc149f98000 164 lru 00000080:00200000:3.0:1788201595.216940:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d1ae7ec3 164: 1< 0 - - > 2< 671744 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.216941:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002daaee4b 00000080:00200000:3.0:1788201595.216943:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 165. 00000080:00200000:3.0:1788201595.216944:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 165 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.216958:0:24470:0:(rw26.c:898:ll_write_end()) pos 675840, len 4096, copied 4096 00000080:00200000:3.0:1788201595.216962:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000454c4a18[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 165] 00000080:00200000:3.0:1788201595.216964:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001791f5ca 17ffffc0001001 3:0 ffff8bc149f98380 165 lru 00000080:00200000:3.0:1788201595.216970:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000002abb92c6 165: 1< 0 - - > 2< 675840 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.216972:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000454c4a18 00000080:00200000:3.0:1788201595.216973:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 166. 00000080:00200000:3.0:1788201595.216975:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 166 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.216988:0:24470:0:(rw26.c:898:ll_write_end()) pos 679936, len 4096, copied 4096 00000080:00200000:3.0:1788201595.216993:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001b62bcb6[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 166] 00000080:00200000:3.0:1788201595.216996:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000092deba50 17ffffc0001001 3:0 ffff8bc149f981c0 166 lru 00000080:00200000:3.0:1788201595.217002:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000002e741d57 166: 1< 0 - - > 2< 679936 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.217005:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001b62bcb6 00000080:00200000:3.0:1788201595.217006:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 167. 00000080:00200000:3.0:1788201595.217007:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 167 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.217019:0:24470:0:(rw26.c:898:ll_write_end()) pos 684032, len 4096, copied 4096 00000080:00200000:3.0:1788201595.217024:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ba04c3f7[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 167] 00000080:00200000:3.0:1788201595.217027:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001d41be77 17ffffc0001001 3:0 ffff8bc149f980e0 167 lru 00000080:00200000:3.0:1788201595.217032:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ab5d29f6 167: 1< 0 - - > 2< 684032 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.217035:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ba04c3f7 00000080:00200000:3.0:1788201595.217036:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 168. 00000080:00200000:3.0:1788201595.217037:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 168 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.217049:0:24470:0:(rw26.c:898:ll_write_end()) pos 688128, len 4096, copied 4096 00000080:00200000:3.0:1788201595.217054:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000056742a0b[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 168] 00000080:00200000:3.0:1788201595.217057:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000030e86edb 17ffffc0001001 3:0 ffff8bc149f989a0 168 lru 00000080:00200000:3.0:1788201595.217062:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d94897c1 168: 1< 0 - - > 2< 688128 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.217065:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000056742a0b 00000080:00200000:3.0:1788201595.217066:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 169. 00000080:00200000:3.0:1788201595.217068:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 169 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.217082:0:24470:0:(rw26.c:898:ll_write_end()) pos 692224, len 4096, copied 4096 00000080:00200000:3.0:1788201595.217086:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a69dc238[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 169] 00000080:00200000:3.0:1788201595.217089:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001f545ca4 17ffffc0001001 3:0 ffff8bc149f98c40 169 lru 00000080:00200000:3.0:1788201595.217095:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009a824b33 169: 1< 0 - - > 2< 692224 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.217098:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a69dc238 00000080:00200000:3.0:1788201595.217100:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 170. 00000080:00200000:3.0:1788201595.217101:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 170 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.217113:0:24470:0:(rw26.c:898:ll_write_end()) pos 696320, len 4096, copied 4096 00000080:00200000:3.0:1788201595.217118:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f0179e8a[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 170] 00000080:00200000:3.0:1788201595.217183:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000016c384d6 17ffffc0001001 3:0 ffff8bc149f98a80 170 lru 00000080:00200000:3.0:1788201595.217190:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000081638c88 170: 1< 0 - - > 2< 696320 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.217192:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f0179e8a 00000080:00200000:3.0:1788201595.217193:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 171. 00000080:00200000:3.0:1788201595.217196:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 171 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.217212:0:24470:0:(rw26.c:898:ll_write_end()) pos 700416, len 4096, copied 4096 00000080:00200000:3.0:1788201595.217217:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f519bd2f[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 171] 00000080:00200000:3.0:1788201595.217220:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009cb3dc7a 17ffffc0001001 3:0 ffff8bc149f98540 171 lru 00000080:00200000:3.0:1788201595.217226:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000074e730c 171: 1< 0 - - > 2< 700416 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.217228:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f519bd2f 00000080:00200000:3.0:1788201595.217230:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 172. 00000080:00200000:3.0:1788201595.217231:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 172 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.217244:0:24470:0:(rw26.c:898:ll_write_end()) pos 704512, len 4096, copied 4096 00000080:00200000:3.0:1788201595.217248:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e09b4a13[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 172] 00000080:00200000:3.0:1788201595.217251:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000c37c48b 17ffffc0001001 3:0 ffff8bc149f988c0 172 lru 00000080:00200000:3.0:1788201595.217257:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000002ec74908 172: 1< 0 - - > 2< 704512 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.217259:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e09b4a13 00000080:00200000:3.0:1788201595.217260:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 173. 00000080:00200000:3.0:1788201595.217262:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 173 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.217274:0:24470:0:(rw26.c:898:ll_write_end()) pos 708608, len 4096, copied 4096 00000080:00200000:3.0:1788201595.217278:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c06902d2[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 173] 00000080:00200000:3.0:1788201595.217282:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b52b13fa 17ffffc0001001 3:0 ffff8bc149f98e00 173 lru 00000080:00200000:3.0:1788201595.217287:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000dab2295d 173: 1< 0 - - > 2< 708608 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.217289:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c06902d2 00000080:00200000:3.0:1788201595.217290:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 174. 00000080:00200000:3.0:1788201595.217292:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 174 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.217306:0:24470:0:(rw26.c:898:ll_write_end()) pos 712704, len 4096, copied 4096 00000080:00200000:3.0:1788201595.217310:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c5050575[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 174] 00000080:00200000:3.0:1788201595.217313:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d6425ac4 17ffffc0001001 3:0 ffff8bc149f98ee0 174 lru 00000080:00200000:3.0:1788201595.217319:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000092eeac36 174: 1< 0 - - > 2< 712704 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.217321:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c5050575 00000080:00200000:3.0:1788201595.217323:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 175. 00000080:00200000:3.0:1788201595.217325:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 175 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.217336:0:24470:0:(rw26.c:898:ll_write_end()) pos 716800, len 4096, copied 4096 00000080:00200000:3.0:1788201595.217352:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000075052989[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 175] 00000080:00200000:3.0:1788201595.217355:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000506fea51 17ffffc0001001 3:0 ffff8bc149f98620 175 lru 00000080:00200000:3.0:1788201595.217361:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003eb2bd35 175: 1< 0 - - > 2< 716800 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.217364:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000075052989 00000080:00200000:3.0:1788201595.217365:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 176. 00000080:00200000:3.0:1788201595.217367:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 176 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.217384:0:24470:0:(rw26.c:898:ll_write_end()) pos 720896, len 4096, copied 4096 00000080:00200000:3.0:1788201595.217388:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d73acffe[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 176] 00000080:00200000:3.0:1788201595.217392:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000062a0a626 17ffffc0001001 3:0 ffff8bc149f987e0 176 lru 00000080:00200000:3.0:1788201595.217398:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000277e6fb7 176: 1< 0 - - > 2< 720896 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.217400:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d73acffe 00000080:00200000:3.0:1788201595.217402:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 177. 00000080:00200000:3.0:1788201595.217404:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 177 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.217416:0:24470:0:(rw26.c:898:ll_write_end()) pos 724992, len 4096, copied 4096 00000080:00200000:3.0:1788201595.217420:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008dcc0cba[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 177] 00000080:00200000:3.0:1788201595.217424:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000046e16435 17ffffc0001001 3:0 ffff8bc149f98700 177 lru 00000080:00200000:3.0:1788201595.217430:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005630944a 177: 1< 0 - - > 2< 724992 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.217432:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008dcc0cba 00000080:00200000:3.0:1788201595.217433:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 178. 00000080:00200000:3.0:1788201595.217435:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 178 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.217447:0:24470:0:(rw26.c:898:ll_write_end()) pos 729088, len 4096, copied 4096 00000080:00200000:3.0:1788201595.217450:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f5310f51[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 178] 00000080:00200000:3.0:1788201595.217454:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000071e60f4b 17ffffc0001001 3:0 ffff8bc149f98b60 178 lru 00000080:00200000:3.0:1788201595.217459:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b45a1d74 178: 1< 0 - - > 2< 729088 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.217462:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f5310f51 00000080:00200000:3.0:1788201595.217463:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 179. 00000080:00200000:3.0:1788201595.217465:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 179 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.217494:0:24470:0:(rw26.c:898:ll_write_end()) pos 733184, len 4096, copied 4096 00000080:00200000:3.0:1788201595.217498:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000656fd271[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 179] 00000080:00200000:3.0:1788201595.217501:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000093714055 17ffffc0001021 2:0 ffff8bc172506700 179 lru 00000080:00200000:3.0:1788201595.217506:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f3b6dbfa 179: 1< 0 - - > 2< 733184 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.217508:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000656fd271 00000080:00200000:3.0:1788201595.217509:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 180. 00000080:00200000:3.0:1788201595.217511:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 180 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.217593:0:24470:0:(rw26.c:898:ll_write_end()) pos 737280, len 4096, copied 4096 00000080:00200000:3.0:1788201595.217598:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ebd64f14[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 180] 00000080:00200000:3.0:1788201595.217601:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000361dc9cf 17ffffc0001001 3:0 ffff8bc172506b60 180 lru 00000080:00200000:3.0:1788201595.217606:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000f969d85 180: 1< 0 - - > 2< 737280 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.217608:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ebd64f14 00000080:00200000:3.0:1788201595.217609:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 181. 00000080:00200000:3.0:1788201595.217610:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 181 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.217626:0:24470:0:(rw26.c:898:ll_write_end()) pos 741376, len 4096, copied 4096 00000080:00200000:3.0:1788201595.217630:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000081e6443f[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 181] 00000080:00200000:3.0:1788201595.217633:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000518eb7e 17ffffc0001001 3:0 ffff8bc1725062a0 181 lru 00000080:00200000:3.0:1788201595.217638:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000021386df1 181: 1< 0 - - > 2< 741376 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.217640:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000081e6443f 00000080:00200000:3.0:1788201595.217641:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 182. 00000080:00200000:3.0:1788201595.217643:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 182 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.217656:0:24470:0:(rw26.c:898:ll_write_end()) pos 745472, len 4096, copied 4096 00000080:00200000:3.0:1788201595.217660:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d33dff36[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 182] 00000080:00200000:3.0:1788201595.217663:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000358e834a 17ffffc0001001 3:0 ffff8bc172506460 182 lru 00000080:00200000:3.0:1788201595.217667:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ce95d127 182: 1< 0 - - > 2< 745472 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.217669:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d33dff36 00000080:00200000:3.0:1788201595.217670:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 183. 00000080:00200000:3.0:1788201595.217672:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 183 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.217689:0:24470:0:(rw26.c:898:ll_write_end()) pos 749568, len 4096, copied 4096 00000080:00200000:3.0:1788201595.217693:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f79faeb6[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 183] 00000080:00200000:3.0:1788201595.217696:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000926adb64 17ffffc0001001 3:0 ffff8bc172506d20 183 lru 00000080:00200000:3.0:1788201595.217700:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c1052979 183: 1< 0 - - > 2< 749568 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.217702:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f79faeb6 00000080:00200000:3.0:1788201595.217703:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 184. 00000080:00200000:3.0:1788201595.217705:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 184 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.217718:0:24470:0:(rw26.c:898:ll_write_end()) pos 753664, len 4096, copied 4096 00000080:00200000:3.0:1788201595.217722:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000aa431c84[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 184] 00000080:00200000:3.0:1788201595.217725:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007a9a2c0f 17ffffc0001001 3:0 ffff8bc172506000 184 lru 00000080:00200000:3.0:1788201595.217731:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d0f35029 184: 1< 0 - - > 2< 753664 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.217734:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000aa431c84 00000080:00200000:3.0:1788201595.217734:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 185. 00000080:00200000:3.0:1788201595.217736:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 185 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.217751:0:24470:0:(rw26.c:898:ll_write_end()) pos 757760, len 4096, copied 4096 00000080:00200000:3.0:1788201595.217755:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002c05a565[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 185] 00000080:00200000:3.0:1788201595.217759:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000168c32a9 17ffffc0001001 3:0 ffff8bc172506380 185 lru 00000080:00200000:3.0:1788201595.217764:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003f0c01c3 185: 1< 0 - - > 2< 757760 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.217767:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002c05a565 00000080:00200000:3.0:1788201595.217768:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 186. 00000080:00200000:3.0:1788201595.217770:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 186 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.217784:0:24470:0:(rw26.c:898:ll_write_end()) pos 761856, len 4096, copied 4096 00000080:00200000:3.0:1788201595.217886:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004ba79775[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 186] 00000080:00200000:3.0:1788201595.217891:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f4538468 17ffffc0001001 3:0 ffff8bc1725061c0 186 lru 00000080:00200000:3.0:1788201595.217897:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006bc3c376 186: 1< 0 - - > 2< 761856 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.217899:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004ba79775 00000080:00200000:3.0:1788201595.217901:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 187. 00000080:00200000:3.0:1788201595.217903:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 187 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.217920:0:24470:0:(rw26.c:898:ll_write_end()) pos 765952, len 4096, copied 4096 00000080:00200000:3.0:1788201595.217925:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000231a4f59[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 187] 00000080:00200000:3.0:1788201595.217927:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004d98090b 17ffffc0001001 3:0 ffff8bc1725060e0 187 lru 00000080:00200000:3.0:1788201595.217933:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000028d73049 187: 1< 0 - - > 2< 765952 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.217935:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000231a4f59 00000080:00200000:3.0:1788201595.217937:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 188. 00000080:00200000:3.0:1788201595.217938:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 188 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.217954:0:24470:0:(rw26.c:898:ll_write_end()) pos 770048, len 4096, copied 4096 00000080:00200000:3.0:1788201595.217958:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000888800ea[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 188] 00000080:00200000:3.0:1788201595.217961:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007f56848e 17ffffc0001001 3:0 ffff8bc1725069a0 188 lru 00000080:00200000:3.0:1788201595.217967:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a6ad3d6b 188: 1< 0 - - > 2< 770048 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.217969:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000888800ea 00000080:00200000:3.0:1788201595.217971:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 189. 00000080:00200000:3.0:1788201595.217972:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 189 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.217985:0:24470:0:(rw26.c:898:ll_write_end()) pos 774144, len 4096, copied 4096 00000080:00200000:3.0:1788201595.217990:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ca6e0924[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 189] 00000080:00200000:3.0:1788201595.217993:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007ba27a1e 17ffffc0001001 3:0 ffff8bc172506c40 189 lru 00000080:00200000:3.0:1788201595.217999:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006aebd351 189: 1< 0 - - > 2< 774144 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.218001:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ca6e0924 00000080:00200000:3.0:1788201595.218002:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 190. 00000080:00200000:3.0:1788201595.218004:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 190 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.218018:0:24470:0:(rw26.c:898:ll_write_end()) pos 778240, len 4096, copied 4096 00000080:00200000:3.0:1788201595.218023:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ffa6904c[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 190] 00000080:00200000:3.0:1788201595.218026:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000deaa289a 17ffffc0001001 3:0 ffff8bc172506a80 190 lru 00000080:00200000:3.0:1788201595.218031:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000002a6117fc 190: 1< 0 - - > 2< 778240 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.218032:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ffa6904c 00000080:00200000:3.0:1788201595.218033:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 191. 00000080:00200000:3.0:1788201595.218035:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 191 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.218047:0:24470:0:(rw26.c:898:ll_write_end()) pos 782336, len 4096, copied 4096 00000080:00200000:3.0:1788201595.218051:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c9bbbc62[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 191] 00000080:00200000:3.0:1788201595.218054:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000179a804b 17ffffc0001001 3:0 ffff8bc172506540 191 lru 00000080:00200000:3.0:1788201595.218060:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000072718c59 191: 1< 0 - - > 2< 782336 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.218062:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c9bbbc62 00000080:00200000:3.0:1788201595.218064:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 192. 00000080:00200000:3.0:1788201595.218066:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 192 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.218085:0:24470:0:(rw26.c:898:ll_write_end()) pos 786432, len 4096, copied 4096 00000080:00200000:3.0:1788201595.218090:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000cc094365[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 192] 00000080:00200000:3.0:1788201595.218092:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000075d257e3 17ffffc0001001 3:0 ffff8bc1725068c0 192 lru 00000080:00200000:3.0:1788201595.218098:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000034118f01 192: 1< 0 - - > 2< 786432 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.218100:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000cc094365 00000080:00200000:3.0:1788201595.218101:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 193. 00000080:00200000:3.0:1788201595.218103:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 193 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.218115:0:24470:0:(rw26.c:898:ll_write_end()) pos 790528, len 4096, copied 4096 00000080:00200000:3.0:1788201595.218119:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008b274dec[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 193] 00000080:00200000:3.0:1788201595.218122:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000de0c407f 17ffffc0001001 3:0 ffff8bc172506e00 193 lru 00000080:00200000:3.0:1788201595.218206:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000803cdecd 193: 1< 0 - - > 2< 790528 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.218209:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008b274dec 00000080:00200000:3.0:1788201595.218210:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 194. 00000080:00200000:3.0:1788201595.218212:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 194 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.218233:0:24470:0:(rw26.c:898:ll_write_end()) pos 794624, len 4096, copied 4096 00000080:00200000:3.0:1788201595.218238:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e54df01d[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 194] 00000080:00200000:3.0:1788201595.218241:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001840051a 17ffffc0001021 2:0 ffff8bc172506ee0 194 lru 00000080:00200000:3.0:1788201595.218246:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000012475d12 194: 1< 0 - - > 2< 794624 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.218248:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e54df01d 00000080:00200000:3.0:1788201595.218249:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 195. 00000080:00200000:3.0:1788201595.218251:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 195 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.218266:0:24470:0:(rw26.c:898:ll_write_end()) pos 798720, len 4096, copied 4096 00000080:00200000:3.0:1788201595.218271:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c2e1a71a[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 195] 00000080:00200000:3.0:1788201595.218274:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000880d04df 17ffffc0001001 3:0 ffff8bc172506620 195 lru 00000080:00200000:3.0:1788201595.218278:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000b72aeca 195: 1< 0 - - > 2< 798720 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.218280:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c2e1a71a 00000080:00200000:3.0:1788201595.218281:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 196. 00000080:00200000:3.0:1788201595.218284:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 196 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.218297:0:24470:0:(rw26.c:898:ll_write_end()) pos 802816, len 4096, copied 4096 00000080:00200000:3.0:1788201595.218302:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000115aef9d[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 196] 00000080:00200000:3.0:1788201595.218305:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000010ecb5b9 17ffffc0001001 3:0 ffff8bc1725067e0 196 lru 00000080:00200000:3.0:1788201595.218310:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000028e8803e 196: 1< 0 - - > 2< 802816 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.218313:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000115aef9d 00000080:00200000:3.0:1788201595.218314:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 197. 00000080:00200000:3.0:1788201595.218316:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 197 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.218355:0:24470:0:(rw26.c:898:ll_write_end()) pos 806912, len 4096, copied 4096 00000080:00200000:3.0:1788201595.218360:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003d94d031[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 197] 00000080:00200000:3.0:1788201595.218362:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000184612e0 17ffffc0001001 3:0 ffff8bc17272d1c0 197 lru 00000080:00200000:3.0:1788201595.218367:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d1ff0ded 197: 1< 0 - - > 2< 806912 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.218369:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003d94d031 00000080:00200000:3.0:1788201595.218370:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 198. 00000080:00200000:3.0:1788201595.218372:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 198 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.218387:0:24470:0:(rw26.c:898:ll_write_end()) pos 811008, len 4096, copied 4096 00000080:00200000:3.0:1788201595.218391:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e1f527a3[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 198] 00000080:00200000:3.0:1788201595.218393:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000be565bda 17ffffc0001001 3:0 ffff8bc17272d0e0 198 lru 00000080:00200000:3.0:1788201595.218398:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000030c01361 198: 1< 0 - - > 2< 811008 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.218400:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e1f527a3 00000080:00200000:3.0:1788201595.218401:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 199. 00000080:00200000:3.0:1788201595.218403:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 199 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.218418:0:24470:0:(rw26.c:898:ll_write_end()) pos 815104, len 4096, copied 4096 00000080:00200000:3.0:1788201595.218422:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000093e9444[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 199] 00000080:00200000:3.0:1788201595.218425:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003296d612 17ffffc0001001 3:0 ffff8bc17272d9a0 199 lru 00000080:00200000:3.0:1788201595.218429:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c7b576d5 199: 1< 0 - - > 2< 815104 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.218431:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000093e9444 00000080:00200000:3.0:1788201595.218433:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 200. 00000080:00200000:3.0:1788201595.218434:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 200 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.218448:0:24470:0:(rw26.c:898:ll_write_end()) pos 819200, len 4096, copied 4096 00000080:00200000:3.0:1788201595.218453:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000023944e10[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 200] 00000080:00200000:3.0:1788201595.218456:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000fa68987c 17ffffc0001001 3:0 ffff8bc17272dc40 200 lru 00000080:00200000:3.0:1788201595.218461:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000457daa76 200: 1< 0 - - > 2< 819200 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.218464:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000023944e10 00000080:00200000:3.0:1788201595.218465:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 201. 00000080:00200000:3.0:1788201595.218467:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 201 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.218484:0:24470:0:(rw26.c:898:ll_write_end()) pos 823296, len 4096, copied 4096 00000080:00200000:3.0:1788201595.218489:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ef5c8b23[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 201] 00000080:00200000:3.0:1788201595.218492:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002bdfd6a3 17ffffc0001001 3:0 ffff8bc17272da80 201 lru 00000080:00200000:3.0:1788201595.218497:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c257b3e0 201: 1< 0 - - > 2< 823296 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.218499:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ef5c8b23 00000080:00200000:3.0:1788201595.218500:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 202. 00000080:00200000:3.0:1788201595.218502:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 202 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.218775:0:24470:0:(rw26.c:898:ll_write_end()) pos 827392, len 4096, copied 4096 00000080:00200000:3.0:1788201595.218782:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001813410c[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 202] 00000080:00200000:3.0:1788201595.218785:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b8bcc6eb 17ffffc0001001 3:0 ffff8bc17272d540 202 lru 00000080:00200000:3.0:1788201595.218815:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000bd90d1eb 202: 1< 0 - - > 2< 827392 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.218817:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001813410c 00000080:00200000:3.0:1788201595.218819:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 203. 00000080:00200000:3.0:1788201595.218822:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 203 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.218839:0:24470:0:(rw26.c:898:ll_write_end()) pos 831488, len 4096, copied 4096 00000080:00200000:3.0:1788201595.218844:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005142700b[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 203] 00000080:00200000:3.0:1788201595.218846:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000fdbc8a27 17ffffc0001001 3:0 ffff8bc17272d8c0 203 lru 00000080:00200000:3.0:1788201595.218852:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000010372512 203: 1< 0 - - > 2< 831488 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.218855:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005142700b 00000080:00200000:3.0:1788201595.218856:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 204. 00000080:00200000:3.0:1788201595.218858:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 204 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.218877:0:24470:0:(rw26.c:898:ll_write_end()) pos 835584, len 4096, copied 4096 00000080:00200000:3.0:1788201595.218882:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008890cab2[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 204] 00000080:00200000:3.0:1788201595.218884:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000166367f2 17ffffc0001001 3:0 ffff8bc17272de00 204 lru 00000080:00200000:3.0:1788201595.218889:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000320873f0 204: 1< 0 - - > 2< 835584 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.218891:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008890cab2 00000080:00200000:3.0:1788201595.218892:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 205. 00000080:00200000:3.0:1788201595.218894:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 205 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.218909:0:24470:0:(rw26.c:898:ll_write_end()) pos 839680, len 4096, copied 4096 00000080:00200000:3.0:1788201595.218913:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ac949c91[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 205] 00000080:00200000:3.0:1788201595.218915:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009efe1e04 17ffffc0001001 3:0 ffff8bc17272dee0 205 lru 00000080:00200000:3.0:1788201595.218919:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009788bf7e 205: 1< 0 - - > 2< 839680 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.218922:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ac949c91 00000080:00200000:3.0:1788201595.218923:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 206. 00000080:00200000:3.0:1788201595.218925:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 206 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.218938:0:24470:0:(rw26.c:898:ll_write_end()) pos 843776, len 4096, copied 4096 00000080:00200000:3.0:1788201595.218941:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f10c9dff[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 206] 00000080:00200000:3.0:1788201595.218943:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002359c044 17ffffc0001001 3:0 ffff8bc17272d620 206 lru 00000080:00200000:3.0:1788201595.218948:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e63eae1b 206: 1< 0 - - > 2< 843776 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.218950:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f10c9dff 00000080:00200000:3.0:1788201595.218951:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 207. 00000080:00200000:3.0:1788201595.218953:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 207 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.218967:0:24470:0:(rw26.c:898:ll_write_end()) pos 847872, len 4096, copied 4096 00000080:00200000:3.0:1788201595.218970:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000015e26a15[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 207] 00000080:00200000:3.0:1788201595.218973:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000070080466 17ffffc0001001 3:0 ffff8bc17272d7e0 207 lru 00000080:00200000:3.0:1788201595.218977:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000055ada893 207: 1< 0 - - > 2< 847872 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.218979:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000015e26a15 00000080:00200000:3.0:1788201595.218981:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 208. 00000080:00200000:3.0:1788201595.218983:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 208 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.218996:0:24470:0:(rw26.c:898:ll_write_end()) pos 851968, len 4096, copied 4096 00000080:00200000:3.0:1788201595.219000:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007e939f30[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 208] 00000080:00200000:3.0:1788201595.219002:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c745f726 17ffffc0001001 3:0 ffff8bc17272d700 208 lru 00000080:00200000:3.0:1788201595.219007:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f996e9f4 208: 1< 0 - - > 2< 851968 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.219009:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007e939f30 00000080:00200000:3.0:1788201595.219010:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 209. 00000080:00200000:3.0:1788201595.219012:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 209 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.219032:0:24470:0:(rw26.c:898:ll_write_end()) pos 856064, len 4096, copied 4096 00000080:00200000:3.0:1788201595.219036:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ad8c6850[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 209] 00000080:00200000:3.0:1788201595.219039:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c9112ba7 17ffffc0001021 2:0 ffff8bc17272db60 209 lru 00000080:00200000:3.0:1788201595.219044:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b5a4f666 209: 1< 0 - - > 2< 856064 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.219046:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ad8c6850 00000080:00200000:3.0:1788201595.219047:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 210. 00000080:00200000:3.0:1788201595.219049:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 210 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.219065:0:24470:0:(rw26.c:898:ll_write_end()) pos 860160, len 4096, copied 4096 00000080:00200000:3.0:1788201595.219069:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ed3b5eaa[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 210] 00000080:00200000:3.0:1788201595.219072:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008165b626 17ffffc0001001 3:0 ffff8bc17272d2a0 210 lru 00000080:00200000:3.0:1788201595.219078:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000089b356aa 210: 1< 0 - - > 2< 860160 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.219080:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ed3b5eaa 00000080:00200000:3.0:1788201595.219081:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 211. 00000080:00200000:3.0:1788201595.219084:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 211 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.219101:0:24470:0:(rw26.c:898:ll_write_end()) pos 864256, len 4096, copied 4096 00000080:00200000:3.0:1788201595.219106:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000008c304fd[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 211] 00000080:00200000:3.0:1788201595.219108:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001cd19c3d 17ffffc0001001 3:0 ffff8bc17272d460 211 lru 00000080:00200000:3.0:1788201595.219115:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009c70b7c6 211: 1< 0 - - > 2< 864256 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.219118:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000008c304fd 00000080:00200000:3.0:1788201595.219119:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 212. 00000080:00200000:3.0:1788201595.219120:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 212 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.219212:0:24470:0:(rw26.c:898:ll_write_end()) pos 868352, len 4096, copied 4096 00000080:00200000:3.0:1788201595.219217:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000351895fc[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 212] 00000080:00200000:3.0:1788201595.219220:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a859d0bf 17ffffc0001001 3:0 ffff8bc17272dd20 212 lru 00000080:00200000:3.0:1788201595.219225:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009d433e79 212: 1< 0 - - > 2< 868352 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.219227:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000351895fc 00000080:00200000:3.0:1788201595.219228:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 213. 00000080:00200000:3.0:1788201595.219230:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 213 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.219244:0:24470:0:(rw26.c:898:ll_write_end()) pos 872448, len 4096, copied 4096 00000080:00200000:3.0:1788201595.219249:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005064f9ef[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 213] 00000080:00200000:3.0:1788201595.219252:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000dba9b3bb 17ffffc0001001 3:0 ffff8bc17272d000 213 lru 00000080:00200000:3.0:1788201595.219256:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ce1b6a0d 213: 1< 0 - - > 2< 872448 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.219258:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005064f9ef 00000080:00200000:3.0:1788201595.219259:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 214. 00000080:00200000:3.0:1788201595.219261:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 214 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.219276:0:24470:0:(rw26.c:898:ll_write_end()) pos 876544, len 4096, copied 4096 00000080:00200000:3.0:1788201595.219280:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d41cf011[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 214] 00000080:00200000:3.0:1788201595.219283:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a1ef74a0 17ffffc0001001 3:0 ffff8bc17272d380 214 lru 00000080:00200000:3.0:1788201595.219289:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008348bdcd 214: 1< 0 - - > 2< 876544 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.219292:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d41cf011 00000080:00200000:3.0:1788201595.219293:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 215. 00000080:00200000:3.0:1788201595.219295:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 215 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.219320:0:24470:0:(rw26.c:898:ll_write_end()) pos 880640, len 4096, copied 4096 00000080:00200000:3.0:1788201595.219325:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002dc547f7[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 215] 00000080:00200000:3.0:1788201595.219328:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000578514fb 17ffffc0001001 3:0 ffff8bc150708620 215 lru 00000080:00200000:3.0:1788201595.219333:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000048c4f267 215: 1< 0 - - > 2< 880640 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.219335:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002dc547f7 00000080:00200000:3.0:1788201595.219336:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 216. 00000080:00200000:3.0:1788201595.219347:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 216 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.219364:0:24470:0:(rw26.c:898:ll_write_end()) pos 884736, len 4096, copied 4096 00000080:00200000:3.0:1788201595.219368:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001147c014[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 216] 00000080:00200000:3.0:1788201595.219371:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000077e2e1ad 17ffffc0001001 3:0 ffff8bc1507087e0 216 lru 00000080:00200000:3.0:1788201595.219377:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f92c40d8 216: 1< 0 - - > 2< 884736 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.219378:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001147c014 00000080:00200000:3.0:1788201595.219380:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 217. 00000080:00200000:3.0:1788201595.219381:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 217 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.219395:0:24470:0:(rw26.c:898:ll_write_end()) pos 888832, len 4096, copied 4096 00000080:00200000:3.0:1788201595.219399:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d0d6096c[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 217] 00000080:00200000:3.0:1788201595.219402:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000cd30074 17ffffc0001001 3:0 ffff8bc150708700 217 lru 00000080:00200000:3.0:1788201595.219408:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000026ee12db 217: 1< 0 - - > 2< 888832 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.219410:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d0d6096c 00000080:00200000:3.0:1788201595.219411:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 218. 00000080:00200000:3.0:1788201595.219413:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 218 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.219429:0:24470:0:(rw26.c:898:ll_write_end()) pos 892928, len 4096, copied 4096 00000080:00200000:3.0:1788201595.219433:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000cb756427[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 218] 00000080:00200000:3.0:1788201595.219436:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009c6ce37c 17ffffc0001001 3:0 ffff8bc150708b60 218 lru 00000080:00200000:3.0:1788201595.219441:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000089529660 218: 1< 0 - - > 2< 892928 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.219444:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000cb756427 00000080:00200000:3.0:1788201595.219445:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 219. 00000080:00200000:3.0:1788201595.219447:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 219 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.219460:0:24470:0:(rw26.c:898:ll_write_end()) pos 897024, len 4096, copied 4096 00000080:00200000:3.0:1788201595.219464:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007eff355d[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 219] 00000080:00200000:3.0:1788201595.219467:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000aabde0e8 17ffffc0001001 3:0 ffff8bc1507082a0 219 lru 00000080:00200000:3.0:1788201595.219472:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006b9fffd2 219: 1< 0 - - > 2< 897024 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.219475:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007eff355d 00000080:00200000:3.0:1788201595.219476:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 220. 00000080:00200000:3.0:1788201595.219478:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 220 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.219493:0:24470:0:(rw26.c:898:ll_write_end()) pos 901120, len 4096, copied 4096 00000080:00200000:3.0:1788201595.219498:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000fa293cba[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 220] 00000080:00200000:3.0:1788201595.219501:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a4ee654f 17ffffc0001001 3:0 ffff8bc150708460 220 lru 00000080:00200000:3.0:1788201595.219506:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000018dce77d 220: 1< 0 - - > 2< 901120 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.219508:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000fa293cba 00000080:00200000:3.0:1788201595.219509:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 221. 00000080:00200000:3.0:1788201595.219511:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 221 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.219593:0:24470:0:(rw26.c:898:ll_write_end()) pos 905216, len 4096, copied 4096 00000080:00200000:3.0:1788201595.219599:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000097a21de9[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 221] 00000080:00200000:3.0:1788201595.219602:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000009b29188 17ffffc0001001 3:0 ffff8bc150708d20 221 lru 00000080:00200000:3.0:1788201595.219607:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c08aa58e 221: 1< 0 - - > 2< 905216 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.219610:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000097a21de9 00000080:00200000:3.0:1788201595.219611:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 222. 00000080:00200000:3.0:1788201595.219613:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 222 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.219627:0:24470:0:(rw26.c:898:ll_write_end()) pos 909312, len 4096, copied 4096 00000080:00200000:3.0:1788201595.219632:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000026251d13[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 222] 00000080:00200000:3.0:1788201595.219635:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000035cd833c 17ffffc0001001 3:0 ffff8bc150708000 222 lru 00000080:00200000:3.0:1788201595.219640:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a2d7f66e 222: 1< 0 - - > 2< 909312 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.219643:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000026251d13 00000080:00200000:3.0:1788201595.219644:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 223. 00000080:00200000:3.0:1788201595.219646:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 223 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.219658:0:24470:0:(rw26.c:898:ll_write_end()) pos 913408, len 4096, copied 4096 00000080:00200000:3.0:1788201595.219662:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a8248bca[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 223] 00000080:00200000:3.0:1788201595.219665:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b148be2c 17ffffc0001001 3:0 ffff8bc150708380 223 lru 00000080:00200000:3.0:1788201595.219670:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000792624b8 223: 1< 0 - - > 2< 913408 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.219674:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a8248bca 00000080:00200000:3.0:1788201595.219675:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 224. 00000080:00200000:3.0:1788201595.219677:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 224 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.219695:0:24470:0:(rw26.c:898:ll_write_end()) pos 917504, len 4096, copied 4096 00000080:00200000:3.0:1788201595.219700:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000073042b75[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 224] 00000080:00200000:3.0:1788201595.219703:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000087f07e99 17ffffc0001021 2:0 ffff8bc1507081c0 224 lru 00000080:00200000:3.0:1788201595.219708:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000051a541d7 224: 1< 0 - - > 2< 917504 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.219711:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000073042b75 00000080:00200000:3.0:1788201595.219713:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 225. 00000080:00200000:3.0:1788201595.219714:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 225 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.219728:0:24470:0:(rw26.c:898:ll_write_end()) pos 921600, len 4096, copied 4096 00000080:00200000:3.0:1788201595.219732:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003e84b935[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 225] 00000080:00200000:3.0:1788201595.219735:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001491a98b 17ffffc0001001 3:0 ffff8bc1507080e0 225 lru 00000080:00200000:3.0:1788201595.219742:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e0c4381b 225: 1< 0 - - > 2< 921600 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.219744:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003e84b935 00000080:00200000:3.0:1788201595.219745:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 226. 00000080:00200000:3.0:1788201595.219747:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 226 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.219760:0:24470:0:(rw26.c:898:ll_write_end()) pos 925696, len 4096, copied 4096 00000080:00200000:3.0:1788201595.219763:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a862a62b[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 226] 00000080:00200000:3.0:1788201595.219767:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004c56cdb1 17ffffc0001001 3:0 ffff8bc1507089a0 226 lru 00000080:00200000:3.0:1788201595.219772:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e1b14e9b 226: 1< 0 - - > 2< 925696 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.219774:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a862a62b 00000080:00200000:3.0:1788201595.219776:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 227. 00000080:00200000:3.0:1788201595.219777:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 227 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.219899:0:24470:0:(rw26.c:898:ll_write_end()) pos 929792, len 4096, copied 4096 00000080:00200000:3.0:1788201595.219905:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002710be6e[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 227] 00000080:00200000:3.0:1788201595.219909:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000af0c2172 17ffffc0001001 3:0 ffff8bc150708c40 227 lru 00000080:00200000:3.0:1788201595.219914:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000055bab82c 227: 1< 0 - - > 2< 929792 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.219917:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002710be6e 00000080:00200000:3.0:1788201595.219918:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 228. 00000080:00200000:3.0:1788201595.219921:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 228 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.219939:0:24470:0:(rw26.c:898:ll_write_end()) pos 933888, len 4096, copied 4096 00000080:00200000:3.0:1788201595.219943:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000008712584[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 228] 00000080:00200000:3.0:1788201595.219946:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f72d5ad4 17ffffc0001001 3:0 ffff8bc150708a80 228 lru 00000080:00200000:3.0:1788201595.219951:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000dc3cf04c 228: 1< 0 - - > 2< 933888 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.219954:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000008712584 00000080:00200000:3.0:1788201595.219955:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 229. 00000080:00200000:3.0:1788201595.219957:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 229 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.219970:0:24470:0:(rw26.c:898:ll_write_end()) pos 937984, len 4096, copied 4096 00000080:00200000:3.0:1788201595.219976:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000613844f3[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 229] 00000080:00200000:3.0:1788201595.219979:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006b9996ca 17ffffc0001001 3:0 ffff8bc150708540 229 lru 00000080:00200000:3.0:1788201595.219984:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006a6cb26a 229: 1< 0 - - > 2< 937984 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.219987:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000613844f3 00000080:00200000:3.0:1788201595.219988:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 230. 00000080:00200000:3.0:1788201595.219990:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 230 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.220004:0:24470:0:(rw26.c:898:ll_write_end()) pos 942080, len 4096, copied 4096 00000080:00200000:3.0:1788201595.220008:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000def49c9[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 230] 00000080:00200000:3.0:1788201595.220011:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000de057212 17ffffc0001001 3:0 ffff8bc1507088c0 230 lru 00000080:00200000:3.0:1788201595.220016:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ccb5cd43 230: 1< 0 - - > 2< 942080 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.220019:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000def49c9 00000080:00200000:3.0:1788201595.220020:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 231. 00000080:00200000:3.0:1788201595.220022:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 231 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.220035:0:24470:0:(rw26.c:898:ll_write_end()) pos 946176, len 4096, copied 4096 00000080:00200000:3.0:1788201595.220039:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a579bcfd[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 231] 00000080:00200000:3.0:1788201595.220042:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000579286df 17ffffc0001001 3:0 ffff8bc150708e00 231 lru 00000080:00200000:3.0:1788201595.220047:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000027ea59ef 231: 1< 0 - - > 2< 946176 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.220049:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a579bcfd 00000080:00200000:3.0:1788201595.220050:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 232. 00000080:00200000:3.0:1788201595.220052:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 232 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.220068:0:24470:0:(rw26.c:898:ll_write_end()) pos 950272, len 4096, copied 4096 00000080:00200000:3.0:1788201595.220072:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000aff1428b[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 232] 00000080:00200000:3.0:1788201595.220075:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f88dcc2e 17ffffc0001001 3:0 ffff8bc150708ee0 232 lru 00000080:00200000:3.0:1788201595.220079:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003c9db55e 232: 1< 0 - - > 2< 950272 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.220082:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000aff1428b 00000080:00200000:3.0:1788201595.220083:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 233. 00000080:00200000:3.0:1788201595.220085:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 233 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.220111:0:24470:0:(rw26.c:898:ll_write_end()) pos 954368, len 4096, copied 4096 00000080:00200000:3.0:1788201595.220115:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000248b1d67[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 233] 00000080:00200000:3.0:1788201595.220118:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003e869b47 17ffffc0001001 3:0 ffff8bc148e428c0 233 lru 00000080:00200000:3.0:1788201595.220200:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c7fe3e88 233: 1< 0 - - > 2< 954368 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.220204:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000248b1d67 00000080:00200000:3.0:1788201595.220205:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 234. 00000080:00200000:3.0:1788201595.220208:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 234 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.220224:0:24470:0:(rw26.c:898:ll_write_end()) pos 958464, len 4096, copied 4096 00000080:00200000:3.0:1788201595.220229:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000951e9a58[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 234] 00000080:00200000:3.0:1788201595.220232:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000006f4a049 17ffffc0001001 3:0 ffff8bc148e42e00 234 lru 00000080:00200000:3.0:1788201595.220237:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b06e11c4 234: 1< 0 - - > 2< 958464 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.220240:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000951e9a58 00000080:00200000:3.0:1788201595.220241:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 235. 00000080:00200000:3.0:1788201595.220243:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 235 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.220255:0:24470:0:(rw26.c:898:ll_write_end()) pos 962560, len 4096, copied 4096 00000080:00200000:3.0:1788201595.220259:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000b602043[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 235] 00000080:00200000:3.0:1788201595.220262:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006d1575b8 17ffffc0001001 3:0 ffff8bc148e42ee0 235 lru 00000080:00200000:3.0:1788201595.220268:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000085b91a76 235: 1< 0 - - > 2< 962560 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.220270:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000b602043 00000080:00200000:3.0:1788201595.220272:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 236. 00000080:00200000:3.0:1788201595.220274:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 236 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.220285:0:24470:0:(rw26.c:898:ll_write_end()) pos 966656, len 4096, copied 4096 00000080:00200000:3.0:1788201595.220290:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d9097614[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 236] 00000080:00200000:3.0:1788201595.220293:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000002e1acd8 17ffffc0001001 3:0 ffff8bc148e42620 236 lru 00000080:00200000:3.0:1788201595.220298:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000591f4724 236: 1< 0 - - > 2< 966656 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.220300:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d9097614 00000080:00200000:3.0:1788201595.220302:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 237. 00000080:00200000:3.0:1788201595.220304:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 237 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.220316:0:24470:0:(rw26.c:898:ll_write_end()) pos 970752, len 4096, copied 4096 00000080:00200000:3.0:1788201595.220321:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002b3ab029[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 237] 00000080:00200000:3.0:1788201595.220324:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000005d3fd6de 17ffffc0001001 3:0 ffff8bc148e427e0 237 lru 00000080:00200000:3.0:1788201595.220329:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e5cf499f 237: 1< 0 - - > 2< 970752 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.220331:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002b3ab029 00000080:00200000:3.0:1788201595.220332:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 238. 00000080:00200000:3.0:1788201595.220333:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 238 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.220636:0:24470:0:(rw26.c:898:ll_write_end()) pos 974848, len 4096, copied 4096 00000080:00200000:3.0:1788201595.220642:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001de592ac[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 238] 00000080:00200000:3.0:1788201595.220645:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007c990871 17ffffc0001001 3:0 ffff8bc148e42700 238 lru 00000080:00200000:3.0:1788201595.220650:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000084b72bd3 238: 1< 0 - - > 2< 974848 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.220709:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001de592ac 00000080:00200000:3.0:1788201595.220712:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 239. 00000080:00200000:3.0:1788201595.220715:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 239 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.220740:0:24470:0:(rw26.c:898:ll_write_end()) pos 978944, len 4096, copied 4096 00000080:00200000:3.0:1788201595.220745:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006bc9a2f3[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 239] 00000080:00200000:3.0:1788201595.220748:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c56a94a5 17ffffc0001021 2:0 ffff8bc148e42b60 239 lru 00000080:00200000:3.0:1788201595.220754:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d940938c 239: 1< 0 - - > 2< 978944 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.220757:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006bc9a2f3 00000080:00200000:3.0:1788201595.220758:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 240. 00000080:00200000:3.0:1788201595.220760:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 240 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.220773:0:24470:0:(rw26.c:898:ll_write_end()) pos 983040, len 4096, copied 4096 00000080:00200000:3.0:1788201595.220778:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008a59c058[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 240] 00000080:00200000:3.0:1788201595.220781:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009f4c56b4 17ffffc0001001 3:0 ffff8bc148e422a0 240 lru 00000080:00200000:3.0:1788201595.220786:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000cea256f 240: 1< 0 - - > 2< 983040 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.220788:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008a59c058 00000080:00200000:3.0:1788201595.220815:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 241. 00000080:00200000:3.0:1788201595.220818:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 241 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.220832:0:24470:0:(rw26.c:898:ll_write_end()) pos 987136, len 4096, copied 4096 00000080:00200000:3.0:1788201595.220837:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004206bbb9[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 241] 00000080:00200000:3.0:1788201595.220840:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001af26bdb 17ffffc0001001 3:0 ffff8bc148e42460 241 lru 00000080:00200000:3.0:1788201595.220846:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e3be9d8e 241: 1< 0 - - > 2< 987136 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.220849:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004206bbb9 00000080:00200000:3.0:1788201595.220851:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 242. 00000080:00200000:3.0:1788201595.220853:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 242 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.220866:0:24470:0:(rw26.c:898:ll_write_end()) pos 991232, len 4096, copied 4096 00000080:00200000:3.0:1788201595.220870:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009c341890[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 242] 00000080:00200000:3.0:1788201595.220873:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008d366271 17ffffc0001001 3:0 ffff8bc148e42d20 242 lru 00000080:00200000:3.0:1788201595.220878:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e0282df7 242: 1< 0 - - > 2< 991232 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.220881:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009c341890 00000080:00200000:3.0:1788201595.220882:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 243. 00000080:00200000:3.0:1788201595.220884:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 243 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.220898:0:24470:0:(rw26.c:898:ll_write_end()) pos 995328, len 4096, copied 4096 00000080:00200000:3.0:1788201595.220903:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000fe4ebfa0[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 243] 00000080:00200000:3.0:1788201595.220906:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008ef6301d 17ffffc0001001 3:0 ffff8bc148e42000 243 lru 00000080:00200000:3.0:1788201595.220912:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004de3fbc4 243: 1< 0 - - > 2< 995328 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.220914:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000fe4ebfa0 00000080:00200000:3.0:1788201595.220916:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 244. 00000080:00200000:3.0:1788201595.220917:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 244 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.220930:0:24470:0:(rw26.c:898:ll_write_end()) pos 999424, len 4096, copied 4096 00000080:00200000:3.0:1788201595.220935:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000061299b97[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 244] 00000080:00200000:3.0:1788201595.220938:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000080c1a996 17ffffc0001001 3:0 ffff8bc148e42380 244 lru 00000080:00200000:3.0:1788201595.220944:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000f18e8d5 244: 1< 0 - - > 2< 999424 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.220946:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000061299b97 00000080:00200000:3.0:1788201595.220948:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 245. 00000080:00200000:3.0:1788201595.220949:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 245 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.220962:0:24470:0:(rw26.c:898:ll_write_end()) pos 1003520, len 4096, copied 4096 00000080:00200000:3.0:1788201595.220966:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000679f0600[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 245] 00000080:00200000:3.0:1788201595.220969:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b6c2678c 17ffffc0001001 3:0 ffff8bc148e421c0 245 lru 00000080:00200000:3.0:1788201595.220975:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d28b5049 245: 1< 0 - - > 2< 1003520 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.220977:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000679f0600 00000080:00200000:3.0:1788201595.220978:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 246. 00000080:00200000:3.0:1788201595.220980:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 246 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.220995:0:24470:0:(rw26.c:898:ll_write_end()) pos 1007616, len 4096, copied 4096 00000080:00200000:3.0:1788201595.220999:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001f26fc9d[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 246] 00000080:00200000:3.0:1788201595.221002:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008219be85 17ffffc0001001 3:0 ffff8bc148e420e0 246 lru 00000080:00200000:3.0:1788201595.221008:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ae7fccb1 246: 1< 0 - - > 2< 1007616 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.221010:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001f26fc9d 00000080:00200000:3.0:1788201595.221011:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 247. 00000080:00200000:3.0:1788201595.221013:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 247 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.221025:0:24470:0:(rw26.c:898:ll_write_end()) pos 1011712, len 4096, copied 4096 00000080:00200000:3.0:1788201595.221029:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006d5df050[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 247] 00000080:00200000:3.0:1788201595.221032:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b3363541 17ffffc0001001 3:0 ffff8bc148e429a0 247 lru 00000080:00200000:3.0:1788201595.221036:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006e37c61e 247: 1< 0 - - > 2< 1011712 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.221038:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006d5df050 00000080:00200000:3.0:1788201595.221039:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 248. 00000080:00200000:3.0:1788201595.221041:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 248 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.221325:0:24470:0:(rw26.c:898:ll_write_end()) pos 1015808, len 4096, copied 4096 00000080:00200000:3.0:1788201595.221331:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000df5215be[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 248] 00000080:00200000:3.0:1788201595.221335:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d54ea479 17ffffc0001001 3:0 ffff8bc148e42c40 248 lru 00000080:00200000:3.0:1788201595.221350:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003f66b2e5 248: 1< 0 - - > 2< 1015808 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.221352:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000df5215be 00000080:00200000:3.0:1788201595.221353:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 249. 00000080:00200000:3.0:1788201595.221355:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 249 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.221372:0:24470:0:(rw26.c:898:ll_write_end()) pos 1019904, len 4096, copied 4096 00000080:00200000:3.0:1788201595.221377:0:24470:0:(rw26.c:956:ll_write_end()) page@000000001727083b[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 249] 00000080:00200000:3.0:1788201595.221380:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000dcd7be6e 17ffffc0001001 3:0 ffff8bc148e42a80 249 lru 00000080:00200000:3.0:1788201595.221385:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d281f90f 249: 1< 0 - - > 2< 1019904 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.221387:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000001727083b 00000080:00200000:3.0:1788201595.221388:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 250. 00000080:00200000:3.0:1788201595.221390:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 250 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.221403:0:24470:0:(rw26.c:898:ll_write_end()) pos 1024000, len 4096, copied 4096 00000080:00200000:3.0:1788201595.221407:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d73af158[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 250] 00000080:00200000:3.0:1788201595.221410:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000079f8e4a0 17ffffc0001001 3:0 ffff8bc148e42540 250 lru 00000080:00200000:3.0:1788201595.221415:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000013beda88 250: 1< 0 - - > 2< 1024000 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.221417:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d73af158 00000080:00200000:3.0:1788201595.221418:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 251. 00000080:00200000:3.0:1788201595.221420:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 251 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.221444:0:24470:0:(rw26.c:898:ll_write_end()) pos 1028096, len 4096, copied 4096 00000080:00200000:3.0:1788201595.221448:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000bb96f4a9[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 251] 00000080:00200000:3.0:1788201595.221451:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ac0be1ef 17ffffc0001001 3:0 ffff8bc1434502a0 251 lru 00000080:00200000:3.0:1788201595.221456:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000353cd57c 251: 1< 0 - - > 2< 1028096 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.221458:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000bb96f4a9 00000080:00200000:3.0:1788201595.221459:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 252. 00000080:00200000:3.0:1788201595.221461:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 252 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.221608:0:24470:0:(rw26.c:898:ll_write_end()) pos 1032192, len 4096, copied 4096 00000080:00200000:3.0:1788201595.221613:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003d825d68[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 252] 00000080:00200000:3.0:1788201595.221616:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a1f80545 17ffffc0001001 3:0 ffff8bc143450460 252 lru 00000080:00200000:3.0:1788201595.221622:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000bfc583fe 252: 1< 0 - - > 2< 1032192 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.221624:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003d825d68 00000080:00200000:3.0:1788201595.221625:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 253. 00000080:00200000:3.0:1788201595.221627:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 253 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.221645:0:24470:0:(rw26.c:898:ll_write_end()) pos 1036288, len 4096, copied 4096 00000080:00200000:3.0:1788201595.221650:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000040fc296c[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 253] 00000080:00200000:3.0:1788201595.221652:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008dd8ccbe 17ffffc0001001 3:0 ffff8bc143450d20 253 lru 00000080:00200000:3.0:1788201595.221658:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000023aa688d 253: 1< 0 - - > 2< 1036288 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.221660:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000040fc296c 00000080:00200000:3.0:1788201595.221661:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 254. 00000080:00200000:3.0:1788201595.221663:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 254 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.221686:0:24470:0:(rw26.c:898:ll_write_end()) pos 1040384, len 4096, copied 4096 00000080:00200000:3.0:1788201595.221690:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e245cdde[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 254] 00000080:00200000:3.0:1788201595.221693:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000053bcbe11 17ffffc0001021 2:0 ffff8bc143450000 254 lru 00000080:00200000:3.0:1788201595.221698:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006371ad20 254: 1< 0 - - > 2< 1040384 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.221701:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e245cdde 00000080:00200000:3.0:1788201595.221702:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 255. 00000080:00200000:3.0:1788201595.221704:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 255 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.221718:0:24470:0:(rw26.c:898:ll_write_end()) pos 1044480, len 4096, copied 4096 00000080:00200000:3.0:1788201595.221723:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000991fa9d8[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 255] 00000080:00200000:3.0:1788201595.221726:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000255c987c 17ffffc0001001 3:0 ffff8bc143450380 255 lru 00000080:00200000:3.0:1788201595.221731:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f7ebf2e0 255: 1< 0 - - > 2< 1044480 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.221733:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000991fa9d8 00000080:00200000:3.0:1788201595.221734:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 256. 00000080:00200000:3.0:1788201595.221736:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 256 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.221759:0:24470:0:(rw26.c:898:ll_write_end()) pos 1048576, len 4096, copied 4096 00000080:00200000:3.0:1788201595.221764:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000076d56c5d[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 256] 00000080:00200000:3.0:1788201595.221767:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007bff8a11 17ffffc0001001 3:0 ffff8bc1434501c0 256 lru 00000080:00200000:3.0:1788201595.221772:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d8138199 256: 1< 0 - - > 2< 1048576 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.221774:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000076d56c5d 00000080:00200000:3.0:1788201595.221775:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 257. 00000080:00200000:3.0:1788201595.221777:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 257 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.222411:0:24470:0:(rw26.c:898:ll_write_end()) pos 1052672, len 4096, copied 4096 00000080:00200000:2.0:1788201595.222419:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ac465d9d[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 257] 00000080:00200000:2.0:1788201595.222422:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a6c69925 17ffffc0001001 3:0 ffff8bc172538620 257 lru 00000080:00200000:2.0:1788201595.222428:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000beb6895e 257: 1< 0 - - > 2< 1052672 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.222430:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ac465d9d 00000080:00200000:2.0:1788201595.222431:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 258. 00000080:00200000:2.0:1788201595.222434:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 258 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.222454:0:24470:0:(rw26.c:898:ll_write_end()) pos 1056768, len 4096, copied 4096 00000080:00200000:2.0:1788201595.222459:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000fafa673c[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 258] 00000080:00200000:2.0:1788201595.222462:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000045ccf9b 17ffffc0001001 3:0 ffff8bc1725387e0 258 lru 00000080:00200000:2.0:1788201595.222467:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000023e2fe83 258: 1< 0 - - > 2< 1056768 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.222469:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000fafa673c 00000080:00200000:2.0:1788201595.222470:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 259. 00000080:00200000:2.0:1788201595.222471:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 259 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.222488:0:24470:0:(rw26.c:898:ll_write_end()) pos 1060864, len 4096, copied 4096 00000080:00200000:2.0:1788201595.222493:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000004eadadf[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 259] 00000080:00200000:2.0:1788201595.222495:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000019627386 17ffffc0001001 3:0 ffff8bc172538700 259 lru 00000080:00200000:2.0:1788201595.222500:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000de4b6bdd 259: 1< 0 - - > 2< 1060864 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.222502:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000004eadadf 00000080:00200000:2.0:1788201595.222504:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 260. 00000080:00200000:2.0:1788201595.222506:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 260 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.222598:0:24470:0:(rw26.c:898:ll_write_end()) pos 1064960, len 4096, copied 4096 00000080:00200000:2.0:1788201595.222603:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003d8c3c22[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 260] 00000080:00200000:2.0:1788201595.222606:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e64d419a 17ffffc0001001 3:0 ffff8bc172538b60 260 lru 00000080:00200000:2.0:1788201595.222611:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003b3da7a6 260: 1< 0 - - > 2< 1064960 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.222613:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003d8c3c22 00000080:00200000:2.0:1788201595.222614:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 261. 00000080:00200000:2.0:1788201595.222616:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 261 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.222634:0:24470:0:(rw26.c:898:ll_write_end()) pos 1069056, len 4096, copied 4096 00000080:00200000:2.0:1788201595.222638:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000696e603c[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 261] 00000080:00200000:2.0:1788201595.222641:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003188a34b 17ffffc0001001 3:0 ffff8bc1725382a0 261 lru 00000080:00200000:2.0:1788201595.222646:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003126b1da 261: 1< 0 - - > 2< 1069056 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.222649:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000696e603c 00000080:00200000:2.0:1788201595.222650:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 262. 00000080:00200000:2.0:1788201595.222652:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 262 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.222676:0:24470:0:(rw26.c:898:ll_write_end()) pos 1073152, len 4096, copied 4096 00000080:00200000:2.0:1788201595.222681:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000072e74d04[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 262] 00000080:00200000:2.0:1788201595.222684:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000089572d8e 17ffffc0001021 2:0 ffff8bc172538460 262 lru 00000080:00200000:2.0:1788201595.222689:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c5256f3a 262: 1< 0 - - > 2< 1073152 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.222691:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000072e74d04 00000080:00200000:2.0:1788201595.222693:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 263. 00000080:00200000:2.0:1788201595.222694:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 263 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.222708:0:24470:0:(rw26.c:898:ll_write_end()) pos 1077248, len 4096, copied 4096 00000080:00200000:2.0:1788201595.222712:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007ad9633e[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 263] 00000080:00200000:2.0:1788201595.222715:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000cd35287f 17ffffc0001001 3:0 ffff8bc172538d20 263 lru 00000080:00200000:2.0:1788201595.222720:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000039c75b54 263: 1< 0 - - > 2< 1077248 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.222722:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007ad9633e 00000080:00200000:2.0:1788201595.222723:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 264. 00000080:00200000:2.0:1788201595.222725:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 264 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.222737:0:24470:0:(rw26.c:898:ll_write_end()) pos 1081344, len 4096, copied 4096 00000080:00200000:2.0:1788201595.222740:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004b0184df[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 264] 00000080:00200000:2.0:1788201595.222743:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000084a91853 17ffffc0001001 3:0 ffff8bc172538000 264 lru 00000080:00200000:2.0:1788201595.222748:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004797914f 264: 1< 0 - - > 2< 1081344 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.222750:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004b0184df 00000080:00200000:2.0:1788201595.222751:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 265. 00000080:00200000:2.0:1788201595.222753:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 265 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.222776:0:24470:0:(rw26.c:898:ll_write_end()) pos 1085440, len 4096, copied 4096 00000080:00200000:2.0:1788201595.222780:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000aaa8bb31[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 265] 00000080:00200000:2.0:1788201595.222784:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000083bc891 17ffffc0001001 3:0 ffff8bc1725649a0 265 lru 00000080:00200000:2.0:1788201595.222809:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003a74da4e 265: 1< 0 - - > 2< 1085440 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.222812:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000aaa8bb31 00000080:00200000:2.0:1788201595.222813:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 266. 00000080:00200000:2.0:1788201595.222815:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 266 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.222831:0:24470:0:(rw26.c:898:ll_write_end()) pos 1089536, len 4096, copied 4096 00000080:00200000:2.0:1788201595.222836:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f0ad6cb5[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 266] 00000080:00200000:2.0:1788201595.222838:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002c581b3e 17ffffc0001001 3:0 ffff8bc172564c40 266 lru 00000080:00200000:2.0:1788201595.222843:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000034996072 266: 1< 0 - - > 2< 1089536 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.222845:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f0ad6cb5 00000080:00200000:2.0:1788201595.222846:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 267. 00000080:00200000:2.0:1788201595.222849:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 267 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.222864:0:24470:0:(rw26.c:898:ll_write_end()) pos 1093632, len 4096, copied 4096 00000080:00200000:2.0:1788201595.222868:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000064f9defe[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 267] 00000080:00200000:2.0:1788201595.222871:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b4bd7c87 17ffffc0001001 3:0 ffff8bc172564a80 267 lru 00000080:00200000:2.0:1788201595.222876:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000044fe1cb5 267: 1< 0 - - > 2< 1093632 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.222878:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000064f9defe 00000080:00200000:2.0:1788201595.222879:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 268. 00000080:00200000:2.0:1788201595.222881:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 268 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.222897:0:24470:0:(rw26.c:898:ll_write_end()) pos 1097728, len 4096, copied 4096 00000080:00200000:2.0:1788201595.222902:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000082d8c97d[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 268] 00000080:00200000:2.0:1788201595.222905:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000053fec315 17ffffc0001001 3:0 ffff8bc172564540 268 lru 00000080:00200000:2.0:1788201595.222911:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000030d2972f 268: 1< 0 - - > 2< 1097728 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.222913:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000082d8c97d 00000080:00200000:2.0:1788201595.222914:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 269. 00000080:00200000:2.0:1788201595.222916:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 269 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.222929:0:24470:0:(rw26.c:898:ll_write_end()) pos 1101824, len 4096, copied 4096 00000080:00200000:2.0:1788201595.222933:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007d11c7cd[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 269] 00000080:00200000:2.0:1788201595.222936:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004be46e11 17ffffc0001001 3:0 ffff8bc1725648c0 269 lru 00000080:00200000:2.0:1788201595.222942:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b0f26e5a 269: 1< 0 - - > 2< 1101824 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.222944:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007d11c7cd 00000080:00200000:2.0:1788201595.222945:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 270. 00000080:00200000:2.0:1788201595.222946:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 270 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.222957:0:24470:0:(rw26.c:898:ll_write_end()) pos 1105920, len 4096, copied 4096 00000080:00200000:2.0:1788201595.222961:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000882c71e8[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 270] 00000080:00200000:2.0:1788201595.222964:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004c78da45 17ffffc0001001 3:0 ffff8bc172564e00 270 lru 00000080:00200000:2.0:1788201595.222969:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a1528c33 270: 1< 0 - - > 2< 1105920 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.222971:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000882c71e8 00000080:00200000:2.0:1788201595.222972:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 271. 00000080:00200000:2.0:1788201595.222974:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 271 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.222986:0:24470:0:(rw26.c:898:ll_write_end()) pos 1110016, len 4096, copied 4096 00000080:00200000:2.0:1788201595.222989:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000db79536b[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 271] 00000080:00200000:2.0:1788201595.222992:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000986d58d3 17ffffc0001001 3:0 ffff8bc172564ee0 271 lru 00000080:00200000:2.0:1788201595.222997:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000975f1c9e 271: 1< 0 - - > 2< 1110016 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.222999:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000db79536b 00000080:00200000:2.0:1788201595.223001:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 272. 00000080:00200000:2.0:1788201595.223002:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 272 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.223015:0:24470:0:(rw26.c:898:ll_write_end()) pos 1114112, len 4096, copied 4096 00000080:00200000:2.0:1788201595.223019:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004e2fd015[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 272] 00000080:00200000:2.0:1788201595.223022:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000073da5514 17ffffc0001001 3:0 ffff8bc172564620 272 lru 00000080:00200000:2.0:1788201595.223027:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000037fc8809 272: 1< 0 - - > 2< 1114112 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.223030:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004e2fd015 00000080:00200000:2.0:1788201595.223031:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 273. 00000080:00200000:2.0:1788201595.223033:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 273 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.223046:0:24470:0:(rw26.c:898:ll_write_end()) pos 1118208, len 4096, copied 4096 00000080:00200000:2.0:1788201595.223050:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000e23cbe5[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 273] 00000080:00200000:2.0:1788201595.223052:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f0dc61ab 17ffffc0001001 3:0 ffff8bc1725647e0 273 lru 00000080:00200000:2.0:1788201595.223058:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000bceae774 273: 1< 0 - - > 2< 1118208 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.223060:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000e23cbe5 00000080:00200000:2.0:1788201595.223061:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 274. 00000080:00200000:2.0:1788201595.223063:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 274 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.223076:0:24470:0:(rw26.c:898:ll_write_end()) pos 1122304, len 4096, copied 4096 00000080:00200000:2.0:1788201595.223080:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005b6d6970[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 274] 00000080:00200000:2.0:1788201595.223083:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000416900a7 17ffffc0001001 3:0 ffff8bc172564700 274 lru 00000080:00200000:2.0:1788201595.223088:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000002010558 274: 1< 0 - - > 2< 1122304 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.223090:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005b6d6970 00000080:00200000:2.0:1788201595.223092:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 275. 00000080:00200000:2.0:1788201595.223093:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 275 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.223111:0:24470:0:(rw26.c:898:ll_write_end()) pos 1126400, len 4096, copied 4096 00000080:00200000:2.0:1788201595.223115:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b95c11f7[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 275] 00000080:00200000:2.0:1788201595.223118:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004314193f 17ffffc0001001 3:0 ffff8bc172564b60 275 lru 00000080:00200000:2.0:1788201595.223195:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f272794d 275: 1< 0 - - > 2< 1126400 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.223198:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b95c11f7 00000080:00200000:2.0:1788201595.223200:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 276. 00000080:00200000:2.0:1788201595.223202:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 276 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.223220:0:24470:0:(rw26.c:898:ll_write_end()) pos 1130496, len 4096, copied 4096 00000080:00200000:2.0:1788201595.223225:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000163af118[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 276] 00000080:00200000:2.0:1788201595.223228:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006cc402f6 17ffffc0001001 3:0 ffff8bc1725642a0 276 lru 00000080:00200000:2.0:1788201595.223233:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006021896f 276: 1< 0 - - > 2< 1130496 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.223235:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000163af118 00000080:00200000:2.0:1788201595.223236:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 277. 00000080:00200000:2.0:1788201595.223238:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 277 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.223254:0:24470:0:(rw26.c:898:ll_write_end()) pos 1134592, len 4096, copied 4096 00000080:00200000:2.0:1788201595.223259:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000384b367f[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 277] 00000080:00200000:2.0:1788201595.223262:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c48d8902 17ffffc0001021 2:0 ffff8bc172564460 277 lru 00000080:00200000:2.0:1788201595.223267:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000fe21a370 277: 1< 0 - - > 2< 1134592 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.223270:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000384b367f 00000080:00200000:2.0:1788201595.223271:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 278. 00000080:00200000:2.0:1788201595.223273:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 278 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.223285:0:24470:0:(rw26.c:898:ll_write_end()) pos 1138688, len 4096, copied 4096 00000080:00200000:2.0:1788201595.223289:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009e7ca931[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 278] 00000080:00200000:2.0:1788201595.223291:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000cfb12da1 17ffffc0001001 3:0 ffff8bc172564d20 278 lru 00000080:00200000:2.0:1788201595.223296:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000044e23855 278: 1< 0 - - > 2< 1138688 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.223298:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009e7ca931 00000080:00200000:2.0:1788201595.223299:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 279. 00000080:00200000:2.0:1788201595.223301:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 279 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.223314:0:24470:0:(rw26.c:898:ll_write_end()) pos 1142784, len 4096, copied 4096 00000080:00200000:2.0:1788201595.223319:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e73d3f59[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 279] 00000080:00200000:2.0:1788201595.223323:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000009ea95bac 17ffffc0001001 3:0 ffff8bc172564000 279 lru 00000080:00200000:2.0:1788201595.223328:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000600d96f8 279: 1< 0 - - > 2< 1142784 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.223331:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e73d3f59 00000080:00200000:2.0:1788201595.223332:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 280. 00000080:00200000:2.0:1788201595.223334:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 280 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.223361:0:24470:0:(rw26.c:898:ll_write_end()) pos 1146880, len 4096, copied 4096 00000080:00200000:2.0:1788201595.223366:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000136612d9[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 280] 00000080:00200000:2.0:1788201595.223369:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000bc5fae5c 17ffffc0001001 3:0 ffff8bc172564380 280 lru 00000080:00200000:2.0:1788201595.223375:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000060f9774b 280: 1< 0 - - > 2< 1146880 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.223377:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000136612d9 00000080:00200000:2.0:1788201595.223378:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 281. 00000080:00200000:2.0:1788201595.223380:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 281 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.223395:0:24470:0:(rw26.c:898:ll_write_end()) pos 1150976, len 4096, copied 4096 00000080:00200000:2.0:1788201595.223399:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007448b930[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 281] 00000080:00200000:2.0:1788201595.223403:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008dbab3d4 17ffffc0001001 3:0 ffff8bc1725641c0 281 lru 00000080:00200000:2.0:1788201595.223407:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000028658037 281: 1< 0 - - > 2< 1150976 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.223409:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007448b930 00000080:00200000:2.0:1788201595.223410:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 282. 00000080:00200000:2.0:1788201595.223413:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 282 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.223426:0:24470:0:(rw26.c:898:ll_write_end()) pos 1155072, len 4096, copied 4096 00000080:00200000:2.0:1788201595.223431:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000876a4910[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 282] 00000080:00200000:2.0:1788201595.223434:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006a2084f3 17ffffc0001001 3:0 ffff8bc1725640e0 282 lru 00000080:00200000:2.0:1788201595.223440:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ae008ebf 282: 1< 0 - - > 2< 1155072 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.223442:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000876a4910 00000080:00200000:2.0:1788201595.223443:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 283. 00000080:00200000:2.0:1788201595.223445:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 283 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.223466:0:24470:0:(rw26.c:898:ll_write_end()) pos 1159168, len 4096, copied 4096 00000080:00200000:2.0:1788201595.223471:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000055e03103[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 283] 00000080:00200000:2.0:1788201595.223474:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004cd7f32d 17ffffc0001001 3:0 ffff8bc172622460 283 lru 00000080:00200000:2.0:1788201595.223480:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000f66ad79 283: 1< 0 - - > 2< 1159168 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.223484:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000055e03103 00000080:00200000:2.0:1788201595.223486:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 284. 00000080:00200000:2.0:1788201595.223487:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 284 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.223500:0:24470:0:(rw26.c:898:ll_write_end()) pos 1163264, len 4096, copied 4096 00000080:00200000:2.0:1788201595.223504:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000042976e9a[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 284] 00000080:00200000:2.0:1788201595.223507:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006be118ab 17ffffc0001001 3:0 ffff8bc172622d20 284 lru 00000080:00200000:2.0:1788201595.223513:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ea4b30ba 284: 1< 0 - - > 2< 1163264 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.223584:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000042976e9a 00000080:00200000:2.0:1788201595.223587:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 285. 00000080:00200000:2.0:1788201595.223590:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 285 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.223606:0:24470:0:(rw26.c:898:ll_write_end()) pos 1167360, len 4096, copied 4096 00000080:00200000:2.0:1788201595.223611:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000790e5564[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 285] 00000080:00200000:2.0:1788201595.223614:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000065422166 17ffffc0001001 3:0 ffff8bc172622000 285 lru 00000080:00200000:2.0:1788201595.223620:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000635952d7 285: 1< 0 - - > 2< 1167360 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.223622:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000790e5564 00000080:00200000:2.0:1788201595.223623:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 286. 00000080:00200000:2.0:1788201595.223625:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 286 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.223637:0:24470:0:(rw26.c:898:ll_write_end()) pos 1171456, len 4096, copied 4096 00000080:00200000:2.0:1788201595.223642:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007a5f91ce[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 286] 00000080:00200000:2.0:1788201595.223645:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000474e8ec6 17ffffc0001001 3:0 ffff8bc172622380 286 lru 00000080:00200000:2.0:1788201595.223650:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005d8d426c 286: 1< 0 - - > 2< 1171456 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.223652:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007a5f91ce 00000080:00200000:2.0:1788201595.223653:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 287. 00000080:00200000:2.0:1788201595.223654:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 287 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.223666:0:24470:0:(rw26.c:898:ll_write_end()) pos 1175552, len 4096, copied 4096 00000080:00200000:2.0:1788201595.223670:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000099b6867f[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 287] 00000080:00200000:2.0:1788201595.223673:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007348afae 17ffffc0001001 3:0 ffff8bc1726221c0 287 lru 00000080:00200000:2.0:1788201595.223677:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000052f1ee2b 287: 1< 0 - - > 2< 1175552 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.223679:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000099b6867f 00000080:00200000:2.0:1788201595.223680:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 288. 00000080:00200000:2.0:1788201595.223682:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 288 of 0 to 1910 bytes 00000080:00200000:2.0:1788201595.223708:0:24470:0:(rw26.c:898:ll_write_end()) pos 1179648, len 1910, copied 1910 00000080:00200000:2.0:1788201595.223712:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000198a28b[3 00000000ae729ed8 2 1 00000000a46cf215 0 0 288] 00000080:00200000:2.0:1788201595.223715:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d5755202 17ffffc0001001 3:0 ffff8bc1726220e0 288 lru 00000080:00200000:2.0:1788201595.223720:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d73d28b7 288: 1< 0 - - > 2< 1179648 0 0 0x0 0x0 | 000000008930e75a 00000000728fcd06 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.223722:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000198a28b 00000080:00200000:2.0:1788201595.223723:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 289. 00000080:00200000:2.0:1788201595.223728:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 289, from 0, to 1910 prio 0 00000008:00010000:2.0:1788201595.223913:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000f57833e2 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1788201595.223953:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d5d38, count 15, dirtied 15 00000080:00200000:2.0:1788201595.223972:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d5d38, count 15, dirtied 15 00000080:00200000:2.0:1788201595.223988:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d5d38, count 15, dirtied 15 00000080:00200000:2.0:1788201595.224005:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d5d38, count 15, dirtied 15 00000080:00200000:2.0:1788201595.224019:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d5d38, count 15, dirtied 15 00000080:00200000:2.0:1788201595.224034:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d5d38, count 15, dirtied 15 00000080:00200000:2.0:1788201595.224052:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d5d38, count 15, dirtied 15 00000080:00200000:2.0:1788201595.224069:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d5d38, count 15, dirtied 15 00000080:00200000:2.0:1788201595.224084:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d5d38, count 15, dirtied 15 00000080:00200000:2.0:1788201595.224098:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d5d38, count 15, dirtied 15 00000080:00200000:2.0:1788201595.224114:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d5d38, count 15, dirtied 15 00000080:00200000:2.0:1788201595.224202:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d5d38, count 15, dirtied 15 00000080:00200000:2.0:1788201595.224438:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d5d38, count 15, dirtied 15 00000080:00200000:2.0:1788201595.224460:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d5d38, count 15, dirtied 15 00000080:00200000:2.0:1788201595.224479:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d5d38, count 15, dirtied 15 00000080:00200000:2.0:1788201595.224498:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d5d38, count 15, dirtied 15 00000080:00200000:2.0:1788201595.224514:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d5d38, count 15, dirtied 15 00000080:00200000:2.0:1788201595.224618:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d5d38, count 1, dirtied 1 00000008:00010000:2.0:1788201595.224684:0:754:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000f57833e2 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1788201595.224705:0:754:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000f57833e2 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.224929:0:754:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00100000:2.0:1788201595.225742:0:754:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc145e89f80 - object 0x280000400:451 offset 0<>1048576 00000100:00100000:3.0:1788201595.225860:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728024960:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201595.226239:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 0000000081c0d89d ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1788201595.226285:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d5d38, count 15, dirtied 15 00000080:00200000:2.0:1788201595.226310:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d5d38, count 15, dirtied 15 00000080:00200000:2.0:1788201595.226317:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d5d38, count 3, dirtied 3 00000080:00200000:2.0:1788201595.226322:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 289 pages 1181558 bytes, tot: 1181558 00000080:00200000:2.0:1788201595.226327:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) sanity.sh: write bytes 0, result: 1181558 00000020:00010000:2.0:1788201595.226444:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460e6a88 (ffff8bc1460e95a8/0) at cl_lock_release():245 00000020:00010000:2.0:1788201595.226449:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460e6a88 (ffff8bc1460e95a8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.226453:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149fec330 (ffff8bc1460e9008/1) at cl_lock_cancel():142 00010000:00010000:2.0:1788201595.226462:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.226476:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1788201595.226501:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460e6a88 (ffff8bc1460e95a8/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201595.226503:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149fec330 (ffff8bc1460e95a8/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201595.226514:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 1181558 bytes 00000080:00200000:2.0:1788201595.226534:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 288] 00000080:00200000:2.0:1788201595.226565:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a1:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201595.226570:0:24470:0:(file.c:2238:ll_file_io_generic()) sanity.sh: 2 io complete with rc: 0, result: 1181558, restart: 0 00000080:00200000:2.0:1788201595.226584:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a1:0x0] updating i_size 1181558 i_blocks 1 00000080:00200000:2.0:1788201595.226591:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 1181558 00000080:00200008:2.0:1788201595.226654:0:24470:0:(file.c:479:ll_file_release()) START file sanity.sh:[0x200000bd7:0x1a1:0x0](ffff8bc1459d5b88), flags 100001 00000002:00100000:2.0:1788201595.226713:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1727d5180 x1875064728024448/t8589937476(8589937476) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201611 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1788201595.226727:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1788201595.226733:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc145e88e00 x1875064728025216/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1788201595.226756:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e88e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728025216:192.168.201.143@tcp:35:cp.0 00000100:00100000:2.0:1788201595.232310:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.232388:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e88e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728025216:192.168.201.143@tcp:35:cp.0 00000002:00100000:2.0:1788201595.232426:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1727d5180 x1875064728024448/t8589937476(8589937476) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201595.232534:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.232558:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.232583:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.232601:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.232609:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.232615:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.232620:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.232629:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201595.232634:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.232643:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.232661:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.232670:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201595.232676:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.232680:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sanity.sh, flags=8 00000080:00200008:2.0:1788201595.232689:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sanity.sh:[0x200000bd7:0x1a1:0x0](ffff8bc1459d5b88), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1788201595.232693:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x1a1:0x0](ffff8bc1459d5b88),name=sanity.sh 00000002:00010000:2.0:1788201595.232706:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x1a1:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.232715:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109839e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201595.232723:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109839e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1788201595.232730:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.232734:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a1:0x0](ffff8bc1459d5b88) 00000080:00010000:2.0:1788201595.232736:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a1:0x0](ffff8bc1459d5b88) for lock 0xd138388016f6f889 00000080:00010000:2.0:1788201595.232740:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f889 from it ffffadd1c7debcb8 00010000:00010000:2.0:1788201595.232743:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109839e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201595.232756:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109839e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201595.232863:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a1:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201595.232874:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x1a1:0x0] 00000008:00010000:2.0:1788201595.232904:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201595.232909:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d8b0, osc lock ffff8bc151fc0e40, flags 0x400001002 00010000:00010000:2.0:1788201595.232929:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.232942:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:2.0:1788201595.232957:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1788201595.232961:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 7/0,1 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.232970:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1788201595.232981:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1788201595.232991:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a1:0x0] updating i_size 1181558 i_blocks 1 00000020:00010000:2.0:1788201595.232996:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460079d0 (ffff8bc146919d88/0) at cl_lock_release():245 00000020:00010000:2.0:1788201595.232999:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460079d0 (ffff8bc146919d88/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.233002:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d8b0 (ffff8bc146919128/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.233006:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460079d0 (ffff8bc146919d88/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201595.233010:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d8b0 (ffff8bc146919d88/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201595.233046:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a1:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201595.233105:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.233114:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.233121:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.233251:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.233258:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.233263:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.233267:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.233271:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201595.233274:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.233281:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.233291:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.233296:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201595.233299:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.233318:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=scrub-performance.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:2.0:1788201595.233322:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=scrub-performance.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201595.233333:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: scrub-performance.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201595.233397:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f89e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.233407:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f89e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.233417:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f89e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.233444:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e8b800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728025344:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201595.233593:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.240288:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e8b800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728025344:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201595.240317:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f89e lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.240334:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f89e lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.240353:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f89e lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.240362:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f89e lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.240373:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f89e lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.240381:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1443b7400 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:2.0:1788201595.240386:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f89e lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.240394:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f89e lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.240403:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f89e lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.240411:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201595.240418:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f89e lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.240426:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f89e lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201595.240448:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc145e8b800 x1875064728025344/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201595.240466:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1788201595.240497:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201595.240571:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.240588:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.240597:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.240611:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.240618:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.240623:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.240627:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.240633:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201595.240637:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.240650:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.240666:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.240675:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201595.240681:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.240697:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=scrub-performance.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:2.0:1788201595.240701:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=scrub-performance.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201595.240714:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: scrub-performance.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201595.240762:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8a5 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.240770:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8a5 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.240782:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8a5 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.240871:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e8b800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728025472:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201595.241058:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.254969:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e8b800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728025472:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201595.255000:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8a5 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.255018:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8a5 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.255030:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8a5 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.255038:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8a5 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.255049:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8a5 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.255057:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1443b7200 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:2.0:1788201595.255063:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8a5 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.255071:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8a5 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.255079:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8a5 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.255088:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201595.255095:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8a5 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.255103:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8a5 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201595.255127:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc145e8b800 x1875064728025472/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201595.255153:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1788201595.255186:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201595.255327:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.255360:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.255372:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.255385:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.255393:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.255399:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.255403:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.255409:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:2.0:1788201595.255414:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.255424:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.255444:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.255454:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201595.255461:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.255478:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.255484:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=scrub-performance.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14c595500, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:2.0:1788201595.255494:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=scrub-performance.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:2.0:1788201595.255530:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: scrub-performance.sh,[0x200000bd7:0x1a2:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:2.0:1788201595.255594:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.255607:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1788201595.255622:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1788201595.255630:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc145e8b800 x1875064728025728/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1788201595.255641:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.255668:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e8b800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728025728:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201595.255908:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.260073:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e8b800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728025728:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201595.260109:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710983f9 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.260149:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710983f9 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.260159:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710983f9 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.260171:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710983f9 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.260183:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710983f9 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.260204:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710983f9 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.260213:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710983f9 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.260222:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710983f9 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201595.260236:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc145e8b800 x1875064728025728/t8589937478(8589937478) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1788201595.260250:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc145e8b800 x1875064728025728/t8589937478(8589937478) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1788201595.260266:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710983f9 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1788201595.260279:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710983f9 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.260291:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/418 (0 0) 00000080:00200000:2.0:1788201595.260299:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1788201595.260316:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=scrub-performance.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:2.0:1788201595.260364:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1a2:0x0](ffff8bc145981988) 00000080:00200000:2.0:1788201595.260521:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x1a2:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1788201595.260533:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x1a2:0x0](ffff8bc145981988) 00000080:00010000:2.0:1788201595.260537:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a2:0x0](ffff8bc145981988) for lock 0xd138388016f6f8ac 00000080:00010000:2.0:1788201595.260548:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a2:0x0](ffff8bc145981988) 00000080:00200008:2.0:1788201595.260565:0:24470:0:(file.c:1090:ll_file_open()) START file scrub-performance.sh:[0x200000bd7:0x1a2:0x0](ffff8bc145981988), flags 100301 00000002:00100000:2.0:1788201595.260588:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc145e8b800 x1875064728025728/t8589937478(8589937478) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1788201595.260639:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f8ac from it ffff8bc150632d80 00010000:00010000:2.0:1788201595.260644:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710983f9 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.260653:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710983f9 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201595.260685:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1a2:0x0](ffff8bc145981988), inode mode 81a4 mask 40 00000080:00200008:2.0:1788201595.260725:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file scrub-performance.sh:[0x200000bd7:0x1a2:0x0](ffff8bc145981988), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1788201595.260732:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x1a2:0x0](ffff8bc145981988),name=scrub-performance.sh 00000002:00010000:2.0:1788201595.260755:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x1a2:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.260767:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710983f9 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.260780:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710983f9 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201595.260787:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.260823:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a2:0x0](ffff8bc145981988) 00000080:00010000:2.0:1788201595.260828:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a2:0x0](ffff8bc145981988) for lock 0xd138388016f6f8ac 00000080:00010000:2.0:1788201595.260833:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f8ac from it ffffadd1c7debcd8 00010000:00010000:2.0:1788201595.260836:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710983f9 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.260845:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710983f9 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1788201595.260873:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a2:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201595.260883:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x1a2:0x0] 00000008:00010000:2.0:1788201595.260911:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201595.260915:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261dcb0, osc lock ffff8bc151fc0e40, flags 0x400001002 00010000:00010000:2.0:1788201595.260976:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009df3ef72/0xd138388016f6f8b3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.260987:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009df3ef72/0xd138388016f6f8b3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201595.261084:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728025856:192.168.201.143@tcp:101:cp.0 00000020:00200000:2.0:1788201595.261218:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:0.0:1788201595.267042:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000f57833e2 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201595.267277:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000f57833e2 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000100:00100000:0.0:1788201595.267321:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728024960:192.168.201.143@tcp:4:cp.0 00010000:00010000:1.0:1788201595.269784:0:10055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009df3ef72/0xd138388016f6f8b3 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.269849:0:10055:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009df3ef72/0xd138388016f6f8b3 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098407 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.269869:0:10055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009df3ef72/0xd138388016f6f8b3 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098407 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.269885:0:10055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009df3ef72/0xd138388016f6f8b3 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098407 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201595.269904:0:10055:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009df3ef72/0xd138388016f6f8b3 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171098407 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201595.269918:0:10055:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1788201595.269937:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009df3ef72/0xd138388016f6f8b3 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171098407 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.269948:0:10055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009df3ef72/0xd138388016f6f8b3 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171098407 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.269956:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009df3ef72/0xd138388016f6f8b3 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171098407 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.269972:0:10055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009df3ef72/0xd138388016f6f8b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171098407 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201595.270000:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728025856:192.168.201.143@tcp:101:cp.0 00000080:00200000:2.0:1788201595.270132:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a2:0x0] updating i_size 0 i_blocks 1 00000020:00010000:2.0:1788201595.270140:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460079d0 (ffff8bc146919d88/0) at cl_lock_release():245 00000020:00010000:2.0:1788201595.270143:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460079d0 (ffff8bc146919d88/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.270149:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261dcb0 (ffff8bc146919128/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.270153:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460079d0 (ffff8bc146919d88/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201595.270156:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261dcb0 (ffff8bc146919d88/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201595.270204:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a2:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1788201595.270281:0:24470:0:(file.c:2638:do_file_write_iter()) START file scrub-performance.sh:[0x200000bd7:0x1a2:0x0], ppos: 0, count: 5105 00000080:00200000:2.0:1788201595.270309:0:24470:0:(file.c:2090:ll_file_io_generic()) scrub-performance.sh: write ppos: 0, bytes: 5105 00000080:00200000:2.0:1788201595.270316:0:24470:0:(file.c:1848:ll_io_set_mirror()) scrub-performance.sh: desiginated mirror: 0 00000020:00200000:2.0:1788201595.270323:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000cfe061d0[0x110, 1, [0x200000bd7:0x1a2:0x0] hash] 00000020:00200000:2.0:1788201595.270325:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5105) 0 0 00000080:00200000:2.0:1788201595.270329:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a2:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201595.270357:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 1] 00020000:00200000:2.0:1788201595.270365:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5105) 5105, 5105 00020000:00200000:2.0:1788201595.270369:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201595.270399:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 1] 00000008:00010000:2.0:1788201595.270412:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1788201595.270418:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261dcb0, osc lock ffff8bc151fc0e40, flags 0x0 00010000:00010000:2.0:1788201595.270436:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/451 (0 8191) 00010000:00010000:2.0:1788201595.270479:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.270488:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.270498:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.270536:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e8a300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728025984:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201595.270639:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201595.272885:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201595.273037:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743489280 00000100:00100000:1.0:1788201595.273051:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743489280 00000100:00100000:1.0:1788201595.273139:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 827 00000100:00100000:1.0:1788201595.273151:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1726cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23415:x1875064743489280:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201595.273172:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009df3ef72/0xd138388016f6f8b3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171098407 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201595.273270:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201595.273278:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1726cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23415:x1875064743489280:12345-192.168.201.143@tcp:104: Request processed in 129us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201595.273285:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 827 00010000:00010000:3.0:1788201595.273671:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201595.273681:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009df3ef72/0xd138388016f6f8b3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171098407 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201595.273692:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1443b7200 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201595.273699:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009df3ef72/0xd138388016f6f8b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171098407 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201595.273759:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a2:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201595.273773:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201595.273877:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009df3ef72/0xd138388016f6f8b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171098407 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201595.273887:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201595.273924:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009df3ef72/0xd138388016f6f8b3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171098407 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201595.273932:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009df3ef72/0xd138388016f6f8b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171098407 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201595.273953:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201595.273955:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201595.273956:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201595.274005:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201595.274025:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728026112:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201595.277296:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201595.277851:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e8a300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728025984:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201595.277890:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.277909:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.277919:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.278897:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743489408 00000100:00100000:2.0:1788201595.278910:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743489408 00000100:00100000:2.0:1788201595.279020:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 828 00000100:00100000:2.0:1788201595.279032:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1726ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743489408:12345-192.168.201.143@tcp:105: 00010000:00010000:2.0:1788201595.279047:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.279058:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.279068:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.279079:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.279107:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.279126:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.279191:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1443b6200) 00000100:00100000:2.0:1788201595.279272:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1726ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21003:x1875064743489408:12345-192.168.201.143@tcp:105: Request processed in 242us (1990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201595.279281:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 828 00010000:00010000:0.0:1788201595.281355:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.281380:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.281403:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201595.281419:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.281433:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.281443:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201595.281598:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728026112:192.168.201.143@tcp:103:ldlm_bl.0 00000080:00200000:0.0:1788201595.281635:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) scrub-performance.sh: write [0, 5105) append 0 append lockpos 0 00000080:00200000:0.0:1788201595.281662:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.281738:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:0.0:1788201595.281752:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000070b3d27c[3 0000000016404203 2 1 0000000044063476 0 0 0] 00000080:00200000:0.0:1788201595.281756:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f4bb50de 17ffffc0001001 3:0 ffff8bc16652d1c0 0 lru 00000080:00200000:0.0:1788201595.281765:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a4ce8814 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000e8b452ec > 3< 0 0 > 4< 0 0 8 0 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.281767:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000070b3d27c 00000080:00200000:0.0:1788201595.281769:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1788201595.281778:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 1009 bytes 00000080:00200000:0.0:1788201595.281895:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 1009, copied 1009 00000080:00200000:0.0:1788201595.281901:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008800d81a[3 0000000016404203 2 1 0000000044063476 0 0 1] 00000080:00200000:0.0:1788201595.281904:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000049d1bdfa 17ffffc0001001 3:0 ffff8bc16652d0e0 1 lru 00000080:00200000:0.0:1788201595.281910:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000005eae285 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 00000000e8b452ec > 3< 0 0 > 4< 0 0 8 0 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.281912:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008800d81a 00000080:00200000:0.0:1788201595.281914:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:0.0:1788201595.281917:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 2, from 0, to 1009 prio 0 00000008:00010000:0.0:1788201595.282002:0:13591:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000ac85aa45 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201595.282019:0:13591:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000ac85aa45 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201595.282076:0:13591:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 1 00000008:00100000:0.0:1788201595.282579:0:13591:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc172648e00 - object 0x240000400:426 offset 0<>18269 00000100:00100000:1.0:1788201595.282637:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000008:00010000:0.0:1788201595.282664:0:13591:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 0000000075aa8b31 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fd829a5f/0xd138388016f6f22a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710972fe expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201595.282681:0:13591:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 0000000075aa8b31 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fd829a5f/0xd138388016f6f22a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710972fe expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201595.282711:0:13591:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fd829a5f/0xd138388016f6f22a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710972fe expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201595.282746:0:13591:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc172648000 - object 0x240000400:427 offset 0<>3006 00000008:00010000:0.0:1788201595.282785:0:13591:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000003bb2c203 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201595.282818:0:13591:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000003bb2c203 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201595.282842:0:13591:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201595.282873:0:13591:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc17264bb80 - object 0x240000400:428 offset 0<>938 00000008:00010000:0.0:1788201595.282886:0:13591:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000e4976b9a ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f2b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109746a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201595.282895:0:13591:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000e4976b9a ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f2b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109746a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201595.282919:0:13591:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f2b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109746a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201595.282958:0:13591:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc17264b800 - object 0x240000400:429 offset 0<>6813 00000100:00100000:2.0:1788201595.283013:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17264bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728026496:192.168.201.143@tcp:4:cp.0 00000100:00100000:2.0:1788201595.283134:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201595.283142:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728026368:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201595.286923:0:10055:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 0000000075aa8b31 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fd829a5f/0xd138388016f6f22a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710972fe expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:2.0:1788201595.286998:0:10055:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 0000000075aa8b31 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fd829a5f/0xd138388016f6f22a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710972fe expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1788201595.287034:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728026368:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201595.287066:0:10055:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000003bb2c203 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:2.0:1788201595.287082:0:10055:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000003bb2c203 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1788201595.287108:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17264bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728026496:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201595.287320:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000cc8ad32a ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201595.287363:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145981b38, count 2, dirtied 2 00000080:00200000:3.0:1788201595.287371:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 2 pages 5105 bytes, tot: 5105 00000080:00200000:3.0:1788201595.287377:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) scrub-performance.sh: write bytes 0, result: 5105 00000020:00010000:3.0:1788201595.287400:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc149844c68 (ffff8bc146919d88/0) at cl_lock_release():245 00000020:00010000:3.0:1788201595.287404:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149844c68 (ffff8bc146919d88/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201595.287408:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261dcb0 (ffff8bc146919128/1) at cl_lock_cancel():142 00010000:00010000:3.0:1788201595.287418:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.287431:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1788201595.287456:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149844c68 (ffff8bc146919d88/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201595.287459:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261dcb0 (ffff8bc146919d88/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201595.287468:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 5105 bytes 00000080:00200000:3.0:1788201595.287477:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 1] 00000080:00200000:3.0:1788201595.287533:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a2:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201595.287538:0:24470:0:(file.c:2238:ll_file_io_generic()) scrub-performance.sh: 2 io complete with rc: 0, result: 5105, restart: 0 00000080:00200000:3.0:1788201595.287553:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a2:0x0] updating i_size 5105 i_blocks 1 00000080:00200000:3.0:1788201595.287559:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5105 00000080:00200008:3.0:1788201595.287619:0:24470:0:(file.c:479:ll_file_release()) START file scrub-performance.sh:[0x200000bd7:0x1a2:0x0](ffff8bc145981988), flags 100001 00000002:00100000:3.0:1788201595.287690:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc145e8b800 x1875064728025728/t8589937478(8589937478) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201611 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1788201595.287702:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1788201595.287708:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1726cf100 x1875064728026880/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1788201595.287735:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728026880:192.168.201.143@tcp:35:cp.0 00000100:00100000:3.0:1788201595.287844:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.288899:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17264b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728026624:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201595.288980:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728026240:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201595.295669:0:10052:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000e4976b9a ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f2b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109746a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201595.295724:0:10052:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000e4976b9a ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f2b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109746a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201595.295758:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17264b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728026624:192.168.201.143@tcp:4:cp.0 00000100:00100000:2.0:1788201595.296906:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728026880:192.168.201.143@tcp:35:cp.0 00000002:00100000:2.0:1788201595.296945:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc145e8b800 x1875064728025728/t8589937478(8589937478) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201595.297045:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.297070:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.297104:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.297128:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.297138:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.297146:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.297150:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.297160:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201595.297165:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.297174:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.297195:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.297204:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201595.297211:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.297215:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=scrub-performance.sh, flags=8 00000080:00200008:2.0:1788201595.297223:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file scrub-performance.sh:[0x200000bd7:0x1a2:0x0](ffff8bc145981988), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1788201595.297229:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x1a2:0x0](ffff8bc145981988),name=scrub-performance.sh 00000002:00010000:2.0:1788201595.297242:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x1a2:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.297251:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710983f9 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201595.297259:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710983f9 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1788201595.297265:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.297269:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a2:0x0](ffff8bc145981988) 00000080:00010000:2.0:1788201595.297272:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a2:0x0](ffff8bc145981988) for lock 0xd138388016f6f8ac 00000080:00010000:2.0:1788201595.297276:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f8ac from it ffffadd1c7debcb8 00010000:00010000:2.0:1788201595.297280:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710983f9 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201595.297288:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710983f9 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201595.297356:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a2:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201595.297367:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x1a2:0x0] 00000008:00010000:2.0:1788201595.297399:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201595.297404:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d830, osc lock ffff8bc151fc0000, flags 0x400001002 00010000:00010000:2.0:1788201595.297425:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.297439:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:2.0:1788201595.297454:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1788201595.297458:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.297466:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1788201595.297478:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1788201595.297487:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a2:0x0] updating i_size 5105 i_blocks 1 00000020:00010000:2.0:1788201595.297491:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc146007090 (ffff8bc1469191b8/0) at cl_lock_release():245 00000020:00010000:2.0:1788201595.297495:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146007090 (ffff8bc1469191b8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.297498:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d830 (ffff8bc146919098/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.297501:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146007090 (ffff8bc1469191b8/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201595.297504:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d830 (ffff8bc1469191b8/1) at cl_lock_fini():72 00000008:00010000:1.0:1788201595.297670:0:10052:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000ac85aa45 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 1 00000008:00010000:1.0:1788201595.297703:0:10052:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000ac85aa45 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 1 00000100:00100000:1.0:1788201595.297722:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728026240:192.168.201.143@tcp:4:cp.0 00000080:00200000:2.0:1788201595.298088:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a2:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201595.298179:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.298191:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.298203:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.298215:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.298223:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.298228:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.298231:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.298237:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201595.298240:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.298249:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.298260:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.298266:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201595.298270:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.298293:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=setup-cifs.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:2.0:1788201595.298297:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=setup-cifs.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201595.298310:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: setup-cifs.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201595.298376:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f8c1 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.298385:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f8c1 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.298398:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f8c1 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.298423:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e8b480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728027008:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201595.298556:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.302370:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e8b480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728027008:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201595.302400:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f8c1 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.302416:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f8c1 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.302423:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f8c1 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.302431:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f8c1 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.302441:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f8c1 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.302449:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1443b7a00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:2.0:1788201595.302455:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f8c1 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.302464:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f8c1 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.302472:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f8c1 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.302481:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201595.302489:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f8c1 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.302497:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7a00/0xd138388016f6f8c1 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201595.302535:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc145e8b480 x1875064728027008/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201595.302554:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1788201595.302588:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201595.302667:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.302685:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.302696:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.302710:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.302717:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.302723:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.302727:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.302734:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201595.302738:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.302747:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.302765:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.302774:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201595.302781:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.302950:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=setup-cifs.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:2.0:1788201595.302957:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=setup-cifs.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201595.302971:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: setup-cifs.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201595.303023:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8c8 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.303031:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8c8 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.303044:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8c8 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.303069:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e8b480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728027136:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201595.303329:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.306371:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e8b480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728027136:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201595.306399:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8c8 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.306415:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8c8 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.306422:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8c8 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.306429:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8c8 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.306438:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8c8 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.306444:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1443b7c00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:2.0:1788201595.306450:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8c8 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.306458:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8c8 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.306467:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8c8 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.306475:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201595.306482:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8c8 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.306489:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8c8 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201595.306513:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc145e8b480 x1875064728027136/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201595.306544:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1788201595.306580:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201595.306727:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.306745:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.306757:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.306770:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.306776:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.306781:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.306786:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.306846:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:2.0:1788201595.306851:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.306861:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.306879:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.306889:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201595.306895:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.306912:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.306917:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=setup-cifs.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14c595500, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:2.0:1788201595.306927:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=setup-cifs.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:2.0:1788201595.306952:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: setup-cifs.sh,[0x200000bd7:0x1a3:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:2.0:1788201595.307013:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.307021:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1788201595.307034:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1788201595.307042:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc145e8b480 x1875064728027392/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1788201595.307051:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.307075:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e8b480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728027392:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201595.307247:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.314298:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e8b480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728027392:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201595.314355:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098454 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.314386:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098454 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.314396:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098454 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.314410:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098454 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.314422:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098454 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.314439:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098454 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.314449:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098454 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.314456:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098454 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201595.314470:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc145e8b480 x1875064728027392/t8589937480(8589937480) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1788201595.314486:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc145e8b480 x1875064728027392/t8589937480(8589937480) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1788201595.314501:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098454 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1788201595.314525:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098454 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.314538:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/419 (0 0) 00000080:00200000:2.0:1788201595.314547:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1788201595.314565:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=setup-cifs.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:2.0:1788201595.314598:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1a3:0x0](ffff8bc145985b88) 00000080:00200000:2.0:1788201595.314751:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x1a3:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1788201595.314761:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x1a3:0x0](ffff8bc145985b88) 00000080:00010000:2.0:1788201595.314765:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a3:0x0](ffff8bc145985b88) for lock 0xd138388016f6f8cf 00000080:00010000:2.0:1788201595.314777:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a3:0x0](ffff8bc145985b88) 00000080:00200008:2.0:1788201595.314824:0:24470:0:(file.c:1090:ll_file_open()) START file setup-cifs.sh:[0x200000bd7:0x1a3:0x0](ffff8bc145985b88), flags 100301 00000002:00100000:2.0:1788201595.314846:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc145e8b480 x1875064728027392/t8589937480(8589937480) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1788201595.314896:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f8cf from it ffff8bc1506322a0 00010000:00010000:2.0:1788201595.314902:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171098454 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.314913:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098454 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201595.314944:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1a3:0x0](ffff8bc145985b88), inode mode 81a4 mask 40 00000080:00200008:2.0:1788201595.314975:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file setup-cifs.sh:[0x200000bd7:0x1a3:0x0](ffff8bc145985b88), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1788201595.314982:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x1a3:0x0](ffff8bc145985b88),name=setup-cifs.sh 00000002:00010000:2.0:1788201595.315003:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x1a3:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.315014:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098454 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.315027:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098454 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201595.315035:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.315040:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a3:0x0](ffff8bc145985b88) 00000080:00010000:2.0:1788201595.315044:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a3:0x0](ffff8bc145985b88) for lock 0xd138388016f6f8cf 00000080:00010000:2.0:1788201595.315048:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f8cf from it ffffadd1c7debcd8 00010000:00010000:2.0:1788201595.315052:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171098454 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.315060:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098454 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1788201595.315086:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a3:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201595.315489:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x1a3:0x0] 00000008:00010000:2.0:1788201595.315538:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201595.315542:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d130, osc lock ffff8bc151fc0000, flags 0x400001002 00010000:00010000:2.0:1788201595.315613:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8d6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.315631:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8d6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1788201595.315684:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1788201595.315839:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201595.315863:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728027520:192.168.201.143@tcp:101:cp.0 00010000:00010000:1.0:1788201595.318731:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8d6 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.318766:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8d6 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098462 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.318783:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8d6 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098462 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.318851:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8d6 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098462 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201595.318872:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8d6 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171098462 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201595.318892:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1788201595.318906:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8d6 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171098462 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.318916:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8d6 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171098462 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.318924:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8d6 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171098462 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.318933:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171098462 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201595.318959:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728027520:192.168.201.143@tcp:101:cp.0 00000080:00200000:2.0:1788201595.319151:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a3:0x0] updating i_size 0 i_blocks 1 00000020:00010000:2.0:1788201595.319159:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc146007090 (ffff8bc1469191b8/0) at cl_lock_release():245 00000020:00010000:2.0:1788201595.319163:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc146007090 (ffff8bc1469191b8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.319168:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d130 (ffff8bc146919098/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.319172:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc146007090 (ffff8bc1469191b8/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201595.319175:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d130 (ffff8bc1469191b8/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201595.319219:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a3:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1788201595.319288:0:24470:0:(file.c:2638:do_file_write_iter()) START file setup-cifs.sh:[0x200000bd7:0x1a3:0x0], ppos: 0, count: 2475 00000080:00200000:2.0:1788201595.319307:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 2475 bytes 00000080:00200000:2.0:1788201595.319313:0:24470:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 2475 00000080:00200000:2.0:1788201595.319350:0:24470:0:(file.c:2090:ll_file_io_generic()) setup-cifs.sh: write ppos: 0, bytes: 2475 00000080:00200000:2.0:1788201595.319357:0:24470:0:(file.c:1848:ll_io_set_mirror()) setup-cifs.sh: desiginated mirror: 0 00000020:00200000:2.0:1788201595.319364:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000bce77aa7[0x110, 1, [0x200000bd7:0x1a3:0x0] hash] 00000020:00200000:2.0:1788201595.319366:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 2475) 0 0 00000080:00200000:2.0:1788201595.319371:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a3:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201595.319386:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1788201595.319395:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 2475) 2475, 2475 00020000:00200000:2.0:1788201595.319399:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201595.319432:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1788201595.319447:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1788201595.319453:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d130, osc lock ffff8bc151fc0000, flags 0x0 00010000:00010000:2.0:1788201595.319473:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/452 (0 4095) 00010000:00010000:2.0:1788201595.319517:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.319536:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.319548:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.319576:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e8aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728027648:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201595.319690:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201595.322041:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201595.322161:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743489536 00000100:00100000:2.0:1788201595.322175:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743489536 00000100:00100000:2.0:1788201595.322247:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 829 00000100:00100000:2.0:1788201595.322260:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17264b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23408:x1875064743489536:12345-192.168.201.143@tcp:104: 00010000:00010000:2.0:1788201595.322286:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171098462 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.323026:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201595.323038:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17264b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23408:x1875064743489536:12345-192.168.201.143@tcp:104: Request processed in 779us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201595.323048:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 829 00000100:00100000:2.0:1788201595.324574:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e8aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728027648:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201595.324611:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.324628:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.324643:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.326593:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201595.326684:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171098462 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.326700:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1443b7c00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201595.326708:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171098462 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201595.326806:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201595.326940:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1788201595.327184:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171098462 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.327194:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201595.327242:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8d6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171098462 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.327250:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171098462 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.327268:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201595.327270:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201595.327272:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201595.327566:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728027776:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201595.335537:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201595.335770:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743489664 00000100:00100000:2.0:1788201595.335784:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743489664 00000100:00100000:2.0:1788201595.335892:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 830 00000100:00100000:2.0:1788201595.335905:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1726cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23418:x1875064743489664:12345-192.168.201.143@tcp:105: 00010000:00010000:2.0:1788201595.335928:0:21781:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.335947:0:21781:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.335959:0:21781:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.335973:0:21781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.335985:0:21781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.335998:0:21781:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.336036:0:21781:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1443b7a00) 00000100:00100000:2.0:1788201595.336124:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1726cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23418:x1875064743489664:12345-192.168.201.143@tcp:105: Request processed in 221us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201595.336134:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 830 00010000:00010000:3.0:1788201595.336589:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.336603:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.336625:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201595.336641:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.336656:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.336665:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201595.336701:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) setup-cifs.sh: write [0, 2475) append 0 append lockpos 0 00000080:00200000:3.0:1788201595.336726:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 2475 bytes 00000080:00200000:3.0:1788201595.336848:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 2475, copied 2475 00000080:00200000:3.0:1788201595.336862:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004b98adaa[3 00000000c04bb7d9 2 1 00000000bc75318a 0 0 0] 00000080:00200000:3.0:1788201595.336866:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ff541c86 17ffffc0001001 3:0 ffff8bc1434500e0 0 lru 00000080:00200000:3.0:1788201595.336875:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c83953f5 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 00000000b6de3168 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.336877:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004b98adaa 00000080:00200000:3.0:1788201595.336879:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201595.336885:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 2475 prio 0 00000008:00010000:3.0:1788201595.336913:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 000000006f33c7c4 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201595.336941:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145985d38, count 1, dirtied 1 00000080:00200000:3.0:1788201595.336949:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 2475 bytes, tot: 2475 00000080:00200000:3.0:1788201595.336953:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) setup-cifs.sh: write bytes 0, result: 2475 00000020:00010000:3.0:1788201595.336977:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc149844b78 (ffff8bc1469191b8/0) at cl_lock_release():245 00000020:00010000:3.0:1788201595.336981:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149844b78 (ffff8bc1469191b8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201595.336985:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d130 (ffff8bc146919098/1) at cl_lock_cancel():142 00010000:00010000:3.0:1788201595.336990:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.337000:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1788201595.337021:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149844b78 (ffff8bc1469191b8/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201595.337024:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d130 (ffff8bc1469191b8/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201595.337032:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 2475 bytes 00000080:00200000:3.0:1788201595.337040:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1788201595.337081:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a3:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201595.337085:0:24470:0:(file.c:2238:ll_file_io_generic()) setup-cifs.sh: 2 io complete with rc: 0, result: 2475, restart: 0 00000080:00200000:3.0:1788201595.337093:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a3:0x0] updating i_size 2475 i_blocks 1 00000080:00200000:3.0:1788201595.337099:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 2475 00000080:00200008:3.0:1788201595.337154:0:24470:0:(file.c:479:ll_file_release()) START file setup-cifs.sh:[0x200000bd7:0x1a3:0x0](ffff8bc145985b88), flags 100001 00000002:00100000:3.0:1788201595.337235:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc145e8b480 x1875064728027392/t8589937480(8589937480) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201611 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1788201595.337249:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1788201595.337255:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1726cd500 x1875064728028032/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1788201595.337282:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728028032:192.168.201.143@tcp:35:cp.0 00000100:00100000:3.0:1788201595.337382:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201595.344263:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728027776:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788201595.349013:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728028032:192.168.201.143@tcp:35:cp.0 00000002:00100000:2.0:1788201595.349062:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc145e8b480 x1875064728027392/t8589937480(8589937480) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201595.349169:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.349198:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.349225:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.349245:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.349256:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.349264:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.349269:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.349278:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201595.349284:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.349294:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.349320:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.349328:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201595.349336:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.349355:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=setup-cifs.sh, flags=8 00000080:00200008:2.0:1788201595.349364:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file setup-cifs.sh:[0x200000bd7:0x1a3:0x0](ffff8bc145985b88), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1788201595.349370:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x1a3:0x0](ffff8bc145985b88),name=setup-cifs.sh 00000002:00010000:2.0:1788201595.349385:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x1a3:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.349394:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098454 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201595.349403:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098454 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1788201595.349410:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.349413:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a3:0x0](ffff8bc145985b88) 00000080:00010000:2.0:1788201595.349416:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a3:0x0](ffff8bc145985b88) for lock 0xd138388016f6f8cf 00000080:00010000:2.0:1788201595.349420:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f8cf from it ffffadd1c7debcb8 00010000:00010000:2.0:1788201595.349423:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171098454 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201595.349431:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098454 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201595.349498:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a3:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201595.349509:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x1a3:0x0] 00000008:00010000:2.0:1788201595.349670:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201595.349676:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d9b0, osc lock ffff8bc151fc0720, flags 0x400001002 00010000:00010000:2.0:1788201595.349697:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.349712:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:2.0:1788201595.349726:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1788201595.349731:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.349740:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1788201595.349753:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1788201595.349765:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a3:0x0] updating i_size 2475 i_blocks 1 00000020:00010000:2.0:1788201595.349770:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460044a0 (ffff8bc146919758/0) at cl_lock_release():245 00000020:00010000:2.0:1788201595.349774:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460044a0 (ffff8bc146919758/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.349777:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d9b0 (ffff8bc146919f38/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.349782:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460044a0 (ffff8bc146919758/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201595.349785:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d9b0 (ffff8bc146919758/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201595.349884:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a3:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201595.349962:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.349973:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.349982:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.349992:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.349999:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.350003:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.350006:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.350009:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201595.350013:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.350020:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.350029:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.350034:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201595.350037:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.350051:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=setup_kerberos.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:2.0:1788201595.350056:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=setup_kerberos.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201595.350067:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: setup_kerberos.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201595.350119:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6c00/0xd138388016f6f8e4 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.350128:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6c00/0xd138388016f6f8e4 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.350139:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6c00/0xd138388016f6f8e4 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.350166:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e8aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728028160:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201595.350289:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.356038:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e8aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728028160:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201595.356071:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6c00/0xd138388016f6f8e4 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.356090:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6c00/0xd138388016f6f8e4 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.356098:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6c00/0xd138388016f6f8e4 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.356107:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6c00/0xd138388016f6f8e4 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.356119:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6c00/0xd138388016f6f8e4 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.356139:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1443b6c00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:2.0:1788201595.356145:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6c00/0xd138388016f6f8e4 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.356153:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6c00/0xd138388016f6f8e4 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.356162:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6c00/0xd138388016f6f8e4 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.356170:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201595.356178:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6c00/0xd138388016f6f8e4 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.356186:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6c00/0xd138388016f6f8e4 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201595.356217:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc145e8aa00 x1875064728028160/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201595.356237:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1788201595.356275:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201595.356372:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.356393:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.356405:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.356421:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.356429:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.356436:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.356440:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.356447:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201595.356452:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.356462:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.356484:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.356496:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201595.356503:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.356534:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=setup_kerberos.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:2.0:1788201595.356539:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=setup_kerberos.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201595.356555:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: setup_kerberos.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201595.356616:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8eb lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.356625:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8eb lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.356636:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8eb lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.356664:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e8aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728028288:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201595.356784:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.360905:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e8aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728028288:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201595.360939:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8eb lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.360955:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8eb lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.360963:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8eb lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.360971:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8eb lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.360981:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8eb lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.360987:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1443b7c00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:2.0:1788201595.360994:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8eb lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.361001:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8eb lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.361009:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8eb lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.361018:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201595.361026:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8eb lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.361033:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7c00/0xd138388016f6f8eb lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201595.361057:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc145e8aa00 x1875064728028288/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201595.361075:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1788201595.361106:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201595.361255:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.361273:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.361286:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.361299:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.361306:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.361312:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.361317:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.361323:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:2.0:1788201595.361327:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.361350:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.361369:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.361378:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201595.361385:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.361402:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.361408:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=setup_kerberos.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14c595500, open_flags 80c1, mode 81ed opened 0 00000080:00200000:2.0:1788201595.361417:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=setup_kerberos.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:2.0:1788201595.361442:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: setup_kerberos.sh,[0x200000bd7:0x1a4:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:2.0:1788201595.361642:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.361651:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1788201595.361667:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1788201595.361674:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc145e8aa00 x1875064728028544/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1788201595.361685:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.361711:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e8aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728028544:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201595.361912:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.369979:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e8aa00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728028544:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201595.370018:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710984af expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.370049:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710984af expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.370061:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710984af expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.370075:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710984af expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.370089:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710984af expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.370107:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710984af expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.370117:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710984af expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.370127:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710984af expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201595.370140:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc145e8aa00 x1875064728028544/t8589937482(8589937482) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1788201595.370157:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc145e8aa00 x1875064728028544/t8589937482(8589937482) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1788201595.370176:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710984af expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1788201595.370191:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710984af expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.370203:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/420 (0 0) 00000080:00200000:2.0:1788201595.370211:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1788201595.370231:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=setup_kerberos.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:2.0:1788201595.370268:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1a4:0x0](ffff8bc145980908) 00000080:00200000:2.0:1788201595.370449:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x1a4:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1788201595.370461:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x1a4:0x0](ffff8bc145980908) 00000080:00010000:2.0:1788201595.370465:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a4:0x0](ffff8bc145980908) for lock 0xd138388016f6f8f2 00000080:00010000:2.0:1788201595.370478:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a4:0x0](ffff8bc145980908) 00000080:00200008:2.0:1788201595.370497:0:24470:0:(file.c:1090:ll_file_open()) START file setup_kerberos.sh:[0x200000bd7:0x1a4:0x0](ffff8bc145980908), flags 100301 00000002:00100000:2.0:1788201595.370520:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc145e8aa00 x1875064728028544/t8589937482(8589937482) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1788201595.370575:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f8f2 from it ffff8bc150632ae0 00010000:00010000:2.0:1788201595.370580:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710984af expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.370592:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710984af expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201595.370630:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1a4:0x0](ffff8bc145980908), inode mode 81ed mask 40 00000080:00200008:2.0:1788201595.370665:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file setup_kerberos.sh:[0x200000bd7:0x1a4:0x0](ffff8bc145980908), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1788201595.370672:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x1a4:0x0](ffff8bc145980908),name=setup_kerberos.sh 00000002:00010000:2.0:1788201595.370694:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x1a4:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.370706:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710984af expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.370720:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710984af expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201595.370728:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.370734:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a4:0x0](ffff8bc145980908) 00000080:00010000:2.0:1788201595.370738:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a4:0x0](ffff8bc145980908) for lock 0xd138388016f6f8f2 00000080:00010000:2.0:1788201595.370742:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f8f2 from it ffffadd1c7debcd8 00010000:00010000:2.0:1788201595.370745:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710984af expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.370752:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710984af expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1788201595.370780:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a4:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201595.371918:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x1a4:0x0] 00000008:00010000:2.0:1788201595.371966:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201595.371970:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d130, osc lock ffff8bc151fc0720, flags 0x400001002 00010000:00010000:2.0:1788201595.372037:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8f9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.372057:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8f9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201595.372165:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728028672:192.168.201.143@tcp:101:cp.0 00000020:00200000:2.0:1788201595.372556:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1788201595.379251:0:10055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8f9 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.379295:0:10055:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8f9 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710984bd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.379314:0:10055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8f9 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710984bd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.379347:0:10055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8f9 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710984bd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1788201595.379368:0:10055:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8f9 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710984bd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1788201595.379381:0:10055:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1788201595.379480:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8f9 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710984bd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.379490:0:10055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8f9 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710984bd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.379499:0:10055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8f9 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710984bd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.379510:0:10055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e21710984bd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1788201595.379553:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728028672:192.168.201.143@tcp:101:cp.0 00000080:00200000:2.0:1788201595.379760:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a4:0x0] updating i_size 0 i_blocks 1 00000020:00010000:2.0:1788201595.379768:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460044a0 (ffff8bc146919758/0) at cl_lock_release():245 00000020:00010000:2.0:1788201595.379771:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460044a0 (ffff8bc146919758/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.379777:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d130 (ffff8bc146919f38/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.379782:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460044a0 (ffff8bc146919758/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201595.379785:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d130 (ffff8bc146919758/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201595.379852:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a4:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1788201595.379943:0:24470:0:(file.c:2638:do_file_write_iter()) START file setup_kerberos.sh:[0x200000bd7:0x1a4:0x0], ppos: 0, count: 24288 00000080:00200000:2.0:1788201595.379981:0:24470:0:(file.c:2090:ll_file_io_generic()) setup_kerberos.sh: write ppos: 0, bytes: 24288 00000080:00200000:2.0:1788201595.379989:0:24470:0:(file.c:1848:ll_io_set_mirror()) setup_kerberos.sh: desiginated mirror: 0 00000020:00200000:2.0:1788201595.379995:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@0000000087300a64[0x110, 1, [0x200000bd7:0x1a4:0x0] hash] 00000020:00200000:2.0:1788201595.379998:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 24288) 0 0 00000080:00200000:2.0:1788201595.380002:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a4:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201595.380017:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 5] 00020000:00200000:2.0:1788201595.380026:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 24288) 24288, 24288 00020000:00200000:2.0:1788201595.380030:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201595.380063:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 5] 00000008:00010000:2.0:1788201595.380078:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1788201595.380083:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d130, osc lock ffff8bc151fc0720, flags 0x0 00010000:00010000:2.0:1788201595.380105:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/452 (0 24575) 00010000:00010000:2.0:1788201595.380334:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.380353:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.380365:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.380393:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e8a300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728028800:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201595.380639:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201595.384202:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201595.384762:0:20877:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788201595.384788:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743489792 00000100:00100000:2.0:1788201595.385074:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743489792 00000100:00100000:2.0:1788201595.385137:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 831 00000100:00100000:2.0:1788201595.385151:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc145d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23413:x1875064743489792:12345-192.168.201.143@tcp:104: 00010000:00010000:2.0:1788201595.385174:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710984bd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.385274:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201595.385282:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc145d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23413:x1875064743489792:12345-192.168.201.143@tcp:104: Request processed in 135us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201595.385291:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 831 00010000:00010000:1.0:1788201595.385474:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201595.385484:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710984bd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201595.385499:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1443b7c00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201595.385506:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e21710984bd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201595.385586:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201595.385601:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201595.385686:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710984bd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201595.385695:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201595.385736:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8f9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710984bd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201595.385745:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f8f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710984bd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201595.385765:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201595.385767:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201595.385768:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201595.385877:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201595.385899:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728028928:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201595.395636:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201595.395750:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743489920 00000100:00100000:1.0:1788201595.395763:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743489920 00000100:00100000:1.0:1788201595.395874:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 832 00000100:00100000:1.0:1788201595.395886:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172649180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21005:x1875064743489920:12345-192.168.201.143@tcp:105: 00010000:00010000:1.0:1788201595.395908:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.395931:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.395943:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.395954:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.395965:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.395977:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.396001:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1443b6c00) 00000100:00100000:1.0:1788201595.396073:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172649180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21005:x1875064743489920:12345-192.168.201.143@tcp:105: Request processed in 189us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201595.396081:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 832 00000100:00100000:2.0:1788201595.396189:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e8a300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728028800:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201595.396207:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.396221:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1788201595.396231:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.396242:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.396247:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1788201595.396273:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) setup_kerberos.sh: write [0, 24288) append 0 append lockpos 0 00000080:00200000:2.0:1788201595.396291:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.396357:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:2.0:1788201595.396373:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000148ebb30[3 000000005ab11d44 2 1 000000007aed2f44 0 0 0] 00000080:00200000:2.0:1788201595.396376:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004d3133b0 17ffffc0001001 3:0 ffff8bc1726229a0 0 lru 00000080:00200000:2.0:1788201595.396384:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c60ebd79 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000e46a07f0 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.396386:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000148ebb30 00000080:00200000:2.0:1788201595.396387:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1788201595.396392:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.396421:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:2.0:1788201595.396426:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ee7fab69[3 000000005ab11d44 2 1 000000007aed2f44 0 0 1] 00000080:00200000:2.0:1788201595.396429:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006c9a3437 17ffffc0001001 3:0 ffff8bc172622c40 1 lru 00000080:00200000:2.0:1788201595.396434:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c5f7db72 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 00000000e46a07f0 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.396436:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ee7fab69 00000080:00200000:2.0:1788201595.396437:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:2.0:1788201595.396439:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.396454:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:2.0:1788201595.396458:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c9725b62[3 000000005ab11d44 2 1 000000007aed2f44 0 0 2] 00000080:00200000:2.0:1788201595.396461:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b8cce3a2 17ffffc0001001 3:0 ffff8bc172622a80 2 lru 00000080:00200000:2.0:1788201595.396466:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004b8c6b3b 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000000ce25486 00000000e46a07f0 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.396468:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c9725b62 00000080:00200000:2.0:1788201595.396469:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:2.0:1788201595.396471:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.396494:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:2.0:1788201595.396499:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009e833dc2[3 000000005ab11d44 2 1 000000007aed2f44 0 0 3] 00000080:00200000:2.0:1788201595.396502:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000724ac633 17ffffc0001021 2:0 ffff8bc172622540 3 lru 00000080:00200000:2.0:1788201595.396507:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005ad2e5cc 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000000ce25486 00000000e46a07f0 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.396509:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009e833dc2 00000080:00200000:2.0:1788201595.396511:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:2.0:1788201595.396512:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.396528:0:24470:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:2.0:1788201595.396533:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000098269c1a[3 000000005ab11d44 2 1 000000007aed2f44 0 0 4] 00000080:00200000:2.0:1788201595.396535:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d36714b8 17ffffc0001001 3:0 ffff8bc1726228c0 4 lru 00000080:00200000:2.0:1788201595.396540:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c54d0802 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000000ce25486 00000000e46a07f0 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.396542:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000098269c1a 00000080:00200000:2.0:1788201595.396543:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:2.0:1788201595.396544:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 3808 bytes 00000080:00200000:2.0:1788201595.396569:0:24470:0:(rw26.c:898:ll_write_end()) pos 20480, len 3808, copied 3808 00000080:00200000:2.0:1788201595.396573:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f01870e1[3 000000005ab11d44 2 1 000000007aed2f44 0 0 5] 00000080:00200000:2.0:1788201595.396576:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003e07369b 17ffffc0001001 3:0 ffff8bc172622e00 5 lru 00000080:00200000:2.0:1788201595.396582:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000002b947158 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000000ce25486 00000000e46a07f0 > 3< 0 0 > 4< 0 0 8 11927552 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.396583:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f01870e1 00000080:00200000:2.0:1788201595.396584:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:2.0:1788201595.396588:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 6, from 0, to 3808 prio 0 00000008:00010000:2.0:1788201595.396617:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 000000009ffd8b5f ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1788201595.396644:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145980ab8, count 6, dirtied 6 00000080:00200000:2.0:1788201595.396650:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 6 pages 24288 bytes, tot: 24288 00000080:00200000:2.0:1788201595.396653:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) setup_kerberos.sh: write bytes 0, result: 24288 00000020:00010000:2.0:1788201595.396671:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc149844b78 (ffff8bc146919758/0) at cl_lock_release():245 00000020:00010000:2.0:1788201595.396675:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149844b78 (ffff8bc146919758/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.396678:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d130 (ffff8bc146919f38/1) at cl_lock_cancel():142 00010000:00010000:2.0:1788201595.396684:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.396694:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1788201595.396711:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149844b78 (ffff8bc146919758/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201595.396715:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d130 (ffff8bc146919758/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201595.396722:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 24288 bytes 00000080:00200000:2.0:1788201595.396731:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 5] 00000080:00200000:2.0:1788201595.396775:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a4:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201595.396780:0:24470:0:(file.c:2238:ll_file_io_generic()) setup_kerberos.sh: 2 io complete with rc: 0, result: 24288, restart: 0 00000080:00200000:2.0:1788201595.396788:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a4:0x0] updating i_size 24288 i_blocks 1 00000080:00200000:2.0:1788201595.397015:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 24288 00000080:00200008:0.0:1788201595.397221:0:24470:0:(file.c:479:ll_file_release()) START file setup_kerberos.sh:[0x200000bd7:0x1a4:0x0](ffff8bc145980908), flags 100001 00000002:00100000:0.0:1788201595.397284:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc145e8aa00 x1875064728028544/t8589937482(8589937482) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201611 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1788201595.397298:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1788201595.397304:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172648700 x1875064728029184/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1788201595.397328:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172648700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728029184:192.168.201.143@tcp:35:cp.0 00000100:00100000:0.0:1788201595.397427:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.400768:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728028928:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201595.402253:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172648700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728029184:192.168.201.143@tcp:35:cp.0 00000002:00100000:3.0:1788201595.402292:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc145e8aa00 x1875064728028544/t8589937482(8589937482) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201595.402397:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201595.402421:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201595.402444:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201595.402458:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201595.402467:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201595.402474:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201595.402479:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201595.402488:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201595.402493:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201595.402502:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201595.402534:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201595.402543:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201595.402550:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201595.402554:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=setup_kerberos.sh, flags=8 00000080:00200008:3.0:1788201595.402563:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file setup_kerberos.sh:[0x200000bd7:0x1a4:0x0](ffff8bc145980908), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201595.402568:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x1a4:0x0](ffff8bc145980908),name=setup_kerberos.sh 00000002:00010000:3.0:1788201595.402581:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x1a4:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201595.402590:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710984af expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201595.402598:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710984af expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201595.402604:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201595.402608:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a4:0x0](ffff8bc145980908) 00000080:00010000:3.0:1788201595.402610:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a4:0x0](ffff8bc145980908) for lock 0xd138388016f6f8f2 00000080:00010000:3.0:1788201595.402614:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f8f2 from it ffffadd1c7debcb8 00010000:00010000:3.0:1788201595.402617:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710984af expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201595.402624:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710984af expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201595.402912:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a4:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201595.402924:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x1a4:0x0] 00000008:00010000:3.0:1788201595.402957:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201595.402961:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149fec4b0, osc lock ffff8bc14691b430, flags 0x400001002 00010000:00010000:3.0:1788201595.402981:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201595.402995:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:3.0:1788201595.403011:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1788201595.403016:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201595.403026:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1788201595.403038:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1788201595.403049:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a4:0x0] updating i_size 24288 i_blocks 1 00000020:00010000:3.0:1788201595.403053:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc6750 (ffff8bc1460e9488/0) at cl_lock_release():245 00000020:00010000:3.0:1788201595.403057:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc6750 (ffff8bc1460e9488/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201595.403059:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149fec4b0 (ffff8bc1460e9998/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201595.403065:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc6750 (ffff8bc1460e9488/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201595.403068:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149fec4b0 (ffff8bc1460e9488/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201595.403116:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a4:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201595.403195:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201595.403204:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201595.403212:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201595.403221:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201595.403227:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201595.403232:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201595.403235:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201595.403240:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201595.403243:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201595.403256:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201595.403265:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201595.403270:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201595.403273:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201595.403290:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=setup-nfs.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:3.0:1788201595.403294:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=setup-nfs.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:3.0:1788201595.403305:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: setup-nfs.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201595.403376:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020600/0xd138388016f6f907 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.403385:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020600/0xd138388016f6f907 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.403396:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020600/0xd138388016f6f907 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201595.403421:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728029312:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201595.403554:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201595.413580:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201595.413633:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201595.413671:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201595.413698:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201595.413711:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201595.413728:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201595.413926:0:20877:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201595.413957:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743490432 00000100:00100000:3.0:1788201595.413970:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743490432 00000100:00100000:3.0:1788201595.414019:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743490560 00000100:00100000:3.0:1788201595.414023:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743490560 00000100:00100000:3.0:1788201595.414034:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743490688 00000100:00100000:3.0:1788201595.414036:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743490688 00000100:00100000:3.0:1788201595.414044:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743492480 00000100:00100000:3.0:1788201595.414047:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743492480 00000100:00100000:3.0:1788201595.414057:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743492608 00000100:00100000:3.0:1788201595.414059:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743492608 00000100:00100000:3.0:1788201595.414067:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743492736 00000100:00100000:3.0:1788201595.414069:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743492736 00000100:00100000:3.0:1788201595.414084:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 833 00000100:00100000:3.0:1788201595.414094:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+7:24636:x1875064743490432:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201595.414116:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201595.414206:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201595.414213:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+7:24636:x1875064743490432:12345-192.168.201.143@tcp:104: Request processed in 121us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201595.414220:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 833 00000100:00100000:3.0:1788201595.414238:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 834 00000100:00100000:3.0:1788201595.414244:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17264b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+6:21822:x1875064743490560:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201595.414252:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201595.414281:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788201595.414286:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17264b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+6:21822:x1875064743490560:12345-192.168.201.143@tcp:104: Request processed in 42us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201595.414292:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 834 00000100:00100000:3.0:1788201595.414303:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 835 00000100:00100000:3.0:1788201595.414309:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17264b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+5:21821:x1875064743490688:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201595.414317:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201595.414361:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788201595.414367:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17264b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+5:21821:x1875064743490688:12345-192.168.201.143@tcp:104: Request processed in 58us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201595.414373:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 835 00000100:00100000:3.0:1788201595.414388:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 836 00000100:00100000:3.0:1788201595.414394:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1724a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+5:24638:x1875064743492480:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201595.414402:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201595.414424:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788201595.414429:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1724a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+5:24638:x1875064743492480:12345-192.168.201.143@tcp:104: Request processed in 36us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201595.414434:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 836 00000100:00100000:3.0:1788201595.414444:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 837 00000100:00100000:3.0:1788201595.414450:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc146028a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23390:x1875064743492608:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201595.414458:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000acf6f96b/0xd138388016f6e7b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109460a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201595.414479:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788201595.414483:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc146028a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23390:x1875064743492608:12345-192.168.201.143@tcp:104: Request processed in 34us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201595.414489:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 837 00000100:00100000:3.0:1788201595.414500:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 838 00000100:00100000:3.0:1788201595.414506:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc145ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21820:x1875064743492736:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201595.414516:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000618f56a5/0xd138388016f6e81a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109471b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201595.414538:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1788201595.414543:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc145ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21820:x1875064743492736:12345-192.168.201.143@tcp:104: Request processed in 38us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201595.414549:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 838 00010000:00010000:3.0:1788201595.414606:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788201595.414614:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201595.414624:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172611800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201595.414631:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201595.414731:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201595.414740:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201595.414765:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201595.414773:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000b35ad8b2/0xd138388016f6e60d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710941c6 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201595.414828:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788201595.414832:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201595.414840:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1727c8c00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201595.414844:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201595.414877:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201595.414885:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201595.414899:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201595.414907:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000efb19ca4/0xd138388016f6e883 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109482c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201595.414921:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788201595.414924:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201595.414931:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14400d000 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201595.414934:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201595.414963:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201595.414976:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201595.414982:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201595.414990:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000fcebd82d/0xd138388016f6eaf9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094e92 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201595.415003:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788201595.415006:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201595.415014:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bca00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201595.415017:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201595.415048:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201595.415055:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201595.415061:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201595.415069:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002c641499/0xd138388016f6ecc0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171095331 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201595.415113:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201595.415118:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000acf6f96b/0xd138388016f6e7b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109460a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201595.415124:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1727c9000 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201595.415128:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000acf6f96b/0xd138388016f6e7b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e217109460a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201595.415163:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000acf6f96b/0xd138388016f6e7b1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109460a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201595.415169:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201595.415174:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000acf6f96b/0xd138388016f6e7b1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109460a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201595.415181:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000acf6f96b/0xd138388016f6e7b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109460a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201595.415195:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201595.415198:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000618f56a5/0xd138388016f6e81a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109471b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201595.415203:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1727c9200 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201595.415207:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000618f56a5/0xd138388016f6e81a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e217109471b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201595.415235:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000618f56a5/0xd138388016f6e81a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109471b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201595.415247:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201595.415252:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000618f56a5/0xd138388016f6e81a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109471b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201595.415259:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000618f56a5/0xd138388016f6e81a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109471b expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1788201595.415271:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201595.415273:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201595.415275:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201595.415420:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728029440:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.415496:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728029952:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.415525:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201595.415532:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728029824:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201595.415559:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201595.415568:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728029696:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.415588:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788201595.415594:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728029568:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.415608:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728030080:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201595.415814:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201595.415850:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201595.415942:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201595.415990:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201595.416610:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743492864 00000100:00100000:1.0:1788201595.416621:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743492864 00000100:00100000:1.0:1788201595.416664:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743492992 00000100:00100000:1.0:1788201595.416667:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743492992 00000100:00100000:1.0:1788201595.416680:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743493120 00000100:00100000:1.0:1788201595.416682:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743493120 00000100:00100000:1.0:1788201595.416697:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 839 00000100:00100000:1.0:1788201595.416708:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc146028a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23415:x1875064743492864:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201595.416726:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008332e9f8/0xd138388016f6e76b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094554 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.416834:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201595.416841:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc146028a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23415:x1875064743492864:12345-192.168.201.143@tcp:104: Request processed in 135us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201595.416850:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 839 00000100:00100000:1.0:1788201595.416872:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 840 00000100:00100000:1.0:1788201595.416879:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1474d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+5:23131:x1875064743492992:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201595.416887:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000004e9ac6d/0xd138388016f6e8ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109493d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201595.416923:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788201595.416929:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1474d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+5:23131:x1875064743492992:12345-192.168.201.143@tcp:104: Request processed in 51us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201595.416935:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 840 00000100:00100000:1.0:1788201595.416947:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 841 00000100:00100000:1.0:1788201595.416953:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1474d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23394:x1875064743493120:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201595.416961:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a08eaec7/0xd138388016f6e8a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094887 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.416987:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788201595.416993:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1474d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23394:x1875064743493120:12345-192.168.201.143@tcp:104: Request processed in 40us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201595.416999:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 841 00010000:00010000:1.0:1788201595.417015:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201595.417022:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008332e9f8/0xd138388016f6e76b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094554 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.417030:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172724c00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201595.417036:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008332e9f8/0xd138388016f6e76b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171094554 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.417135:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008332e9f8/0xd138388016f6e76b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094554 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.417143:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201595.417164:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008332e9f8/0xd138388016f6e76b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094554 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.417172:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008332e9f8/0xd138388016f6e76b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094554 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.417196:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201595.417200:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000004e9ac6d/0xd138388016f6e8ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109493d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201595.417206:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172725400 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201595.417210:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000004e9ac6d/0xd138388016f6e8ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e217109493d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201595.417246:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000004e9ac6d/0xd138388016f6e8ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109493d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201595.417254:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201595.417266:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000004e9ac6d/0xd138388016f6e8ec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109493d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201595.417273:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000004e9ac6d/0xd138388016f6e8ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109493d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201595.417287:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201595.417290:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a08eaec7/0xd138388016f6e8a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094887 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.417303:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172734000 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201595.417306:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a08eaec7/0xd138388016f6e8a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171094887 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.417349:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a08eaec7/0xd138388016f6e8a6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094887 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.417356:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201595.417362:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a08eaec7/0xd138388016f6e8a6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094887 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.417369:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a08eaec7/0xd138388016f6e8a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094887 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.417382:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201595.417384:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201595.417386:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201595.417407:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728030464:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.417473:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201595.417480:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728030336:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.418214:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728030208:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201595.418268:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201595.419252:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201595.419325:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201595.419415:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201595.419454:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201595.419490:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201595.419646:0:20877:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788201595.419671:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743493248 00000100:00100000:0.0:1788201595.419680:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743493248 00000100:00100000:0.0:1788201595.419724:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743493376 00000100:00100000:0.0:1788201595.419727:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743493376 00000100:00100000:0.0:1788201595.419739:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743493504 00000100:00100000:0.0:1788201595.419740:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743493504 00000100:00100000:0.0:1788201595.419752:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743493632 00000100:00100000:0.0:1788201595.419754:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743493632 00000100:00100000:0.0:1788201595.419768:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 842 00000100:00100000:0.0:1788201595.419779:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc144143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+6:23392:x1875064743493248:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201595.419831:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.419906:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201595.419914:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc144143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+6:23392:x1875064743493248:12345-192.168.201.143@tcp:104: Request processed in 137us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201595.419921:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 842 00000100:00100000:0.0:1788201595.419940:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 843 00000100:00100000:0.0:1788201595.419947:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc144141f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+5:23407:x1875064743493376:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201595.419956:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005c0c7627/0xd138388016f6e3ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093a72 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.420016:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788201595.420022:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc144141f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+5:23407:x1875064743493376:12345-192.168.201.143@tcp:104: Request processed in 76us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201595.420033:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 843 00000100:00100000:0.0:1788201595.420045:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 844 00000100:00100000:0.0:1788201595.420052:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc144143480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23411:x1875064743493504:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201595.420061:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.420103:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788201595.420109:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc144143480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23411:x1875064743493504:12345-192.168.201.143@tcp:104: Request processed in 57us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201595.420116:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 844 00000100:00100000:0.0:1788201595.420129:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 845 00000100:00100000:0.0:1788201595.420135:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc149f1b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23391:x1875064743493632:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201595.420144:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.420169:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788201595.420173:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc149f1b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23391:x1875064743493632:12345-192.168.201.143@tcp:104: Request processed in 39us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201595.420179:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 845 00010000:00010000:0.0:1788201595.420218:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788201595.420224:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.420233:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14400d200 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201595.420240:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.420332:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.420352:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201595.420373:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.420382:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d2db3fbc/0xd138388016f6ea90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094d81 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.420408:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201595.420412:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005c0c7627/0xd138388016f6e3ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093a72 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.420418:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17267f200 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201595.420422:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005c0c7627/0xd138388016f6e3ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171093a72 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.420453:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005c0c7627/0xd138388016f6e3ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093a72 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.420460:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201595.420466:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005c0c7627/0xd138388016f6e3ba lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093a72 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.420474:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005c0c7627/0xd138388016f6e3ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093a72 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.420487:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201595.420490:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.420496:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14a779200 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201595.420499:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.420533:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.420540:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201595.420566:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.420574:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e21ca93f/0xd138388016f6ebcb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710950b4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.420592:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201595.420595:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.420602:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bc000 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201595.420606:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.420645:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.420652:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201595.420658:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.420666:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000598c16dc/0xd138388016f6ec34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710951c5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.420680:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201595.420682:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201595.420684:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201595.420700:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728030592:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201595.420762:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201595.420769:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728030720:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201595.420850:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201595.420910:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201595.420938:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201595.420976:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743493760 00000100:00100000:0.0:1788201595.420981:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743493760 00000100:00100000:0.0:1788201595.421003:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743493888 00000100:00100000:0.0:1788201595.421006:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743493888 00000100:00100000:0.0:1788201595.421016:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743494016 00000100:00100000:0.0:1788201595.421019:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743494016 00000100:00100000:0.0:1788201595.421031:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 846 00000100:00100000:0.0:1788201595.421040:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc144143800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23408:x1875064743493760:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201595.421049:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000499c3d5c/0xd138388016f6e630 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094221 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.421081:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201595.421087:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc144143800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23408:x1875064743493760:12345-192.168.201.143@tcp:104: Request processed in 49us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201595.421094:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 846 00000100:00100000:0.0:1788201595.421107:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 847 00000100:00100000:0.0:1788201595.421113:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc144143b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+5:23416:x1875064743493888:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201595.421122:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000cd330330/0xd138388016f6e53b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093fa4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.421141:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788201595.421146:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc144143b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+5:23416:x1875064743493888:12345-192.168.201.143@tcp:104: Request processed in 34us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201595.421152:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 847 00000100:00100000:0.0:1788201595.421163:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 848 00000100:00100000:0.0:1788201595.421169:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc144141500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23413:x1875064743494016:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201595.421176:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6ec57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171095220 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.421194:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788201595.421199:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc144141500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23413:x1875064743494016:12345-192.168.201.143@tcp:104: Request processed in 31us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201595.421205:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 848 00010000:00010000:0.0:1788201595.421217:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201595.421221:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000499c3d5c/0xd138388016f6e630 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094221 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.421229:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14400c000 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201595.421233:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000499c3d5c/0xd138388016f6e630 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171094221 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.421275:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000499c3d5c/0xd138388016f6e630 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094221 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.421282:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201595.421293:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000499c3d5c/0xd138388016f6e630 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094221 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.421300:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000499c3d5c/0xd138388016f6e630 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094221 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.421315:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201595.421319:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000cd330330/0xd138388016f6e53b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093fa4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.421325:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17267ec00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201595.421330:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000cd330330/0xd138388016f6e53b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171093fa4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.421379:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000cd330330/0xd138388016f6e53b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093fa4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.421387:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201595.421394:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000cd330330/0xd138388016f6e53b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093fa4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.421401:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000cd330330/0xd138388016f6e53b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093fa4 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.421414:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201595.421418:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6ec57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171095220 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.421425:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc15c12ba00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201595.421428:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6ec57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171095220 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.421459:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6ec57 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171095220 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.421466:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201595.421471:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6ec57 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171095220 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.421477:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6ec57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171095220 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.421492:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201595.421495:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201595.421496:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201595.421507:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728031104:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201595.421539:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201595.421546:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728031232:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201595.422110:0:24470:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8bc143fc0000: committing for last_committed 8589937480 gen 1 00000100:00100000:3.0:1788201595.422716:0:24470:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8bc1726cd500 x1875064728028032/t8589937481(8589937481) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/456 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201595.422733:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728029312:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201595.422752:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020600/0xd138388016f6f907 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.422765:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020600/0xd138388016f6f907 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.422772:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020600/0xd138388016f6f907 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.422781:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020600/0xd138388016f6f907 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.422819:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020600/0xd138388016f6f907 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.422827:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc144020600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201595.422833:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020600/0xd138388016f6f907 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.422840:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020600/0xd138388016f6f907 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.422848:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020600/0xd138388016f6f907 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.422855:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201595.422861:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020600/0xd138388016f6f907 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.422868:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020600/0xd138388016f6f907 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201595.422886:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1726ce300 x1875064728029312/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201595.422903:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201595.422933:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:3.0:1788201595.423007:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201595.423025:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201595.423036:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201595.423048:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201595.423061:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201595.423066:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201595.423070:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201595.423075:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201595.423079:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201595.423088:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201595.423105:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201595.423114:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201595.423121:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201595.423135:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=setup-nfs.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:3.0:1788201595.423139:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=setup-nfs.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:3.0:1788201595.423152:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: setup-nfs.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201595.423197:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f90e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.423206:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f90e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.423219:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f90e lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201595.423240:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728031488:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201595.423316:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.423643:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728030976:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.423700:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788201595.423709:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728030848:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.423739:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728031360:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201595.423781:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201595.423811:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201595.426744:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728029568:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201595.426768:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728030080:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201595.426778:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728029696:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788201595.426976:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728029824:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788201595.426987:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728029440:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788201595.426996:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728029952:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201595.428734:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201595.428929:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743494400 00000100:00100000:1.0:1788201595.428942:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743494400 00000100:00100000:1.0:1788201595.429013:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 849 00000100:00100000:1.0:1788201595.429025:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1726cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21822:x1875064743494400:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201595.429051:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ab995f56/0xd138388016f6e581 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109405a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.429171:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201595.429179:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1726cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21822:x1875064743494400:12345-192.168.201.143@tcp:104: Request processed in 156us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201595.429186:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 849 00010000:00010000:1.0:1788201595.430284:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201595.430297:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ab995f56/0xd138388016f6e581 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109405a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.430311:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17267ee00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201595.430320:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ab995f56/0xd138388016f6e581 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e217109405a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.430452:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ab995f56/0xd138388016f6e581 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109405a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.430461:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201595.430499:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ab995f56/0xd138388016f6e581 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109405a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.430508:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ab995f56/0xd138388016f6e581 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109405a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000100:00100000:3.0:1788201595.430606:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201595.430630:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728031616:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201595.431115:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201595.431118:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201595.431120:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201595.441057:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201595.441106:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743494528 00000100:00100000:2.0:1788201595.441117:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743494528 00000100:00100000:2.0:1788201595.441178:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 850 00000100:00100000:2.0:1788201595.441189:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc145e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:28099:x1875064743494528:12345-192.168.201.143@tcp:104: 00010000:00010000:2.0:1788201595.441213:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.441316:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201595.441324:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc145e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:28099:x1875064743494528:12345-192.168.201.143@tcp:104: Request processed in 137us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201595.441331:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 850 00000100:00100000:1.0:1788201595.441526:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728030336:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.441547:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728030464:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201595.441838:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201595.441847:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.441859:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149eb6c00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:2.0:1788201595.441866:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.441976:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.441984:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201595.441999:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.442008:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c6bec3d5/0xd138388016f6e9e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094bba expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.442034:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201595.442036:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201595.442038:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201595.442683:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728031744:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201595.442781:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728031232:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201595.442822:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728031104:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201595.442835:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728030720:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201595.442845:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728030592:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201595.450028:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728030208:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201595.456115:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201595.456142:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201595.456832:0:20876:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788201595.456863:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743494784 00000100:00100000:2.0:1788201595.456874:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743494784 00000100:00100000:2.0:1788201595.456931:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743495424 00000100:00100000:2.0:1788201595.456935:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743495424 00000100:00100000:2.0:1788201595.456954:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 851 00000100:00100000:2.0:1788201595.456964:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc144143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:24638:x1875064743494784:12345-192.168.201.143@tcp:104: 00010000:00010000:2.0:1788201595.456987:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008a78353e/0xd138388016f6e278 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093723 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1788201595.457078:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201595.457086:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc144143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:24638:x1875064743494784:12345-192.168.201.143@tcp:104: Request processed in 123us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201595.457094:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 851 00000100:00100000:2.0:1788201595.457113:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 852 00000100:00100000:2.0:1788201595.457120:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc17270e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23389:x1875064743495424:12345-192.168.201.143@tcp:104: 00010000:00010000:2.0:1788201595.457130:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000024db6f57/0xd138388016f6e2a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109379a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1788201595.457158:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788201595.457163:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc17270e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23389:x1875064743495424:12345-192.168.201.143@tcp:104: Request processed in 44us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201595.457170:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 852 00000100:00100000:2.0:1788201595.457230:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201595.457246:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743495552 00000100:00100000:2.0:1788201595.457250:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743495552 00000100:00100000:2.0:1788201595.457267:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 853 00000100:00100000:2.0:1788201595.457273:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc145e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23392:x1875064743495552:12345-192.168.201.143@tcp:104: 00010000:00010000:2.0:1788201595.457281:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1788201595.457314:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788201595.457320:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc145e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23392:x1875064743495552:12345-192.168.201.143@tcp:104: Request processed in 47us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201595.457327:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 853 00010000:00010000:2.0:1788201595.457354:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788201595.457362:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008a78353e/0xd138388016f6e278 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093723 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1788201595.457373:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc143a48000 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:2.0:1788201595.457380:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008a78353e/0xd138388016f6e278 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171093723 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1788201595.457480:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008a78353e/0xd138388016f6e278 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093723 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1788201595.457489:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201595.457516:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008a78353e/0xd138388016f6e278 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093723 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1788201595.457524:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008a78353e/0xd138388016f6e278 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093723 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.457642:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201595.457651:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000024db6f57/0xd138388016f6e2a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109379a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.457659:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc143a48e00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201595.457663:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000024db6f57/0xd138388016f6e2a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e217109379a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.457720:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000024db6f57/0xd138388016f6e2a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109379a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.457727:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201595.457744:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000024db6f57/0xd138388016f6e2a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109379a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.457752:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000024db6f57/0xd138388016f6e2a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109379a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.457779:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201595.457782:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.457812:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172725e00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201595.457816:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.457852:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.457859:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201595.457866:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.457873:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000002e78e162/0xd138388016f6e6bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109438d expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.457887:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201595.457889:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201595.457891:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201595.457914:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728032128:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.457986:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201595.457993:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728032000:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201595.458024:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201595.459692:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201595.459720:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728031872:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201595.459976:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201595.460001:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201595.460025:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743496064 00000100:00100000:0.0:1788201595.460034:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743496064 00000100:00100000:0.0:1788201595.460073:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743496192 00000100:00100000:0.0:1788201595.460076:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743496192 00000100:00100000:0.0:1788201595.460089:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 854 00000100:00100000:0.0:1788201595.460098:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc144141f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+5:21820:x1875064743496064:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201595.460118:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000096aa1f32/0xd138388016f6e9be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094b5f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.460165:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201595.460171:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc144141f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+5:21820:x1875064743496064:12345-192.168.201.143@tcp:104: Request processed in 74us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201595.460179:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 854 00000100:00100000:0.0:1788201595.460198:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 855 00000100:00100000:0.0:1788201595.460204:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc144141c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23390:x1875064743496192:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201595.460212:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6ea4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094ccb expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.460236:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788201595.460242:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc144141c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23390:x1875064743496192:12345-192.168.201.143@tcp:104: Request processed in 38us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201595.460248:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 855 00000100:00100000:0.0:1788201595.460276:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201595.460289:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743496576 00000100:00100000:0.0:1788201595.460293:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743496576 00000100:00100000:0.0:1788201595.460307:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 856 00000100:00100000:0.0:1788201595.460313:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc144140e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23411:x1875064743496576:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201595.460321:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f5d8f02/0xd138388016f6e469 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093c39 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.460405:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788201595.460411:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc144140e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23411:x1875064743496576:12345-192.168.201.143@tcp:104: Request processed in 99us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201595.460417:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 856 00000100:00100000:0.0:1788201595.460447:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201595.460462:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743496704 00000100:00100000:0.0:1788201595.460465:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743496704 00000100:00100000:0.0:1788201595.460479:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 857 00000100:00100000:0.0:1788201595.460485:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc144142300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23417:x1875064743496704:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201595.460493:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000aeeedc3c/0xd138388016f6eb3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094f48 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.460513:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788201595.460518:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc144142300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23417:x1875064743496704:12345-192.168.201.143@tcp:104: Request processed in 33us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201595.460524:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 857 00010000:00010000:2.0:1788201595.460674:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788201595.460680:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000096aa1f32/0xd138388016f6e9be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094b5f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.460695:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3d600 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:2.0:1788201595.460701:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000096aa1f32/0xd138388016f6e9be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171094b5f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.460807:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000096aa1f32/0xd138388016f6e9be lrc: 2/0,0 mode: --/PW res: [0x240000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094b5f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.460816:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201595.460836:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000096aa1f32/0xd138388016f6e9be lrc: 1/0,0 mode: --/PW res: [0x240000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094b5f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.460844:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000096aa1f32/0xd138388016f6e9be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094b5f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.460858:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788201595.460862:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6ea4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094ccb expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.460869:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149eb7800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:2.0:1788201595.460873:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6ea4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171094ccb expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.460907:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6ea4a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094ccb expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.460920:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201595.460927:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6ea4a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094ccb expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.460934:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008483090b/0xd138388016f6ea4a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094ccb expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.460948:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201595.460952:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f5d8f02/0xd138388016f6e469 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093c39 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1788201595.460958:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172735a00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:2.0:1788201595.460962:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f5d8f02/0xd138388016f6e469 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171093c39 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1788201595.460993:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f5d8f02/0xd138388016f6e469 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093c39 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1788201595.461000:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201595.461007:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f5d8f02/0xd138388016f6e469 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093c39 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1788201595.461013:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006f5d8f02/0xd138388016f6e469 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093c39 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1788201595.461026:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201595.461029:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000aeeedc3c/0xd138388016f6eb3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094f48 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.461036:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc16645dc00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:2.0:1788201595.461039:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000aeeedc3c/0xd138388016f6eb3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171094f48 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.461103:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000aeeedc3c/0xd138388016f6eb3f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094f48 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.461111:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201595.461118:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000aeeedc3c/0xd138388016f6eb3f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094f48 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.461126:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000aeeedc3c/0xd138388016f6eb3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094f48 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.461139:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201595.461141:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201595.461143:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201595.461161:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728032384:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788201595.461209:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201595.461216:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728032256:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788201595.461327:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201595.461363:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743497088 00000100:00100000:2.0:1788201595.461367:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743497088 00000100:00100000:2.0:1788201595.461396:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 858 00000100:00100000:2.0:1788201595.461404:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172744700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21822:x1875064743497088:12345-192.168.201.143@tcp:104: 00010000:00010000:2.0:1788201595.461415:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000094b2d07c/0xd138388016f6ea04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094c15 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.461443:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201595.461449:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172744700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21822:x1875064743497088:12345-192.168.201.143@tcp:104: Request processed in 46us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201595.461455:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 858 00010000:00010000:2.0:1788201595.461472:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201595.461476:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000094b2d07c/0xd138388016f6ea04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094c15 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.461483:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3c400 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:2.0:1788201595.461487:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000094b2d07c/0xd138388016f6ea04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171094c15 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.461523:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000094b2d07c/0xd138388016f6ea04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094c15 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201595.461691:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728032640:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.461752:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728030848:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.461766:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728031360:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.461777:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728030976:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.461826:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201595.461833:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc145e89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728032512:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201595.461862:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201595.461868:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201595.462079:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201595.462207:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728031616:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201595.462249:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728031488:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201595.462265:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f90e lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.462276:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f90e lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.462284:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f90e lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.462291:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f90e lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.462299:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f90e lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.462305:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc144021e00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201595.462312:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f90e lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.462320:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f90e lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.462326:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f90e lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.462333:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201595.462348:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f90e lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.462365:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f90e lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201595.462385:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1726ce300 x1875064728031488/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201595.462405:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1788201595.462437:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:3.0:1788201595.462585:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201595.462600:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201595.462611:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201595.462622:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201595.462629:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201595.462635:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201595.462638:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201595.462644:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:3.0:1788201595.462648:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201595.462657:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201595.462672:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201595.462680:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201595.462686:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201595.462703:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:3.0:1788201595.462708:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=setup-nfs.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc146421680, open_flags 80c1, mode 81ed opened 0 00000080:00200000:3.0:1788201595.462718:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=setup-nfs.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:3.0:1788201595.462741:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: setup-nfs.sh,[0x200000bd7:0x1a5:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:3.0:1788201595.462829:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.462837:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1788201595.462851:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1788201595.462859:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1726ce300 x1875064728033024/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1788201595.462869:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201595.462888:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728033024:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201595.462971:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.463126:0:20877:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788201595.463148:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743497344 00000100:00100000:1.0:1788201595.463155:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743497344 00000100:00100000:1.0:1788201595.463206:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 859 00000100:00100000:1.0:1788201595.463216:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc145ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23415:x1875064743497344:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201595.463229:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000c303a2ad/0xd138388016f6e400 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093b28 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.463269:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201595.463275:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc145ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23415:x1875064743497344:12345-192.168.201.143@tcp:104: Request processed in 62us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201595.463282:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 859 00010000:00010000:1.0:1788201595.463329:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201595.463347:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000c303a2ad/0xd138388016f6e400 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093b28 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.463355:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc143a48600 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201595.463361:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000c303a2ad/0xd138388016f6e400 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171093b28 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.463423:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000c303a2ad/0xd138388016f6e400 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093b28 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.463430:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201595.463450:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000c303a2ad/0xd138388016f6e400 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093b28 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.463457:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000c303a2ad/0xd138388016f6e400 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093b28 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.463475:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201595.463476:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201595.463478:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201595.463488:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201595.463497:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728033152:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201595.463652:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201595.463672:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743497472 00000100:00100000:0.0:1788201595.463675:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743497472 00000100:00100000:0.0:1788201595.463698:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 860 00000100:00100000:0.0:1788201595.463705:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc144140380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21821:x1875064743497472:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201595.463715:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.463744:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201595.463750:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc144140380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21821:x1875064743497472:12345-192.168.201.143@tcp:104: Request processed in 47us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201595.463756:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 860 00010000:00010000:0.0:1788201595.463773:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201595.463779:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.463815:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc14400ca00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201595.463820:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.463877:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.463885:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201595.463896:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.463905:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000c7d3329/0xd138388016f6e932 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710949f3 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201595.463920:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201595.463921:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201595.463923:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201595.463929:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201595.463938:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728033280:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201595.463984:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201595.463996:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743497600 00000100:00100000:0.0:1788201595.463999:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743497600 00000100:00100000:0.0:1788201595.464014:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 861 00000100:00100000:0.0:1788201595.464020:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc144141180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23413:x1875064743497600:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201595.464028:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000052b7c868/0xd138388016f6e3dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093acd expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.464051:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201595.464056:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc144141180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23413:x1875064743497600:12345-192.168.201.143@tcp:104: Request processed in 36us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201595.464062:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 861 00010000:00010000:0.0:1788201595.464072:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201595.464075:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000052b7c868/0xd138388016f6e3dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093acd expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.464083:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17267f600 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201595.464087:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000052b7c868/0xd138388016f6e3dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171093acd expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.464124:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000052b7c868/0xd138388016f6e3dd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093acd expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.464131:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201595.464146:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000052b7c868/0xd138388016f6e3dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093acd expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.464154:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000052b7c868/0xd138388016f6e3dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093acd expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.464168:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201595.464169:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201595.464171:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201595.464179:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201595.464188:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728033408:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201595.464223:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201595.464234:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743497728 00000100:00100000:0.0:1788201595.464237:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743497728 00000100:00100000:0.0:1788201595.464248:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 862 00000100:00100000:0.0:1788201595.464253:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc144142680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23416:x1875064743497728:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201595.464261:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f97ad2a0/0xd138388016f6e5c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094110 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.464281:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201595.464286:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc144142680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23416:x1875064743497728:12345-192.168.201.143@tcp:104: Request processed in 33us (63us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201595.464292:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 862 00010000:00010000:0.0:1788201595.464301:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201595.464305:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f97ad2a0/0xd138388016f6e5c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094110 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.464313:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172734200 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201595.464316:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f97ad2a0/0xd138388016f6e5c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171094110 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.464367:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f97ad2a0/0xd138388016f6e5c7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094110 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.464375:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201595.464384:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f97ad2a0/0xd138388016f6e5c7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094110 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.464398:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f97ad2a0/0xd138388016f6e5c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094110 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.464410:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201595.464412:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201595.464413:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201595.464421:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728033536:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201595.464457:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:0.0:1788201595.464469:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743497856 00000100:00100000:0.0:1788201595.464472:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743497856 00000100:00100000:0.0:1788201595.464488:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 863 00000100:00100000:0.0:1788201595.464494:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc144142d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23408:x1875064743497856:12345-192.168.201.143@tcp:104: 00010000:00010000:0.0:1788201595.464503:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e38d3ff7/0xd138388016f6e4d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093d4a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1788201595.464526:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1788201595.466180:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201595.466219:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000094b2d07c/0xd138388016f6ea04 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094c15 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.466232:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000094b2d07c/0xd138388016f6ea04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094c15 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.466265:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201595.466271:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e38d3ff7/0xd138388016f6e4d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093d4a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1788201595.466279:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172725000 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:2.0:1788201595.466286:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e38d3ff7/0xd138388016f6e4d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171093d4a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000100:00100000:1.0:1788201595.466507:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201595.466540:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728032768:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201595.467705:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e38d3ff7/0xd138388016f6e4d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093d4a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1788201595.467720:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788201595.467766:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201595.467830:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc144142d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23408:x1875064743497856:12345-192.168.201.143@tcp:104: Request processed in 3330us (3366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201595.467841:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 863 00010000:00010000:0.0:1788201595.467883:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201595.468079:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e38d3ff7/0xd138388016f6e4d2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093d4a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1788201595.468089:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e38d3ff7/0xd138388016f6e4d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093d4a expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1788201595.468110:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201595.468112:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201595.468114:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201595.470784:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728033664:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201595.477181:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728033408:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201595.477203:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728032512:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201595.477212:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728032640:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201595.477223:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728032000:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201595.477231:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728032128:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201595.477399:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728033024:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201595.477429:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710985e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.477458:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710985e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.477468:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710985e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.477482:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710985e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.477495:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710985e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.477512:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710985e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.477522:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710985e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.477540:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710985e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1788201595.477554:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc1726ce300 x1875064728033024/t8589937484(8589937484) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1788201595.477569:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1726ce300 x1875064728033024/t8589937484(8589937484) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1788201595.477584:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710985e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1788201595.477597:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710985e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.477609:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/421 (0 0) 00000080:00200000:3.0:1788201595.477617:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1788201595.477636:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=setup-nfs.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:3.0:1788201595.477675:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1a5:0x0](ffff8bc1459d3248) 00000080:00200000:3.0:1788201595.477853:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x1a5:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1788201595.477865:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x1a5:0x0](ffff8bc1459d3248) 00000080:00010000:3.0:1788201595.477868:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a5:0x0](ffff8bc1459d3248) for lock 0xd138388016f6f915 00000080:00010000:3.0:1788201595.477880:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a5:0x0](ffff8bc1459d3248) 00000080:00200008:3.0:1788201595.477901:0:24470:0:(file.c:1090:ll_file_open()) START file setup-nfs.sh:[0x200000bd7:0x1a5:0x0](ffff8bc1459d3248), flags 100301 00000002:00100000:3.0:1788201595.477924:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc1726ce300 x1875064728033024/t8589937484(8589937484) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1788201595.477975:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f915 from it ffff8bc148c9b4e0 00010000:00010000:3.0:1788201595.477981:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710985e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.477991:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710985e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201595.478022:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1a5:0x0](ffff8bc1459d3248), inode mode 81ed mask 40 00000080:00200008:3.0:1788201595.478055:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file setup-nfs.sh:[0x200000bd7:0x1a5:0x0](ffff8bc1459d3248), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201595.478063:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x1a5:0x0](ffff8bc1459d3248),name=setup-nfs.sh 00000002:00010000:3.0:1788201595.478084:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x1a5:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201595.478096:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710985e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201595.478108:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710985e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201595.478116:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201595.478121:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a5:0x0](ffff8bc1459d3248) 00000080:00010000:3.0:1788201595.478125:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a5:0x0](ffff8bc1459d3248) for lock 0xd138388016f6f915 00000080:00010000:3.0:1788201595.478129:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f915 from it ffffadd1c7debcd8 00010000:00010000:3.0:1788201595.478132:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710985e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201595.478140:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710985e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201595.478168:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a5:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201595.478179:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x1a5:0x0] 00000008:00010000:3.0:1788201595.478206:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201595.478210:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149fecd30, osc lock ffff8bc14691b430, flags 0x400001002 00010000:00010000:3.0:1788201595.478264:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c9f80731/0xd138388016f6f91c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.478276:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c9f80731/0xd138388016f6f91c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201595.478311:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1788201595.478350:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728033792:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201595.478756:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728031744:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.478814:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728033152:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.478828:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728032256:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.478841:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728032384:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.478871:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728033280:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.478882:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc145e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728031872:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201595.479011:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201595.479378:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743498240 00000100:00100000:3.0:1788201595.479387:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743498240 00000100:00100000:3.0:1788201595.479441:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 864 00000100:00100000:3.0:1788201595.479451:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc144141880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23407:x1875064743498240:12345-192.168.201.143@tcp:104: 00010000:00010000:3.0:1788201595.479468:0:20876:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000042ad0cc8/0xd138388016f6e2e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093850 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000100:00100000:2.0:1788201595.487907:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201595.488133:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743498496 00000100:00100000:1.0:1788201595.488145:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743498496 00000100:00100000:1.0:1788201595.488217:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 865 00000100:00100000:1.0:1788201595.488228:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+5:24636:x1875064743498496:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201595.488252:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201595.488351:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201595.488364:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+5:24636:x1875064743498496:12345-192.168.201.143@tcp:104: Request processed in 139us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201595.488372:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 865 00000100:00100000:1.0:1788201595.488442:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728032768:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.488484:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728033664:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201595.490720:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201595.490739:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201595.490758:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1460bda00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201595.490768:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201595.490931:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201595.490940:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201595.490972:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201595.490979:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a123c0a1/0xd138388016f6ebee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109510f expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201595.491005:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201595.491008:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201595.491010:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201595.491771:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201595.491816:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728033920:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788201595.492910:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728033536:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201595.493082:0:20876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201595.493094:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc144141880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:23407:x1875064743498240:12345-192.168.201.143@tcp:104: Request processed in 13641us (14081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201595.493106:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 864 00000100:00100000:1.0:1788201595.493291:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201595.493326:0:21781:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788201595.493350:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743499008 00010000:00010000:2.0:1788201595.493367:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788201595.493369:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743499008 00010000:00010000:2.0:1788201595.493376:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000042ad0cc8/0xd138388016f6e2e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093850 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1788201595.493396:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172735c00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:2.0:1788201595.493404:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000042ad0cc8/0xd138388016f6e2e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171093850 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000100:00100000:1.0:1788201595.493417:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 866 00000100:00100000:1.0:1788201595.493426:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc143421450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23413:x1875064743499008:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201595.493442:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084c24abf/0xd138388016f6e860 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710947d1 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.493492:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201595.493498:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc143421450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23413:x1875064743499008:12345-192.168.201.143@tcp:104: Request processed in 74us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201595.493503:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 866 00010000:00010000:2.0:1788201595.493506:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000042ad0cc8/0xd138388016f6e2e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093850 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1788201595.493513:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201595.493533:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000042ad0cc8/0xd138388016f6e2e8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093850 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1788201595.493542:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000042ad0cc8/0xd138388016f6e2e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093850 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000100:00100000:1.0:1788201595.493556:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1788201595.493562:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201595.493565:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084c24abf/0xd138388016f6e860 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710947d1 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000100:00100000:1.0:1788201595.493567:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728034048:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201595.493572:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1727c8a00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:2.0:1788201595.493575:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084c24abf/0xd138388016f6e860 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e21710947d1 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1788201595.493607:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084c24abf/0xd138388016f6e860 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710947d1 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1788201595.493620:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788201595.493635:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00010000:00010000:2.0:1788201595.493637:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084c24abf/0xd138388016f6e860 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710947d1 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1788201595.493645:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084c24abf/0xd138388016f6e860 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710947d1 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000100:00100000:1.0:1788201595.493649:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728034176:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.493696:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201595.493710:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743499136 00000100:00100000:1.0:1788201595.493713:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743499136 00000100:00100000:1.0:1788201595.493729:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743499264 00000100:00100000:1.0:1788201595.493731:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743499264 00000100:00100000:1.0:1788201595.493742:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 867 00000100:00100000:1.0:1788201595.493748:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1727d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+5:23417:x1875064743499136:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201595.493757:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002cadee1/0xd138388016f6e5a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710940b5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.493786:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1788201595.493787:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201595.493810:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002cadee1/0xd138388016f6e5a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710940b5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000100:00100000:1.0:1788201595.493813:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1727d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+5:23417:x1875064743499136:12345-192.168.201.143@tcp:104: Request processed in 43us (159us total) trans 0 rc 0/0 00010000:00010000:2.0:1788201595.493818:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc17267e800 already unused, calling callback (ffffffffc10772d0) 00000100:00100000:1.0:1788201595.493820:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 867 00010000:00010000:2.0:1788201595.493823:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002cadee1/0xd138388016f6e5a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e21710940b5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000100:00100000:1.0:1788201595.493832:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 868 00000100:00100000:1.0:1788201595.493838:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1727d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23390:x1875064743499264:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201595.493846:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001c13ee9a/0xd138388016f6e446 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093bde expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.493868:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1788201595.493868:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002cadee1/0xd138388016f6e5a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710940b5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000100:00100000:1.0:1788201595.493874:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1727d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23390:x1875064743499264:12345-192.168.201.143@tcp:104: Request processed in 36us (179us total) trans 0 rc 0/0 00010000:00010000:2.0:1788201595.493876:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788201595.493883:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 868 00010000:00010000:2.0:1788201595.493887:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002cadee1/0xd138388016f6e5a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710940b5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1788201595.493895:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002cadee1/0xd138388016f6e5a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710940b5 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.493896:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201595.493901:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001c13ee9a/0xd138388016f6e446 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171093bde expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.493908:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172734800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:2.0:1788201595.493909:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201595.493911:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201595.493913:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001c13ee9a/0xd138388016f6e446 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171093bde expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1788201595.493913:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201595.493918:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201595.493926:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728034304:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201595.493964:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001c13ee9a/0xd138388016f6e446 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093bde expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1788201595.493964:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201595.493972:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201595.493996:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001c13ee9a/0xd138388016f6e446 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093bde expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.494003:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001c13ee9a/0xd138388016f6e446 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171093bde expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201595.494017:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201595.494019:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201595.494021:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201595.494108:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728034432:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.494110:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201595.494124:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743499392 00000100:00100000:1.0:1788201595.494127:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743499392 00000100:00100000:1.0:1788201595.494149:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 869 00000100:00100000:1.0:1788201595.494156:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1727d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23394:x1875064743499392:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201595.494166:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094eed expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201595.494197:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201595.494202:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1727d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:23394:x1875064743499392:12345-192.168.201.143@tcp:104: Request processed in 47us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201595.494209:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 869 00010000:00010000:2.0:1788201595.494311:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201595.494316:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094eed expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.494323:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1727c9800 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:2.0:1788201595.494327:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171094eed expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.494375:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094eed expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.494383:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201595.494402:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094eed expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.494411:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a8d58d86/0xd138388016f6eb1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094eed expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201595.494425:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201595.494427:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201595.494428:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201595.494522:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c9f80731/0xd138388016f6f91c lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.494606:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c9f80731/0xd138388016f6f91c lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710985ff expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.494622:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c9f80731/0xd138388016f6f91c lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710985ff expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.494636:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c9f80731/0xd138388016f6f91c lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710985ff expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201595.494652:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c9f80731/0xd138388016f6f91c lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710985ff expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201595.494665:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201595.494683:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c9f80731/0xd138388016f6f91c lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710985ff expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.494692:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c9f80731/0xd138388016f6f91c lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710985ff expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.494700:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c9f80731/0xd138388016f6f91c lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710985ff expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.494709:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c9f80731/0xd138388016f6f91c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e21710985ff expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201595.494731:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728033792:192.168.201.143@tcp:101:cp.0 00000080:00200000:2.0:1788201595.494842:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a5:0x0] updating i_size 0 i_blocks 1 00000020:00010000:2.0:1788201595.494848:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc6750 (ffff8bc1460e9488/0) at cl_lock_release():245 00000020:00010000:2.0:1788201595.494852:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc6750 (ffff8bc1460e9488/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.494857:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149fecd30 (ffff8bc1460e9998/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.494862:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc6750 (ffff8bc1460e9488/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201595.494865:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149fecd30 (ffff8bc1460e9488/1) at cl_lock_fini():72 00000100:00100000:1.0:1788201595.494893:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000080:00200000:2.0:1788201595.494895:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a5:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:1.0:1788201595.494904:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728034560:192.168.201.143@tcp:103:ldlm_bl.0 00000080:00200008:2.0:1788201595.494968:0:24470:0:(file.c:2638:do_file_write_iter()) START file setup-nfs.sh:[0x200000bd7:0x1a5:0x0], ppos: 0, count: 1611 00000080:00200000:2.0:1788201595.494985:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 1611 bytes 00000080:00200000:2.0:1788201595.494990:0:24470:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 1611 00000080:00200000:2.0:1788201595.495004:0:24470:0:(file.c:2090:ll_file_io_generic()) setup-nfs.sh: write ppos: 0, bytes: 1611 00000080:00200000:2.0:1788201595.495009:0:24470:0:(file.c:1848:ll_io_set_mirror()) setup-nfs.sh: desiginated mirror: 0 00000020:00200000:2.0:1788201595.495015:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@000000003a7e3b76[0x110, 1, [0x200000bd7:0x1a5:0x0] hash] 00000020:00200000:2.0:1788201595.495017:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 1611) 0 0 00000080:00200000:2.0:1788201595.495021:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a5:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201595.495032:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1788201595.495041:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 1611) 1611, 1611 00020000:00200000:2.0:1788201595.495044:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201595.495074:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1788201595.495086:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1788201595.495091:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261dcb0, osc lock ffff8bc151fc0720, flags 0x0 00010000:00010000:2.0:1788201595.495108:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/453 (0 4095) 00010000:00010000:2.0:1788201595.495136:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.495146:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.495156:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.495177:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172745f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728034688:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201595.495200:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.499722:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728034176:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.499745:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728034048:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.499776:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728034560:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201595.499963:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728034432:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201595.499976:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728034304:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.502281:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201595.502345:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743499520 00000100:00100000:1.0:1788201595.502363:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743499520 00000100:00100000:1.0:1788201595.502424:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 870 00000100:00100000:1.0:1788201595.502438:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1727d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:24636:x1875064743499520:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201595.502463:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c9f80731/0xd138388016f6f91c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710985ff expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201595.502577:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201595.502584:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1727d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:24636:x1875064743499520:12345-192.168.201.143@tcp:104: Request processed in 150us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201595.502592:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 870 00010000:00010000:1.0:1788201595.502624:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201595.502632:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c9f80731/0xd138388016f6f91c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710985ff expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201595.502642:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc144020600 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201595.502649:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c9f80731/0xd138388016f6f91c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e21710985ff expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201595.502715:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1788201595.502731:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1788201595.502832:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c9f80731/0xd138388016f6f91c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710985ff expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201595.502842:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788201595.502859:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728033920:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201595.502869:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c9f80731/0xd138388016f6f91c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710985ff expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201595.502879:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c9f80731/0xd138388016f6f91c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710985ff expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1788201595.502894:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201595.502897:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201595.502899:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201595.502917:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728034816:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201595.505989:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201595.506431:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172745f80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728034688:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201595.506480:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.506500:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.506512:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201595.506641:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743499648 00000100:00100000:0.0:1788201595.506651:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743499648 00000100:00100000:0.0:1788201595.506717:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 871 00000100:00100000:0.0:1788201595.506729:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1726cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21005:x1875064743499648:12345-192.168.201.143@tcp:105: 00010000:00010000:0.0:1788201595.506742:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.506752:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.506762:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.506773:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.506783:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.506835:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.506866:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc1443b7c00) 00010000:00010000:3.0:1788201595.506946:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201595.506947:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1726cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21005:x1875064743499648:12345-192.168.201.143@tcp:105: Request processed in 219us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201595.506963:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 871 00010000:00010000:3.0:1788201595.506966:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.506987:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201595.507010:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.507026:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.507034:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201595.507076:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) setup-nfs.sh: write [0, 1611) append 0 append lockpos 0 00000080:00200000:3.0:1788201595.507532:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 1611 bytes 00000080:00200000:3.0:1788201595.507602:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 1611, copied 1611 00000080:00200000:3.0:1788201595.507616:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000356543b0[3 00000000e6ee64be 2 1 000000007aed2f44 0 0 0] 00000080:00200000:3.0:1788201595.507619:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000806a2e2b 17ffffc0001001 3:0 ffff8bc1434509a0 0 lru 00000080:00200000:3.0:1788201595.507628:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ef55b955 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 00000000ead46661 > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.507630:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000356543b0 00000080:00200000:3.0:1788201595.507631:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201595.507637:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 1611 prio 0 00000008:00010000:3.0:1788201595.507663:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 000000007b4b89b5 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201595.507686:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459d33f8, count 1, dirtied 1 00000080:00200000:3.0:1788201595.507692:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 1611 bytes, tot: 1611 00000080:00200000:3.0:1788201595.507695:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) setup-nfs.sh: write bytes 0, result: 1611 00000020:00010000:3.0:1788201595.507715:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc149844b78 (ffff8bc146919758/0) at cl_lock_release():245 00000020:00010000:3.0:1788201595.507719:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149844b78 (ffff8bc146919758/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201595.507723:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261dcb0 (ffff8bc146919f38/1) at cl_lock_cancel():142 00010000:00010000:3.0:1788201595.507729:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.507741:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1788201595.507760:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149844b78 (ffff8bc146919758/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201595.507763:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261dcb0 (ffff8bc146919758/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201595.507773:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 1611 bytes 00000080:00200000:3.0:1788201595.507782:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1788201595.507953:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a5:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201595.507959:0:24470:0:(file.c:2238:ll_file_io_generic()) setup-nfs.sh: 2 io complete with rc: 0, result: 1611, restart: 0 00000080:00200000:3.0:1788201595.507970:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a5:0x0] updating i_size 1611 i_blocks 1 00000080:00200000:3.0:1788201595.507977:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 1611 00000080:00200008:3.0:1788201595.508200:0:24470:0:(file.c:479:ll_file_release()) START file setup-nfs.sh:[0x200000bd7:0x1a5:0x0](ffff8bc1459d3248), flags 100001 00000002:00100000:3.0:1788201595.508273:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc1726ce300 x1875064728033024/t8589937484(8589937484) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201611 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1788201595.508287:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1788201595.508293:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1726cdc00 x1875064728035072/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1788201595.509621:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728035072:192.168.201.143@tcp:35:cp.0 00000100:00100000:3.0:1788201595.509723:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.513959:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728034816:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201595.515994:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728035072:192.168.201.143@tcp:35:cp.0 00000002:00100000:3.0:1788201595.516040:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc1726ce300 x1875064728033024/t8589937484(8589937484) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1788201595.516138:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201595.516167:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201595.516193:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201595.516210:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201595.516220:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201595.516227:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201595.516231:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201595.516240:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201595.516245:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201595.516254:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201595.516274:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201595.516282:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201595.516289:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201595.516293:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=setup-nfs.sh, flags=8 00000080:00200008:3.0:1788201595.516301:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file setup-nfs.sh:[0x200000bd7:0x1a5:0x0](ffff8bc1459d3248), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201595.516306:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x1a5:0x0](ffff8bc1459d3248),name=setup-nfs.sh 00000002:00010000:3.0:1788201595.516331:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x1a5:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201595.516350:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710985e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201595.516358:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710985e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1788201595.516364:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201595.516369:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a5:0x0](ffff8bc1459d3248) 00000080:00010000:3.0:1788201595.516373:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a5:0x0](ffff8bc1459d3248) for lock 0xd138388016f6f915 00000080:00010000:3.0:1788201595.516376:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f915 from it ffffadd1c7debcb8 00010000:00010000:3.0:1788201595.516379:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710985e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201595.516387:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710985e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201595.516445:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a5:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:3.0:1788201595.516456:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x1a5:0x0] 00000008:00010000:3.0:1788201595.516492:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1788201595.516496:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc149fec530, osc lock ffff8bc14691b560, flags 0x400001002 00010000:00010000:3.0:1788201595.516586:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201595.516600:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:3.0:1788201595.516614:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1788201595.516618:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201595.516625:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1788201595.516636:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1788201595.516647:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a5:0x0] updating i_size 1611 i_blocks 1 00000020:00010000:3.0:1788201595.516651:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc151fc7090 (ffff8bc1460e93f8/0) at cl_lock_release():245 00000020:00010000:3.0:1788201595.516654:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc151fc7090 (ffff8bc1460e93f8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1788201595.516657:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc149fec530 (ffff8bc1460e9bd8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1788201595.516662:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc151fc7090 (ffff8bc1460e93f8/0) at cl_lock_fini():72 00000020:00010000:3.0:1788201595.516665:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc149fec530 (ffff8bc1460e93f8/1) at cl_lock_fini():72 00000080:00200000:3.0:1788201595.516698:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a5:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201595.516772:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201595.516781:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201595.516788:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201595.516860:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201595.516867:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201595.516872:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201595.516874:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201595.516878:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:3.0:1788201595.516882:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201595.516890:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201595.516900:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201595.516905:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:3.0:1788201595.516908:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201595.516924:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sgpdd-survey.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:3.0:1788201595.516929:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sgpdd-survey.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:3.0:1788201595.516941:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sgpdd-survey.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:3.0:1788201595.517002:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f92a lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.517011:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f92a lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.517027:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f92a lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201595.517056:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728035200:192.168.201.143@tcp:101:cp.0 00000100:00100000:3.0:1788201595.517165:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.521164:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728035200:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201595.521195:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f92a lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.521211:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f92a lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.521218:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f92a lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.521225:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f92a lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.521234:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f92a lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.521244:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc144021e00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:2.0:1788201595.521249:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f92a lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.521256:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f92a lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.521265:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f92a lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.521272:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201595.521279:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f92a lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.521286:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021e00/0xd138388016f6f92a lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201595.521306:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc1726cf100 x1875064728035200/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201595.521452:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1788201595.521487:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201595.521580:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.521605:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.521617:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.521630:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.521642:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.521648:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.521651:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.521657:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201595.521662:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.521671:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.521688:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.521697:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201595.521703:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.521720:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sgpdd-survey.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:2.0:1788201595.521725:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sgpdd-survey.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201595.521739:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sgpdd-survey.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201595.521853:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f931 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.521864:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f931 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.521879:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f931 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201595.522346:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172747480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728035328:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201595.522486:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201595.525980:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172747480 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728035328:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201595.526017:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f931 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.526035:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f931 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.526043:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f931 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.526051:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f931 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.526062:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f931 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.526070:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172473800 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201595.526076:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f931 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.526083:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f931 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.526091:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f931 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.526099:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201595.526107:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f931 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.526115:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473800/0xd138388016f6f931 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201595.526144:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc172747480 x1875064728035328/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201595.526161:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201595.526191:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201595.526347:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201595.526383:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201595.526396:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201595.526411:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201595.526418:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201595.526425:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201595.526429:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201595.526437:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:0.0:1788201595.526441:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201595.526449:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201595.526469:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.526478:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201595.526484:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.526501:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201595.526507:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=sgpdd-survey.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc152c96600, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:0.0:1788201595.526517:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sgpdd-survey.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:0.0:1788201595.526617:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sgpdd-survey.sh,[0x200000bd7:0x1a6:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:0.0:1788201595.526681:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.526690:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1788201595.526703:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1788201595.526711:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144140700 x1875064728035584/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1788201595.526721:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201595.526748:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728035584:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201595.527016:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201595.531688:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728035584:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201595.531727:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098668 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.531756:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098668 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.531766:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098668 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.531779:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098668 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.531827:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098668 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.531844:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098668 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.531853:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098668 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.531861:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098668 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201595.531874:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc144140700 x1875064728035584/t8589937486(8589937486) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201595.531890:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc144140700 x1875064728035584/t8589937486(8589937486) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 656/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201595.531906:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098668 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1788201595.531920:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098668 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.531932:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/422 (0 0) 00000080:00200000:0.0:1788201595.531940:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201595.531956:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=sgpdd-survey.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:0.0:1788201595.531996:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1a6:0x0](ffff8bc1459b5b88) 00000080:00200000:0.0:1788201595.532140:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x1a6:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1788201595.532150:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x1a6:0x0](ffff8bc1459b5b88) 00000080:00010000:0.0:1788201595.532154:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a6:0x0](ffff8bc1459b5b88) for lock 0xd138388016f6f938 00000080:00010000:0.0:1788201595.532166:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a6:0x0](ffff8bc1459b5b88) 00000080:00200008:0.0:1788201595.532182:0:24470:0:(file.c:1090:ll_file_open()) START file sgpdd-survey.sh:[0x200000bd7:0x1a6:0x0](ffff8bc1459b5b88), flags 100301 00000002:00100000:0.0:1788201595.532202:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc144140700 x1875064728035584/t8589937486(8589937486) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1788201595.532252:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f938 from it ffff8bc148c059c0 00010000:00010000:0.0:1788201595.532256:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171098668 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.532266:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098668 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201595.532291:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1a6:0x0](ffff8bc1459b5b88), inode mode 81a4 mask 40 00000080:00200008:0.0:1788201595.532344:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sgpdd-survey.sh:[0x200000bd7:0x1a6:0x0](ffff8bc1459b5b88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201595.532351:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x1a6:0x0](ffff8bc1459b5b88),name=sgpdd-survey.sh 00000002:00010000:0.0:1788201595.532384:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x1a6:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201595.532394:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098668 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.532407:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098668 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201595.532414:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201595.532419:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a6:0x0](ffff8bc1459b5b88) 00000080:00010000:0.0:1788201595.532423:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a6:0x0](ffff8bc1459b5b88) for lock 0xd138388016f6f938 00000080:00010000:0.0:1788201595.532426:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f938 from it ffffadd1c7debcd8 00010000:00010000:0.0:1788201595.532430:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171098668 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.532438:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098668 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201595.532463:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a6:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201595.532473:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x1a6:0x0] 00000008:00010000:0.0:1788201595.532500:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201595.532505:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1724561b0, osc lock ffff8bc145d34e40, flags 0x400001002 00010000:00010000:0.0:1788201595.532577:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6f93f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.532588:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6f93f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201595.532635:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:2.0:1788201595.532686:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201595.532707:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728035712:192.168.201.143@tcp:101:cp.0 00010000:00010000:3.0:1788201595.536154:0:10053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6f93f lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.536192:0:10053:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6f93f lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098676 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.536212:0:10053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6f93f lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098676 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.536228:0:10053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6f93f lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098676 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201595.536246:0:10053:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6f93f lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171098676 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201595.536259:0:10053:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201595.536283:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6f93f lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171098676 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.536291:0:10053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6f93f lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171098676 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.536300:0:10053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6f93f lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e2171098676 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.536310:0:10053:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6f93f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e2171098676 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201595.536439:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a6:0x0] updating i_size 0 i_blocks 1 00000020:00010000:0.0:1788201595.536448:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449dae40 (ffff8bc1499c4c68/0) at cl_lock_release():245 00000020:00010000:0.0:1788201595.536452:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449dae40 (ffff8bc1499c4c68/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201595.536458:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1724561b0 (ffff8bc1499c4638/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201595.536463:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449dae40 (ffff8bc1499c4c68/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201595.536466:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1724561b0 (ffff8bc1499c4c68/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201595.536526:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a6:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1788201595.536618:0:24470:0:(file.c:2638:do_file_write_iter()) START file sgpdd-survey.sh:[0x200000bd7:0x1a6:0x0], ppos: 0, count: 1765 00000080:00200000:0.0:1788201595.536638:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 1765 bytes 00000080:00200000:0.0:1788201595.536644:0:24470:0:(file.c:2614:ll_do_tiny_write()) result: 0, original count 1765 00000080:00200000:0.0:1788201595.536672:0:24470:0:(file.c:2090:ll_file_io_generic()) sgpdd-survey.sh: write ppos: 0, bytes: 1765 00000080:00200000:0.0:1788201595.536680:0:24470:0:(file.c:1848:ll_io_set_mirror()) sgpdd-survey.sh: desiginated mirror: 0 00000020:00200000:0.0:1788201595.536687:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000c5bcc592[0x110, 1, [0x200000bd7:0x1a6:0x0] hash] 00000020:00200000:0.0:1788201595.536690:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 1765) 0 0 00000080:00200000:0.0:1788201595.536694:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a6:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201595.536708:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1788201595.536717:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 1765) 1765, 1765 00020000:00200000:0.0:1788201595.536721:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201595.536754:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:0.0:1788201595.536769:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1788201595.536776:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1724561b0, osc lock ffff8bc145d34e40, flags 0x0 00010000:00010000:0.0:1788201595.536845:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/453 (0 4095) 00010000:00010000:0.0:1788201595.536900:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.536911:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.536923:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201595.536955:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728035840:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201595.537066:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621840 going to sleep for 11 seconds 00000100:00100000:3.0:1788201595.537292:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728035712:192.168.201.143@tcp:101:cp.0 00000100:00100000:1.0:1788201595.539766:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201595.539950:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743499776 00000100:00100000:2.0:1788201595.539967:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743499776 00000100:00100000:2.0:1788201595.540107:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 872 00000100:00100000:2.0:1788201595.540121:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1727d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:24638:x1875064743499776:12345-192.168.201.143@tcp:104: 00010000:00010000:2.0:1788201595.540145:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6f93f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171098676 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.540260:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201595.540268:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1727d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:24638:x1875064743499776:12345-192.168.201.143@tcp:104: Request processed in 150us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201595.540276:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 872 00010000:00010000:3.0:1788201595.540505:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201595.540515:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6f93f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e2171098676 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201595.540525:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc15c12ba00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201595.540531:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6f93f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e2171098676 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201595.540646:0:20882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201595.540662:0:20882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201595.540743:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6f93f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171098676 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201595.540752:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201595.540816:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6f93f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171098676 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201595.540833:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004e09ad8e/0xd138388016f6f93f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e2171098676 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201595.540854:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201595.540856:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201595.540858:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201595.540869:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201595.540890:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728035968:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201595.543585:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728035840:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201595.543624:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.543641:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.543656:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201595.544607:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201595.544696:0:20877:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788201595.544717:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743499904 00000100:00100000:2.0:1788201595.544727:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743499904 00000100:00100000:2.0:1788201595.544835:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 873 00000100:00100000:2.0:1788201595.544849:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc143422c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21004:x1875064743499904:12345-192.168.201.143@tcp:105: 00010000:00010000:2.0:1788201595.544864:0:20877:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.545298:0:20877:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.545309:0:20877:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.545386:0:20877:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.545397:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.545409:0:20877:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.546189:0:20877:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc15c12aa00) 00010000:00010000:0.0:1788201595.546224:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.546238:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x20000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.546259:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201595.546273:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201595.546285:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc143422c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21004:x1875064743499904:12345-192.168.201.143@tcp:105: Request processed in 1434us (1677us total) trans 0 rc 0/0 00010000:00010000:0.0:1788201595.546288:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.546300:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201595.546311:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 873 00000080:00200000:0.0:1788201595.546570:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) sgpdd-survey.sh: write [0, 1765) append 0 append lockpos 0 00000080:00200000:0.0:1788201595.546595:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 1765 bytes 00000080:00200000:0.0:1788201595.546669:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 1765, copied 1765 00000080:00200000:0.0:1788201595.546682:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008c7467c5[3 0000000061812485 2 1 00000000ea1f5651 0 0 0] 00000080:00200000:0.0:1788201595.546685:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000da076f99 17ffffc0001001 3:0 ffff8bc16652d9a0 0 lru 00000080:00200000:0.0:1788201595.546694:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005b572c14 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000f9540ab0 > 3< 0 0 > 4< 0 0 8 10223616 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.546696:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008c7467c5 00000080:00200000:0.0:1788201595.546697:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1788201595.546703:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 1765 prio 0 00000008:00010000:0.0:1788201595.546729:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 0000000041ed5eb8 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201595.546751:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459b5d38, count 1, dirtied 1 00000080:00200000:0.0:1788201595.546757:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 1765 bytes, tot: 1765 00000080:00200000:0.0:1788201595.546760:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) sgpdd-survey.sh: write bytes 0, result: 1765 00000020:00010000:0.0:1788201595.546781:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc148fb1d58 (ffff8bc1499c4c68/0) at cl_lock_release():245 00000020:00010000:0.0:1788201595.546786:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc148fb1d58 (ffff8bc1499c4c68/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201595.547621:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1724561b0 (ffff8bc1499c4638/1) at cl_lock_cancel():142 00010000:00010000:0.0:1788201595.547634:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.547648:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1788201595.547668:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc148fb1d58 (ffff8bc1499c4c68/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201595.547671:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1724561b0 (ffff8bc1499c4c68/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201595.547683:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 1765 bytes 00000080:00200000:0.0:1788201595.547692:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1788201595.547729:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a6:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201595.547733:0:24470:0:(file.c:2238:ll_file_io_generic()) sgpdd-survey.sh: 2 io complete with rc: 0, result: 1765, restart: 0 00000080:00200000:0.0:1788201595.547743:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a6:0x0] updating i_size 1765 i_blocks 1 00000080:00200000:0.0:1788201595.547750:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 1765 00000080:00200008:0.0:1788201595.547839:0:24470:0:(file.c:479:ll_file_release()) START file sgpdd-survey.sh:[0x200000bd7:0x1a6:0x0](ffff8bc1459b5b88), flags 100001 00000002:00100000:0.0:1788201595.547919:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc144140700 x1875064728035584/t8589937486(8589937486) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201611 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1788201595.547934:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1788201595.547940:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144141c00 x1875064728036224/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1788201595.547969:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728036224:192.168.201.143@tcp:35:cp.0 00000100:00100000:0.0:1788201595.548049:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621840 going to sleep for 11 seconds 00000100:00100000:3.0:1788201595.551680:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728035968:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201595.551853:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728036224:192.168.201.143@tcp:35:cp.0 00000002:00100000:0.0:1788201595.551890:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc144140700 x1875064728035584/t8589937486(8589937486) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 584/664 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201595.551985:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201595.552008:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201595.552032:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201595.552048:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201595.552059:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201595.552065:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201595.552069:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201595.552079:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201595.552084:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201595.552095:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201595.552126:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.552136:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201595.552142:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.552146:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=sgpdd-survey.sh, flags=8 00000080:00200008:0.0:1788201595.552154:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file sgpdd-survey.sh:[0x200000bd7:0x1a6:0x0](ffff8bc1459b5b88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201595.552160:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x1a6:0x0](ffff8bc1459b5b88),name=sgpdd-survey.sh 00000002:00010000:0.0:1788201595.552173:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x1a6:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201595.552182:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098668 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201595.552191:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098668 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201595.552198:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201595.552202:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a6:0x0](ffff8bc1459b5b88) 00000080:00010000:0.0:1788201595.552204:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a6:0x0](ffff8bc1459b5b88) for lock 0xd138388016f6f938 00000080:00010000:0.0:1788201595.552208:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f938 from it ffffadd1c7debcb8 00010000:00010000:0.0:1788201595.552212:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e2171098668 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201595.552220:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e2171098668 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201595.552265:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a6:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201595.552276:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x1a6:0x0] 00000008:00010000:0.0:1788201595.552304:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201595.552309:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1724561b0, osc lock ffff8bc145d34e40, flags 0x400001002 00010000:00010000:0.0:1788201595.552347:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.552361:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:0.0:1788201595.552377:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1788201595.552382:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.552391:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1788201595.552402:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1788201595.552411:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a6:0x0] updating i_size 1765 i_blocks 1 00000020:00010000:0.0:1788201595.552415:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449dae40 (ffff8bc1499c4c68/0) at cl_lock_release():245 00000020:00010000:0.0:1788201595.552417:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449dae40 (ffff8bc1499c4c68/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201595.552421:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1724561b0 (ffff8bc1499c4638/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201595.552425:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449dae40 (ffff8bc1499c4c68/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201595.552428:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1724561b0 (ffff8bc1499c4c68/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201595.552457:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a6:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201595.552510:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201595.552517:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201595.552524:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201595.552533:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201595.552540:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201595.552544:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201595.552547:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201595.552550:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201595.552554:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201595.552561:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201595.552569:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.552572:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201595.552575:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.552588:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=test-framework.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:0.0:1788201595.552592:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=test-framework.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201595.552601:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: test-framework.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201595.552649:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6f94d lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.552657:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6f94d lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.552669:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6f94d lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201595.552691:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728036352:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201595.552781:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201595.558559:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728036352:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201595.558591:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6f94d lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.558609:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6f94d lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.558616:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6f94d lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.558624:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6f94d lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.558634:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6f94d lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.558642:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc15c12b200 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201595.558647:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6f94d lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.558654:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6f94d lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.558661:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6f94d lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.558668:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201595.558676:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6f94d lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.558683:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b200/0xd138388016f6f94d lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201595.558711:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc144140e00 x1875064728036352/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201595.558730:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201595.558763:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201595.558990:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201595.559008:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201595.559020:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201595.559034:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201595.559041:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201595.559047:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201595.559051:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201595.559057:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201595.559061:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201595.559071:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201595.559105:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.559114:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201595.559128:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.559148:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=test-framework.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:0.0:1788201595.559153:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=test-framework.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:0.0:1788201595.559167:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: test-framework.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:0.0:1788201595.559220:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6f954 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.559227:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6f954 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.559237:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6f954 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201595.559261:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728036480:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201595.559382:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201595.564224:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728036480:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201595.564256:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6f954 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.564273:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6f954 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.564281:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6f954 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.564289:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6f954 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.564298:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6f954 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.564305:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc15c12b600 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:0.0:1788201595.564311:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6f954 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.564327:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6f954 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.564345:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6f954 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.564353:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201595.564361:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6f954 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.564368:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b600/0xd138388016f6f954 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201595.564393:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc144140e00 x1875064728036480/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201595.564412:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1788201595.564445:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:0.0:1788201595.564589:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201595.564604:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201595.564614:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201595.564627:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201595.564635:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201595.564639:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201595.564643:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201595.564649:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:0.0:1788201595.564654:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201595.564663:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201595.564680:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.564688:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:0.0:1788201595.564694:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.564711:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201595.564717:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=test-framework.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc152c96600, open_flags 80c1, mode 81ed opened 0 00000080:00200000:0.0:1788201595.564725:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=test-framework.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:0.0:1788201595.564748:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: test-framework.sh,[0x200000bd7:0x1a7:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:0.0:1788201595.564835:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.564842:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1788201595.564856:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1788201595.564864:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144140e00 x1875064728036736/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1788201595.564874:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201595.564900:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728036736:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201595.565602:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201595.570344:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728036736:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201595.570380:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710986c3 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.570407:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710986c3 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.570416:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710986c3 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.570430:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710986c3 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.570443:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710986c3 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.570461:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710986c3 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.570471:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710986c3 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.570478:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710986c3 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201595.570491:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc144140e00 x1875064728036736/t8589937488(8589937488) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1788201595.570507:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc144140e00 x1875064728036736/t8589937488(8589937488) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 664/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201595.570530:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710986c3 expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1788201595.570545:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710986c3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.570557:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/423 (0 0) 00000080:00200000:0.0:1788201595.570566:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201595.570584:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=test-framework.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:0.0:1788201595.570624:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1a7:0x0](ffff8bc1459b00c8) 00000080:00200000:0.0:1788201595.570778:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x1a7:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1788201595.570788:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x1a7:0x0](ffff8bc1459b00c8) 00000080:00010000:0.0:1788201595.570815:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a7:0x0](ffff8bc1459b00c8) for lock 0xd138388016f6f95b 00000080:00010000:0.0:1788201595.570828:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a7:0x0](ffff8bc1459b00c8) 00000080:00200008:0.0:1788201595.570845:0:24470:0:(file.c:1090:ll_file_open()) START file test-framework.sh:[0x200000bd7:0x1a7:0x0](ffff8bc1459b00c8), flags 100301 00000002:00100000:0.0:1788201595.570868:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc144140e00 x1875064728036736/t8589937488(8589937488) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1788201595.570919:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f95b from it ffff8bc148c059c0 00010000:00010000:0.0:1788201595.570924:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710986c3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.570935:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710986c3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201595.570967:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1a7:0x0](ffff8bc1459b00c8), inode mode 81ed mask 40 00000080:00200008:0.0:1788201595.571000:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file test-framework.sh:[0x200000bd7:0x1a7:0x0](ffff8bc1459b00c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201595.571008:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x1a7:0x0](ffff8bc1459b00c8),name=test-framework.sh 00000002:00010000:0.0:1788201595.571031:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x1a7:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201595.571043:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710986c3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.571055:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710986c3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201595.571063:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201595.571068:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a7:0x0](ffff8bc1459b00c8) 00000080:00010000:0.0:1788201595.571072:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a7:0x0](ffff8bc1459b00c8) for lock 0xd138388016f6f95b 00000080:00010000:0.0:1788201595.571075:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f95b from it ffffadd1c7debcd8 00010000:00010000:0.0:1788201595.571078:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710986c3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.571085:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710986c3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201595.571113:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a7:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201595.571122:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x1a7:0x0] 00000008:00010000:0.0:1788201595.571150:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201595.571154:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456930, osc lock ffff8bc145d34e40, flags 0x400001002 00010000:00010000:0.0:1788201595.571210:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004cc15962/0xd138388016f6f962 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.571228:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004cc15962/0xd138388016f6f962 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201595.571292:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1788201595.571478:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728036864:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201595.578286:0:10054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004cc15962/0xd138388016f6f962 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.578408:0:10054:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004cc15962/0xd138388016f6f962 lrc: 6/2,0 mode: --/PR res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710986d1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.578428:0:10054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004cc15962/0xd138388016f6f962 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710986d1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.578442:0:10054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004cc15962/0xd138388016f6f962 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e21710986d1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201595.578463:0:10054:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004cc15962/0xd138388016f6f962 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710986d1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1788201595.578478:0:10054:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1788201595.578604:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004cc15962/0xd138388016f6f962 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710986d1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.578616:0:10054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004cc15962/0xd138388016f6f962 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710986d1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.578629:0:10054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004cc15962/0xd138388016f6f962 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e21710986d1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.578639:0:10054:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004cc15962/0xd138388016f6f962 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e21710986d1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1788201595.578665:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728036864:192.168.201.143@tcp:101:cp.0 00000080:00200000:1.0:1788201595.578747:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a7:0x0] updating i_size 0 i_blocks 1 00000020:00010000:1.0:1788201595.578754:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449dae40 (ffff8bc1499c4c68/0) at cl_lock_release():245 00000020:00010000:1.0:1788201595.578757:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449dae40 (ffff8bc1499c4c68/0) at cl_lock_cancel():142 00000020:00010000:1.0:1788201595.578762:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456930 (ffff8bc1499c4638/1) at cl_lock_cancel():142 00000020:00010000:1.0:1788201595.578767:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449dae40 (ffff8bc1499c4c68/0) at cl_lock_fini():72 00000020:00010000:1.0:1788201595.578770:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456930 (ffff8bc1499c4c68/1) at cl_lock_fini():72 00000080:00200000:1.0:1788201595.579019:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a7:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1788201595.579650:0:24470:0:(file.c:2638:do_file_write_iter()) START file test-framework.sh:[0x200000bd7:0x1a7:0x0], ppos: 0, count: 317150 00000080:00200000:0.0:1788201595.579695:0:24470:0:(file.c:2090:ll_file_io_generic()) test-framework.sh: write ppos: 0, bytes: 317150 00000080:00200000:0.0:1788201595.579702:0:24470:0:(file.c:1848:ll_io_set_mirror()) test-framework.sh: desiginated mirror: 0 00000020:00200000:0.0:1788201595.579709:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000fdf34c88[0x110, 1, [0x200000bd7:0x1a7:0x0] hash] 00000020:00200000:0.0:1788201595.579711:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 317150) 0 0 00000080:00200000:0.0:1788201595.579716:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a7:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201595.579730:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 77] 00020000:00200000:0.0:1788201595.579739:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 317150) 317150, 317150 00020000:00200000:0.0:1788201595.579742:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201595.579775:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 77] 00000008:00010000:0.0:1788201595.579819:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1788201595.579826:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc172456bb0, osc lock ffff8bc145d34000, flags 0x0 00010000:00010000:0.0:1788201595.579847:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc172716400 type 11 mode 2 res 10737419264/454 (0 319487) 00010000:00010000:0.0:1788201595.579900:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.579911:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->319487] (req 0->319487) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.579923:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->319487] (req 0->319487) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201595.579950:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728036992:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201595.580115:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621180 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.583039:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201595.583259:0:21781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743500032 00000100:00100000:2.0:1788201595.583272:0:21781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743500032 00000100:00100000:2.0:1788201595.583452:0:21781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 874 00000100:00100000:2.0:1788201595.583465:0:21781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1727d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21820:x1875064743500032:12345-192.168.201.143@tcp:104: 00010000:00010000:2.0:1788201595.583490:0:21781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004cc15962/0xd138388016f6f962 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710986d1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.585147:0:21781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201595.585170:0:21781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1727d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:LOV_OSC_UUID+4:21820:x1875064743500032:12345-192.168.201.143@tcp:104: Request processed in 1700us (2137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201595.585181:0:21781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 874 00010000:00010000:3.0:1788201595.585740:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201595.585754:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004cc15962/0xd138388016f6f962 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e21710986d1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201595.585768:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc15c12be00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201595.585776:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004cc15962/0xd138388016f6f962 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e21710986d1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1788201595.585855:0:23027:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1788201595.585870:0:23027:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1788201595.585960:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004cc15962/0xd138388016f6f962 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710986d1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201595.585975:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201595.586012:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004cc15962/0xd138388016f6f962 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710986d1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201595.586022:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004cc15962/0xd138388016f6f962 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e21710986d1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1788201595.586044:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201595.586047:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201595.586049:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201595.586254:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728037120:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201595.589000:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728036992:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201595.589046:0:24470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->319487] (req 0->319487) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.589064:0:24470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->319487] (req 0->319487) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.589074:0:24470:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->319487] (req 0->319487) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201595.589683:0:10046:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201595.589971:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743500160 00000100:00100000:1.0:1788201595.589981:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743500160 00000100:00100000:1.0:1788201595.590084:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 875 00000100:00100000:1.0:1788201595.590106:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1726cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21003:x1875064743500160:12345-192.168.201.143@tcp:105: 00010000:00010000:1.0:1788201595.590129:0:20877:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->319487] (req 0->319487) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.590139:0:20877:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->319487] (req 0->319487) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.590149:0:20877:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.590160:0:20877:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.590170:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x10080000020000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.590182:0:20877:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x80000020000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.590217:0:20877:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc15c12b600) 00000100:00100000:1.0:1788201595.590286:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1726cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21003:x1875064743500160:12345-192.168.201.143@tcp:105: Request processed in 192us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201595.590294:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 875 00010000:00010000:3.0:1788201595.592302:0:24470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.592400:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x20000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.592422:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201595.592438:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 4/0,2 mode: PW/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.592452:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 5/0,2 mode: PW/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.592467:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1788201595.592506:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) test-framework.sh: write [0, 317150) append 0 append lockpos 0 00000080:00200000:3.0:1788201595.592542:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.592609:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:3.0:1788201595.592622:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000046841e0f[3 0000000092c56bd2 2 1 0000000000e48688 0 0 0] 00000080:00200000:3.0:1788201595.592626:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000940806aa 17ffffc0001001 3:0 ffff8bc143450c40 0 lru 00000080:00200000:3.0:1788201595.592634:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007f42ed39 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.592636:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000046841e0f 00000080:00200000:3.0:1788201595.592637:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1788201595.592641:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.592677:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 4096, copied 4096 00000080:00200000:3.0:1788201595.592682:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c4a72c77[3 0000000092c56bd2 2 1 0000000000e48688 0 0 1] 00000080:00200000:3.0:1788201595.592685:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000eff8b660 17ffffc0001001 3:0 ffff8bc143450a80 1 lru 00000080:00200000:3.0:1788201595.592690:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000001884e46 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.592692:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c4a72c77 00000080:00200000:3.0:1788201595.592693:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:3.0:1788201595.592694:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 2 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.592712:0:24470:0:(rw26.c:898:ll_write_end()) pos 8192, len 4096, copied 4096 00000080:00200000:3.0:1788201595.592716:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007929146c[3 0000000092c56bd2 2 1 0000000000e48688 0 0 2] 00000080:00200000:3.0:1788201595.592719:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000059bfbef5 17ffffc0001001 3:0 ffff8bc143450540 2 lru 00000080:00200000:3.0:1788201595.592724:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009c05eb98 2: 1< 0 - - > 2< 8192 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.592726:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007929146c 00000080:00200000:3.0:1788201595.592727:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 3. 00000080:00200000:3.0:1788201595.592729:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 3 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.592743:0:24470:0:(rw26.c:898:ll_write_end()) pos 12288, len 4096, copied 4096 00000080:00200000:3.0:1788201595.592747:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000030673689[3 0000000092c56bd2 2 1 0000000000e48688 0 0 3] 00000080:00200000:3.0:1788201595.592750:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000493518e3 17ffffc0001001 3:0 ffff8bc1434508c0 3 lru 00000080:00200000:3.0:1788201595.592755:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003d1ffdfe 3: 1< 0 - - > 2< 12288 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.592756:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000030673689 00000080:00200000:3.0:1788201595.592757:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 4. 00000080:00200000:3.0:1788201595.592759:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 4 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.592774:0:24470:0:(rw26.c:898:ll_write_end()) pos 16384, len 4096, copied 4096 00000080:00200000:3.0:1788201595.592778:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000438bd108[3 0000000092c56bd2 2 1 0000000000e48688 0 0 4] 00000080:00200000:3.0:1788201595.592780:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ed8027b8 17ffffc0001001 3:0 ffff8bc143450e00 4 lru 00000080:00200000:3.0:1788201595.592785:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a588b781 4: 1< 0 - - > 2< 16384 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.592786:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000438bd108 00000080:00200000:3.0:1788201595.592787:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 5. 00000080:00200000:3.0:1788201595.592789:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 5 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.592844:0:24470:0:(rw26.c:898:ll_write_end()) pos 20480, len 4096, copied 4096 00000080:00200000:3.0:1788201595.592849:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000053e38a7e[3 0000000092c56bd2 2 1 0000000000e48688 0 0 5] 00000080:00200000:3.0:1788201595.592852:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f9350c26 17ffffc0001001 3:0 ffff8bc143450ee0 5 lru 00000080:00200000:3.0:1788201595.592857:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004718ba50 5: 1< 0 - - > 2< 20480 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.592859:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000053e38a7e 00000080:00200000:3.0:1788201595.592860:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 6. 00000080:00200000:3.0:1788201595.592862:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 6 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.592878:0:24470:0:(rw26.c:898:ll_write_end()) pos 24576, len 4096, copied 4096 00000080:00200000:3.0:1788201595.592882:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ae5ff45c[3 0000000092c56bd2 2 1 0000000000e48688 0 0 6] 00000080:00200000:3.0:1788201595.592885:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000004cfb0a9 17ffffc0001001 3:0 ffff8bc143450620 6 lru 00000080:00200000:3.0:1788201595.592890:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000089dde145 6: 1< 0 - - > 2< 24576 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.592892:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ae5ff45c 00000080:00200000:3.0:1788201595.592893:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 7. 00000080:00200000:3.0:1788201595.592895:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 7 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.592911:0:24470:0:(rw26.c:898:ll_write_end()) pos 28672, len 4096, copied 4096 00000080:00200000:3.0:1788201595.592916:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003e0a5ad1[3 0000000092c56bd2 2 1 0000000000e48688 0 0 7] 00000080:00200000:3.0:1788201595.592918:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000eec2bbeb 17ffffc0001001 3:0 ffff8bc1434507e0 7 lru 00000080:00200000:3.0:1788201595.592924:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000500da0cb 7: 1< 0 - - > 2< 28672 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.592926:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003e0a5ad1 00000080:00200000:3.0:1788201595.592927:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 8. 00000080:00200000:3.0:1788201595.592930:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 8 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.592946:0:24470:0:(rw26.c:898:ll_write_end()) pos 32768, len 4096, copied 4096 00000080:00200000:3.0:1788201595.592950:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e2e527db[3 0000000092c56bd2 2 1 0000000000e48688 0 0 8] 00000080:00200000:3.0:1788201595.592953:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000000b79ff6e 17ffffc0001001 3:0 ffff8bc143450700 8 lru 00000080:00200000:3.0:1788201595.592958:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006cd254e6 8: 1< 0 - - > 2< 32768 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.592961:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e2e527db 00000080:00200000:3.0:1788201595.592962:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 9. 00000080:00200000:3.0:1788201595.592963:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 9 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.592990:0:24470:0:(rw26.c:898:ll_write_end()) pos 36864, len 4096, copied 4096 00000080:00200000:3.0:1788201595.592995:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003aa99824[3 0000000092c56bd2 2 1 0000000000e48688 0 0 9] 00000080:00200000:3.0:1788201595.592998:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000049da1e47 17ffffc0001021 2:0 ffff8bc143450b60 9 lru 00000080:00200000:3.0:1788201595.593003:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000807f21c6 9: 1< 0 - - > 2< 36864 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.593006:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003aa99824 00000080:00200000:3.0:1788201595.593007:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 10. 00000080:00200000:3.0:1788201595.593009:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 10 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.593042:0:24470:0:(rw26.c:898:ll_write_end()) pos 40960, len 4096, copied 4096 00000080:00200000:3.0:1788201595.593047:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f6f7ebbb[3 0000000092c56bd2 2 1 0000000000e48688 0 0 10] 00000080:00200000:3.0:1788201595.593050:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000062f8e0c3 17ffffc0001001 3:0 ffff8bc17254e9a0 10 lru 00000080:00200000:3.0:1788201595.593055:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000006908aeeb 10: 1< 0 - - > 2< 40960 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.593058:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f6f7ebbb 00000080:00200000:3.0:1788201595.593058:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 11. 00000080:00200000:3.0:1788201595.593060:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 11 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.593077:0:24470:0:(rw26.c:898:ll_write_end()) pos 45056, len 4096, copied 4096 00000080:00200000:3.0:1788201595.593081:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000407b168[3 0000000092c56bd2 2 1 0000000000e48688 0 0 11] 00000080:00200000:3.0:1788201595.593084:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a72f346f 17ffffc0001001 3:0 ffff8bc17254ec40 11 lru 00000080:00200000:3.0:1788201595.593089:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000ccdeafb0 11: 1< 0 - - > 2< 45056 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.593091:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000407b168 00000080:00200000:3.0:1788201595.593092:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 12. 00000080:00200000:3.0:1788201595.593094:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 12 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.593109:0:24470:0:(rw26.c:898:ll_write_end()) pos 49152, len 4096, copied 4096 00000080:00200000:3.0:1788201595.593113:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000295a08d1[3 0000000092c56bd2 2 1 0000000000e48688 0 0 12] 00000080:00200000:3.0:1788201595.593115:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000924f18d5 17ffffc0001001 3:0 ffff8bc17254ea80 12 lru 00000080:00200000:3.0:1788201595.593120:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005032052d 12: 1< 0 - - > 2< 49152 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.593122:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000295a08d1 00000080:00200000:3.0:1788201595.593123:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 13. 00000080:00200000:3.0:1788201595.593125:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 13 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.593140:0:24470:0:(rw26.c:898:ll_write_end()) pos 53248, len 4096, copied 4096 00000080:00200000:3.0:1788201595.593144:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000fc515734[3 0000000092c56bd2 2 1 0000000000e48688 0 0 13] 00000080:00200000:3.0:1788201595.593147:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000056ccd3be 17ffffc0001001 3:0 ffff8bc17254e540 13 lru 00000080:00200000:3.0:1788201595.593152:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f437cadc 13: 1< 0 - - > 2< 53248 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.593153:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000fc515734 00000080:00200000:3.0:1788201595.593155:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 14. 00000080:00200000:3.0:1788201595.593156:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 14 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.593173:0:24470:0:(rw26.c:898:ll_write_end()) pos 57344, len 4096, copied 4096 00000080:00200000:3.0:1788201595.593177:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002c2e7a2a[3 0000000092c56bd2 2 1 0000000000e48688 0 0 14] 00000080:00200000:3.0:1788201595.593179:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000053d007e5 17ffffc0001001 3:0 ffff8bc17254e8c0 14 lru 00000080:00200000:3.0:1788201595.593184:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d85bd2eb 14: 1< 0 - - > 2< 57344 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.593186:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002c2e7a2a 00000080:00200000:3.0:1788201595.593187:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 15. 00000080:00200000:3.0:1788201595.593189:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 15 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.593203:0:24470:0:(rw26.c:898:ll_write_end()) pos 61440, len 4096, copied 4096 00000080:00200000:3.0:1788201595.593207:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ba622fb0[3 0000000092c56bd2 2 1 0000000000e48688 0 0 15] 00000080:00200000:3.0:1788201595.593210:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000c09b86cd 17ffffc0001001 3:0 ffff8bc17254ee00 15 lru 00000080:00200000:3.0:1788201595.593214:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001f404abc 15: 1< 0 - - > 2< 61440 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.593216:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ba622fb0 00000080:00200000:3.0:1788201595.593218:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 16. 00000080:00200000:3.0:1788201595.593220:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 16 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.593233:0:24470:0:(rw26.c:898:ll_write_end()) pos 65536, len 4096, copied 4096 00000080:00200000:3.0:1788201595.593237:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000bdba17aa[3 0000000092c56bd2 2 1 0000000000e48688 0 0 16] 00000080:00200000:3.0:1788201595.593240:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000dd90c55e 17ffffc0001001 3:0 ffff8bc17254eee0 16 lru 00000080:00200000:3.0:1788201595.593245:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000095316e56 16: 1< 0 - - > 2< 65536 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.593247:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000bdba17aa 00000080:00200000:3.0:1788201595.593248:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 17. 00000080:00200000:3.0:1788201595.593251:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 17 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.593265:0:24470:0:(rw26.c:898:ll_write_end()) pos 69632, len 4096, copied 4096 00000080:00200000:3.0:1788201595.593269:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003aa33d37[3 0000000092c56bd2 2 1 0000000000e48688 0 0 17] 00000080:00200000:3.0:1788201595.593272:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000008941a3a 17ffffc0001001 3:0 ffff8bc17254e620 17 lru 00000080:00200000:3.0:1788201595.593276:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001a79b206 17: 1< 0 - - > 2< 69632 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.593279:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003aa33d37 00000080:00200000:3.0:1788201595.593280:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 18. 00000080:00200000:3.0:1788201595.593281:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 18 of 0 to 4096 bytes 00000080:00200000:3.0:1788201595.593297:0:24470:0:(rw26.c:898:ll_write_end()) pos 73728, len 4096, copied 4096 00000080:00200000:3.0:1788201595.593301:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ce9776bc[3 0000000092c56bd2 2 1 0000000000e48688 0 0 18] 00000080:00200000:3.0:1788201595.593304:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f087338c 17ffffc0001001 3:0 ffff8bc17254e7e0 18 lru 00000080:00200000:3.0:1788201595.593309:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000002e7aae97 18: 1< 0 - - > 2< 73728 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1788201595.593311:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ce9776bc 00000080:00200000:3.0:1788201595.593987:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 19. 00000100:00100000:2.0:1788201595.594147:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728037120:192.168.201.143@tcp:103:ldlm_bl.0 00000080:00200000:2.0:1788201595.594187:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 19 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.594224:0:24470:0:(rw26.c:898:ll_write_end()) pos 77824, len 4096, copied 4096 00000080:00200000:2.0:1788201595.594231:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000068289a0c[3 0000000092c56bd2 2 1 0000000000e48688 0 0 19] 00000080:00200000:2.0:1788201595.594234:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b5da0e7d 17ffffc0001001 3:0 ffff8bc172622ee0 19 lru 00000080:00200000:2.0:1788201595.594241:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000402473ed 19: 1< 0 - - > 2< 77824 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.594244:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000068289a0c 00000080:00200000:2.0:1788201595.594246:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 20. 00000080:00200000:2.0:1788201595.594248:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 20 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.594264:0:24470:0:(rw26.c:898:ll_write_end()) pos 81920, len 4096, copied 4096 00000080:00200000:2.0:1788201595.594269:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000039459cf0[3 0000000092c56bd2 2 1 0000000000e48688 0 0 20] 00000080:00200000:2.0:1788201595.594272:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008934ec83 17ffffc0001001 3:0 ffff8bc172622620 20 lru 00000080:00200000:2.0:1788201595.594277:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000e746deb 20: 1< 0 - - > 2< 81920 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.594279:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000039459cf0 00000080:00200000:2.0:1788201595.594280:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 21. 00000080:00200000:2.0:1788201595.594282:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 21 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.594301:0:24470:0:(rw26.c:898:ll_write_end()) pos 86016, len 4096, copied 4096 00000080:00200000:2.0:1788201595.594305:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f60fe365[3 0000000092c56bd2 2 1 0000000000e48688 0 0 21] 00000080:00200000:2.0:1788201595.594308:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d553a6c1 17ffffc0001001 3:0 ffff8bc1726227e0 21 lru 00000080:00200000:2.0:1788201595.594482:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000078b0876b 21: 1< 0 - - > 2< 86016 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.594486:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f60fe365 00000080:00200000:2.0:1788201595.594487:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 22. 00000080:00200000:2.0:1788201595.594490:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 22 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.594508:0:24470:0:(rw26.c:898:ll_write_end()) pos 90112, len 4096, copied 4096 00000080:00200000:2.0:1788201595.594524:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000084daaad8[3 0000000092c56bd2 2 1 0000000000e48688 0 0 22] 00000080:00200000:2.0:1788201595.594527:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006d9b835f 17ffffc0001001 3:0 ffff8bc172622700 22 lru 00000080:00200000:2.0:1788201595.594533:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000009c3a3c8 22: 1< 0 - - > 2< 90112 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.594535:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000084daaad8 00000080:00200000:2.0:1788201595.594536:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 23. 00000080:00200000:2.0:1788201595.594538:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 23 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.594555:0:24470:0:(rw26.c:898:ll_write_end()) pos 94208, len 4096, copied 4096 00000080:00200000:2.0:1788201595.594561:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008b7f449f[3 0000000092c56bd2 2 1 0000000000e48688 0 0 23] 00000080:00200000:2.0:1788201595.594563:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001d3d4728 17ffffc0001001 3:0 ffff8bc172622b60 23 lru 00000080:00200000:2.0:1788201595.594568:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000eb3b5c82 23: 1< 0 - - > 2< 94208 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.594571:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008b7f449f 00000080:00200000:2.0:1788201595.594572:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 24. 00000080:00200000:2.0:1788201595.594573:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 24 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.594588:0:24470:0:(rw26.c:898:ll_write_end()) pos 98304, len 4096, copied 4096 00000080:00200000:2.0:1788201595.594592:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000077f62c00[3 0000000092c56bd2 2 1 0000000000e48688 0 0 24] 00000080:00200000:2.0:1788201595.594596:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d946a5b6 17ffffc0001001 3:0 ffff8bc1726222a0 24 lru 00000080:00200000:2.0:1788201595.594600:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000008ff13f6a 24: 1< 0 - - > 2< 98304 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.594602:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000077f62c00 00000080:00200000:2.0:1788201595.594603:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 25. 00000080:00200000:2.0:1788201595.594605:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 25 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.594633:0:24470:0:(rw26.c:898:ll_write_end()) pos 102400, len 4096, copied 4096 00000080:00200000:2.0:1788201595.594637:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f0684f44[3 0000000092c56bd2 2 1 0000000000e48688 0 0 25] 00000080:00200000:2.0:1788201595.594640:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000d2ac8896 17ffffc0001001 3:0 ffff8bc150a4eee0 25 lru 00000080:00200000:2.0:1788201595.594645:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e71cf0c1 25: 1< 0 - - > 2< 102400 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.594647:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f0684f44 00000080:00200000:2.0:1788201595.594648:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 26. 00000080:00200000:2.0:1788201595.594650:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 26 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.594666:0:24470:0:(rw26.c:898:ll_write_end()) pos 106496, len 4096, copied 4096 00000080:00200000:2.0:1788201595.594670:0:24470:0:(rw26.c:956:ll_write_end()) page@000000005a121d19[3 0000000092c56bd2 2 1 0000000000e48688 0 0 26] 00000080:00200000:2.0:1788201595.594673:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a1cef3e1 17ffffc0001001 3:0 ffff8bc150a4e620 26 lru 00000080:00200000:2.0:1788201595.594678:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d0167119 26: 1< 0 - - > 2< 106496 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.594680:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000005a121d19 00000080:00200000:2.0:1788201595.594681:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 27. 00000080:00200000:2.0:1788201595.594683:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 27 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.594698:0:24470:0:(rw26.c:898:ll_write_end()) pos 110592, len 4096, copied 4096 00000080:00200000:2.0:1788201595.594702:0:24470:0:(rw26.c:956:ll_write_end()) page@000000009d78df58[3 0000000092c56bd2 2 1 0000000000e48688 0 0 27] 00000080:00200000:2.0:1788201595.594705:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000032b77fe7 17ffffc0001001 3:0 ffff8bc150a4e7e0 27 lru 00000080:00200000:2.0:1788201595.594709:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b867d655 27: 1< 0 - - > 2< 110592 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.594711:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000009d78df58 00000080:00200000:2.0:1788201595.594713:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 28. 00000080:00200000:2.0:1788201595.594714:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 28 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.594731:0:24470:0:(rw26.c:898:ll_write_end()) pos 114688, len 4096, copied 4096 00000080:00200000:2.0:1788201595.594734:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000eff54e61[3 0000000092c56bd2 2 1 0000000000e48688 0 0 28] 00000080:00200000:2.0:1788201595.594736:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000dce6c3df 17ffffc0001001 3:0 ffff8bc150a4e700 28 lru 00000080:00200000:2.0:1788201595.594741:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007ec64294 28: 1< 0 - - > 2< 114688 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.594743:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000eff54e61 00000080:00200000:2.0:1788201595.594744:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 29. 00000080:00200000:2.0:1788201595.594746:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 29 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.594759:0:24470:0:(rw26.c:898:ll_write_end()) pos 118784, len 4096, copied 4096 00000080:00200000:2.0:1788201595.594763:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003930be88[3 0000000092c56bd2 2 1 0000000000e48688 0 0 29] 00000080:00200000:2.0:1788201595.594766:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006641bb51 17ffffc0001001 3:0 ffff8bc150a4eb60 29 lru 00000080:00200000:2.0:1788201595.594770:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000a66c889a 29: 1< 0 - - > 2< 118784 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.594772:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003930be88 00000080:00200000:2.0:1788201595.594773:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 30. 00000080:00200000:2.0:1788201595.594774:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 30 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.594788:0:24470:0:(rw26.c:898:ll_write_end()) pos 122880, len 4096, copied 4096 00000080:00200000:2.0:1788201595.594827:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d7242f14[3 0000000092c56bd2 2 1 0000000000e48688 0 0 30] 00000080:00200000:2.0:1788201595.594830:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f1a73023 17ffffc0001001 3:0 ffff8bc150a4e2a0 30 lru 00000080:00200000:2.0:1788201595.594835:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000de44ed73 30: 1< 0 - - > 2< 122880 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.594837:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d7242f14 00000080:00200000:2.0:1788201595.594839:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 31. 00000080:00200000:2.0:1788201595.594841:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 31 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.594868:0:24470:0:(rw26.c:898:ll_write_end()) pos 126976, len 4096, copied 4096 00000080:00200000:2.0:1788201595.594872:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000952091e5[3 0000000092c56bd2 2 1 0000000000e48688 0 0 31] 00000080:00200000:2.0:1788201595.594875:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f02003b4 17ffffc0001021 2:0 ffff8bc150a4e460 31 lru 00000080:00200000:2.0:1788201595.594880:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000dd036c01 31: 1< 0 - - > 2< 126976 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.594882:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000952091e5 00000080:00200000:2.0:1788201595.594884:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 32. 00000080:00200000:2.0:1788201595.594886:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 32 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.594901:0:24470:0:(rw26.c:898:ll_write_end()) pos 131072, len 4096, copied 4096 00000080:00200000:2.0:1788201595.594905:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e81828df[3 0000000092c56bd2 2 1 0000000000e48688 0 0 32] 00000080:00200000:2.0:1788201595.594908:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000003b148947 17ffffc0001001 3:0 ffff8bc150a4ed20 32 lru 00000080:00200000:2.0:1788201595.594913:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000ab2b380 32: 1< 0 - - > 2< 131072 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.594915:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e81828df 00000080:00200000:2.0:1788201595.594916:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 33. 00000080:00200000:2.0:1788201595.594918:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 33 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.594935:0:24470:0:(rw26.c:898:ll_write_end()) pos 135168, len 4096, copied 4096 00000080:00200000:2.0:1788201595.594939:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b0c47069[3 0000000092c56bd2 2 1 0000000000e48688 0 0 33] 00000080:00200000:2.0:1788201595.594943:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a36d48a6 17ffffc0001001 3:0 ffff8bc150a4e000 33 lru 00000080:00200000:2.0:1788201595.594948:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f2c54802 33: 1< 0 - - > 2< 135168 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.594951:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b0c47069 00000080:00200000:2.0:1788201595.594952:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 34. 00000080:00200000:2.0:1788201595.594954:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 34 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.594970:0:24470:0:(rw26.c:898:ll_write_end()) pos 139264, len 4096, copied 4096 00000080:00200000:2.0:1788201595.594974:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000015ad6a00[3 0000000092c56bd2 2 1 0000000000e48688 0 0 34] 00000080:00200000:2.0:1788201595.594977:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000bed9e1b6 17ffffc0001001 3:0 ffff8bc150a4e380 34 lru 00000080:00200000:2.0:1788201595.594983:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000f4a6da61 34: 1< 0 - - > 2< 139264 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.594985:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000015ad6a00 00000080:00200000:2.0:1788201595.594986:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 35. 00000080:00200000:2.0:1788201595.594988:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 35 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.595004:0:24470:0:(rw26.c:898:ll_write_end()) pos 143360, len 4096, copied 4096 00000080:00200000:2.0:1788201595.595007:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000030cc8bf[3 0000000092c56bd2 2 1 0000000000e48688 0 0 35] 00000080:00200000:2.0:1788201595.595010:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000076c7e48b 17ffffc0001001 3:0 ffff8bc150a4e1c0 35 lru 00000080:00200000:2.0:1788201595.595014:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005a7990f7 35: 1< 0 - - > 2< 143360 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.595016:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000030cc8bf 00000080:00200000:2.0:1788201595.595017:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 36. 00000080:00200000:2.0:1788201595.595019:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 36 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.595032:0:24470:0:(rw26.c:898:ll_write_end()) pos 147456, len 4096, copied 4096 00000080:00200000:2.0:1788201595.595035:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c2dcba59[3 0000000092c56bd2 2 1 0000000000e48688 0 0 36] 00000080:00200000:2.0:1788201595.595038:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008b970a50 17ffffc0001001 3:0 ffff8bc150a4e0e0 36 lru 00000080:00200000:2.0:1788201595.595042:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c352aaad 36: 1< 0 - - > 2< 147456 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.595044:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c2dcba59 00000080:00200000:2.0:1788201595.595045:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 37. 00000080:00200000:2.0:1788201595.595046:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 37 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.595059:0:24470:0:(rw26.c:898:ll_write_end()) pos 151552, len 4096, copied 4096 00000080:00200000:2.0:1788201595.595063:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000241a38bf[3 0000000092c56bd2 2 1 0000000000e48688 0 0 37] 00000080:00200000:2.0:1788201595.595066:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006ec08242 17ffffc0001001 3:0 ffff8bc150a4e9a0 37 lru 00000080:00200000:2.0:1788201595.595071:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000003992dc5b 37: 1< 0 - - > 2< 151552 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.595073:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000241a38bf 00000080:00200000:2.0:1788201595.595074:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 38. 00000080:00200000:2.0:1788201595.595076:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 38 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.595089:0:24470:0:(rw26.c:898:ll_write_end()) pos 155648, len 4096, copied 4096 00000080:00200000:2.0:1788201595.595093:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f6f4d373[3 0000000092c56bd2 2 1 0000000000e48688 0 0 38] 00000080:00200000:2.0:1788201595.595095:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001d43653f 17ffffc0001001 3:0 ffff8bc150a4ec40 38 lru 00000080:00200000:2.0:1788201595.595099:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d21631e5 38: 1< 0 - - > 2< 155648 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.595101:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f6f4d373 00000080:00200000:2.0:1788201595.595102:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 39. 00000080:00200000:2.0:1788201595.595104:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 39 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.595130:0:24470:0:(rw26.c:898:ll_write_end()) pos 159744, len 4096, copied 4096 00000080:00200000:2.0:1788201595.595134:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006a8b86e4[3 0000000092c56bd2 2 1 0000000000e48688 0 0 39] 00000080:00200000:2.0:1788201595.595138:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000da0d238d 17ffffc0001001 3:0 ffff8bc150a4ea80 39 lru 00000080:00200000:2.0:1788201595.595142:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000843ef896 39: 1< 0 - - > 2< 159744 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.595144:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006a8b86e4 00000080:00200000:2.0:1788201595.595146:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 40. 00000080:00200000:2.0:1788201595.595147:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 40 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.595162:0:24470:0:(rw26.c:898:ll_write_end()) pos 163840, len 4096, copied 4096 00000080:00200000:2.0:1788201595.595166:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000fcb2bacf[3 0000000092c56bd2 2 1 0000000000e48688 0 0 40] 00000080:00200000:2.0:1788201595.595168:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000871cf9e2 17ffffc0001001 3:0 ffff8bc150a4e540 40 lru 00000080:00200000:2.0:1788201595.595172:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000022d6bc53 40: 1< 0 - - > 2< 163840 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.595174:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000fcb2bacf 00000080:00200000:2.0:1788201595.595175:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 41. 00000080:00200000:2.0:1788201595.595177:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 41 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.595191:0:24470:0:(rw26.c:898:ll_write_end()) pos 167936, len 4096, copied 4096 00000080:00200000:2.0:1788201595.595194:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a06b3474[3 0000000092c56bd2 2 1 0000000000e48688 0 0 41] 00000080:00200000:2.0:1788201595.595197:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008f8a6c12 17ffffc0001001 3:0 ffff8bc150a4e8c0 41 lru 00000080:00200000:2.0:1788201595.595201:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004113f54f 41: 1< 0 - - > 2< 167936 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.595204:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a06b3474 00000080:00200000:2.0:1788201595.595205:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 42. 00000080:00200000:2.0:1788201595.595206:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 42 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.595220:0:24470:0:(rw26.c:898:ll_write_end()) pos 172032, len 4096, copied 4096 00000080:00200000:2.0:1788201595.595224:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000011f77600[3 0000000092c56bd2 2 1 0000000000e48688 0 0 42] 00000080:00200000:2.0:1788201595.595227:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000cccbe809 17ffffc0001001 3:0 ffff8bc150a4ee00 42 lru 00000080:00200000:2.0:1788201595.595231:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000041efaa59 42: 1< 0 - - > 2< 172032 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.595233:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000011f77600 00000080:00200000:2.0:1788201595.595234:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 43. 00000080:00200000:2.0:1788201595.595235:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 43 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.595260:0:24470:0:(rw26.c:898:ll_write_end()) pos 176128, len 4096, copied 4096 00000080:00200000:2.0:1788201595.595263:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000f6809c00[3 0000000092c56bd2 2 1 0000000000e48688 0 0 43] 00000080:00200000:2.0:1788201595.595266:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000afeb4d52 17ffffc0001001 3:0 ffff8bc149fed380 43 lru 00000080:00200000:2.0:1788201595.595270:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000d4f7dbca 43: 1< 0 - - > 2< 176128 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.595272:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000f6809c00 00000080:00200000:2.0:1788201595.595273:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 44. 00000080:00200000:2.0:1788201595.595274:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 44 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.595288:0:24470:0:(rw26.c:898:ll_write_end()) pos 180224, len 4096, copied 4096 00000080:00200000:2.0:1788201595.595291:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e5dc13db[3 0000000092c56bd2 2 1 0000000000e48688 0 0 44] 00000080:00200000:2.0:1788201595.595294:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b646f799 17ffffc0001001 3:0 ffff8bc149fed1c0 44 lru 00000080:00200000:2.0:1788201595.595298:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000401c4612 44: 1< 0 - - > 2< 180224 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.595300:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e5dc13db 00000080:00200000:2.0:1788201595.595301:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 45. 00000080:00200000:2.0:1788201595.595303:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 45 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.595940:0:24470:0:(rw26.c:898:ll_write_end()) pos 184320, len 4096, copied 4096 00000080:00200000:2.0:1788201595.595949:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c62b4536[3 0000000092c56bd2 2 1 0000000000e48688 0 0 45] 00000080:00200000:2.0:1788201595.595952:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000483b7537 17ffffc0001001 3:0 ffff8bc149fed0e0 45 lru 00000080:00200000:2.0:1788201595.595957:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005832646d 45: 1< 0 - - > 2< 184320 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.595960:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c62b4536 00000080:00200000:2.0:1788201595.595961:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 46. 00000080:00200000:2.0:1788201595.595964:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 46 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.595997:0:24470:0:(rw26.c:898:ll_write_end()) pos 188416, len 4096, copied 4096 00000080:00200000:2.0:1788201595.596001:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ebf14fc1[3 0000000092c56bd2 2 1 0000000000e48688 0 0 46] 00000080:00200000:2.0:1788201595.596004:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000aac53cc1 17ffffc0001021 2:0 ffff8bc149fed9a0 46 lru 00000080:00200000:2.0:1788201595.596009:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000017368f57 46: 1< 0 - - > 2< 188416 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.596011:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ebf14fc1 00000080:00200000:2.0:1788201595.596013:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 47. 00000080:00200000:2.0:1788201595.596015:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 47 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.596030:0:24470:0:(rw26.c:898:ll_write_end()) pos 192512, len 4096, copied 4096 00000080:00200000:2.0:1788201595.596034:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000cfbf61d0[3 0000000092c56bd2 2 1 0000000000e48688 0 0 47] 00000080:00200000:2.0:1788201595.596037:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b14e2dbb 17ffffc0001001 3:0 ffff8bc149fedc40 47 lru 00000080:00200000:2.0:1788201595.596042:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000399d8a5e 47: 1< 0 - - > 2< 192512 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.596044:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000cfbf61d0 00000080:00200000:2.0:1788201595.596045:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 48. 00000080:00200000:2.0:1788201595.596047:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 48 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.596062:0:24470:0:(rw26.c:898:ll_write_end()) pos 196608, len 4096, copied 4096 00000080:00200000:2.0:1788201595.596066:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000d3e108ff[3 0000000092c56bd2 2 1 0000000000e48688 0 0 48] 00000080:00200000:2.0:1788201595.596069:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e0db0023 17ffffc0001001 3:0 ffff8bc149feda80 48 lru 00000080:00200000:2.0:1788201595.596074:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000085a4caa0 48: 1< 0 - - > 2< 196608 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.596076:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000d3e108ff 00000080:00200000:2.0:1788201595.596077:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 49. 00000080:00200000:2.0:1788201595.596079:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 49 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.596098:0:24470:0:(rw26.c:898:ll_write_end()) pos 200704, len 4096, copied 4096 00000080:00200000:2.0:1788201595.596103:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c8d25ca7[3 0000000092c56bd2 2 1 0000000000e48688 0 0 49] 00000080:00200000:2.0:1788201595.596106:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000274f40e9 17ffffc0001001 3:0 ffff8bc149fed540 49 lru 00000080:00200000:2.0:1788201595.596111:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e208c56f 49: 1< 0 - - > 2< 200704 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.596113:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c8d25ca7 00000080:00200000:2.0:1788201595.596208:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 50. 00000080:00200000:2.0:1788201595.596211:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 50 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.596231:0:24470:0:(rw26.c:898:ll_write_end()) pos 204800, len 4096, copied 4096 00000080:00200000:2.0:1788201595.596235:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000041462a40[3 0000000092c56bd2 2 1 0000000000e48688 0 0 50] 00000080:00200000:2.0:1788201595.596238:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ac18dcf2 17ffffc0001001 3:0 ffff8bc149fed8c0 50 lru 00000080:00200000:2.0:1788201595.596243:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c7b3fed1 50: 1< 0 - - > 2< 204800 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.596245:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000041462a40 00000080:00200000:2.0:1788201595.596246:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 51. 00000080:00200000:2.0:1788201595.596248:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 51 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.596262:0:24470:0:(rw26.c:898:ll_write_end()) pos 208896, len 4096, copied 4096 00000080:00200000:2.0:1788201595.596266:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006bddc82b[3 0000000092c56bd2 2 1 0000000000e48688 0 0 51] 00000080:00200000:2.0:1788201595.596269:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006416e318 17ffffc0001001 3:0 ffff8bc149fede00 51 lru 00000080:00200000:2.0:1788201595.596275:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000000c458c0b 51: 1< 0 - - > 2< 208896 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.596277:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006bddc82b 00000080:00200000:2.0:1788201595.596278:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 52. 00000080:00200000:2.0:1788201595.596280:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 52 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.596295:0:24470:0:(rw26.c:898:ll_write_end()) pos 212992, len 4096, copied 4096 00000080:00200000:2.0:1788201595.596299:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000010ab722f[3 0000000092c56bd2 2 1 0000000000e48688 0 0 52] 00000080:00200000:2.0:1788201595.596302:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b74e9523 17ffffc0001001 3:0 ffff8bc149fedee0 52 lru 00000080:00200000:2.0:1788201595.596308:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000001fa3336e 52: 1< 0 - - > 2< 212992 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.596310:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000010ab722f 00000080:00200000:2.0:1788201595.596388:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 53. 00000080:00200000:2.0:1788201595.596391:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 53 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.596409:0:24470:0:(rw26.c:898:ll_write_end()) pos 217088, len 4096, copied 4096 00000080:00200000:2.0:1788201595.596413:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000da862016[3 0000000092c56bd2 2 1 0000000000e48688 0 0 53] 00000080:00200000:2.0:1788201595.596416:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000906295f0 17ffffc0001001 3:0 ffff8bc149fed620 53 lru 00000080:00200000:2.0:1788201595.596421:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000debdfa25 53: 1< 0 - - > 2< 217088 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.596423:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000da862016 00000080:00200000:2.0:1788201595.596424:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 54. 00000080:00200000:2.0:1788201595.596426:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 54 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.596440:0:24470:0:(rw26.c:898:ll_write_end()) pos 221184, len 4096, copied 4096 00000080:00200000:2.0:1788201595.596445:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000036530949[3 0000000092c56bd2 2 1 0000000000e48688 0 0 54] 00000080:00200000:2.0:1788201595.596447:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000004e032cbb 17ffffc0001001 3:0 ffff8bc149fed7e0 54 lru 00000080:00200000:2.0:1788201595.596452:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c04625b5 54: 1< 0 - - > 2< 221184 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.596454:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000036530949 00000080:00200000:2.0:1788201595.596455:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 55. 00000080:00200000:2.0:1788201595.596457:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 55 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.596471:0:24470:0:(rw26.c:898:ll_write_end()) pos 225280, len 4096, copied 4096 00000080:00200000:2.0:1788201595.596474:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000b8e07ed5[3 0000000092c56bd2 2 1 0000000000e48688 0 0 55] 00000080:00200000:2.0:1788201595.596476:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000bcec9b5c 17ffffc0001001 3:0 ffff8bc149fed700 55 lru 00000080:00200000:2.0:1788201595.596481:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009fa8d97c 55: 1< 0 - - > 2< 225280 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.596482:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000b8e07ed5 00000080:00200000:2.0:1788201595.596484:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 56. 00000080:00200000:2.0:1788201595.596486:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 56 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.596503:0:24470:0:(rw26.c:898:ll_write_end()) pos 229376, len 4096, copied 4096 00000080:00200000:2.0:1788201595.596507:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c5f3f1d6[3 0000000092c56bd2 2 1 0000000000e48688 0 0 56] 00000080:00200000:2.0:1788201595.596584:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000016c14ee 17ffffc0001001 3:0 ffff8bc149fedb60 56 lru 00000080:00200000:2.0:1788201595.596589:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000062ec32f 56: 1< 0 - - > 2< 229376 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.596591:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c5f3f1d6 00000080:00200000:2.0:1788201595.596593:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 57. 00000080:00200000:2.0:1788201595.596595:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 57 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.596614:0:24470:0:(rw26.c:898:ll_write_end()) pos 233472, len 4096, copied 4096 00000080:00200000:2.0:1788201595.596618:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ccd890a2[3 0000000092c56bd2 2 1 0000000000e48688 0 0 57] 00000080:00200000:2.0:1788201595.596621:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006c8b7aa2 17ffffc0001001 3:0 ffff8bc149fed2a0 57 lru 00000080:00200000:2.0:1788201595.596626:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000073c00f53 57: 1< 0 - - > 2< 233472 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.596628:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ccd890a2 00000080:00200000:2.0:1788201595.596629:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 58. 00000080:00200000:2.0:1788201595.596631:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 58 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.596646:0:24470:0:(rw26.c:898:ll_write_end()) pos 237568, len 4096, copied 4096 00000080:00200000:2.0:1788201595.596650:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000cffff6de[3 0000000092c56bd2 2 1 0000000000e48688 0 0 58] 00000080:00200000:2.0:1788201595.596652:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000001db114fd 17ffffc0001001 3:0 ffff8bc149fed460 58 lru 00000080:00200000:2.0:1788201595.596657:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000035cb152f 58: 1< 0 - - > 2< 237568 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.596660:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000cffff6de 00000080:00200000:2.0:1788201595.596661:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 59. 00000080:00200000:2.0:1788201595.596662:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 59 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.596678:0:24470:0:(rw26.c:898:ll_write_end()) pos 241664, len 4096, copied 4096 00000080:00200000:2.0:1788201595.596682:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007f99270b[3 0000000092c56bd2 2 1 0000000000e48688 0 0 59] 00000080:00200000:2.0:1788201595.596685:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006fcc1eb7 17ffffc0001001 3:0 ffff8bc149fedd20 59 lru 00000080:00200000:2.0:1788201595.596690:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000060af05af 59: 1< 0 - - > 2< 241664 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.596692:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007f99270b 00000080:00200000:2.0:1788201595.596693:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 60. 00000080:00200000:2.0:1788201595.596695:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 60 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.596711:0:24470:0:(rw26.c:898:ll_write_end()) pos 245760, len 4096, copied 4096 00000080:00200000:2.0:1788201595.596715:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000013843884[3 0000000092c56bd2 2 1 0000000000e48688 0 0 60] 00000080:00200000:2.0:1788201595.596718:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000002b9f46f5 17ffffc0001001 3:0 ffff8bc149fed000 60 lru 00000080:00200000:2.0:1788201595.596724:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000509ffe77 60: 1< 0 - - > 2< 245760 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.596726:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000013843884 00000080:00200000:2.0:1788201595.596728:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 61. 00000080:00200000:2.0:1788201595.596730:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 61 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.596765:0:24470:0:(rw26.c:898:ll_write_end()) pos 249856, len 4096, copied 4096 00000080:00200000:2.0:1788201595.596771:0:24470:0:(rw26.c:956:ll_write_end()) page@000000000f12bc4b[3 0000000092c56bd2 2 1 0000000000e48688 0 0 61] 00000080:00200000:2.0:1788201595.596774:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000f5ebea07 17ffffc0001021 2:0 ffff8bc146dab2a0 61 lru 00000080:00200000:2.0:1788201595.596779:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000038128c4d 61: 1< 0 - - > 2< 249856 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.596781:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000000f12bc4b 00000080:00200000:2.0:1788201595.596782:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 62. 00000080:00200000:2.0:1788201595.596784:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 62 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.597923:0:24470:0:(rw26.c:898:ll_write_end()) pos 253952, len 4096, copied 4096 00000080:00200000:2.0:1788201595.597936:0:24470:0:(rw26.c:956:ll_write_end()) page@000000004f907fa7[3 0000000092c56bd2 2 1 0000000000e48688 0 0 62] 00000080:00200000:2.0:1788201595.597939:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a6984b72 17ffffc0001001 3:0 ffff8bc146dab460 62 lru 00000080:00200000:2.0:1788201595.597946:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009837448d 62: 1< 0 - - > 2< 253952 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.597948:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000004f907fa7 00000080:00200000:2.0:1788201595.597950:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 63. 00000080:00200000:2.0:1788201595.597952:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 63 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.597980:0:24470:0:(rw26.c:898:ll_write_end()) pos 258048, len 4096, copied 4096 00000080:00200000:2.0:1788201595.597985:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000e54e4cd1[3 0000000092c56bd2 2 1 0000000000e48688 0 0 63] 00000080:00200000:2.0:1788201595.597988:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000008a931d47 17ffffc0001001 3:0 ffff8bc146dabd20 63 lru 00000080:00200000:2.0:1788201595.597993:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000005f1ac171 63: 1< 0 - - > 2< 258048 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.597995:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000e54e4cd1 00000080:00200000:2.0:1788201595.597996:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 64. 00000080:00200000:2.0:1788201595.597999:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 64 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.598029:0:24470:0:(rw26.c:898:ll_write_end()) pos 262144, len 4096, copied 4096 00000080:00200000:2.0:1788201595.598034:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000056629307[3 0000000092c56bd2 2 1 0000000000e48688 0 0 64] 00000080:00200000:2.0:1788201595.598037:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000007a9124b5 17ffffc0001001 3:0 ffff8bc146dab000 64 lru 00000080:00200000:2.0:1788201595.598042:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c519000d 64: 1< 0 - - > 2< 262144 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.598044:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000056629307 00000080:00200000:2.0:1788201595.598046:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 65. 00000080:00200000:2.0:1788201595.598048:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 65 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.598064:0:24470:0:(rw26.c:898:ll_write_end()) pos 266240, len 4096, copied 4096 00000080:00200000:2.0:1788201595.598069:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a4037bf6[3 0000000092c56bd2 2 1 0000000000e48688 0 0 65] 00000080:00200000:2.0:1788201595.598072:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000807bc431 17ffffc0001001 3:0 ffff8bc146dab380 65 lru 00000080:00200000:2.0:1788201595.598077:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004ec4416e 65: 1< 0 - - > 2< 266240 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.598079:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a4037bf6 00000080:00200000:2.0:1788201595.598081:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 66. 00000080:00200000:2.0:1788201595.598082:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 66 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.598099:0:24470:0:(rw26.c:898:ll_write_end()) pos 270336, len 4096, copied 4096 00000080:00200000:2.0:1788201595.598103:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000016e7d724[3 0000000092c56bd2 2 1 0000000000e48688 0 0 66] 00000080:00200000:2.0:1788201595.598106:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000ef9ade95 17ffffc0001001 3:0 ffff8bc146dab1c0 66 lru 00000080:00200000:2.0:1788201595.598110:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000bc74bfa5 66: 1< 0 - - > 2< 270336 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.598112:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000016e7d724 00000080:00200000:2.0:1788201595.598113:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 67. 00000080:00200000:2.0:1788201595.598481:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 67 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.598501:0:24470:0:(rw26.c:898:ll_write_end()) pos 274432, len 4096, copied 4096 00000080:00200000:2.0:1788201595.598506:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007295952d[3 0000000092c56bd2 2 1 0000000000e48688 0 0 67] 00000080:00200000:2.0:1788201595.598572:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000024c58c3f 17ffffc0001001 3:0 ffff8bc146dab0e0 67 lru 00000080:00200000:2.0:1788201595.598579:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000e6ef6ba8 67: 1< 0 - - > 2< 274432 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.598581:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007295952d 00000080:00200000:2.0:1788201595.598583:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 68. 00000080:00200000:2.0:1788201595.598585:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 68 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.598601:0:24470:0:(rw26.c:898:ll_write_end()) pos 278528, len 4096, copied 4096 00000080:00200000:2.0:1788201595.598605:0:24470:0:(rw26.c:956:ll_write_end()) page@0000000017fdf081[3 0000000092c56bd2 2 1 0000000000e48688 0 0 68] 00000080:00200000:2.0:1788201595.598608:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000547300bc 17ffffc0001001 3:0 ffff8bc146dab9a0 68 lru 00000080:00200000:2.0:1788201595.598614:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b62d796c 68: 1< 0 - - > 2< 278528 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.598616:0:24470:0:(rw26.c:956:ll_write_end()) end page@0000000017fdf081 00000080:00200000:2.0:1788201595.598617:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 69. 00000080:00200000:2.0:1788201595.598618:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 69 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.598628:0:24470:0:(rw26.c:898:ll_write_end()) pos 282624, len 4096, copied 4096 00000080:00200000:2.0:1788201595.598632:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000c43a8ec5[3 0000000092c56bd2 2 1 0000000000e48688 0 0 69] 00000080:00200000:2.0:1788201595.598635:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000016ae20d7 17ffffc0001001 3:0 ffff8bc146dabc40 69 lru 00000080:00200000:2.0:1788201595.598640:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000927bb568 69: 1< 0 - - > 2< 282624 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.598642:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000c43a8ec5 00000080:00200000:2.0:1788201595.598644:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 70. 00000080:00200000:2.0:1788201595.598645:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 70 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.598658:0:24470:0:(rw26.c:898:ll_write_end()) pos 286720, len 4096, copied 4096 00000080:00200000:2.0:1788201595.598661:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000ce0ed2bf[3 0000000092c56bd2 2 1 0000000000e48688 0 0 70] 00000080:00200000:2.0:1788201595.598664:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000496c914b 17ffffc0001001 3:0 ffff8bc146daba80 70 lru 00000080:00200000:2.0:1788201595.598669:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000063740fa 70: 1< 0 - - > 2< 286720 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.598670:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000ce0ed2bf 00000080:00200000:2.0:1788201595.598672:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 71. 00000080:00200000:2.0:1788201595.598673:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 71 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.598687:0:24470:0:(rw26.c:898:ll_write_end()) pos 290816, len 4096, copied 4096 00000080:00200000:2.0:1788201595.598691:0:24470:0:(rw26.c:956:ll_write_end()) page@000000008a8af0af[3 0000000092c56bd2 2 1 0000000000e48688 0 0 71] 00000080:00200000:2.0:1788201595.598693:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @0000000017ad9d4a 17ffffc0001001 3:0 ffff8bc146dab540 71 lru 00000080:00200000:2.0:1788201595.598698:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000009f803ec7 71: 1< 0 - - > 2< 290816 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.598700:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000008a8af0af 00000080:00200000:2.0:1788201595.598702:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 72. 00000080:00200000:2.0:1788201595.598703:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 72 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.598717:0:24470:0:(rw26.c:898:ll_write_end()) pos 294912, len 4096, copied 4096 00000080:00200000:2.0:1788201595.598722:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000a00d5f3e[3 0000000092c56bd2 2 1 0000000000e48688 0 0 72] 00000080:00200000:2.0:1788201595.598725:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006fd3c6d5 17ffffc0001001 3:0 ffff8bc146dab8c0 72 lru 00000080:00200000:2.0:1788201595.598730:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000fa451221 72: 1< 0 - - > 2< 294912 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.598732:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000a00d5f3e 00000080:00200000:2.0:1788201595.598734:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 73. 00000080:00200000:2.0:1788201595.598735:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 73 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.598751:0:24470:0:(rw26.c:898:ll_write_end()) pos 299008, len 4096, copied 4096 00000080:00200000:2.0:1788201595.598755:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000eae28d23[3 0000000092c56bd2 2 1 0000000000e48688 0 0 73] 00000080:00200000:2.0:1788201595.598757:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b4277848 17ffffc0001001 3:0 ffff8bc146dabe00 73 lru 00000080:00200000:2.0:1788201595.598762:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000002110b3d0 73: 1< 0 - - > 2< 299008 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.598764:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000eae28d23 00000080:00200000:2.0:1788201595.598766:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 74. 00000080:00200000:2.0:1788201595.598768:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 74 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.598784:0:24470:0:(rw26.c:898:ll_write_end()) pos 303104, len 4096, copied 4096 00000080:00200000:2.0:1788201595.598818:0:24470:0:(rw26.c:956:ll_write_end()) page@000000003e5d3bd5[3 0000000092c56bd2 2 1 0000000000e48688 0 0 74] 00000080:00200000:2.0:1788201595.598822:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000b622435d 17ffffc0001001 3:0 ffff8bc146dabee0 74 lru 00000080:00200000:2.0:1788201595.598828:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000004197581e 74: 1< 0 - - > 2< 303104 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.598830:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000003e5d3bd5 00000080:00200000:2.0:1788201595.598831:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 75. 00000080:00200000:2.0:1788201595.598834:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 75 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.598851:0:24470:0:(rw26.c:898:ll_write_end()) pos 307200, len 4096, copied 4096 00000080:00200000:2.0:1788201595.598855:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000265fc58d[3 0000000092c56bd2 2 1 0000000000e48688 0 0 75] 00000080:00200000:2.0:1788201595.598858:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000379be812 17ffffc0001001 3:0 ffff8bc146dab620 75 lru 00000080:00200000:2.0:1788201595.598863:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000bdf978b8 75: 1< 0 - - > 2< 307200 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.598866:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000265fc58d 00000080:00200000:2.0:1788201595.598867:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 76. 00000080:00200000:2.0:1788201595.598869:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 76 of 0 to 4096 bytes 00000080:00200000:2.0:1788201595.598892:0:24470:0:(rw26.c:898:ll_write_end()) pos 311296, len 4096, copied 4096 00000080:00200000:2.0:1788201595.598897:0:24470:0:(rw26.c:956:ll_write_end()) page@000000002c0f8f1e[3 0000000092c56bd2 2 1 0000000000e48688 0 0 76] 00000080:00200000:2.0:1788201595.598901:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000e761287d 17ffffc0001021 2:0 ffff8bc146dab7e0 76 lru 00000080:00200000:2.0:1788201595.598906:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@000000007858f7e5 76: 1< 0 - - > 2< 311296 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.598908:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000002c0f8f1e 00000080:00200000:2.0:1788201595.598909:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 77. 00000080:00200000:2.0:1788201595.598911:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 77 of 0 to 1758 bytes 00000080:00200000:2.0:1788201595.598940:0:24470:0:(rw26.c:898:ll_write_end()) pos 315392, len 1758, copied 1758 00000080:00200000:2.0:1788201595.598944:0:24470:0:(rw26.c:956:ll_write_end()) page@000000007818b2b1[3 0000000092c56bd2 2 1 0000000000e48688 0 0 77] 00000080:00200000:2.0:1788201595.598947:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000a1c5f59c 17ffffc0001001 3:0 ffff8bc146dab700 77 lru 00000080:00200000:2.0:1788201595.598952:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@0000000043f6b038 77: 1< 0 - - > 2< 315392 0 0 0x0 0x0 | 000000008930e75a 00000000fc7eb627 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1788201595.598954:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000007818b2b1 00000080:00200000:2.0:1788201595.598955:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 78. 00000080:00200000:2.0:1788201595.598959:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 78, from 0, to 1758 prio 0 00000008:00010000:2.0:1788201595.599006:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 00000000fb431209 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1788201595.599050:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459b0278, count 15, dirtied 15 00000080:00200000:2.0:1788201595.599069:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459b0278, count 15, dirtied 15 00000080:00200000:2.0:1788201595.599085:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459b0278, count 15, dirtied 15 00000080:00200000:2.0:1788201595.599101:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459b0278, count 15, dirtied 15 00000080:00200000:2.0:1788201595.599267:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459b0278, count 15, dirtied 15 00000080:00200000:2.0:1788201595.599282:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc1459b0278, count 3, dirtied 3 00000080:00200000:2.0:1788201595.599286:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 78 pages 317150 bytes, tot: 317150 00000080:00200000:2.0:1788201595.599291:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) test-framework.sh: write bytes 0, result: 317150 00000020:00010000:2.0:1788201595.599395:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc148fb1f38 (ffff8bc1499c47e8/0) at cl_lock_release():245 00000020:00010000:2.0:1788201595.599400:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc148fb1f38 (ffff8bc1499c47e8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.599404:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc172456bb0 (ffff8bc1499c4d88/1) at cl_lock_cancel():142 00010000:00010000:2.0:1788201595.599414:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.599429:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1788201595.599453:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc148fb1f38 (ffff8bc1499c47e8/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201595.599456:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc172456bb0 (ffff8bc1499c47e8/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201595.599467:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 317150 bytes 00000080:00200000:2.0:1788201595.599475:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 77] 00000080:00200000:2.0:1788201595.599582:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a7:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201595.599587:0:24470:0:(file.c:2238:ll_file_io_generic()) test-framework.sh: 2 io complete with rc: 0, result: 317150, restart: 0 00000080:00200000:2.0:1788201595.599596:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a7:0x0] updating i_size 317150 i_blocks 1 00000080:00200000:2.0:1788201595.599602:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 317150 00000080:00200008:2.0:1788201595.599665:0:24470:0:(file.c:479:ll_file_release()) START file test-framework.sh:[0x200000bd7:0x1a7:0x0](ffff8bc1459b00c8), flags 100001 00000002:00100000:2.0:1788201595.599745:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc144140e00 x1875064728036736/t8589937488(8589937488) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201611 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1788201595.599760:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1788201595.599766:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172747800 x1875064728037376/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1788201595.599891:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172747800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728037376:192.168.201.143@tcp:35:cp.0 00000100:00100000:2.0:1788201595.600092:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.603444:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172747800 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728037376:192.168.201.143@tcp:35:cp.0 00000002:00100000:2.0:1788201595.603497:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc144140e00 x1875064728036736/t8589937488(8589937488) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 592/664 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201595.603669:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.608202:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.608245:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.608269:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.608281:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.608298:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.608303:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.608392:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201595.608398:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.608410:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.608438:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.608453:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201595.608464:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.608469:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=test-framework.sh, flags=8 00000080:00200008:2.0:1788201595.608483:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file test-framework.sh:[0x200000bd7:0x1a7:0x0](ffff8bc1459b00c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1788201595.608490:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x1a7:0x0](ffff8bc1459b00c8),name=test-framework.sh 00000002:00010000:2.0:1788201595.608581:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x1a7:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.608594:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710986c3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201595.608604:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710986c3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1788201595.608611:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.608616:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a7:0x0](ffff8bc1459b00c8) 00000080:00010000:2.0:1788201595.608619:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a7:0x0](ffff8bc1459b00c8) for lock 0xd138388016f6f95b 00000080:00010000:2.0:1788201595.608624:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f95b from it ffffadd1c7debcb8 00010000:00010000:2.0:1788201595.608628:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e21710986c3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201595.608637:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e21710986c3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201595.608701:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a7:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201595.608713:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x1a7:0x0] 00000008:00010000:2.0:1788201595.608749:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201595.608754:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261d130, osc lock ffff8bc151fc05f0, flags 0x400001002 00010000:00010000:2.0:1788201595.608773:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.608787:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:2.0:1788201595.608825:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1788201595.608830:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 6/0,1 mode: PW/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.608839:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1788201595.608852:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1788201595.608864:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a7:0x0] updating i_size 317150 i_blocks 1 00000020:00010000:2.0:1788201595.608869:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460044a0 (ffff8bc1469192d8/0) at cl_lock_release():245 00000020:00010000:2.0:1788201595.608872:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460044a0 (ffff8bc1469192d8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.608875:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261d130 (ffff8bc146919ea8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1788201595.608880:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460044a0 (ffff8bc1469192d8/0) at cl_lock_fini():72 00000020:00010000:2.0:1788201595.608882:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261d130 (ffff8bc1469192d8/1) at cl_lock_fini():72 00000080:00200000:2.0:1788201595.608920:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a7:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201595.609008:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.609018:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.609026:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.609035:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.609043:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.609048:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.609051:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.609055:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201595.609058:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.609066:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.609075:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.609080:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201595.609084:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.609100:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=yaml.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=9 00000080:00200000:2.0:1788201595.609105:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=yaml.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201595.609641:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: yaml.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201595.609710:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f970 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.609719:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f970 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.609732:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f970 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.609765:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172747b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728037504:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201595.609912:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.614715:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172747b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728037504:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201595.614747:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f970 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.614764:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f970 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.614772:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f970 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.614781:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f970 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.614815:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f970 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.614823:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1427ddc00 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:2.0:1788201595.614828:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f970 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.614836:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f970 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.614845:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f970 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.614854:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201595.614862:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f970 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.614869:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427ddc00/0xd138388016f6f970 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201595.614895:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc172747b80 x1875064728037504/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201595.614914:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1788201595.614944:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201595.615017:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.615034:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.615044:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.615056:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.615063:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.615069:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.615074:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.615080:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:2.0:1788201595.615085:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.615105:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.615218:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.615228:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201595.615234:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.615251:0:24470:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=yaml.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=8 00000080:00200000:2.0:1788201595.615255:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=yaml.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=getattr 00000002:00010000:2.0:1788201595.615268:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: yaml.sh,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 01 00010000:00010000:2.0:1788201595.615384:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490200/0xd138388016f6f977 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.615392:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490200/0xd138388016f6f977 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.615405:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490200/0xd138388016f6f977 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.615428:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172747b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728037632:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201595.616198:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.619053:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172747b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728037632:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201595.619081:0:24470:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490200/0xd138388016f6f977 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.619190:0:24470:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490200/0xd138388016f6f977 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.619196:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490200/0xd138388016f6f977 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.619202:0:24470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490200/0xd138388016f6f977 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.619209:0:24470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490200/0xd138388016f6f977 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.619214:0:24470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172490200 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:2.0:1788201595.619219:0:24470:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490200/0xd138388016f6f977 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.619226:0:24470:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490200/0xd138388016f6f977 lrc: 4/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.619235:0:24470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490200/0xd138388016f6f977 lrc: 5/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.619242:0:24470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201595.619249:0:24470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490200/0xd138388016f6f977 lrc: 3/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.619256:0:24470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490200/0xd138388016f6f977 lrc: 0/0,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201595.619283:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff8bc172747b80 x1875064728037632/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1788201595.619300:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1788201595.619404:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 30 res 8589937623/347 (0 0) 00000080:00200000:2.0:1788201595.619621:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.619643:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.619655:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.619668:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.619676:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.619682:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.619686:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.619692:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debbf8 00010000:00010000:2.0:1788201595.619696:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.619704:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.619722:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.619731:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=25 00000080:00200000:2.0:1788201595.619737:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.619752:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.619758:0:24470:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=yaml.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), file ffff8bc14c594000, open_flags 80c1, mode 81a4 opened 0 00000080:00200000:2.0:1788201595.619767:0:24470:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=yaml.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000002:00010000:2.0:1788201595.619821:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: yaml.sh,[0x200000bd7:0x1a8:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: open|creat flags 0100302 00010000:00010000:2.0:1788201595.619891:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.619899:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1788201595.619912:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1788201595.619921:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172747b80 x1875064728037888/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1788201595.619930:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 3/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24470 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201595.619957:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172747b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728037888:192.168.201.143@tcp:101:cp.0 00000100:00100000:2.0:1788201595.620296:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.624593:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172747b80 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728037888:192.168.201.143@tcp:101:cp.0 00010000:00010000:2.0:1788201595.624630:0:24470:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 4/0,1 mode: --/CW res: [0x200000bd7:0x15b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109871e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.624659:0:24470:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109871e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.624668:0:24470:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 4/0,1 mode: --/PR res: [0x200000bd7:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109871e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.624680:0:24470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109871e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.624693:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 4/0,1 mode: PR/PR res: [0x200000bd7:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109871e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.624709:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109871e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.624720:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 5/1,1 mode: PR/PR res: [0x200000bd7:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109871e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.624728:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109871e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1788201595.624741:0:24470:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x37, status=0 req@ffff8bc172747b80 x1875064728037888/t8589937490(8589937490) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1788201595.624757:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc172747b80 x1875064728037888/t8589937490(8589937490) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 648/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1788201595.624774:0:24470:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109871e expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1788201595.624788:0:24470:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109871e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.624825:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/424 (0 0) 00000080:00200000:2.0:1788201595.624833:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1788201595.624852:0:24470:0:(namei.c:1628:ll_create_it()) VFS Op:name=yaml.sh, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=open|creat 00000080:00200000:2.0:1788201595.624895:0:24470:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1a8:0x0](ffff8bc145984b08) 00000080:00200000:2.0:1788201595.625046:0:24470:0:(file.c:6824:ll_layout_conf()) [0x200000bd7:0x1a8:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1788201595.625057:0:24470:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000bd7:0x1a8:0x0](ffff8bc145984b08) 00000080:00010000:2.0:1788201595.625061:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a8:0x0](ffff8bc145984b08) for lock 0xd138388016f6f97e 00000080:00010000:2.0:1788201595.625073:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a8:0x0](ffff8bc145984b08) 00000080:00200008:2.0:1788201595.625222:0:24470:0:(file.c:1090:ll_file_open()) START file yaml.sh:[0x200000bd7:0x1a8:0x0](ffff8bc145984b08), flags 100301 00000002:00100000:2.0:1788201595.625248:0:24470:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8bc172747b80 x1875064728037888/t8589937490(8589937490) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/664 e 0 to 0 dl 1788201611 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1788201595.625299:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f97e from it ffff8bc150632d80 00010000:00010000:2.0:1788201595.625305:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109871e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.625395:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109871e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201595.625431:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1a8:0x0](ffff8bc145984b08), inode mode 81a4 mask 40 00000080:00200008:2.0:1788201595.625465:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file yaml.sh:[0x200000bd7:0x1a8:0x0](ffff8bc145984b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1788201595.625472:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x1a8:0x0](ffff8bc145984b08),name=yaml.sh 00000002:00010000:2.0:1788201595.625494:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x1a8:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.625505:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109871e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.625585:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109871e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1788201595.625594:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.625600:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a8:0x0](ffff8bc145984b08) 00000080:00010000:2.0:1788201595.625603:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a8:0x0](ffff8bc145984b08) for lock 0xd138388016f6f97e 00000080:00010000:2.0:1788201595.625607:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f97e from it ffffadd1c7debcd8 00010000:00010000:2.0:1788201595.625610:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109871e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.625618:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109871e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1788201595.625647:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a8:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1788201595.625658:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x1a8:0x0] 00000008:00010000:2.0:1788201595.625686:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1788201595.625690:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc17261dcb0, osc lock ffff8bc151fc05f0, flags 0x400001002 00010000:00010000:2.0:1788201595.625745:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f985 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201595.625762:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f985 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201595.625873:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728038016:192.168.201.143@tcp:101:cp.0 00000020:00200000:2.0:1788201595.626047:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1788201595.629474:0:10052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f985 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.629529:0:10052:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f985 lrc: 6/2,0 mode: --/PR res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109872c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.629548:0:10052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f985 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109872c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.629588:0:10052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f985 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0xe6657e217109872c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1788201595.629608:0:10052:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f985 lrc: 5/2,0 mode: PR/PR res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109872c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1788201595.629622:0:10052:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1788201595.629642:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f985 lrc: 6/2,0 mode: PR/PR res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109872c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.629652:0:10052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f985 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109872c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.629660:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f985 lrc: 5/1,0 mode: PR/PR res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0xe6657e217109872c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.629671:0:10052:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f985 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xe6657e217109872c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1788201595.629695:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728038016:192.168.201.143@tcp:101:cp.0 00000080:00200000:0.0:1788201595.629999:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a8:0x0] updating i_size 0 i_blocks 1 00000020:00010000:0.0:1788201595.630007:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1460044a0 (ffff8bc1469192d8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201595.630010:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1460044a0 (ffff8bc1469192d8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201595.630015:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc17261dcb0 (ffff8bc146919ea8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201595.630020:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1460044a0 (ffff8bc1469192d8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201595.630023:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc17261dcb0 (ffff8bc1469192d8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201595.630069:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a8:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1788201595.630152:0:24470:0:(file.c:2638:do_file_write_iter()) START file yaml.sh:[0x200000bd7:0x1a8:0x0], ppos: 0, count: 4512 00000080:00200000:0.0:1788201595.630188:0:24470:0:(file.c:2090:ll_file_io_generic()) yaml.sh: write ppos: 0, bytes: 4512 00000080:00200000:0.0:1788201595.630197:0:24470:0:(file.c:1848:ll_io_set_mirror()) yaml.sh: desiginated mirror: 0 00000020:00200000:0.0:1788201595.630204:0:24470:0:(cl_io.c:214:cl_io_rw_init()) header@00000000c8fd473d[0x110, 1, [0x200000bd7:0x1a8:0x0] hash] 00000020:00200000:0.0:1788201595.630208:0:24470:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4512) 0 0 00000080:00200000:0.0:1788201595.630212:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a8:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201595.630227:0:24470:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 1] 00020000:00200000:0.0:1788201595.630236:0:24470:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4512) 4512, 4512 00020000:00200000:0.0:1788201595.630239:0:24470:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201595.630278:0:24470:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 1] 00000008:00010000:0.0:1788201595.630295:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1788201595.630302:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1724564b0, osc lock ffff8bc145d34720, flags 0x0 00010000:00010000:0.0:1788201595.630339:0:24470:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc1488b8400 type 11 mode 2 res 9663677440/454 (0 8191) 00010000:00010000:0.0:1788201595.630387:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.630397:0:24470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.630409:0:24470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201595.630433:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728038144:192.168.201.143@tcp:101:cp.0 00000100:00100000:0.0:1788201595.630534:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621180 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.636289:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201595.636417:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743500288 00000100:00100000:2.0:1788201595.636431:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743500288 00000100:00100000:2.0:1788201595.636531:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 876 00000100:00100000:2.0:1788201595.636542:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1727d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23416:x1875064743500288:12345-192.168.201.143@tcp:104: 00010000:00010000:2.0:1788201595.636562:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f985 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109872c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201595.636656:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201595.636661:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1727d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23416:x1875064743500288:12345-192.168.201.143@tcp:104: Request processed in 123us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201595.636666:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 876 00010000:00010000:0.0:1788201595.636996:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201595.637007:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f985 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000000000 nid: local remote: 0xe6657e217109872c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.637019:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172491600 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:0.0:1788201595.637026:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f985 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400000000 nid: local remote: 0xe6657e217109872c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201595.637094:0:20881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1788201595.637111:0:20881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1788201595.637191:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f985 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109872c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.637199:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201595.637238:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f985 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109872c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.637248:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000a38bea3d/0xd138388016f6f985 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400000020 nid: local remote: 0xe6657e217109872c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.637268:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201595.637271:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201595.637272:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201595.637577:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728038272:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201595.641015:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:3.0:1788201595.641128:0:20876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743500416 00000100:00100000:3.0:1788201595.641140:0:20876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743500416 00000100:00100000:3.0:1788201595.641207:0:20876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 877 00000100:00100000:3.0:1788201595.641219:0:20876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc1727d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21005:x1875064743500416:12345-192.168.201.143@tcp:105: 00010000:00010000:3.0:1788201595.641240:0:20876:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.641257:0:20876:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.641268:0:20876:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.641281:0:20876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.641291:0:20876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10080000000000 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.641302:0:20876:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x80000000000 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201595.641342:0:20876:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bc15c12b200) 00000100:00100000:3.0:1788201595.641415:0:20876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc1727d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:21005:x1875064743500416:12345-192.168.201.143@tcp:105: Request processed in 199us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201595.641422:0:20876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 877 00000100:00100000:0.0:1788201595.642073:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728038144:192.168.201.143@tcp:101:cp.0 00010000:00010000:0.0:1788201595.642113:0:24470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x20000 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.642143:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10000000020000 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1788201595.642154:0:24470:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 4/0,2 mode: PW/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x10020000020000 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.642165:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 5/0,2 mode: PW/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.642176:0:24470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201595.642207:0:24470:0:(vvp_io.c:1292:vvp_io_write_start()) yaml.sh: write [0, 4512) append 0 append lockpos 0 00000080:00200000:0.0:1788201595.642226:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 0 of 0 to 4096 bytes 00000080:00200000:0.0:1788201595.642285:0:24470:0:(rw26.c:898:ll_write_end()) pos 0, len 4096, copied 4096 00000080:00200000:0.0:1788201595.642297:0:24470:0:(rw26.c:956:ll_write_end()) page@000000006adb6ce6[3 0000000043b90b4b 2 1 000000003eecb206 0 0 0] 00000080:00200000:0.0:1788201595.642300:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @00000000925c4cde 17ffffc0001001 3:0 ffff8bc16652dc40 0 lru 00000080:00200000:0.0:1788201595.642306:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000b2df1e47 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 000000000ce25486 00000000707a59c0 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.642413:0:24470:0:(rw26.c:956:ll_write_end()) end page@000000006adb6ce6 00000080:00200000:0.0:1788201595.642417:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1788201595.642422:0:24470:0:(rw26.c:704:ll_write_begin()) Writing 1 of 0 to 416 bytes 00000080:00200000:0.0:1788201595.642462:0:24470:0:(rw26.c:898:ll_write_end()) pos 4096, len 416, copied 416 00000080:00200000:0.0:1788201595.642467:0:24470:0:(rw26.c:956:ll_write_end()) page@00000000664e17d6[3 0000000043b90b4b 2 1 000000003eecb206 0 0 1] 00000080:00200000:0.0:1788201595.642471:0:24470:0:(rw26.c:956:ll_write_end()) vmpage @000000006c319a32 17ffffc0001001 3:0 ffff8bc16652da80 1 lru 00000080:00200000:0.0:1788201595.642476:0:24470:0:(rw26.c:956:ll_write_end()) osc-page@00000000c41d855f 1: 1< 0 - - > 2< 4096 0 0 0x0 0x0 | 000000000ce25486 00000000707a59c0 > 3< 0 0 > 4< 0 0 8 8519680 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1788201595.642479:0:24470:0:(rw26.c:956:ll_write_end()) end page@00000000664e17d6 00000080:00200000:0.0:1788201595.642480:0:24470:0:(rw26.c:956:ll_write_end()) queued cl_page: 2. 00000080:00200000:0.0:1788201595.642484:0:24470:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 2, from 0, to 416 prio 0 00000008:00010000:0.0:1788201595.642510:0:24470:0:(osc_cache.c:857:osc_extent_find()) ### extent: 000000006fc7b411 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1788201595.642535:0:24470:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff8bc145984cb8, count 2, dirtied 2 00000080:00200000:0.0:1788201595.642541:0:24470:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 2 pages 4512 bytes, tot: 4512 00000080:00200000:0.0:1788201595.642545:0:24470:0:(vvp_io.c:1358:vvp_io_write_start()) yaml.sh: write bytes 0, result: 4512 00000020:00010000:0.0:1788201595.642565:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc148fb1308 (ffff8bc1499c4ea8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201595.642569:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc148fb1308 (ffff8bc1499c4ea8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201595.642571:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1724564b0 (ffff8bc1499c41b8/1) at cl_lock_cancel():142 00010000:00010000:0.0:1788201595.642576:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.642584:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1788201595.642599:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc148fb1308 (ffff8bc1499c4ea8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201595.642602:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1724564b0 (ffff8bc1499c4ea8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201595.642609:0:24470:0:(vvp_io.c:533:vvp_io_advance()) advancing 4512 bytes 00000080:00200000:0.0:1788201595.642616:0:24470:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 1] 00000080:00200000:0.0:1788201595.642645:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a8:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201595.642648:0:24470:0:(file.c:2238:ll_file_io_generic()) yaml.sh: 2 io complete with rc: 0, result: 4512, restart: 0 00000080:00200000:0.0:1788201595.642655:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a8:0x0] updating i_size 4512 i_blocks 1 00000080:00200000:0.0:1788201595.642659:0:24470:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 4512 00000080:00200008:0.0:1788201595.642718:0:24470:0:(file.c:479:ll_file_release()) START file yaml.sh:[0x200000bd7:0x1a8:0x0](ffff8bc145984b08), flags 100001 00000002:00100000:0.0:1788201595.642780:0:24470:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8bc172747b80 x1875064728037888/t8589937490(8589937490) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/664 e 0 to 0 dl 1788201611 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1788201595.642836:0:24470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1788201595.642844:0:24470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144142a00 x1875064728038528/t0(0) o35->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1788201595.642870:0:24470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728038528:192.168.201.143@tcp:35:cp.0 00000100:00100000:0.0:1788201595.642943:0:24470:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201595.646885:0:24470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job cp:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24470:1875064728038528:192.168.201.143@tcp:35:cp.0 00000002:00100000:0.0:1788201595.646931:0:24470:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8bc172747b80 x1875064728037888/t8589937490(8589937490) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/664 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1788201595.647031:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201595.647056:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201595.647080:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201595.647098:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201595.647108:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201595.647115:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201595.647120:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201595.647138:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7debb58 00010000:00010000:0.0:1788201595.647143:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201595.647153:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201595.647171:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.647180:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201595.647187:0:24470:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.647191:0:24470:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=yaml.sh, flags=8 00000080:00200008:0.0:1788201595.647200:0:24470:0:(file.c:6283:ll_getattr_dentry()) START file yaml.sh:[0x200000bd7:0x1a8:0x0](ffff8bc145984b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201595.647205:0:24470:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000bd7:0x1a8:0x0](ffff8bc145984b08),name=yaml.sh 00000002:00010000:0.0:1788201595.647218:0:24470:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd7:0x1a8:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201595.647228:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109871e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201595.647236:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 2/1,0 mode: PR/PR res: [0x200000bd7:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109871e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1788201595.647244:0:24470:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201595.647247:0:24470:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a8:0x0](ffff8bc145984b08) 00000080:00010000:0.0:1788201595.647250:0:24470:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a8:0x0](ffff8bc145984b08) for lock 0xd138388016f6f97e 00000080:00010000:0.0:1788201595.647253:0:24470:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f97e from it ffffadd1c7debcb8 00010000:00010000:0.0:1788201595.647256:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe6657e217109871e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201595.647263:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe6657e217109871e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1788201595.647327:0:24470:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a8:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1788201595.647347:0:24470:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd7:0x1a8:0x0] 00000008:00010000:0.0:1788201595.647382:0:24470:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1788201595.647386:0:24470:0:(osc_lock.c:1310:osc_lock_init()) ### lock ffff8bc1724564b0, osc lock ffff8bc145d34720, flags 0x400001002 00010000:00010000:0.0:1788201595.647408:0:24470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.647421:0:24470:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:0.0:1788201595.647435:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1788201595.647439:0:24470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x810020000020000 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1788201595.647447:0:24470:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1788201595.647464:0:24470:0:(cl_io.c:1872:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1788201595.647475:0:24470:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000bd7:0x1a8:0x0] updating i_size 4512 i_blocks 1 00000020:00010000:0.0:1788201595.647479:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff8bc1449d9280 (ffff8bc1499c4ea8/0) at cl_lock_release():245 00000020:00010000:0.0:1788201595.647483:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1449d9280 (ffff8bc1499c4ea8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1788201595.647486:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff8bc1724564b0 (ffff8bc1499c41b8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1788201595.647490:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1449d9280 (ffff8bc1499c4ea8/0) at cl_lock_fini():72 00000020:00010000:0.0:1788201595.647493:0:24470:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff8bc1724564b0 (ffff8bc1499c4ea8/1) at cl_lock_fini():72 00000080:00200000:0.0:1788201595.647522:0:24470:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a8:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:3.0:1788201595.649763:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728038272:192.168.201.143@tcp:103:ldlm_bl.0 00000080:00200000:2.0:1788201595.660675:0:24472:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.660718:0:24472:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.660749:0:24472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.660772:0:24472:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.660782:0:24472:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.660823:0:24472:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.660827:0:24472:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.660838:0:24472:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e13be0 00010000:00010000:2.0:1788201595.660843:0:24472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.660854:0:24472:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.660878:0:24472:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.660889:0:24472:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201595.660896:0:24472:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.660915:0:24472:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d0, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=1536 00000080:00200000:2.0:1788201595.660918:0:24472:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.660924:0:24472:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.660930:0:24472:0:(namei.c:2239:do_mkdir()) VFS Op:name=d0, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8) 00000020:00100000:2.0:1788201595.661031:0:24472:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1788201595.661050:0:24472:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172746300 x1875064728038784/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201595.661083:0:24472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172746300 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24472:1875064728038784:192.168.201.143@tcp:36:createmany.0 00000100:00100000:2.0:1788201595.661379:0:24472:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.664477:0:24472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172746300 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24472:1875064728038784:192.168.201.143@tcp:36:createmany.0 00000080:00200000:2.0:1788201595.664547:0:24472:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1a9:0x0](ffff8bc145987448) 00000080:00200000:2.0:1788201595.664557:0:24472:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x1a9:0x0], updating i_size 512 00000080:00200000:2.0:1788201595.664659:0:24472:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.664686:0:24472:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.664710:0:24472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.664733:0:24472:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.664742:0:24472:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.664748:0:24472:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.664753:0:24472:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.664762:0:24472:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e13be0 00010000:00010000:2.0:1788201595.664767:0:24472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.664777:0:24472:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.665044:0:24472:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.665053:0:24472:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201595.665060:0:24472:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.665075:0:24472:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d1, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=1536 00000080:00200000:2.0:1788201595.665078:0:24472:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.665084:0:24472:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.665089:0:24472:0:(namei.c:2239:do_mkdir()) VFS Op:name=d1, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8) 00000020:00100000:2.0:1788201595.665413:0:24472:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1788201595.665424:0:24472:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172744380 x1875064728039040/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201595.665451:0:24472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172744380 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24472:1875064728039040:192.168.201.143@tcp:36:createmany.0 00000100:00100000:2.0:1788201595.665591:0:24472:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.669302:0:24472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172744380 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24472:1875064728039040:192.168.201.143@tcp:36:createmany.0 00000080:00200000:2.0:1788201595.669374:0:24472:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8) 00000080:00200000:2.0:1788201595.669383:0:24472:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x1aa:0x0], updating i_size 512 00000080:00200000:2.0:1788201595.669477:0:24472:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.669501:0:24472:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.669527:0:24472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.669544:0:24472:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.669555:0:24472:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.669561:0:24472:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.669565:0:24472:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.669573:0:24472:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e13be0 00010000:00010000:2.0:1788201595.669578:0:24472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.669588:0:24472:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.669607:0:24472:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.669615:0:24472:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201595.669621:0:24472:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.669639:0:24472:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d2, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=1536 00000080:00200000:2.0:1788201595.669643:0:24472:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.669648:0:24472:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.669653:0:24472:0:(namei.c:2239:do_mkdir()) VFS Op:name=d2, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8) 00000020:00100000:2.0:1788201595.669742:0:24472:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1788201595.669754:0:24472:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172745500 x1875064728039296/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201595.669780:0:24472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172745500 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24472:1875064728039296:192.168.201.143@tcp:36:createmany.0 00000100:00100000:2.0:1788201595.669891:0:24472:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.672016:0:24472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172745500 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24472:1875064728039296:192.168.201.143@tcp:36:createmany.0 00000080:00200000:2.0:1788201595.672070:0:24472:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1ab:0x0](ffff8bc145985348) 00000080:00200000:2.0:1788201595.672078:0:24472:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x1ab:0x0], updating i_size 512 00000080:00200000:2.0:1788201595.672168:0:24472:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.672189:0:24472:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.672209:0:24472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.672225:0:24472:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.672234:0:24472:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.672240:0:24472:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.672244:0:24472:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.672252:0:24472:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e13be0 00010000:00010000:2.0:1788201595.672256:0:24472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.672266:0:24472:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.672283:0:24472:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.672290:0:24472:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201595.672296:0:24472:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.672308:0:24472:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d3, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=1536 00000080:00200000:2.0:1788201595.672312:0:24472:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.672317:0:24472:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.672322:0:24472:0:(namei.c:2239:do_mkdir()) VFS Op:name=d3, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8) 00000020:00100000:2.0:1788201595.672393:0:24472:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1788201595.672403:0:24472:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172747100 x1875064728039552/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201595.672427:0:24472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172747100 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24472:1875064728039552:192.168.201.143@tcp:36:createmany.0 00000100:00100000:2.0:1788201595.672502:0:24472:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.675548:0:24472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172747100 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24472:1875064728039552:192.168.201.143@tcp:36:createmany.0 00000080:00200000:2.0:1788201595.675616:0:24472:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1ac:0x0](ffff8bc145981148) 00000080:00200000:2.0:1788201595.675625:0:24472:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x1ac:0x0], updating i_size 512 00000080:00200000:2.0:1788201595.675722:0:24472:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.675747:0:24472:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.675771:0:24472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.675843:0:24472:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.675854:0:24472:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.675861:0:24472:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.675865:0:24472:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.675874:0:24472:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e13be0 00010000:00010000:2.0:1788201595.675879:0:24472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.675890:0:24472:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.675909:0:24472:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.675917:0:24472:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201595.675924:0:24472:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.675938:0:24472:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d4, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=1536 00000080:00200000:2.0:1788201595.675942:0:24472:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.675947:0:24472:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.675951:0:24472:0:(namei.c:2239:do_mkdir()) VFS Op:name=d4, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8) 00000020:00100000:2.0:1788201595.676027:0:24472:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1788201595.676039:0:24472:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172744a80 x1875064728039808/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201595.676066:0:24472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172744a80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24472:1875064728039808:192.168.201.143@tcp:36:createmany.0 00000100:00100000:2.0:1788201595.676164:0:24472:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.679927:0:24472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172744a80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24472:1875064728039808:192.168.201.143@tcp:36:createmany.0 00000080:00200000:2.0:1788201595.679992:0:24472:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1ad:0x0](ffff8bc145983248) 00000080:00200000:2.0:1788201595.680000:0:24472:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x1ad:0x0], updating i_size 512 00000080:00200000:1.0:1788201595.687925:0:24473:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201595.687968:0:24473:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.687997:0:24473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.688018:0:24473:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.688027:0:24473:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.688035:0:24473:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201595.688040:0:24473:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201595.688050:0:24473:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e03bd0 00010000:00010000:1.0:1788201595.688054:0:24473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.688063:0:24473:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.688081:0:24473:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.688089:0:24473:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201595.688097:0:24473:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.688112:0:24473:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f0, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=1536 00000080:00200000:1.0:1788201595.688115:0:24473:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.688121:0:24473:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.688126:0:24473:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f0, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=33060, excl=1 00000080:00200000:1.0:1788201595.688130:0:24473:0:(namei.c:2084:ll_mknod()) VFS Op:name=f0, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8) mode 100444 dev 0 00000020:00100000:1.0:1788201595.688208:0:24473:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201595.688223:0:24473:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d7100 x1875064728040064/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201595.688250:0:24473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24473:1875064728040064:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201595.688632:0:24473:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145559780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.692426:0:24473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24473:1875064728040064:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201595.692481:0:24473:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1ae:0x0](ffff8bc145929988) 00000080:00200000:1.0:1788201595.692566:0:24473:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f0, unhashed 1 00000080:00200000:1.0:1788201595.692634:0:24473:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201595.692651:0:24473:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.692671:0:24473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.692687:0:24473:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.692696:0:24473:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.692703:0:24473:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201595.692707:0:24473:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201595.692716:0:24473:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e03bd0 00010000:00010000:1.0:1788201595.692721:0:24473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.692732:0:24473:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.692748:0:24473:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.692755:0:24473:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201595.692760:0:24473:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.692773:0:24473:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=1536 00000080:00200000:1.0:1788201595.692775:0:24473:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.692779:0:24473:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.692782:0:24473:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=33060, excl=1 00000080:00200000:1.0:1788201595.692785:0:24473:0:(namei.c:2084:ll_mknod()) VFS Op:name=f1, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8) mode 100444 dev 0 00000020:00100000:1.0:1788201595.693315:0:24473:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201595.693341:0:24473:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d7800 x1875064728040320/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201595.693368:0:24473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24473:1875064728040320:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201595.693502:0:24473:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145559780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.696045:0:24473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24473:1875064728040320:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201595.696105:0:24473:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1af:0x0](ffff8bc14592cb08) 00000080:00200000:1.0:1788201595.696200:0:24473:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f1, unhashed 1 00000080:00200000:1.0:1788201595.696277:0:24473:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201595.696298:0:24473:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.696321:0:24473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.696349:0:24473:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.696358:0:24473:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.696365:0:24473:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201595.696369:0:24473:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201595.696378:0:24473:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e03bd0 00010000:00010000:1.0:1788201595.696383:0:24473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.696390:0:24473:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.696406:0:24473:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.696412:0:24473:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201595.696416:0:24473:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.696429:0:24473:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f2, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=1536 00000080:00200000:1.0:1788201595.696432:0:24473:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.696436:0:24473:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.696439:0:24473:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f2, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=33060, excl=1 00000080:00200000:1.0:1788201595.696442:0:24473:0:(namei.c:2084:ll_mknod()) VFS Op:name=f2, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8) mode 100444 dev 0 00000020:00100000:1.0:1788201595.696493:0:24473:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201595.696501:0:24473:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d4a80 x1875064728040576/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201595.696520:0:24473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24473:1875064728040576:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201595.696583:0:24473:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145559780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.701638:0:24473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24473:1875064728040576:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201595.701700:0:24473:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1b0:0x0](ffff8bc14592f448) 00000080:00200000:1.0:1788201595.701832:0:24473:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f2, unhashed 1 00000080:00200000:1.0:1788201595.701901:0:24473:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201595.701918:0:24473:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.701937:0:24473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.701950:0:24473:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.701956:0:24473:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.701961:0:24473:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201595.701964:0:24473:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201595.701971:0:24473:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e03bd0 00010000:00010000:1.0:1788201595.701974:0:24473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.701980:0:24473:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.701994:0:24473:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.702001:0:24473:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201595.702005:0:24473:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.702355:0:24473:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f3, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=1536 00000080:00200000:1.0:1788201595.702361:0:24473:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.702367:0:24473:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.702372:0:24473:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f3, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=33060, excl=1 00000080:00200000:1.0:1788201595.702376:0:24473:0:(namei.c:2084:ll_mknod()) VFS Op:name=f3, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8) mode 100444 dev 0 00000020:00100000:1.0:1788201595.702441:0:24473:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201595.702449:0:24473:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d6a00 x1875064728040832/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201595.702471:0:24473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24473:1875064728040832:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201595.702913:0:24473:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145559780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.706012:0:24473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24473:1875064728040832:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201595.706080:0:24473:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1b1:0x0](ffff8bc14592c2c8) 00000080:00200000:1.0:1788201595.706239:0:24473:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f3, unhashed 1 00000080:00200000:1.0:1788201595.706318:0:24473:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201595.706351:0:24473:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.706375:0:24473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.706392:0:24473:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.706401:0:24473:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.706407:0:24473:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201595.706411:0:24473:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201595.706422:0:24473:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e03bd0 00010000:00010000:1.0:1788201595.706426:0:24473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.706434:0:24473:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.706448:0:24473:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.706455:0:24473:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201595.706460:0:24473:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.706474:0:24473:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=1536 00000080:00200000:1.0:1788201595.706476:0:24473:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.706480:0:24473:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.706483:0:24473:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=33060, excl=1 00000080:00200000:1.0:1788201595.706486:0:24473:0:(namei.c:2084:ll_mknod()) VFS Op:name=f4, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8) mode 100444 dev 0 00000020:00100000:1.0:1788201595.706592:0:24473:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201595.706600:0:24473:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d4e00 x1875064728041088/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201595.706620:0:24473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24473:1875064728041088:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201595.706745:0:24473:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145559780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.709032:0:24473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24473:1875064728041088:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201595.709087:0:24473:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1b2:0x0](ffff8bc145929148) 00000080:00200000:1.0:1788201595.709170:0:24473:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f4, unhashed 1 00000080:00200000:1.0:1788201595.726662:0:24474:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201595.726703:0:24474:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.726730:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.726753:0:24474:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.726759:0:24474:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.726768:0:24474:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201595.726771:0:24474:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201595.726778:0:24474:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e13bd0 00010000:00010000:1.0:1788201595.726781:0:24474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.726788:0:24474:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.726914:0:24474:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.726922:0:24474:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201595.726927:0:24474:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.726938:0:24474:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d0, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=24 00000080:00200000:1.0:1788201595.726941:0:24474:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=d0, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=0 00000002:00010000:1.0:1788201595.726952:0:24474:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d0,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: lookup flags 0 00010000:00010000:1.0:1788201595.727002:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11200/0xd138388016f6f993 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.727008:0:24474:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11200/0xd138388016f6f993 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.727017:0:24474:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11200/0xd138388016f6f993 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201595.727047:0:24474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24474:1875064728041216:192.168.201.143@tcp:101:createmany.0 00000100:00100000:1.0:1788201595.727256:0:24474:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145559780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.730486:0:24474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24474:1875064728041216:192.168.201.143@tcp:101:createmany.0 00010000:00010000:1.0:1788201595.730519:0:24474:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11200/0xd138388016f6f993 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710987db expref: -99 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.730547:0:24474:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11200/0xd138388016f6f993 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x1a9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710987db expref: -99 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.730557:0:24474:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11200/0xd138388016f6f993 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x1a9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710987db expref: -99 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.730569:0:24474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11200/0xd138388016f6f993 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x1a9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710987db expref: -99 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.730578:0:24474:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11200/0xd138388016f6f993 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x1a9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710987db expref: -99 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.730591:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11200/0xd138388016f6f993 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x1a9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710987db expref: -99 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.730597:0:24474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11200/0xd138388016f6f993 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x1a9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710987db expref: -99 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.730602:0:24474:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11200/0xd138388016f6f993 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x1a9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710987db expref: -99 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201595.730616:0:24474:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x10 disposition=0xb, status=0 req@ffff8bc1727d5c00 x1875064728041216/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201595.730628:0:24474:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11200/0xd138388016f6f993 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710987db expref: -99 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.730636:0:24474:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/425 (0 0) 00000080:00200000:1.0:1788201595.730642:0:24474:0:(namei.c:952:ll_intent_lock()) intent lock 16 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201595.730666:0:24474:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x1a9:0x0], updating i_size 512 00000080:00200000:1.0:1788201595.730669:0:24474:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x1a9:0x0](ffff8bc145987448): rc = 0 00000080:00010000:1.0:1788201595.730675:0:24474:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1a9:0x0](ffff8bc145987448) for lock 0xd138388016f6f993 00000080:00010000:1.0:1788201595.730689:0:24474:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1a9:0x0](ffff8bc145987448) 00000080:00010000:1.0:1788201595.730693:0:24474:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f993 from it ffffadd1c7e13aa0 00010000:00010000:1.0:1788201595.730696:0:24474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11200/0xd138388016f6f993 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1a9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e21710987db expref: -99 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.730706:0:24474:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11200/0xd138388016f6f993 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e21710987db expref: -99 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201595.730747:0:24474:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1a9:0x0](ffff8bc145987448), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.730773:0:24474:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f0, dir=[0x200000bd7:0x1a9:0x0](ffff8bc145987448), flags=1536 00000080:00200000:1.0:1788201595.730775:0:24474:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1a9:0x0](ffff8bc145987448), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.730781:0:24474:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1a9:0x0](ffff8bc145987448), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.730784:0:24474:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f0, dir=[0x200000bd7:0x1a9:0x0](ffff8bc145987448), flags=33060, excl=1 00000080:00200000:1.0:1788201595.730787:0:24474:0:(namei.c:2084:ll_mknod()) VFS Op:name=f0, dir=[0x200000bd7:0x1a9:0x0](ffff8bc145987448) mode 100444 dev 0 00000020:00100000:1.0:1788201595.730889:0:24474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201595.730895:0:24474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d5c00 x1875064728041472/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201595.730918:0:24474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24474:1875064728041472:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201595.731003:0:24474:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145559780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201595.736276:0:24474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24474:1875064728041472:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201595.736429:0:24474:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1b3:0x0](ffff8bc1459b42c8) 00000080:00200000:0.0:1788201595.736542:0:24474:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f0, unhashed 1 00000080:00200000:0.0:1788201595.736629:0:24474:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201595.736651:0:24474:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201595.736687:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201595.736707:0:24474:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201595.736716:0:24474:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201595.736723:0:24474:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201595.736727:0:24474:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201595.736736:0:24474:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e13bd0 00010000:00010000:0.0:1788201595.736741:0:24474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201595.736757:0:24474:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201595.736776:0:24474:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.736784:0:24474:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201595.736824:0:24474:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.736829:0:24474:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d0, flags=24 00000080:00200000:0.0:1788201595.736832:0:24474:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1a9:0x0](ffff8bc145987448), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.736850:0:24474:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x1a9:0x0](ffff8bc145987448), flags=1536 00000080:00200000:0.0:1788201595.736853:0:24474:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1a9:0x0](ffff8bc145987448), inode mode 41ed mask 3 00000080:00200000:0.0:1788201595.736858:0:24474:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1a9:0x0](ffff8bc145987448), inode mode 41ed mask 3 00000080:00200000:0.0:1788201595.736863:0:24474:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x1a9:0x0](ffff8bc145987448), flags=33060, excl=1 00000080:00200000:0.0:1788201595.736866:0:24474:0:(namei.c:2084:ll_mknod()) VFS Op:name=f1, dir=[0x200000bd7:0x1a9:0x0](ffff8bc145987448) mode 100444 dev 0 00000020:00100000:0.0:1788201595.736937:0:24474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201595.736949:0:24474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144143480 x1875064728041728/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201595.736978:0:24474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24474:1875064728041728:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201595.737090:0:24474:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.740396:0:24474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24474:1875064728041728:192.168.201.143@tcp:36:createmany.0 00000080:00200000:2.0:1788201595.740467:0:24474:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1b4:0x0](ffff8bc145955b88) 00000080:00200000:2.0:1788201595.740570:0:24474:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f1, unhashed 1 00000080:00200000:2.0:1788201595.741220:0:24474:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.741248:0:24474:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.741275:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.741296:0:24474:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.741304:0:24474:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.741433:0:24474:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.741439:0:24474:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.741449:0:24474:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e13bd0 00010000:00010000:2.0:1788201595.741454:0:24474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.741465:0:24474:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.741486:0:24474:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.741495:0:24474:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201595.741502:0:24474:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.741505:0:24474:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d0, flags=24 00000080:00200000:2.0:1788201595.741508:0:24474:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1a9:0x0](ffff8bc145987448), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.741525:0:24474:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f2, dir=[0x200000bd7:0x1a9:0x0](ffff8bc145987448), flags=1536 00000080:00200000:2.0:1788201595.741529:0:24474:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1a9:0x0](ffff8bc145987448), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.741534:0:24474:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1a9:0x0](ffff8bc145987448), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.741539:0:24474:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f2, dir=[0x200000bd7:0x1a9:0x0](ffff8bc145987448), flags=33060, excl=1 00000080:00200000:2.0:1788201595.741543:0:24474:0:(namei.c:2084:ll_mknod()) VFS Op:name=f2, dir=[0x200000bd7:0x1a9:0x0](ffff8bc145987448) mode 100444 dev 0 00000020:00100000:2.0:1788201595.741620:0:24474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1788201595.741633:0:24474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172747480 x1875064728041984/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201595.741664:0:24474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172747480 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24474:1875064728041984:192.168.201.143@tcp:36:createmany.0 00000100:00100000:2.0:1788201595.741907:0:24474:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.753488:0:24474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172747480 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24474:1875064728041984:192.168.201.143@tcp:36:createmany.0 00000080:00200000:2.0:1788201595.753560:0:24474:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1b5:0x0](ffff8bc145951988) 00000080:00200000:2.0:1788201595.753859:0:24474:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f2, unhashed 1 00000080:00200000:2.0:1788201595.753943:0:24474:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.753966:0:24474:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.753991:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.754009:0:24474:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.754018:0:24474:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.754025:0:24474:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.754029:0:24474:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.754038:0:24474:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e13bd0 00010000:00010000:2.0:1788201595.754043:0:24474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.754055:0:24474:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.754074:0:24474:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.754083:0:24474:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201595.754089:0:24474:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.754235:0:24474:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d0, flags=24 00000080:00200000:2.0:1788201595.754239:0:24474:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1a9:0x0](ffff8bc145987448), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.754255:0:24474:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f3, dir=[0x200000bd7:0x1a9:0x0](ffff8bc145987448), flags=1536 00000080:00200000:2.0:1788201595.754259:0:24474:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1a9:0x0](ffff8bc145987448), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.754265:0:24474:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1a9:0x0](ffff8bc145987448), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.754270:0:24474:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f3, dir=[0x200000bd7:0x1a9:0x0](ffff8bc145987448), flags=33060, excl=1 00000080:00200000:2.0:1788201595.754274:0:24474:0:(namei.c:2084:ll_mknod()) VFS Op:name=f3, dir=[0x200000bd7:0x1a9:0x0](ffff8bc145987448) mode 100444 dev 0 00000020:00100000:2.0:1788201595.754510:0:24474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1788201595.754527:0:24474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172745f80 x1875064728042240/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201595.754561:0:24474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172745f80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24474:1875064728042240:192.168.201.143@tcp:36:createmany.0 00000100:00100000:2.0:1788201595.754887:0:24474:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.761269:0:24474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172745f80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24474:1875064728042240:192.168.201.143@tcp:36:createmany.0 00000080:00200000:2.0:1788201595.761419:0:24474:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1b6:0x0](ffff8bc145953248) 00000080:00200000:2.0:1788201595.761615:0:24474:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f3, unhashed 1 00000080:00200000:2.0:1788201595.762066:0:24474:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.762097:0:24474:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.762130:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.762147:0:24474:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.762156:0:24474:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.762163:0:24474:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.762167:0:24474:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.762176:0:24474:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e13bd0 00010000:00010000:2.0:1788201595.762182:0:24474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.762193:0:24474:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.762212:0:24474:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.762222:0:24474:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201595.762229:0:24474:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.762232:0:24474:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d0, flags=24 00000080:00200000:2.0:1788201595.762235:0:24474:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1a9:0x0](ffff8bc145987448), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.762251:0:24474:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x1a9:0x0](ffff8bc145987448), flags=1536 00000080:00200000:2.0:1788201595.762255:0:24474:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1a9:0x0](ffff8bc145987448), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.762261:0:24474:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1a9:0x0](ffff8bc145987448), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.762266:0:24474:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x1a9:0x0](ffff8bc145987448), flags=33060, excl=1 00000080:00200000:2.0:1788201595.762270:0:24474:0:(namei.c:2084:ll_mknod()) VFS Op:name=f4, dir=[0x200000bd7:0x1a9:0x0](ffff8bc145987448) mode 100444 dev 0 00000020:00100000:2.0:1788201595.762367:0:24474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1788201595.762382:0:24474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172746a00 x1875064728042496/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201595.762410:0:24474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172746a00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24474:1875064728042496:192.168.201.143@tcp:36:createmany.0 00000100:00100000:2.0:1788201595.762530:0:24474:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.768541:0:24474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172746a00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24474:1875064728042496:192.168.201.143@tcp:36:createmany.0 00000080:00200000:2.0:1788201595.768607:0:24474:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1b7:0x0](ffff8bc145955348) 00000080:00200000:2.0:1788201595.768732:0:24474:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f4, unhashed 1 00000080:00200000:1.0:1788201595.797317:0:24475:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201595.797371:0:24475:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.797397:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.797419:0:24475:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.797429:0:24475:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.797439:0:24475:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201595.797443:0:24475:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201595.797452:0:24475:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e0bbd0 00010000:00010000:1.0:1788201595.797458:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.797468:0:24475:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.797488:0:24475:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.797498:0:24475:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201595.797506:0:24475:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.797521:0:24475:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d1, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=24 00000080:00200000:1.0:1788201595.797526:0:24475:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=d1, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=0 00000002:00010000:1.0:1788201595.798201:0:24475:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d1,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: lookup flags 0 00010000:00010000:1.0:1788201595.798269:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11000/0xd138388016f6f99a lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.798279:0:24475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11000/0xd138388016f6f99a lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.798291:0:24475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11000/0xd138388016f6f99a lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24475 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201595.798324:0:24475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24475:1875064728042624:192.168.201.143@tcp:101:createmany.0 00000100:00100000:1.0:1788201595.798472:0:24475:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1455593c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.801888:0:24475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24475:1875064728042624:192.168.201.143@tcp:101:createmany.0 00010000:00010000:1.0:1788201595.801927:0:24475:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11000/0xd138388016f6f99a lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109883d expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.801955:0:24475:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11000/0xd138388016f6f99a lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109883d expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.801964:0:24475:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11000/0xd138388016f6f99a lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x1aa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109883d expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.801977:0:24475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11000/0xd138388016f6f99a lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x1aa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109883d expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.801990:0:24475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11000/0xd138388016f6f99a lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x1aa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109883d expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.802005:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11000/0xd138388016f6f99a lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x1aa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109883d expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.802018:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11000/0xd138388016f6f99a lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x1aa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109883d expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.802026:0:24475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11000/0xd138388016f6f99a lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x1aa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109883d expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201595.802040:0:24475:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x10 disposition=0xb, status=0 req@ffff8bc1727d4700 x1875064728042624/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201595.802055:0:24475:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11000/0xd138388016f6f99a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1aa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109883d expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.802066:0:24475:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/426 (0 0) 00000080:00200000:1.0:1788201595.802075:0:24475:0:(namei.c:952:ll_intent_lock()) intent lock 16 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201595.802104:0:24475:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x1aa:0x0], updating i_size 512 00000080:00200000:1.0:1788201595.802108:0:24475:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x1aa:0x0](ffff8bc1459800c8): rc = 0 00000080:00010000:1.0:1788201595.802114:0:24475:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1aa:0x0](ffff8bc1459800c8) for lock 0xd138388016f6f99a 00000080:00010000:1.0:1788201595.802143:0:24475:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1aa:0x0](ffff8bc1459800c8) 00000080:00010000:1.0:1788201595.802149:0:24475:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f99a from it ffffadd1c7e0baa0 00010000:00010000:1.0:1788201595.802152:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11000/0xd138388016f6f99a lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1aa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109883d expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.802162:0:24475:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11000/0xd138388016f6f99a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1aa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109883d expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201595.802204:0:24475:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.802233:0:24475:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f0, dir=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8), flags=1536 00000080:00200000:1.0:1788201595.802238:0:24475:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.802246:0:24475:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.802252:0:24475:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f0, dir=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8), flags=33060, excl=1 00000080:00200000:1.0:1788201595.802255:0:24475:0:(namei.c:2084:ll_mknod()) VFS Op:name=f0, dir=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8) mode 100444 dev 0 00000020:00100000:1.0:1788201595.802342:0:24475:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201595.802350:0:24475:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d4700 x1875064728042880/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201595.802378:0:24475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24475:1875064728042880:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201595.802485:0:24475:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1455593c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.809748:0:24475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24475:1875064728042880:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201595.809844:0:24475:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1b8:0x0](ffff8bc14592d348) 00000080:00200000:1.0:1788201595.809932:0:24475:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f0, unhashed 1 00000080:00200000:1.0:1788201595.810002:0:24475:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201595.810019:0:24475:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.810039:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.810054:0:24475:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.810060:0:24475:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.810064:0:24475:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201595.810068:0:24475:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201595.810078:0:24475:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e0bbd0 00010000:00010000:1.0:1788201595.810082:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.810099:0:24475:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.810120:0:24475:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.810129:0:24475:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201595.810134:0:24475:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.810137:0:24475:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d1, flags=24 00000080:00200000:1.0:1788201595.810140:0:24475:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.810156:0:24475:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8), flags=1536 00000080:00200000:1.0:1788201595.810160:0:24475:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.810166:0:24475:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.810171:0:24475:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8), flags=33060, excl=1 00000080:00200000:1.0:1788201595.810175:0:24475:0:(namei.c:2084:ll_mknod()) VFS Op:name=f1, dir=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8) mode 100444 dev 0 00000020:00100000:1.0:1788201595.810243:0:24475:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201595.810253:0:24475:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d6300 x1875064728043136/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201595.810279:0:24475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24475:1875064728043136:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201595.810372:0:24475:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1455593c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.815497:0:24475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24475:1875064728043136:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201595.815639:0:24475:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1b9:0x0](ffff8bc14592ba88) 00000080:00200000:1.0:1788201595.815972:0:24475:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f1, unhashed 1 00000080:00200000:1.0:1788201595.816057:0:24475:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201595.816218:0:24475:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.816244:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.816268:0:24475:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.816277:0:24475:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.816285:0:24475:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201595.816289:0:24475:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201595.816298:0:24475:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e0bbd0 00010000:00010000:1.0:1788201595.816304:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.816315:0:24475:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.816343:0:24475:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.816351:0:24475:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201595.816358:0:24475:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.816362:0:24475:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d1, flags=24 00000080:00200000:1.0:1788201595.816365:0:24475:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.816382:0:24475:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f2, dir=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8), flags=1536 00000080:00200000:1.0:1788201595.816386:0:24475:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.816392:0:24475:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.816396:0:24475:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f2, dir=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8), flags=33060, excl=1 00000080:00200000:1.0:1788201595.816400:0:24475:0:(namei.c:2084:ll_mknod()) VFS Op:name=f2, dir=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8) mode 100444 dev 0 00000020:00100000:1.0:1788201595.816472:0:24475:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201595.816486:0:24475:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d5f80 x1875064728043392/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201595.816519:0:24475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24475:1875064728043392:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201595.817880:0:24475:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1455593c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.830966:0:24475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24475:1875064728043392:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201595.831095:0:24475:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1ba:0x0](ffff8bc144695348) 00000080:00200000:1.0:1788201595.831205:0:24475:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f2, unhashed 1 00000080:00200000:1.0:1788201595.831286:0:24475:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201595.831310:0:24475:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.831346:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.831363:0:24475:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.831371:0:24475:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.831377:0:24475:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201595.831381:0:24475:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201595.831390:0:24475:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e0bbd0 00010000:00010000:1.0:1788201595.831395:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.831405:0:24475:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.831425:0:24475:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.831433:0:24475:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201595.831440:0:24475:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.831445:0:24475:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d1, flags=24 00000080:00200000:1.0:1788201595.831449:0:24475:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.831465:0:24475:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f3, dir=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8), flags=1536 00000080:00200000:1.0:1788201595.831468:0:24475:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.831473:0:24475:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.831477:0:24475:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f3, dir=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8), flags=33060, excl=1 00000080:00200000:1.0:1788201595.831481:0:24475:0:(namei.c:2084:ll_mknod()) VFS Op:name=f3, dir=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8) mode 100444 dev 0 00000020:00100000:1.0:1788201595.832999:0:24475:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201595.833026:0:24475:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d5180 x1875064728043648/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201595.833064:0:24475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24475:1875064728043648:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201595.833986:0:24475:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1455593c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.850475:0:24475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24475:1875064728043648:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201595.851210:0:24475:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1bb:0x0](ffff8bc144691148) 00000080:00200000:1.0:1788201595.851322:0:24475:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f3, unhashed 1 00000080:00200000:1.0:1788201595.851426:0:24475:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201595.851447:0:24475:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.851474:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.851495:0:24475:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.851503:0:24475:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.851523:0:24475:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201595.851527:0:24475:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201595.852994:0:24475:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e0bbd0 00010000:00010000:1.0:1788201595.853007:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.853018:0:24475:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.853037:0:24475:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.853048:0:24475:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201595.855570:0:24475:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.855590:0:24475:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d1, flags=24 00000080:00200000:2.0:1788201595.855596:0:24475:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.855625:0:24475:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8), flags=1536 00000080:00200000:2.0:1788201595.855628:0:24475:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.855639:0:24475:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.855643:0:24475:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8), flags=33060, excl=1 00000080:00200000:2.0:1788201595.855646:0:24475:0:(namei.c:2084:ll_mknod()) VFS Op:name=f4, dir=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8) mode 100444 dev 0 00000020:00100000:2.0:1788201595.855749:0:24475:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1788201595.855763:0:24475:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172746d80 x1875064728043904/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201595.855787:0:24475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172746d80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24475:1875064728043904:192.168.201.143@tcp:36:createmany.0 00000100:00100000:2.0:1788201595.856427:0:24475:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201595.860360:0:24475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172746d80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24475:1875064728043904:192.168.201.143@tcp:36:createmany.0 00000080:00200000:3.0:1788201595.860430:0:24475:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1bc:0x0](ffff8bc1459d1148) 00000080:00200000:3.0:1788201595.861782:0:24475:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f4, unhashed 1 00000080:00200000:1.0:1788201595.880444:0:24476:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201595.880479:0:24476:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.880501:0:24476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.880519:0:24476:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.880528:0:24476:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.880596:0:24476:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201595.880600:0:24476:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201595.880608:0:24476:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e1bbd0 00010000:00010000:1.0:1788201595.880612:0:24476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.880619:0:24476:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.880636:0:24476:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.880643:0:24476:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201595.880649:0:24476:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.880660:0:24476:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d2, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=24 00000080:00200000:1.0:1788201595.880715:0:24476:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=d2, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=0 00000002:00010000:1.0:1788201595.880729:0:24476:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d2,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: lookup flags 0 00010000:00010000:1.0:1788201595.880782:0:24476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f10600/0xd138388016f6f9a1 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.880788:0:24476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f10600/0xd138388016f6f9a1 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.880957:0:24476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f10600/0xd138388016f6f9a1 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24476 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201595.880987:0:24476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24476:1875064728044032:192.168.201.143@tcp:101:createmany.0 00000100:00100000:1.0:1788201595.881215:0:24476:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1455593c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.884241:0:24476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24476:1875064728044032:192.168.201.143@tcp:101:createmany.0 00010000:00010000:1.0:1788201595.884280:0:24476:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f10600/0xd138388016f6f9a1 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109889f expref: -99 pid: 24476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.884308:0:24476:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f10600/0xd138388016f6f9a1 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109889f expref: -99 pid: 24476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.884317:0:24476:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f10600/0xd138388016f6f9a1 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x1ab:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109889f expref: -99 pid: 24476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.884342:0:24476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f10600/0xd138388016f6f9a1 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x1ab:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109889f expref: -99 pid: 24476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.884354:0:24476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f10600/0xd138388016f6f9a1 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x1ab:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109889f expref: -99 pid: 24476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.884370:0:24476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f10600/0xd138388016f6f9a1 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x1ab:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109889f expref: -99 pid: 24476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.884379:0:24476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f10600/0xd138388016f6f9a1 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x1ab:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109889f expref: -99 pid: 24476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.884388:0:24476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f10600/0xd138388016f6f9a1 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x1ab:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109889f expref: -99 pid: 24476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1788201595.884404:0:24476:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x10 disposition=0xb, status=0 req@ffff8bc1727d6680 x1875064728044032/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1788201595.884420:0:24476:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f10600/0xd138388016f6f9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1ab:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109889f expref: -99 pid: 24476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.884433:0:24476:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/427 (0 0) 00000080:00200000:1.0:1788201595.884442:0:24476:0:(namei.c:952:ll_intent_lock()) intent lock 16 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1788201595.884475:0:24476:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x1ab:0x0], updating i_size 512 00000080:00200000:1.0:1788201595.884479:0:24476:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x1ab:0x0](ffff8bc145985348): rc = 0 00000080:00010000:1.0:1788201595.884486:0:24476:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1ab:0x0](ffff8bc145985348) for lock 0xd138388016f6f9a1 00000080:00010000:1.0:1788201595.884504:0:24476:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1ab:0x0](ffff8bc145985348) 00000080:00010000:1.0:1788201595.884509:0:24476:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f9a1 from it ffffadd1c7e1baa0 00010000:00010000:1.0:1788201595.884512:0:24476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f10600/0xd138388016f6f9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1ab:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e217109889f expref: -99 pid: 24476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201595.884522:0:24476:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f10600/0xd138388016f6f9a1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1ab:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e217109889f expref: -99 pid: 24476 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1788201595.884582:0:24476:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ab:0x0](ffff8bc145985348), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.884609:0:24476:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f0, dir=[0x200000bd7:0x1ab:0x0](ffff8bc145985348), flags=1536 00000080:00200000:1.0:1788201595.884612:0:24476:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ab:0x0](ffff8bc145985348), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.884621:0:24476:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ab:0x0](ffff8bc145985348), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.884625:0:24476:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f0, dir=[0x200000bd7:0x1ab:0x0](ffff8bc145985348), flags=33060, excl=1 00000080:00200000:1.0:1788201595.884629:0:24476:0:(namei.c:2084:ll_mknod()) VFS Op:name=f0, dir=[0x200000bd7:0x1ab:0x0](ffff8bc145985348) mode 100444 dev 0 00000020:00100000:1.0:1788201595.884717:0:24476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201595.884723:0:24476:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d6680 x1875064728044288/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201595.884747:0:24476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24476:1875064728044288:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201595.885167:0:24476:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1455593c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.888530:0:24476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24476:1875064728044288:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201595.888601:0:24476:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1bd:0x0](ffff8bc144690908) 00000080:00200000:1.0:1788201595.888717:0:24476:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f0, unhashed 1 00000080:00200000:1.0:1788201595.888787:0:24476:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201595.889017:0:24476:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.889041:0:24476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.889059:0:24476:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.889080:0:24476:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.889088:0:24476:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201595.889092:0:24476:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201595.889102:0:24476:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e1bbd0 00010000:00010000:1.0:1788201595.889107:0:24476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.889117:0:24476:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.889135:0:24476:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.889143:0:24476:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201595.889148:0:24476:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.889151:0:24476:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d2, flags=24 00000080:00200000:1.0:1788201595.889154:0:24476:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ab:0x0](ffff8bc145985348), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.889167:0:24476:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x1ab:0x0](ffff8bc145985348), flags=1536 00000080:00200000:1.0:1788201595.889170:0:24476:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ab:0x0](ffff8bc145985348), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.889176:0:24476:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ab:0x0](ffff8bc145985348), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.889180:0:24476:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x1ab:0x0](ffff8bc145985348), flags=33060, excl=1 00000080:00200000:1.0:1788201595.889185:0:24476:0:(namei.c:2084:ll_mknod()) VFS Op:name=f1, dir=[0x200000bd7:0x1ab:0x0](ffff8bc145985348) mode 100444 dev 0 00000020:00100000:1.0:1788201595.889252:0:24476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201595.889263:0:24476:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d5500 x1875064728044544/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201595.889288:0:24476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24476:1875064728044544:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201595.890935:0:24476:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1455593c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201595.898488:0:24476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24476:1875064728044544:192.168.201.143@tcp:36:createmany.0 00000080:00200000:3.0:1788201595.898578:0:24476:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1be:0x0](ffff8bc1459d21c8) 00000080:00200000:3.0:1788201595.898695:0:24476:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f1, unhashed 1 00000080:00200000:3.0:1788201595.898786:0:24476:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201595.900249:0:24476:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201595.900273:0:24476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201595.900288:0:24476:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201595.900294:0:24476:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201595.900300:0:24476:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201595.900303:0:24476:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201595.900311:0:24476:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e1bbd0 00010000:00010000:3.0:1788201595.900316:0:24476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201595.900325:0:24476:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201595.900355:0:24476:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201595.900367:0:24476:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201595.900375:0:24476:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201595.900378:0:24476:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d2, flags=24 00000080:00200000:3.0:1788201595.900381:0:24476:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ab:0x0](ffff8bc145985348), inode mode 41ed mask 1 00000080:00200000:3.0:1788201595.900396:0:24476:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f2, dir=[0x200000bd7:0x1ab:0x0](ffff8bc145985348), flags=1536 00000080:00200000:3.0:1788201595.900398:0:24476:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ab:0x0](ffff8bc145985348), inode mode 41ed mask 3 00000080:00200000:3.0:1788201595.900403:0:24476:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ab:0x0](ffff8bc145985348), inode mode 41ed mask 3 00000080:00200000:3.0:1788201595.900406:0:24476:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f2, dir=[0x200000bd7:0x1ab:0x0](ffff8bc145985348), flags=33060, excl=1 00000080:00200000:3.0:1788201595.900409:0:24476:0:(namei.c:2084:ll_mknod()) VFS Op:name=f2, dir=[0x200000bd7:0x1ab:0x0](ffff8bc145985348) mode 100444 dev 0 00000020:00100000:3.0:1788201595.900472:0:24476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1788201595.900486:0:24476:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1726cfb80 x1875064728044800/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201595.900511:0:24476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24476:1875064728044800:192.168.201.143@tcp:36:createmany.0 00000100:00100000:3.0:1788201595.901990:0:24476:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201595.909901:0:24476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24476:1875064728044800:192.168.201.143@tcp:36:createmany.0 00000080:00200000:2.0:1788201595.910862:0:24476:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1bf:0x0](ffff8bc145957448) 00000080:00200000:2.0:1788201595.910978:0:24476:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f2, unhashed 1 00000080:00200000:2.0:1788201595.911057:0:24476:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.911086:0:24476:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.911600:0:24476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.911623:0:24476:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.911634:0:24476:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.911643:0:24476:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.911648:0:24476:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.911657:0:24476:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e1bbd0 00010000:00010000:2.0:1788201595.911723:0:24476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.911741:0:24476:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.911764:0:24476:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.911774:0:24476:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201595.911782:0:24476:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.911785:0:24476:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d2, flags=24 00000080:00200000:2.0:1788201595.911788:0:24476:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ab:0x0](ffff8bc145985348), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.911972:0:24476:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f3, dir=[0x200000bd7:0x1ab:0x0](ffff8bc145985348), flags=1536 00000080:00200000:2.0:1788201595.911976:0:24476:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ab:0x0](ffff8bc145985348), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.911982:0:24476:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ab:0x0](ffff8bc145985348), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.911987:0:24476:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f3, dir=[0x200000bd7:0x1ab:0x0](ffff8bc145985348), flags=33060, excl=1 00000080:00200000:2.0:1788201595.911991:0:24476:0:(namei.c:2084:ll_mknod()) VFS Op:name=f3, dir=[0x200000bd7:0x1ab:0x0](ffff8bc145985348) mode 100444 dev 0 00000020:00100000:2.0:1788201595.912070:0:24476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1788201595.912087:0:24476:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172745c00 x1875064728045056/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201595.912135:0:24476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172745c00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24476:1875064728045056:192.168.201.143@tcp:36:createmany.0 00000100:00100000:2.0:1788201595.912257:0:24476:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.917085:0:24476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172745c00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24476:1875064728045056:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201595.917157:0:24476:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1c0:0x0](ffff8bc144694b08) 00000080:00200000:1.0:1788201595.917262:0:24476:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f3, unhashed 1 00000080:00200000:1.0:1788201595.917350:0:24476:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:1.0:1788201595.917372:0:24476:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1788201595.917395:0:24476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.917412:0:24476:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.917420:0:24476:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1788201595.917427:0:24476:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:1.0:1788201595.917431:0:24476:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:1.0:1788201595.917440:0:24476:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e1bbd0 00010000:00010000:1.0:1788201595.917444:0:24476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1788201595.917454:0:24476:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1788201595.917472:0:24476:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.917480:0:24476:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:1.0:1788201595.917486:0:24476:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.917490:0:24476:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d2, flags=24 00000080:00200000:1.0:1788201595.917492:0:24476:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ab:0x0](ffff8bc145985348), inode mode 41ed mask 1 00000080:00200000:1.0:1788201595.917506:0:24476:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x1ab:0x0](ffff8bc145985348), flags=1536 00000080:00200000:1.0:1788201595.917509:0:24476:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ab:0x0](ffff8bc145985348), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.917515:0:24476:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ab:0x0](ffff8bc145985348), inode mode 41ed mask 3 00000080:00200000:1.0:1788201595.917519:0:24476:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x1ab:0x0](ffff8bc145985348), flags=33060, excl=1 00000080:00200000:1.0:1788201595.917523:0:24476:0:(namei.c:2084:ll_mknod()) VFS Op:name=f4, dir=[0x200000bd7:0x1ab:0x0](ffff8bc145985348) mode 100444 dev 0 00000020:00100000:1.0:1788201595.917602:0:24476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1788201595.917614:0:24476:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1727d4000 x1875064728045312/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201595.917642:0:24476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24476:1875064728045312:192.168.201.143@tcp:36:createmany.0 00000100:00100000:1.0:1788201595.917746:0:24476:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1455593c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201595.921967:0:24476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24476:1875064728045312:192.168.201.143@tcp:36:createmany.0 00000080:00200000:1.0:1788201595.922048:0:24476:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1c1:0x0](ffff8bc144693a88) 00000080:00200000:1.0:1788201595.927591:0:24476:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f4, unhashed 1 00000080:00200000:0.0:1788201595.942968:0:24477:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201595.943011:0:24477:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201595.943035:0:24477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201595.943055:0:24477:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201595.943376:0:24477:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201595.943387:0:24477:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201595.943391:0:24477:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201595.943399:0:24477:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e13bd0 00010000:00010000:0.0:1788201595.943403:0:24477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201595.943412:0:24477:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201595.943429:0:24477:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.943437:0:24477:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201595.943444:0:24477:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.943463:0:24477:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d3, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=24 00000080:00200000:0.0:1788201595.943468:0:24477:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=d3, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=0 00000002:00010000:0.0:1788201595.943480:0:24477:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d3,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: lookup flags 0 00010000:00010000:0.0:1788201595.943550:0:24477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a400/0xd138388016f6f9a8 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.943560:0:24477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a400/0xd138388016f6f9a8 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.943573:0:24477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a400/0xd138388016f6f9a8 lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24477 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201595.943603:0:24477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24477:1875064728045440:192.168.201.143@tcp:101:createmany.0 00000100:00100000:0.0:1788201595.943733:0:24477:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201595.948902:0:24477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24477:1875064728045440:192.168.201.143@tcp:101:createmany.0 00010000:00010000:0.0:1788201595.948940:0:24477:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a400/0xd138388016f6f9a8 lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098901 expref: -99 pid: 24477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.948968:0:24477:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a400/0xd138388016f6f9a8 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x1ac:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098901 expref: -99 pid: 24477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.948977:0:24477:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a400/0xd138388016f6f9a8 lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x1ac:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098901 expref: -99 pid: 24477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.948990:0:24477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a400/0xd138388016f6f9a8 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x1ac:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098901 expref: -99 pid: 24477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.949004:0:24477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a400/0xd138388016f6f9a8 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x1ac:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098901 expref: -99 pid: 24477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.949020:0:24477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a400/0xd138388016f6f9a8 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x1ac:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098901 expref: -99 pid: 24477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.949029:0:24477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a400/0xd138388016f6f9a8 lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x1ac:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098901 expref: -99 pid: 24477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.949037:0:24477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a400/0xd138388016f6f9a8 lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x1ac:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098901 expref: -99 pid: 24477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201595.949053:0:24477:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x10 disposition=0xb, status=0 req@ffff8bc144143800 x1875064728045440/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201611 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201595.949067:0:24477:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a400/0xd138388016f6f9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1ac:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098901 expref: -99 pid: 24477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.949082:0:24477:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/428 (0 0) 00000080:00200000:0.0:1788201595.949091:0:24477:0:(namei.c:952:ll_intent_lock()) intent lock 16 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201595.949132:0:24477:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x1ac:0x0], updating i_size 512 00000080:00200000:0.0:1788201595.949137:0:24477:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x1ac:0x0](ffff8bc145981148): rc = 0 00000080:00010000:0.0:1788201595.949143:0:24477:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1ac:0x0](ffff8bc145981148) for lock 0xd138388016f6f9a8 00000080:00010000:0.0:1788201595.949161:0:24477:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1ac:0x0](ffff8bc145981148) 00000080:00010000:0.0:1788201595.949165:0:24477:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f9a8 from it ffffadd1c7e13aa0 00010000:00010000:0.0:1788201595.949168:0:24477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a400/0xd138388016f6f9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1ac:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098901 expref: -99 pid: 24477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.949177:0:24477:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a400/0xd138388016f6f9a8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1ac:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098901 expref: -99 pid: 24477 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201595.949224:0:24477:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ac:0x0](ffff8bc145981148), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.949257:0:24477:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f0, dir=[0x200000bd7:0x1ac:0x0](ffff8bc145981148), flags=1536 00000080:00200000:0.0:1788201595.949261:0:24477:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ac:0x0](ffff8bc145981148), inode mode 41ed mask 3 00000080:00200000:0.0:1788201595.949269:0:24477:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ac:0x0](ffff8bc145981148), inode mode 41ed mask 3 00000080:00200000:0.0:1788201595.949274:0:24477:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f0, dir=[0x200000bd7:0x1ac:0x0](ffff8bc145981148), flags=33060, excl=1 00000080:00200000:0.0:1788201595.949279:0:24477:0:(namei.c:2084:ll_mknod()) VFS Op:name=f0, dir=[0x200000bd7:0x1ac:0x0](ffff8bc145981148) mode 100444 dev 0 00000020:00100000:0.0:1788201595.949949:0:24477:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201595.949961:0:24477:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144143800 x1875064728045696/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201595.949987:0:24477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24477:1875064728045696:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201595.950100:0:24477:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201595.954541:0:24477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24477:1875064728045696:192.168.201.143@tcp:36:createmany.0 00000080:00200000:2.0:1788201595.954612:0:24477:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1c2:0x0](ffff8bc145956c08) 00000080:00200000:2.0:1788201595.954721:0:24477:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f0, unhashed 1 00000080:00200000:2.0:1788201595.954871:0:24477:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:2.0:1788201595.954894:0:24477:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1788201595.954918:0:24477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.954942:0:24477:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.954951:0:24477:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1788201595.954957:0:24477:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:2.0:1788201595.954961:0:24477:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:2.0:1788201595.954970:0:24477:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e13bd0 00010000:00010000:2.0:1788201595.954975:0:24477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201595.954984:0:24477:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1788201595.955003:0:24477:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.955010:0:24477:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:2.0:1788201595.955016:0:24477:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.955020:0:24477:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d3, flags=24 00000080:00200000:2.0:1788201595.955022:0:24477:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ac:0x0](ffff8bc145981148), inode mode 41ed mask 1 00000080:00200000:2.0:1788201595.955037:0:24477:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x1ac:0x0](ffff8bc145981148), flags=1536 00000080:00200000:2.0:1788201595.955041:0:24477:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ac:0x0](ffff8bc145981148), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.955046:0:24477:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ac:0x0](ffff8bc145981148), inode mode 41ed mask 3 00000080:00200000:2.0:1788201595.955051:0:24477:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x1ac:0x0](ffff8bc145981148), flags=33060, excl=1 00000080:00200000:2.0:1788201595.955055:0:24477:0:(namei.c:2084:ll_mknod()) VFS Op:name=f1, dir=[0x200000bd7:0x1ac:0x0](ffff8bc145981148) mode 100444 dev 0 00000020:00100000:2.0:1788201595.955132:0:24477:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1788201595.955143:0:24477:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc172744e00 x1875064728045952/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201595.955177:0:24477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172744e00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24477:1875064728045952:192.168.201.143@tcp:36:createmany.0 00000100:00100000:2.0:1788201595.956994:0:24477:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726230c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201595.969680:0:24477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172744e00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24477:1875064728045952:192.168.201.143@tcp:36:createmany.0 00000080:00200000:3.0:1788201595.969757:0:24477:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1c3:0x0](ffff8bc1459d00c8) 00000080:00200000:3.0:1788201595.970425:0:24477:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f1, unhashed 1 00000080:00200000:3.0:1788201595.970662:0:24477:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201595.970685:0:24477:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201595.970708:0:24477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201595.970728:0:24477:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201595.970738:0:24477:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201595.970745:0:24477:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201595.970750:0:24477:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201595.970759:0:24477:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e13bd0 00010000:00010000:3.0:1788201595.970764:0:24477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201595.970773:0:24477:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201595.970836:0:24477:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201595.970845:0:24477:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201595.970852:0:24477:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201595.970856:0:24477:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d3, flags=24 00000080:00200000:3.0:1788201595.970860:0:24477:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ac:0x0](ffff8bc145981148), inode mode 41ed mask 1 00000080:00200000:3.0:1788201595.970878:0:24477:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f2, dir=[0x200000bd7:0x1ac:0x0](ffff8bc145981148), flags=1536 00000080:00200000:3.0:1788201595.970881:0:24477:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ac:0x0](ffff8bc145981148), inode mode 41ed mask 3 00000080:00200000:3.0:1788201595.970886:0:24477:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ac:0x0](ffff8bc145981148), inode mode 41ed mask 3 00000080:00200000:3.0:1788201595.970890:0:24477:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f2, dir=[0x200000bd7:0x1ac:0x0](ffff8bc145981148), flags=33060, excl=1 00000080:00200000:3.0:1788201595.970893:0:24477:0:(namei.c:2084:ll_mknod()) VFS Op:name=f2, dir=[0x200000bd7:0x1ac:0x0](ffff8bc145981148) mode 100444 dev 0 00000020:00100000:3.0:1788201595.970962:0:24477:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1788201595.970977:0:24477:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1726ce680 x1875064728046208/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201595.971004:0:24477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24477:1875064728046208:192.168.201.143@tcp:36:createmany.0 00000100:00100000:3.0:1788201595.974530:0:24477:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201595.977609:0:24477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24477:1875064728046208:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201595.977835:0:24477:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1c4:0x0](ffff8bc1459b3248) 00000080:00200000:0.0:1788201595.977942:0:24477:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f2, unhashed 1 00000080:00200000:0.0:1788201595.978022:0:24477:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201595.978043:0:24477:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201595.978068:0:24477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201595.978086:0:24477:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201595.978238:0:24477:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201595.978245:0:24477:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201595.978250:0:24477:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201595.978261:0:24477:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e13bd0 00010000:00010000:0.0:1788201595.978265:0:24477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201595.978276:0:24477:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201595.978295:0:24477:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.978303:0:24477:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201595.978379:0:24477:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.978385:0:24477:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d3, flags=24 00000080:00200000:0.0:1788201595.978389:0:24477:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ac:0x0](ffff8bc145981148), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.978408:0:24477:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f3, dir=[0x200000bd7:0x1ac:0x0](ffff8bc145981148), flags=1536 00000080:00200000:0.0:1788201595.978412:0:24477:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ac:0x0](ffff8bc145981148), inode mode 41ed mask 3 00000080:00200000:0.0:1788201595.978417:0:24477:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ac:0x0](ffff8bc145981148), inode mode 41ed mask 3 00000080:00200000:0.0:1788201595.978421:0:24477:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f3, dir=[0x200000bd7:0x1ac:0x0](ffff8bc145981148), flags=33060, excl=1 00000080:00200000:0.0:1788201595.978425:0:24477:0:(namei.c:2084:ll_mknod()) VFS Op:name=f3, dir=[0x200000bd7:0x1ac:0x0](ffff8bc145981148) mode 100444 dev 0 00000020:00100000:0.0:1788201595.978574:0:24477:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201595.978587:0:24477:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144143b80 x1875064728046464/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201595.978617:0:24477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24477:1875064728046464:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201595.978730:0:24477:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201595.983568:0:24477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24477:1875064728046464:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201595.983635:0:24477:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1c5:0x0](ffff8bc1459b21c8) 00000080:00200000:0.0:1788201595.983734:0:24477:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f3, unhashed 1 00000080:00200000:0.0:1788201595.983851:0:24477:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201595.983874:0:24477:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201595.983898:0:24477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201595.983916:0:24477:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201595.983924:0:24477:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201595.983931:0:24477:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201595.983934:0:24477:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201595.983944:0:24477:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e13bd0 00010000:00010000:0.0:1788201595.983948:0:24477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201595.983958:0:24477:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201595.983975:0:24477:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.983984:0:24477:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201595.983990:0:24477:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.983994:0:24477:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d3, flags=24 00000080:00200000:0.0:1788201595.983997:0:24477:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ac:0x0](ffff8bc145981148), inode mode 41ed mask 1 00000080:00200000:0.0:1788201595.984015:0:24477:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x1ac:0x0](ffff8bc145981148), flags=1536 00000080:00200000:0.0:1788201595.984019:0:24477:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ac:0x0](ffff8bc145981148), inode mode 41ed mask 3 00000080:00200000:0.0:1788201595.984024:0:24477:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ac:0x0](ffff8bc145981148), inode mode 41ed mask 3 00000080:00200000:0.0:1788201595.984028:0:24477:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x1ac:0x0](ffff8bc145981148), flags=33060, excl=1 00000080:00200000:0.0:1788201595.984032:0:24477:0:(namei.c:2084:ll_mknod()) VFS Op:name=f4, dir=[0x200000bd7:0x1ac:0x0](ffff8bc145981148) mode 100444 dev 0 00000020:00100000:0.0:1788201595.984250:0:24477:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201595.984262:0:24477:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144141500 x1875064728046720/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201595.984290:0:24477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24477:1875064728046720:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201595.984393:0:24477:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201595.991085:0:24477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24477:1875064728046720:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201595.991173:0:24477:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1c6:0x0](ffff8bc1459b1988) 00000080:00200000:0.0:1788201595.991277:0:24477:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f4, unhashed 1 00000080:00200000:0.0:1788201596.006074:0:24478:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201596.006184:0:24478:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201596.006209:0:24478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201596.006229:0:24478:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201596.006238:0:24478:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201596.006247:0:24478:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201596.006252:0:24478:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201596.006261:0:24478:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e0bbd0 00010000:00010000:0.0:1788201596.006266:0:24478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201596.006275:0:24478:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201596.006294:0:24478:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201596.006302:0:24478:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201596.006386:0:24478:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201596.006402:0:24478:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d4, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=24 00000080:00200000:0.0:1788201596.006408:0:24478:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=d4, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), intent=0 00000002:00010000:0.0:1788201596.006422:0:24478:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d4,[0x0:0x0:0x0]) in obj [0x200000bd7:0x15b:0x0], intent: lookup flags 0 00010000:00010000:0.0:1788201596.006490:0:24478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6f9af lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.006499:0:24478:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6f9af lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.006579:0:24478:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6f9af lrc: 3/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201596.006615:0:24478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24478:1875064728046848:192.168.201.143@tcp:101:createmany.0 00000100:00100000:0.0:1788201596.006863:0:24478:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201596.011619:0:24478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24478:1875064728046848:192.168.201.143@tcp:101:createmany.0 00010000:00010000:0.0:1788201596.011660:0:24478:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6f9af lrc: 4/1,0 mode: --/CR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098963 expref: -99 pid: 24478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.011702:0:24478:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6f9af lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x1ad:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098963 expref: -99 pid: 24478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.011711:0:24478:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6f9af lrc: 4/1,0 mode: --/PR res: [0x200000bd7:0x1ad:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098963 expref: -99 pid: 24478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.011727:0:24478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6f9af lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x1ad:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098963 expref: -99 pid: 24478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.011742:0:24478:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6f9af lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x1ad:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098963 expref: -99 pid: 24478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.011760:0:24478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6f9af lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x1ad:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098963 expref: -99 pid: 24478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.011771:0:24478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6f9af lrc: 5/2,0 mode: PR/PR res: [0x200000bd7:0x1ad:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098963 expref: -99 pid: 24478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.011780:0:24478:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6f9af lrc: 4/1,0 mode: PR/PR res: [0x200000bd7:0x1ad:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098963 expref: -99 pid: 24478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1788201596.012040:0:24478:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x10 disposition=0xb, status=0 req@ffff8bc144143100 x1875064728046848/t0(0) o101->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1788201612 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'createmany.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1788201596.012060:0:24478:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6f9af lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1ad:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098963 expref: -99 pid: 24478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.012081:0:24478:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8bc14692e400 type 13 mode 4 res 8589937623/429 (0 0) 00000080:00200000:0.0:1788201596.012227:0:24478:0:(namei.c:952:ll_intent_lock()) intent lock 16 on i1 [0x200000bd7:0x15b:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1788201596.012262:0:24478:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x1ad:0x0], updating i_size 512 00000080:00200000:0.0:1788201596.012265:0:24478:0:(namei.c:147:ll_iget()) got inode: [0x200000bd7:0x1ad:0x0](ffff8bc145983248): rc = 0 00000080:00010000:0.0:1788201596.012273:0:24478:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000bd7:0x1ad:0x0](ffff8bc145983248) for lock 0xd138388016f6f9af 00000080:00010000:0.0:1788201596.012289:0:24478:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd7:0x1ad:0x0](ffff8bc145983248) 00000080:00010000:0.0:1788201596.012292:0:24478:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6f9af from it ffffadd1c7e0baa0 00010000:00010000:0.0:1788201596.012297:0:24478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6f9af lrc: 3/1,0 mode: PR/PR res: [0x200000bd7:0x1ad:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171098963 expref: -99 pid: 24478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201596.012383:0:24478:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6f9af lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1ad:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171098963 expref: -99 pid: 24478 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1788201596.012436:0:24478:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ad:0x0](ffff8bc145983248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201596.012464:0:24478:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f0, dir=[0x200000bd7:0x1ad:0x0](ffff8bc145983248), flags=1536 00000080:00200000:0.0:1788201596.012467:0:24478:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ad:0x0](ffff8bc145983248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201596.012475:0:24478:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ad:0x0](ffff8bc145983248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201596.012480:0:24478:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f0, dir=[0x200000bd7:0x1ad:0x0](ffff8bc145983248), flags=33060, excl=1 00000080:00200000:0.0:1788201596.012484:0:24478:0:(namei.c:2084:ll_mknod()) VFS Op:name=f0, dir=[0x200000bd7:0x1ad:0x0](ffff8bc145983248) mode 100444 dev 0 00000020:00100000:0.0:1788201596.012639:0:24478:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201596.012649:0:24478:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144143100 x1875064728047104/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201596.012678:0:24478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24478:1875064728047104:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201596.012943:0:24478:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201596.022267:0:24478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24478:1875064728047104:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201596.022362:0:24478:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1c7:0x0](ffff8bc1459b7448) 00000080:00200000:0.0:1788201596.022472:0:24478:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f0, unhashed 1 00000080:00200000:0.0:1788201596.022571:0:24478:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201596.022593:0:24478:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201596.022617:0:24478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201596.022636:0:24478:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201596.022646:0:24478:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201596.022652:0:24478:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201596.022656:0:24478:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201596.022664:0:24478:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e0bbd0 00010000:00010000:0.0:1788201596.022669:0:24478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201596.022679:0:24478:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201596.022699:0:24478:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201596.022708:0:24478:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201596.022715:0:24478:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201596.022719:0:24478:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d4, flags=24 00000080:00200000:0.0:1788201596.022722:0:24478:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ad:0x0](ffff8bc145983248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201596.022738:0:24478:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x1ad:0x0](ffff8bc145983248), flags=1536 00000080:00200000:0.0:1788201596.022741:0:24478:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ad:0x0](ffff8bc145983248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201596.022748:0:24478:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ad:0x0](ffff8bc145983248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201596.022753:0:24478:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f1, dir=[0x200000bd7:0x1ad:0x0](ffff8bc145983248), flags=33060, excl=1 00000080:00200000:0.0:1788201596.022756:0:24478:0:(namei.c:2084:ll_mknod()) VFS Op:name=f1, dir=[0x200000bd7:0x1ad:0x0](ffff8bc145983248) mode 100444 dev 0 00000020:00100000:0.0:1788201596.022850:0:24478:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201596.022864:0:24478:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144140000 x1875064728047360/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201596.022891:0:24478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24478:1875064728047360:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201596.022969:0:24478:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201596.028983:0:24478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24478:1875064728047360:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201596.029043:0:24478:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1c8:0x0](ffff8bc1459b3a88) 00000080:00200000:0.0:1788201596.029157:0:24478:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f1, unhashed 1 00000080:00200000:0.0:1788201596.029233:0:24478:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201596.029255:0:24478:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201596.029281:0:24478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201596.029299:0:24478:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201596.029523:0:24478:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201596.029531:0:24478:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201596.029535:0:24478:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201596.029546:0:24478:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e0bbd0 00010000:00010000:0.0:1788201596.029551:0:24478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201596.029562:0:24478:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201596.029586:0:24478:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201596.029593:0:24478:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201596.029599:0:24478:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201596.029603:0:24478:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d4, flags=24 00000080:00200000:0.0:1788201596.029606:0:24478:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ad:0x0](ffff8bc145983248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201596.029620:0:24478:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f2, dir=[0x200000bd7:0x1ad:0x0](ffff8bc145983248), flags=1536 00000080:00200000:0.0:1788201596.029624:0:24478:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ad:0x0](ffff8bc145983248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201596.029629:0:24478:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ad:0x0](ffff8bc145983248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201596.029634:0:24478:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f2, dir=[0x200000bd7:0x1ad:0x0](ffff8bc145983248), flags=33060, excl=1 00000080:00200000:0.0:1788201596.029638:0:24478:0:(namei.c:2084:ll_mknod()) VFS Op:name=f2, dir=[0x200000bd7:0x1ad:0x0](ffff8bc145983248) mode 100444 dev 0 00000020:00100000:0.0:1788201596.029704:0:24478:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201596.029714:0:24478:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144142300 x1875064728047616/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201596.029741:0:24478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24478:1875064728047616:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201596.029970:0:24478:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201596.036662:0:24478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24478:1875064728047616:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201596.036767:0:24478:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1c9:0x0](ffff8bc1459faa08) 00000080:00200000:0.0:1788201596.036887:0:24478:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f2, unhashed 1 00000080:00200000:0.0:1788201596.036959:0:24478:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201596.036979:0:24478:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201596.037003:0:24478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201596.037021:0:24478:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201596.037036:0:24478:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201596.037042:0:24478:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201596.037046:0:24478:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201596.037055:0:24478:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e0bbd0 00010000:00010000:0.0:1788201596.037060:0:24478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201596.037071:0:24478:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201596.037106:0:24478:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201596.037302:0:24478:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201596.037380:0:24478:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201596.037385:0:24478:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d4, flags=24 00000080:00200000:0.0:1788201596.037388:0:24478:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ad:0x0](ffff8bc145983248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201596.037403:0:24478:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f3, dir=[0x200000bd7:0x1ad:0x0](ffff8bc145983248), flags=1536 00000080:00200000:0.0:1788201596.037407:0:24478:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ad:0x0](ffff8bc145983248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201596.037412:0:24478:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ad:0x0](ffff8bc145983248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201596.037417:0:24478:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f3, dir=[0x200000bd7:0x1ad:0x0](ffff8bc145983248), flags=33060, excl=1 00000080:00200000:0.0:1788201596.037421:0:24478:0:(namei.c:2084:ll_mknod()) VFS Op:name=f3, dir=[0x200000bd7:0x1ad:0x0](ffff8bc145983248) mode 100444 dev 0 00000020:00100000:0.0:1788201596.037492:0:24478:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201596.037502:0:24478:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144141f80 x1875064728047872/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201596.037526:0:24478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24478:1875064728047872:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201596.037624:0:24478:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201596.042985:0:24478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24478:1875064728047872:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201596.043045:0:24478:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1ca:0x0](ffff8bc1459fec08) 00000080:00200000:0.0:1788201596.043149:0:24478:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f3, unhashed 1 00000080:00200000:0.0:1788201596.043221:0:24478:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201596.043241:0:24478:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201596.043263:0:24478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201596.043281:0:24478:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201596.043289:0:24478:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201596.043295:0:24478:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201596.043299:0:24478:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201596.043317:0:24478:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e0bbd0 00010000:00010000:0.0:1788201596.043322:0:24478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201596.043343:0:24478:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201596.043361:0:24478:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201596.043368:0:24478:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201596.043373:0:24478:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201596.043377:0:24478:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d4, flags=24 00000080:00200000:0.0:1788201596.043379:0:24478:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ad:0x0](ffff8bc145983248), inode mode 41ed mask 1 00000080:00200000:0.0:1788201596.043393:0:24478:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x1ad:0x0](ffff8bc145983248), flags=1536 00000080:00200000:0.0:1788201596.043396:0:24478:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ad:0x0](ffff8bc145983248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201596.043402:0:24478:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x1ad:0x0](ffff8bc145983248), inode mode 41ed mask 3 00000080:00200000:0.0:1788201596.043406:0:24478:0:(namei.c:2129:ll_create_nd()) VFS Op:name=f4, dir=[0x200000bd7:0x1ad:0x0](ffff8bc145983248), flags=33060, excl=1 00000080:00200000:0.0:1788201596.043410:0:24478:0:(namei.c:2084:ll_mknod()) VFS Op:name=f4, dir=[0x200000bd7:0x1ad:0x0](ffff8bc145983248) mode 100444 dev 0 00000020:00100000:0.0:1788201596.043473:0:24478:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201596.043482:0:24478:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144140380 x1875064728048128/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201596.043508:0:24478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24478:1875064728048128:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201596.043578:0:24478:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201596.048969:0:24478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24478:1875064728048128:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201596.049039:0:24478:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1cb:0x0](ffff8bc1459fd348) 00000080:00200000:0.0:1788201596.049188:0:24478:0:(namei.c:2137:ll_create_nd()) VFS Op:name=f4, unhashed 1 00000080:00200000:3.0:1788201596.059234:0:24479:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201596.059267:0:24479:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201596.059289:0:24479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201596.059307:0:24479:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201596.059316:0:24479:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201596.059335:0:24479:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201596.059339:0:24479:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201596.059348:0:24479:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7de3be0 00010000:00010000:3.0:1788201596.059353:0:24479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201596.059364:0:24479:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201596.059385:0:24479:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201596.059393:0:24479:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201596.059399:0:24479:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201596.059409:0:24479:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=e0, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=1536 00000080:00200000:3.0:1788201596.059412:0:24479:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:3.0:1788201596.059416:0:24479:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:3.0:1788201596.059420:0:24479:0:(namei.c:2239:do_mkdir()) VFS Op:name=e0, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8) 00000020:00100000:3.0:1788201596.059502:0:24479:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1788201596.059519:0:24479:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1726ced80 x1875064728048384/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201596.059565:0:24479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24479:1875064728048384:192.168.201.143@tcp:36:createmany.0 00000100:00100000:3.0:1788201596.059925:0:24479:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1507dc300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201596.063429:0:24479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24479:1875064728048384:192.168.201.143@tcp:36:createmany.0 00000080:00200000:3.0:1788201596.063499:0:24479:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1cc:0x0](ffff8bc1459d7448) 00000080:00200000:3.0:1788201596.063510:0:24479:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x1cc:0x0], updating i_size 512 00000080:00200000:3.0:1788201596.063612:0:24479:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201596.063635:0:24479:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201596.063664:0:24479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201596.063681:0:24479:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201596.063691:0:24479:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201596.063699:0:24479:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201596.063703:0:24479:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201596.063714:0:24479:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7de3be0 00010000:00010000:3.0:1788201596.063718:0:24479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201596.063726:0:24479:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201596.063742:0:24479:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201596.063748:0:24479:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:3.0:1788201596.063754:0:24479:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1788201596.063765:0:24479:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=e1, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=1536 00000080:00200000:3.0:1788201596.063768:0:24479:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:3.0:1788201596.063772:0:24479:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:3.0:1788201596.063776:0:24479:0:(namei.c:2239:do_mkdir()) VFS Op:name=e1, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8) 00000020:00100000:3.0:1788201596.063895:0:24479:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1788201596.063909:0:24479:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc1726cea00 x1875064728048640/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201596.063995:0:24479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24479:1875064728048640:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201596.064075:0:24479:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201596.067312:0:24479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24479:1875064728048640:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201596.067388:0:24479:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1cd:0x0](ffff8bc1459f9148) 00000080:00200000:0.0:1788201596.067397:0:24479:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x1cd:0x0], updating i_size 512 00000080:00200000:0.0:1788201596.067496:0:24479:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201596.067518:0:24479:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201596.067554:0:24479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201596.067573:0:24479:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201596.067583:0:24479:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201596.067592:0:24479:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201596.067596:0:24479:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201596.067606:0:24479:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7de3be0 00010000:00010000:0.0:1788201596.067611:0:24479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201596.067621:0:24479:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201596.067641:0:24479:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201596.067649:0:24479:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201596.067655:0:24479:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201596.067681:0:24479:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=e2, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=1536 00000080:00200000:0.0:1788201596.067686:0:24479:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201596.067691:0:24479:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201596.067695:0:24479:0:(namei.c:2239:do_mkdir()) VFS Op:name=e2, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8) 00000020:00100000:0.0:1788201596.067769:0:24479:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201596.067781:0:24479:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144141180 x1875064728048896/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201596.067854:0:24479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24479:1875064728048896:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201596.068409:0:24479:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201596.070772:0:24479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24479:1875064728048896:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201596.070948:0:24479:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1ce:0x0](ffff8bc1459f8908) 00000080:00200000:0.0:1788201596.070957:0:24479:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x1ce:0x0], updating i_size 512 00000080:00200000:0.0:1788201596.071042:0:24479:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201596.071064:0:24479:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201596.071086:0:24479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201596.071163:0:24479:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201596.071174:0:24479:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201596.071180:0:24479:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201596.071184:0:24479:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201596.071193:0:24479:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7de3be0 00010000:00010000:0.0:1788201596.071197:0:24479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201596.071207:0:24479:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201596.071225:0:24479:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201596.071234:0:24479:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201596.071240:0:24479:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201596.071260:0:24479:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=e3, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=1536 00000080:00200000:0.0:1788201596.071264:0:24479:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201596.071269:0:24479:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201596.071274:0:24479:0:(namei.c:2239:do_mkdir()) VFS Op:name=e3, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8) 00000020:00100000:0.0:1788201596.071373:0:24479:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201596.071385:0:24479:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144142680 x1875064728049152/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201596.071411:0:24479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24479:1875064728049152:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201596.071759:0:24479:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201596.074593:0:24479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24479:1875064728049152:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201596.074651:0:24479:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1cf:0x0](ffff8bc1459fcb08) 00000080:00200000:0.0:1788201596.074660:0:24479:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x1cf:0x0], updating i_size 512 00000080:00200000:0.0:1788201596.074760:0:24479:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201596.074786:0:24479:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201596.075023:0:24479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201596.075041:0:24479:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201596.075049:0:24479:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201596.075056:0:24479:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201596.075060:0:24479:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201596.075069:0:24479:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7de3be0 00010000:00010000:0.0:1788201596.075074:0:24479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201596.075084:0:24479:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201596.075112:0:24479:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201596.075121:0:24479:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d7a.sanity-lfsck, flags=24 00000080:00200000:0.0:1788201596.075127:0:24479:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1788201596.075143:0:24479:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=e4, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), flags=1536 00000080:00200000:0.0:1788201596.075147:0:24479:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201596.075152:0:24479:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8), inode mode 41ed mask 3 00000080:00200000:0.0:1788201596.075157:0:24479:0:(namei.c:2239:do_mkdir()) VFS Op:name=e4, dir=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8) 00000020:00100000:0.0:1788201596.075232:0:24479:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8bc143fc0000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1788201596.075243:0:24479:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bc144142d80 x1875064728049408/t0(0) o36->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 504/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201596.075268:0:24479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24479:1875064728049408:192.168.201.143@tcp:36:createmany.0 00000100:00100000:0.0:1788201596.075360:0:24479:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201596.078006:0:24479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job createmany:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24479:1875064728049408:192.168.201.143@tcp:36:createmany.0 00000080:00200000:0.0:1788201596.078072:0:24479:0:(llite_lib.c:3364:ll_read_inode2()) VFS Op:inode=[0x200000bd7:0x1d0:0x0](ffff8bc1459fba88) 00000080:00200000:0.0:1788201596.078080:0:24479:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000bd7:0x1d0:0x0], updating i_size 512 00010000:00010000:3.0:1788201596.228017:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200008:0.0:1788201596.369950:0:24491:0:(file.c:6283:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8bc1459f00c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1788201596.369970:0:24491:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:0.0:1788201596.370004:0:24491:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1788201596.370033:0:24491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201596.370054:0:24491:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1788201596.370064:0:24491:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1788201596.370077:0:24491:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:0.0:1788201596.370082:0:24491:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:0.0:1788201596.370094:0:24491:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e53cb8 00010000:00010000:0.0:1788201596.370099:0:24491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1788201596.370111:0:24491:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000100:00100000:3.0:1788201596.679729:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728049664:192.168.201.143@tcp:400:kworker.0 00000100:00100000:3.0:1788201596.679900:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201596.679908:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:21dcfac0-2fe1-402c-8fca-db923b83f76c:10055:1875064728049536:192.168.201.143@tcp:400:kworker.0 00000100:00100000:3.0:1788201596.679950:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728049792:192.168.201.143@tcp:400:kworker.0 00000100:00100000:3.0:1788201596.679978:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201596.679983:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728049920:192.168.201.143@tcp:400:kworker.0 00000100:00100000:0.0:1788201596.684289:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728049792:192.168.201.143@tcp:400:kworker.0 00000100:00100000:3.0:1788201596.703470:0:10052:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8bc143fc0000: committing for last_committed 8589935329 gen 1 00000100:00100000:0.0:1788201596.703502:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:21dcfac0-2fe1-402c-8fca-db923b83f76c:10055:1875064728049536:192.168.201.143@tcp:400:kworker.0 00000100:00100000:0.0:1788201596.703532:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728049664:192.168.201.143@tcp:400:kworker.0 00000100:00100000:3.0:1788201596.703663:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728049920:192.168.201.143@tcp:400:kworker.0 00010000:00010000:3.0:1788201597.252045:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201598.279526:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200008:3.0:1788201598.337885:0:24499:0:(file.c:6283:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8bc1459f00c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201598.337899:0:24499:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201598.337920:0:24499:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201598.337939:0:24499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201598.337956:0:24499:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201598.337965:0:24499:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201598.337974:0:24499:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201598.337977:0:24499:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201598.337985:0:24499:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e73cb8 00010000:00010000:3.0:1788201598.337988:0:24499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201598.337997:0:24499:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200008:3.0:1788201598.338210:0:24499:0:(file.c:6283:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8bc1459f00c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1788201598.338216:0:24499:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8),name=/ 00000002:00010000:3.0:1788201598.338224:0:24499:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1788201598.338232:0:24499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201598.338241:0:24499:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1788201598.338247:0:24499:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1788201598.338251:0:24499:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00010000:3.0:1788201598.338254:0:24499:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8bc1459f00c8) for lock 0xd138388016f6eebf 00000080:00010000:3.0:1788201598.338258:0:24499:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xd138388016f6eebf from it ffffadd1c7e73cb8 00010000:00010000:3.0:1788201598.338261:0:24499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201598.338269:0:24499:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1788201599.299982:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201600.324377:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201600.553637:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:2.0:1788201600.553689:0:10045:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201600.553880:0:20877:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788201600.553903:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743501824 00000100:00100000:1.0:1788201600.553913:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743501824 00000100:00100000:1.0:1788201600.553966:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743501952 00000100:00100000:1.0:1788201600.553970:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743501952 00000100:00100000:1.0:1788201600.553999:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 878 00000100:00100000:1.0:1788201600.554010:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc172745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+5:23415:x1875064743501824:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201600.554027:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f6fd8f72/0xd138388016f6e6df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710943e8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201600.554118:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201600.554125:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc172745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+5:23415:x1875064743501824:12345-192.168.201.143@tcp:104: Request processed in 118us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201600.554132:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 878 00000100:00100000:1.0:1788201600.554160:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 879 00000100:00100000:1.0:1788201600.554167:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc145ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23392:x1875064743501952:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201600.554177:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e90f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094998 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201600.554209:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788201600.554214:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc145ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:23392:x1875064743501952:12345-192.168.201.143@tcp:104: Request processed in 48us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201600.554220:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 879 00010000:00010000:1.0:1788201600.554264:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201600.554269:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f6fd8f72/0xd138388016f6e6df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e21710943e8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201600.554278:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172611200 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201600.554285:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f6fd8f72/0xd138388016f6e6df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e21710943e8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201600.554367:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f6fd8f72/0xd138388016f6e6df lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710943e8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201600.554375:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201600.554400:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f6fd8f72/0xd138388016f6e6df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710943e8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201600.554408:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000f6fd8f72/0xd138388016f6e6df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e21710943e8 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1788201600.554436:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201600.554439:0:20881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e90f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e2171094998 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201600.554445:0:20881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172734c00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:1.0:1788201600.554449:0:20881:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e90f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e2171094998 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201600.554483:0:20881:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e90f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094998 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201600.554490:0:20881:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201600.554496:0:20881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e90f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094998 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201600.554503:0:20881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002c74897c/0xd138388016f6e90f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e2171094998 expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201600.554517:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201600.554519:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201600.554520:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201600.554538:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728050048:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201600.554620:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201600.554626:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728050176:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201600.555204:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201600.555486:0:10047:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.143@tcp (source: 12345-192.168.201.143@tcp) 00000100:00100000:1.0:1788201600.555575:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064743502080 00000100:00100000:1.0:1788201600.555580:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064743502080 00000100:00100000:1.0:1788201600.555610:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.143@tcp, seq: 880 00000100:00100000:1.0:1788201600.555618:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bc144141880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21821:x1875064743502080:12345-192.168.201.143@tcp:104: 00010000:00010000:1.0:1788201600.555629:0:20877:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1788201600.555908:0:20877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201600.555915:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bc144141880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:21821:x1875064743502080:12345-192.168.201.143@tcp:104: Request processed in 297us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201600.555923:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.143@tcp, seq: 880 00010000:00010000:3.0:1788201600.556372:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201600.556379:0:23027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x420000030000 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201600.556389:0:23027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc149f3ce00 already unused, calling callback (ffffffffc10772d0) 00010000:00010000:3.0:1788201600.556395:0:23027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x428400030000 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201600.556475:0:23027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201600.556482:0:23027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788201600.556538:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728050304:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201600.556633:0:23027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201600.556642:0:23027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000951f6564/0xd138388016f6ece3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4c29400030020 nid: local remote: 0xe6657e217109538c expref: -99 pid: 23731 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1788201600.556661:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201600.556663:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201600.556665:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201600.560950:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728050048:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201600.560990:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728050176:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788201600.562358:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728050304:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201601.350768:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201601.798772:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728050688:192.168.201.143@tcp:400:kworker.0 00000100:00100000:1.0:1788201601.798986:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201601.798994:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728050560:192.168.201.143@tcp:400:kworker.0 00000100:00100000:0.0:1788201601.800561:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728050816:192.168.201.143@tcp:400:kworker.0 00000100:00100000:0.0:1788201601.800660:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201601.800669:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:21dcfac0-2fe1-402c-8fca-db923b83f76c:10052:1875064728050432:192.168.201.143@tcp:400:kworker.0 00000100:00100000:1.0:1788201601.810480:0:10055:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8bc143fc0000: committing for last_committed 8589937531 gen 1 00000100:00100000:1.0:1788201601.810687:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728050560:192.168.201.143@tcp:400:kworker.0 00000100:00100000:1.0:1788201601.810705:0:10055:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8bc143fc0000: committing for last_committed 8589935331 gen 1 00000100:00100000:1.0:1788201601.810733:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728050688:192.168.201.143@tcp:400:kworker.0 00000100:00100000:0.0:1788201601.811952:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:21dcfac0-2fe1-402c-8fca-db923b83f76c:10052:1875064728050432:192.168.201.143@tcp:400:kworker.0 00000100:00100000:0.0:1788201601.811979:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728050816:192.168.201.143@tcp:400:kworker.0 00010000:00010000:3.0:1788201602.374470:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201603.396292:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201604.431242:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201605.447516:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201606.467998:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201606.917043:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728051328:192.168.201.143@tcp:400:kworker.0 00000100:00100000:0.0:1788201606.917425:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728051200:192.168.201.143@tcp:400:kworker.0 00000100:00100000:0.0:1788201606.917559:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201606.917569:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728051072:192.168.201.143@tcp:400:kworker.0 00000100:00100000:1.0:1788201606.918125:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201606.918145:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:21dcfac0-2fe1-402c-8fca-db923b83f76c:10052:1875064728050944:192.168.201.143@tcp:400:kworker.0 00000100:00100000:1.0:1788201606.925450:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728051328:192.168.201.143@tcp:400:kworker.0 00000100:00100000:1.0:1788201606.942127:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728051072:192.168.201.143@tcp:400:kworker.0 00000100:00100000:1.0:1788201606.942157:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728051200:192.168.201.143@tcp:400:kworker.0 00000100:00100000:1.0:1788201606.955687:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:21dcfac0-2fe1-402c-8fca-db923b83f76c:10052:1875064728050944:192.168.201.143@tcp:400:kworker.0 00010000:00010000:0.0:1788201607.492015:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201608.516284:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201609.539950:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201610.566260:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201611.589259:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201612.038069:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:21dcfac0-2fe1-402c-8fca-db923b83f76c:10053:1875064728051456:192.168.201.143@tcp:400:kworker.0 00000100:00100000:1.0:1788201612.038077:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728051840:192.168.201.143@tcp:400:kworker.0 00000100:00100000:2.0:1788201612.038163:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728051584:192.168.201.143@tcp:400:kworker.0 00000100:00100000:1.0:1788201612.039006:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728051712:192.168.201.143@tcp:400:kworker.0 00000100:00100000:3.0:1788201612.056248:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728051840:192.168.201.143@tcp:400:kworker.0 00000100:00100000:0.0:1788201612.066571:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:21dcfac0-2fe1-402c-8fca-db923b83f76c:10053:1875064728051456:192.168.201.143@tcp:400:kworker.0 00000100:00100000:0.0:1788201612.078216:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728051584:192.168.201.143@tcp:400:kworker.0 00000100:00100000:1.0:1788201612.078382:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728051712:192.168.201.143@tcp:400:kworker.0 00010000:00010000:3.0:1788201612.612183:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201613.637262:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201614.660024:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201615.684103:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201616.708828:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201617.157172:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728052352:192.168.201.143@tcp:400:kworker.0 00000100:00100000:2.0:1788201617.157308:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201617.157316:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:21dcfac0-2fe1-402c-8fca-db923b83f76c:10052:1875064728051968:192.168.201.143@tcp:400:kworker.0 00000100:00100000:0.0:1788201617.157538:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728052096:192.168.201.143@tcp:400:kworker.0 00000100:00100000:0.0:1788201617.157575:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201617.157581:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728052224:192.168.201.143@tcp:400:kworker.0 00000100:00100000:2.0:1788201617.164355:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728052352:192.168.201.143@tcp:400:kworker.0 00000100:00100000:0.0:1788201617.164526:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728052224:192.168.201.143@tcp:400:kworker.0 00000100:00100000:0.0:1788201617.164540:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728052096:192.168.201.143@tcp:400:kworker.0 00000100:00100000:3.0:1788201617.167529:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:21dcfac0-2fe1-402c-8fca-db923b83f76c:10052:1875064728051968:192.168.201.143@tcp:400:kworker.0 00010000:00010000:3.0:1788201617.731995:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201618.756031:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201619.782829:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201620.804135:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201621.253438:0:24466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490200/0xd138388016f6f9b6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201621.253459:0:24466:0:(ldlm_request.c:1275:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490200/0xd138388016f6f9b6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201621.254122:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201621.254152:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728052480:192.168.201.143@tcp:63:ll_sa.0 00010000:00010000:3.0:1788201621.274016:0:10052:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490200/0xd138388016f6f9b6 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201621.274035:0:10052:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490200/0xd138388016f6f9b6 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201621.274042:0:10052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490200/0xd138388016f6f9b6 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201621.274048:0:10052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490200/0xd138388016f6f9b6 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201621.274057:0:10052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490200/0xd138388016f6f9b6 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201621.274076:0:10052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc172490200 already unused, calling callback (ffffffffc19a82a0) 00010000:00010000:3.0:1788201621.274080:0:10052:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490200/0xd138388016f6f9b6 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 3 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201621.274087:0:10052:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490200/0xd138388016f6f9b6 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 3 type: IBT flags: 0x206400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201621.274093:0:10052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490200/0xd138388016f6f9b6 lrc: 5/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201621.274100:0:10052:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201621.274107:0:10052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490200/0xd138388016f6f9b6 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201621.274113:0:10052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490200/0xd138388016f6f9b6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x3 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201621.274147:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728052480:192.168.201.143@tcp:63:ll_sa.0 00000080:00200000:2.0:1788201621.398081:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x15c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.398098:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.398177:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x15c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.398211:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x15d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.398216:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.398235:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x15d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.398250:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x15e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.398255:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.398271:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x15e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.398288:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x15f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.398293:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.398309:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x15f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.398338:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x160:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.398343:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.398360:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x160:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.398378:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x161:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.398382:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.398421:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x161:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.398441:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x162:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.398446:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.398461:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x162:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.398476:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x163:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.398480:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.398494:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x163:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.398511:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x164:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.398515:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.398531:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x164:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.398548:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x165:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.398552:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.398570:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x165:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.398587:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x166:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.398590:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.398607:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x166:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.398623:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x167:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.398627:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.398658:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x167:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.398676:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x168:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.398680:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.398696:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x168:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.398714:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x169:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.398729:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.398748:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x169:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.398776:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x16a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.398780:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.398823:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x16a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.398842:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x16b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.398846:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.398864:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x16b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.398881:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x16c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.398897:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.398916:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x16c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.398934:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x16d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.398939:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.398955:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x16d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.398972:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x16e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.398976:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:2.0:1788201621.398997:0:37:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 0000000022ba4270 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.399016:0:37:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 0000000022ba4270 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201621.399082:0:37:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.399173:0:37:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc172744000 - object 0x240000400:425 offset 0<>838 00000080:00200000:2.0:1788201621.399228:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x16e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.399249:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x16f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.399253:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.399272:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x16f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.399288:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x170:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.399292:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.399310:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x170:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.399326:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x171:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.399330:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.399346:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x171:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.399362:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x172:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.399367:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.399382:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x172:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.399399:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x173:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.399403:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.399419:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x173:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.399434:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x174:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.399438:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.399454:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x174:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.399470:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x175:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.399475:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.399489:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x175:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.399505:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x176:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.399510:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.399526:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x176:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.399542:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x177:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.399545:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:2.0:1788201621.399559:0:37:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000effc8163 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.399570:0:37:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000effc8163 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201621.399618:0:37:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.399674:0:37:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc172745180 - object 0x280000400:430 offset 0<>6213 00000080:00200000:2.0:1788201621.399695:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x177:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.399715:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x178:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.399720:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:2.0:1788201621.399734:0:37:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 0000000028f6ddfc ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.399744:0:37:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 0000000028f6ddfc ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201621.399764:0:37:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.399821:0:37:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc172744700 - object 0x240000400:430 offset 0<>269 00000080:00200000:2.0:1788201621.399855:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x178:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.399875:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x179:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.399879:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:2.0:1788201621.399905:0:37:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 0000000041b4f8c3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f31f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109757b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.399915:0:37:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 0000000041b4f8c3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f31f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109757b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201621.399950:0:37:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f31f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109757b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.399980:0:37:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc172746680 - object 0x280000400:431 offset 0<>234 00000080:00200000:2.0:1788201621.400000:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x179:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.400020:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.400025:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:2.0:1788201621.400039:0:37:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000a635ea37 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000bfd1eb34/0xd138388016f6f342 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710975d6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.400048:0:37:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000a635ea37 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000bfd1eb34/0xd138388016f6f342 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710975d6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201621.400071:0:37:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000bfd1eb34/0xd138388016f6f342 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710975d6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.400115:0:37:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc172744e00 - object 0x240000400:431 offset 0<>4117 00000080:00200000:2.0:1788201621.400135:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.400156:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.400162:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:2.0:1788201621.400176:0:37:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000009a8144be ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.400186:0:37:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000009a8144be ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201621.400206:0:37:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.400250:0:37:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc172745c00 - object 0x280000400:432 offset 0<>3079 00000080:00200000:2.0:1788201621.400268:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.400286:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.400291:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:2.0:1788201621.400305:0:37:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000004788e32b ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f388 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109768c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.400315:0:37:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000004788e32b ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f388 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109768c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201621.400337:0:37:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f388 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109768c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.400381:0:37:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc172746d80 - object 0x240000400:432 offset 0<>4150 00000080:00200000:2.0:1788201621.400401:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.400420:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.400425:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:2.0:1788201621.400439:0:37:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000006e2340c0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000069322032/0xd138388016f6f3ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710976e7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.400448:0:37:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000006e2340c0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000069322032/0xd138388016f6f3ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710976e7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201621.400470:0:37:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000069322032/0xd138388016f6f3ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710976e7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.400499:0:37:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc172746a00 - object 0x280000400:433 offset 0<>7187 00000080:00200000:2.0:1788201621.400517:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.400536:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.400541:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:2.0:1788201621.400554:0:37:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 0000000014c5a66b ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097742 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.400562:0:37:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 0000000014c5a66b ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097742 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201621.400585:0:37:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097742 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.400653:0:37:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc172745f80 - object 0x240000400:433 offset 0<>8441 00000080:00200000:2.0:1788201621.400674:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.400695:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.400700:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:2.0:1788201621.400714:0:37:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000003e326483 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000943c2caa/0xd138388016f6f3f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109779d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.400723:0:37:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000003e326483 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000943c2caa/0xd138388016f6f3f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109779d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201621.400744:0:37:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000943c2caa/0xd138388016f6f3f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109779d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.400772:0:37:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc172747480 - object 0x280000400:434 offset 0<>1790 00000080:00200000:2.0:1788201621.400820:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.400844:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x180:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.400849:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:2.0:1788201621.400865:0:37:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000ba6985c4 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f40fa3a5/0xd138388016f6f414 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710977f8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.400874:0:37:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000ba6985c4 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f40fa3a5/0xd138388016f6f414 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710977f8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000100:00100000:0.0:1788201621.401205:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728052608:192.168.201.143@tcp:4:cp.0 00000100:00100000:0.0:1788201621.401336:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728053120:192.168.201.143@tcp:4:cp.0 00000100:00100000:0.0:1788201621.401361:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728053632:192.168.201.143@tcp:4:cp.0 00000100:00100000:0.0:1788201621.401387:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788201621.401393:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728052736:192.168.201.143@tcp:4:cp.0 00000100:00100000:0.0:1788201621.401417:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728053248:192.168.201.143@tcp:4:cp.0 00000100:00100000:0.0:1788201621.401436:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728053760:192.168.201.143@tcp:4:cp.0 00000100:00100000:0.0:1788201621.401648:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728052992:192.168.201.143@tcp:4:cp.0 00000100:00100000:0.0:1788201621.401678:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728053504:192.168.201.143@tcp:4:cp.0 00000100:00100000:0.0:1788201621.401700:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788201621.401706:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728052864:192.168.201.143@tcp:4:cp.0 00000100:00100000:0.0:1788201621.401724:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728053376:192.168.201.143@tcp:4:cp.0 00010000:00010000:2.0:1788201621.405030:0:37:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f40fa3a5/0xd138388016f6f414 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710977f8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.405294:0:37:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc172744a80 - object 0x240000400:434 offset 0<>1694 00000100:00100000:3.0:1788201621.405358:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728053888:192.168.201.143@tcp:4:cp.0 00000080:00200000:2.0:1788201621.405691:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x180:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.405749:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x181:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.405771:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:2.0:1788201621.405825:0:37:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000908bab3b ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097853 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.405846:0:37:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000908bab3b ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097853 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201621.405880:0:37:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097853 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.405952:0:37:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc172747100 - object 0x280000400:435 offset 0<>6430 00000100:00100000:0.0:1788201621.406018:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728054016:192.168.201.143@tcp:4:cp.0 00000080:00200000:2.0:1788201621.411320:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x181:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.411380:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x182:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.411391:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:2.0:1788201621.411428:0:37:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000bf7e2717 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.411449:0:37:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000bf7e2717 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201621.411504:0:37:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.411606:0:37:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc172745500 - object 0x240000400:435 offset 0<>6234 00000100:00100000:1.0:1788201621.411958:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000080:00200000:2.0:1788201621.413311:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x182:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.413354:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x183:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.413364:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:2.0:1788201621.413392:0:37:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000000feb0963 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097909 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.413413:0:37:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000000feb0963 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097909 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201621.413479:0:37:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097909 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.414425:0:37:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc172744380 - object 0x280000400:436 offset 0<>111139 00000100:00100000:1.0:1788201621.416385:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728054272:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201621.416557:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728054144:192.168.201.143@tcp:4:cp.0 00000080:00200000:2.0:1788201621.418385:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x183:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.418443:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x184:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.418455:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:2.0:1788201621.418489:0:37:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000006c089184 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000003039f059/0xd138388016f6f4a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097964 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.418509:0:37:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000006c089184 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000003039f059/0xd138388016f6f4a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097964 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201621.418570:0:37:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000003039f059/0xd138388016f6f4a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097964 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.424354:0:37:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc172746300 - object 0x240000400:436 offset 0<>35427 00000080:00200000:2.0:1788201621.424459:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x184:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.424515:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x185:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.424527:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:2.0:1788201621.424562:0:37:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000007e517272 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.424586:0:37:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000007e517272 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000100:00100000:0.0:1788201621.424754:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201621.424783:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728054400:192.168.201.143@tcp:4:cp.0 00010000:00010000:2.0:1788201621.424919:0:37:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.425035:0:37:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc172747b80 - object 0x280000400:437 offset 0<>13879 00000080:00200000:2.0:1788201621.425060:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x185:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.425083:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x186:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.425089:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:2.0:1788201621.425106:0:37:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000dc1150d4 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.425129:0:37:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000dc1150d4 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201621.425152:0:37:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.425182:0:37:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc172747800 - object 0x240000400:437 offset 0<>2129 00000080:00200000:2.0:1788201621.425441:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x186:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.425463:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x187:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.425469:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:2.0:1788201621.425483:0:37:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000953f8997 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.425499:0:37:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000953f8997 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201621.425562:0:37:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.430140:0:37:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc172745880 - object 0x280000400:438 offset 0<>158554 00000080:00200000:2.0:1788201621.430418:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x187:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.430476:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x188:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.430487:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.430526:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x188:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.430546:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x189:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.430551:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.430570:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x189:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.430586:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.430591:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.430607:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.430624:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.430628:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.430644:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.430660:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.430664:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.430683:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.430700:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.430704:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.430735:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.430753:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.431373:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.431407:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.431428:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.431433:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.431450:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.431467:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x190:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.431471:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.431488:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x190:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.431505:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x191:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.431510:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.431529:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x191:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.431545:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x192:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.431549:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.431566:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x192:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.431582:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x193:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.431585:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.431600:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x193:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.431615:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x194:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.431618:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.431632:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x194:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.431657:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x195:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.431662:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.431681:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x195:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.431698:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x196:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.431702:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.431733:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x196:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.431751:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x197:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.431766:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.431786:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x197:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.431821:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x198:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.431825:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:1.0:1788201621.433204:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728054784:192.168.201.143@tcp:4:cp.0 00000080:00200000:2.0:1788201621.433346:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x198:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.433388:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x199:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.433397:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.433431:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x199:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.433451:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.433455:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.433474:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.433490:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.433494:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.433513:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.433530:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.433534:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.433552:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.433570:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.433574:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.433593:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.433610:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.433614:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.433633:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.433651:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.433655:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.433675:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.433693:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.433697:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:0.0:1788201621.439568:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728054528:192.168.201.143@tcp:4:cp.0 00000100:00100000:0.0:1788201621.439693:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc172747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728054656:192.168.201.143@tcp:4:cp.0 00000080:00200000:2.0:1788201621.439891:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.439963:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.439978:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.440039:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.440061:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a2:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.440065:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.440088:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.440105:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.440110:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.440142:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.440159:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.440164:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.440182:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.440210:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.440215:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.440234:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.440251:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.440255:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.440273:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.440290:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.440295:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.440311:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.440329:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.440334:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.440353:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.440473:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x188:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.440478:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:3.0:1788201621.471587:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000effc8163 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201621.471859:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000effc8163 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201621.471912:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728052736:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201621.471947:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000009a8144be ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201621.471964:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000009a8144be ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201621.471977:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728053248:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201621.472001:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000003e326483 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000943c2caa/0xd138388016f6f3f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109779d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201621.472015:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000003e326483 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000943c2caa/0xd138388016f6f3f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109779d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201621.472028:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728053760:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201621.472055:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 0000000022ba4270 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201621.472069:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 0000000022ba4270 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201621.472083:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728052608:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201621.472106:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000a635ea37 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000bfd1eb34/0xd138388016f6f342 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710975d6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201621.472120:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000a635ea37 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000bfd1eb34/0xd138388016f6f342 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710975d6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201621.472132:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728053120:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201621.472154:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 0000000014c5a66b ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097742 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201621.472169:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 0000000014c5a66b ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097742 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201621.472182:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728053632:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201621.472263:0:9520:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000000ce1d5f3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:3.0:1788201621.472280:0:9520:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000000ce1d5f3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201621.472337:0:9520:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:3.0:1788201621.472467:0:9520:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1726cd180 - object 0x280000400:447 offset 0<>10934 00000008:00010000:3.0:1788201621.472489:0:9520:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 0000000015882d22 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:3.0:1788201621.472498:0:9520:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 0000000015882d22 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201621.472523:0:9520:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:3.0:1788201621.472554:0:9520:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1726cf100 - object 0x280000400:443 offset 0<>4750 00000008:00010000:3.0:1788201621.472565:0:9520:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000122197b3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:3.0:1788201621.472575:0:9520:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000122197b3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201621.473485:0:9520:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201621.473542:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000dc1150d4 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201621.473586:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000dc1150d4 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201621.473607:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728054656:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201621.473666:0:10055:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000bf7e2717 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201621.473682:0:10055:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000bf7e2717 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201621.473694:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728054144:192.168.201.143@tcp:4:cp.0 00000100:00100000:0.0:1788201621.474613:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728054912:192.168.201.143@tcp:4:cp.0 00000008:00010000:0.0:1788201621.474806:0:10052:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000ba6985c4 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f40fa3a5/0xd138388016f6f414 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710977f8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201621.474830:0:10052:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000ba6985c4 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f40fa3a5/0xd138388016f6f414 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710977f8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:0.0:1788201621.474860:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728053888:192.168.201.143@tcp:4:cp.0 00000100:00100000:0.0:1788201621.474872:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201621.474879:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728055040:192.168.201.143@tcp:4:cp.0 00000008:00100000:3.0:1788201621.476349:0:9520:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1726cf480 - object 0x280000400:448 offset 0<>159678 00000008:00010000:3.0:1788201621.476702:0:9520:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000781b57b3 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:3.0:1788201621.476722:0:9520:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000781b57b3 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201621.476925:0:9520:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:3.0:1788201621.477776:0:9520:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1726cea00 - object 0x240000400:447 offset 0<>227516 00000008:00010000:3.0:1788201621.477819:0:9520:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000fa2f0cf3 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:3.0:1788201621.477842:0:9520:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000fa2f0cf3 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201621.477876:0:9520:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:3.0:1788201621.477944:0:9520:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1726ced80 - object 0x240000400:440 offset 0<>1753 00000008:00010000:3.0:1788201621.477966:0:9520:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000c5f1d161 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:3.0:1788201621.477976:0:9520:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000c5f1d161 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201621.478020:0:9520:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:3.0:1788201621.478425:0:9520:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1726ce680 - object 0x240000400:448 offset 0<>88087 00000008:00010000:3.0:1788201621.478440:0:9520:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000007e2782b1 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:3.0:1788201621.478450:0:9520:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000007e2782b1 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201621.478598:0:9520:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:3.0:1788201621.478637:0:9520:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1726cfb80 - object 0x240000400:443 offset 0<>6821 00000008:00010000:3.0:1788201621.478651:0:9520:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000009abf31be ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:3.0:1788201621.478661:0:9520:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000009abf31be ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201621.478691:0:9520:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:3.0:1788201621.478756:0:9520:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1726cdc00 - object 0x240000400:449 offset 0<>42517 00000008:00010000:3.0:1788201621.478767:0:9520:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000e6b9159f ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:3.0:1788201621.478776:0:9520:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000e6b9159f ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201621.478967:0:9520:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:3.0:1788201621.478997:0:9520:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1726ce300 - object 0x240000400:439 offset 0<>1342 00000100:00100000:3.0:1788201621.479062:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728055168:192.168.201.143@tcp:4:cp.0 00000100:00100000:3.0:1788201621.479150:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728055680:192.168.201.143@tcp:4:cp.0 00000100:00100000:3.0:1788201621.479189:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788201621.479196:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728055296:192.168.201.143@tcp:4:cp.0 00000100:00100000:3.0:1788201621.479222:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728055808:192.168.201.143@tcp:4:cp.0 00000100:00100000:0.0:1788201621.479750:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728055424:192.168.201.143@tcp:4:cp.0 00000100:00100000:0.0:1788201621.479831:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728055936:192.168.201.143@tcp:4:cp.0 00000100:00100000:0.0:1788201621.479875:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201621.479881:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728055552:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201621.482106:0:10053:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 0000000028f6ddfc ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:2.0:1788201621.482751:0:10053:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 0000000028f6ddfc ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1788201621.482818:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728052864:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201621.482865:0:10053:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000004788e32b ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f388 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109768c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:2.0:1788201621.482894:0:10053:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000004788e32b ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f388 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109768c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1788201621.482908:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728053376:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201621.482936:0:10053:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 0000000041b4f8c3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f31f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109757b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:2.0:1788201621.482951:0:10053:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 0000000041b4f8c3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f31f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109757b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1788201621.482965:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728052992:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201621.482986:0:10053:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000006e2340c0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000069322032/0xd138388016f6f3ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710976e7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:2.0:1788201621.483007:0:10053:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000006e2340c0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000069322032/0xd138388016f6f3ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710976e7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1788201621.483020:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728053504:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201621.483049:0:10053:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000007e517272 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:2.0:1788201621.483067:0:10053:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000007e517272 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1788201621.483080:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728054528:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201621.483107:0:10053:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000908bab3b ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097853 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:2.0:1788201621.483364:0:10053:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000908bab3b ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097853 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1788201621.483379:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728054016:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201621.483452:0:754:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 0000000055bc5188 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.483464:0:754:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 0000000055bc5188 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201621.483552:0:754:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.484058:0:754:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc17257c000 - object 0x240000400:444 offset 0<>143467 00000008:00010000:2.0:1788201621.484091:0:754:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000cc8ad32a ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.484101:0:754:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000cc8ad32a ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201621.484271:0:754:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.484314:0:754:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc17257e680 - object 0x240000400:451 offset 0<>5105 00000008:00010000:2.0:1788201621.484388:0:754:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000c88bdffc ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.484400:0:754:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000c88bdffc ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000100:00100000:1.0:1788201621.484435:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201621.484473:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728056192:192.168.201.143@tcp:4:cp.0 00010000:00010000:2.0:1788201621.484504:0:754:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.484668:0:754:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc17257d880 - object 0x280000400:449 offset 0<>254129 00000008:00010000:2.0:1788201621.484685:0:754:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000911ee68f ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.484695:0:754:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000911ee68f ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000100:00100000:1.0:1788201621.484821:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728056320:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201621.484927:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728056064:192.168.201.143@tcp:4:cp.0 00010000:00010000:2.0:1788201621.485436:0:754:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.485535:0:754:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc17257dc00 - object 0x280000400:444 offset 0<>116978 00000008:00010000:2.0:1788201621.485562:0:754:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000b2e36bf7 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.485572:0:754:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000b2e36bf7 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000100:00100000:1.0:1788201621.485599:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201621.485616:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728056448:192.168.201.143@tcp:4:cp.0 00010000:00010000:2.0:1788201621.486287:0:754:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.486528:0:754:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc17257ce00 - object 0x280000400:450 offset 0<>429670 00000100:00100000:1.0:1788201621.486610:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728056576:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201621.487076:0:754:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000000d6673c0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.487093:0:754:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000000d6673c0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201621.487267:0:754:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.487540:0:754:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc17257ea00 - object 0x280000400:440 offset 0<>1659 00000100:00100000:0.0:1788201621.487608:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728056704:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201621.488063:0:10053:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000006c089184 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000003039f059/0xd138388016f6f4a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097964 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201621.488113:0:10053:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000006c089184 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000003039f059/0xd138388016f6f4a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097964 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201621.488152:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728054400:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201621.488387:0:10055:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000000feb0963 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097909 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201621.488498:0:10055:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000000feb0963 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097909 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201621.488524:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728054272:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201621.488598:0:9520:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000d04bdfba ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:3.0:1788201621.488620:0:9520:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000d04bdfba ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201621.488737:0:9520:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:3.0:1788201621.488952:0:9520:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1726cd500 - object 0x280000400:445 offset 0<>170595 00000100:00100000:2.0:1788201621.489023:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728056832:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201621.489265:0:17816:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000009ffd8b5f ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:1.0:1788201621.489280:0:17816:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000009ffd8b5f ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201621.489320:0:17816:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:1.0:1788201621.489380:0:17816:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1727d6d80 - object 0x240000400:452 offset 0<>24288 00000100:00100000:0.0:1788201621.489462:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728056960:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201621.522171:0:10055:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000cc8ad32a ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:2.0:1788201621.522237:0:10055:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000cc8ad32a ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1788201621.522283:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728056192:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201621.522342:0:754:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 0000000041ed5eb8 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.522359:0:754:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 0000000041ed5eb8 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201621.522412:0:754:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.522530:0:754:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc17257ed80 - object 0x240000400:453 offset 0<>1765 00000100:00100000:2.0:1788201621.522637:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728057088:192.168.201.143@tcp:4:cp.0 00000008:00010000:0.0:1788201621.525543:0:10052:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000fa2f0cf3 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201621.525598:0:10052:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000fa2f0cf3 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:0.0:1788201621.525640:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728055424:192.168.201.143@tcp:4:cp.0 00000008:00010000:0.0:1788201621.525681:0:10052:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000e6b9159f ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201621.525697:0:10052:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000e6b9159f ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:0.0:1788201621.525710:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728055936:192.168.201.143@tcp:4:cp.0 00000008:00010000:0.0:1788201621.525742:0:10052:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 0000000015882d22 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201621.525759:0:10052:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 0000000015882d22 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:0.0:1788201621.525781:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728055040:192.168.201.143@tcp:4:cp.0 00000008:00010000:0.0:1788201621.525869:0:10052:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000000ce1d5f3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201621.525896:0:10052:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000000ce1d5f3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:0.0:1788201621.525909:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728054912:192.168.201.143@tcp:4:cp.0 00000008:00010000:0.0:1788201621.526126:0:13591:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000006fc7b411 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201621.526142:0:13591:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000006fc7b411 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201621.526200:0:13591:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201621.526302:0:13591:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc144140380 - object 0x240000400:454 offset 0<>4512 00000008:00010000:0.0:1788201621.526327:0:13591:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000298588cb ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201621.526337:0:13591:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000298588cb ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201621.526416:0:13591:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201621.528836:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728057216:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201621.529056:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000007e2782b1 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201621.529113:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000007e2782b1 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201621.529139:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728055680:192.168.201.143@tcp:4:cp.0 00000008:00100000:0.0:1788201621.529176:0:13591:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc144141f80 - object 0x240000400:446 offset 0<>199288 00000008:00010000:0.0:1788201621.529235:0:13591:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000637616f9 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201621.529255:0:13591:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000637616f9 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201621.529322:0:13591:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201621.529403:0:13591:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc144142300 - object 0x240000400:442 offset 0<>6548 00000008:00010000:0.0:1788201621.529493:0:13591:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000009fce27d9 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201621.529504:0:13591:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000009fce27d9 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201621.529528:0:13591:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201621.529558:0:13591:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc144140000 - object 0x280000400:442 offset 0<>1654 00000008:00010000:0.0:1788201621.529570:0:13591:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000007b4b89b5 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201621.529580:0:13591:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000007b4b89b5 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201621.529601:0:13591:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201621.529625:0:13591:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc144143100 - object 0x280000400:453 offset 0<>1611 00000100:00100000:0.0:1788201621.529685:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728057472:192.168.201.143@tcp:4:cp.0 00000100:00100000:0.0:1788201621.529773:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201621.529782:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728057600:192.168.201.143@tcp:4:cp.0 00000100:00100000:2.0:1788201621.530264:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728057344:192.168.201.143@tcp:4:cp.0 00000100:00100000:2.0:1788201621.530331:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201621.530339:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728057728:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201621.539167:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000000d6673c0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201621.539220:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000000d6673c0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201621.539273:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728056704:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201621.539345:0:17816:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000fb431209 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:1.0:1788201621.539360:0:17816:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000fb431209 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201621.539514:0:17816:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:1.0:1788201621.544044:0:17816:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1727d4380 - object 0x280000400:454 offset 0<>317150 00000100:00100000:1.0:1788201621.544195:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201621.547542:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728057856:192.168.201.143@tcp:4:cp.0 00000008:00010000:0.0:1788201621.565744:0:10053:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 0000000041ed5eb8 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201621.565813:0:10053:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 0000000041ed5eb8 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:0.0:1788201621.565846:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728057088:192.168.201.143@tcp:4:cp.0 00000008:00010000:0.0:1788201621.565923:0:13591:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000cd0be2df ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201621.565939:0:13591:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000cd0be2df ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201621.566005:0:13591:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201621.566850:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000006fc7b411 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201621.566879:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000006fc7b411 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201621.566911:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728057216:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201621.566968:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000122197b3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201621.567012:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000122197b3 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201621.567033:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728055168:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201621.567200:0:9520:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000398cf242 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:3.0:1788201621.567213:0:9520:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000398cf242 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1788201621.567245:0:9520:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:3.0:1788201621.567309:0:9520:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1726cca80 - object 0x280000400:441 offset 0<>1408 00000008:00010000:1.0:1788201621.567832:0:10055:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000953f8997 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201621.567893:0:10055:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000953f8997 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201621.567919:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc172745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728054784:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201621.567958:0:17816:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000006f33c7c4 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:1.0:1788201621.567968:0:17816:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000006f33c7c4 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201621.567996:0:17816:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:1.0:1788201621.568037:0:17816:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1727d4000 - object 0x280000400:452 offset 0<>2475 00000100:00100000:1.0:1788201621.568387:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728058112:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201621.568623:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201621.568632:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728058240:192.168.201.143@tcp:4:cp.0 00000008:00100000:0.0:1788201621.568869:0:13591:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc144141500 - object 0x240000400:445 offset 0<>31711 00000008:00010000:0.0:1788201621.568905:0:13591:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000163f5c32 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201621.568924:0:13591:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000163f5c32 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201621.568969:0:13591:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201621.569034:0:13591:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc144143b80 - object 0x240000400:438 offset 0<>37842 00000100:00100000:1.0:1788201621.570002:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728058368:192.168.201.143@tcp:4:cp.0 00000100:00100000:1.0:1788201621.570314:0:10055:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201621.570323:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728057984:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201621.575381:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000781b57b3 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:2.0:1788201621.575477:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000781b57b3 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1788201621.575534:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728055296:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201621.575596:0:754:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000ac77a73d ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.575612:0:754:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000ac77a73d ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201621.575688:0:754:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.575852:0:754:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc17257df80 - object 0x240000400:450 offset 0<>26716 00000100:00100000:2.0:1788201621.575954:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728058496:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201621.601473:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000009abf31be ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:2.0:1788201621.601537:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000009abf31be ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1788201621.601572:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728055808:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201621.601631:0:754:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000005de6e866 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:2.0:1788201621.601649:0:754:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000005de6e866 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1788201621.601821:0:754:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:2.0:1788201621.602425:0:754:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc17257f480 - object 0x240000400:441 offset 0<>855 00000100:00100000:2.0:1788201621.602509:0:10053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728058624:192.168.201.143@tcp:4:cp.0 00000008:00010000:0.0:1788201621.603120:0:10052:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000009fce27d9 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201621.603154:0:10052:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000009fce27d9 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:0.0:1788201621.603184:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728057600:192.168.201.143@tcp:4:cp.0 00000008:00010000:0.0:1788201621.603214:0:10052:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000637616f9 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201621.603236:0:10052:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000637616f9 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:0.0:1788201621.603251:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728057472:192.168.201.143@tcp:4:cp.0 00000008:00010000:0.0:1788201621.603281:0:10052:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000c5f1d161 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201621.603311:0:10052:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000c5f1d161 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:0.0:1788201621.603326:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728055552:192.168.201.143@tcp:4:cp.0 00000008:00010000:0.0:1788201621.603379:0:13591:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 000000009a71e902 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1788201621.603392:0:13591:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 000000009a71e902 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1788201621.603429:0:13591:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:0.0:1788201621.603507:0:13591:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc144143800 - object 0x280000400:439 offset 0<>423 00000008:00010000:1.0:1788201621.605859:0:10053:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 0000000055bc5188 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201621.605942:0:10053:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 0000000055bc5188 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201621.605979:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728056064:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201621.606984:0:10055:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000007b4b89b5 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1788201621.607013:0:10055:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000007b4b89b5 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201621.607043:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728057728:192.168.201.143@tcp:4:cp.0 00000100:00100000:2.0:1788201621.607536:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728058752:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201621.608667:0:17816:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 00000000efb6ca0b ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:1.0:1788201621.608692:0:17816:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 00000000efb6ca0b ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201621.608820:0:17816:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:1.0:1788201621.609034:0:17816:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1727d5500 - object 0x280000400:446 offset 0<>215293 00000008:00010000:1.0:1788201621.609182:0:10055:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000c88bdffc ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1788201621.609182:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201621.609213:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728058880:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201621.609265:0:10055:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000c88bdffc ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201621.609300:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728056320:192.168.201.143@tcp:4:cp.0 00000008:00010000:1.0:1788201621.609343:0:17816:0:(osc_cache.c:2022:try_to_add_extent_for_io()) ### extent: 0000000081c0d89d ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:1.0:1788201621.609374:0:17816:0:(osc_cache.c:1176:osc_extent_make_ready()) ### extent: 0000000081c0d89d ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1788201621.609432:0:17816:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (1048576 1052671) ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00100000:1.0:1788201621.609530:0:17816:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff8bc1727d6680 - object 0x280000400:451 offset 1048576<>1181558 00000100:00100000:0.0:1788201621.610383:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728059008:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201621.610751:0:10053:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000b2e36bf7 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:2.0:1788201621.610941:0:10053:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000b2e36bf7 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1788201621.610981:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728056576:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201621.624332:0:10055:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000d04bdfba ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:2.0:1788201621.624447:0:10055:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000d04bdfba ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1788201621.624490:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728056832:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201621.636171:0:10052:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000009ffd8b5f ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:2.0:1788201621.636236:0:10052:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000009ffd8b5f ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1788201621.636290:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728056960:192.168.201.143@tcp:4:cp.0 00000008:00010000:0.0:1788201621.640033:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000009a71e902 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201621.640083:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000009a71e902 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:0.0:1788201621.640134:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728058752:192.168.201.143@tcp:4:cp.0 00000008:00010000:0.0:1788201621.640175:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000fb431209 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1788201621.640247:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000fb431209 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:0.0:1788201621.640264:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728057856:192.168.201.143@tcp:4:cp.0 00000008:00010000:3.0:1788201621.640905:0:10053:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000911ee68f ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201621.640945:0:10053:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000911ee68f ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:2.0:1788201621.641078:0:10052:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000ac77a73d ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:2.0:1788201621.641169:0:10052:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000ac77a73d ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1788201621.641192:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728058496:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201621.641218:0:10052:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000006f33c7c4 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:2.0:1788201621.641232:0:10052:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000006f33c7c4 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1788201621.641248:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728058240:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201621.641269:0:10052:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000398cf242 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:2.0:1788201621.641281:0:10052:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000398cf242 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1788201621.641299:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728058112:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201621.641381:0:10055:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000cd0be2df ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:2.0:1788201621.641402:0:10055:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000cd0be2df ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1788201621.641417:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728057984:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201621.641463:0:10055:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000163f5c32 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:2.0:1788201621.641488:0:10055:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000163f5c32 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1788201621.641502:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728058368:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201621.641550:0:10055:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000298588cb ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:2.0:1788201621.641597:0:10055:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000298588cb ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1788201621.641613:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10055:1875064728057344:192.168.201.143@tcp:4:cp.0 00000100:00100000:3.0:1788201621.641862:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728056448:192.168.201.143@tcp:4:cp.0 00000080:00200000:0.0:1788201621.642293:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x188:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.642336:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x189:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.642347:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.642388:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x189:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.642406:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.642409:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.642425:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.642441:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.642445:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.642460:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.642476:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.642481:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.642496:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.642511:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.642515:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.642530:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.642546:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.642550:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:3.0:1788201621.644897:0:10053:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 000000005de6e866 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201621.644946:0:10053:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 000000005de6e866 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201621.644976:0:10053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10053:1875064728058624:192.168.201.143@tcp:4:cp.0 00000080:00200000:0.0:1788201621.645266:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.645307:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.645319:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.645358:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.645378:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x190:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.645383:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.645400:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x190:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.645418:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x191:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.645423:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.645441:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x191:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.645458:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x192:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.645462:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.645477:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x192:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.645495:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x193:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.645499:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.645515:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x193:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.645533:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x194:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.645537:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.645553:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x194:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.645569:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x195:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.645574:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.645610:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x195:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.645630:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x196:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.645634:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.645651:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x196:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.645668:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x197:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.645672:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000008:00010000:3.0:1788201621.663944:0:10052:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 0000000081c0d89d ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1788201621.664014:0:10052:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 0000000081c0d89d ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1788201621.664043:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10052:1875064728059008:192.168.201.143@tcp:4:cp.0 00000008:00010000:2.0:1788201621.664284:0:10054:0:(osc_cache.c:910:osc_extent_finish()) ### extent: 00000000efb6ca0b ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:2.0:1788201621.664351:0:10054:0:(osc_cache.c:496:__osc_extent_remove()) ### extent: 00000000efb6ca0b ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1788201621.664372:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10054:1875064728058880:192.168.201.143@tcp:4:cp.0 00000080:00200000:0.0:1788201621.664867:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x197:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.664922:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x198:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.664934:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.664969:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x198:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.664989:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x199:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.664994:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.665012:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x199:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.665031:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.665035:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.665051:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.665070:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.665074:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.665172:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.665192:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.665196:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.665213:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.665230:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.665234:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.665251:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.665269:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.665273:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.665291:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.665309:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.665314:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.665332:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.665349:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.665353:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.665369:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.665387:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.665391:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.665408:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.665427:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a2:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.665431:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.665449:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.665467:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.665471:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.665489:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.665508:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.665512:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.665528:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.665545:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.665549:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.665565:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.665582:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.665586:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.665619:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.665637:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.665641:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.665659:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1788201621.665677:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1788201621.665682:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1788201621.665700:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.666302:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8bc1459f00c8) 00000080:00200000:2.0:1788201621.666340:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000002:0x1:0x0](ffff8bc1459b9148) 00000080:00200000:2.0:1788201621.666373:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000002:0x3:0x0](ffff8bc1459b8908) 00000080:00200000:2.0:1788201621.666429:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000402:0x1:0x0](ffff8bc1459bcb08) 00000080:00200000:2.0:1788201621.666442:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x15b:0x0](ffff8bc1459d63c8) 00000080:00200000:2.0:1788201621.666477:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x15c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.666485:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.666525:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x15c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.666559:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x15c:0x0](ffff8bc1446bc2c8) 00000008:00010000:2.0:1788201621.666593:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 903 blocks 1 [cma]time 1788201590 1788201590 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 1 00000080:00200000:2.0:1788201621.666647:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x15d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.666652:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.666671:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x15d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.666703:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x15d:0x0](ffff8bc1459f7448) 00000008:00010000:2.0:1788201621.666726:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 5634 blocks 1 [cma]time 1788201590 1788201590 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.666765:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x15e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.666771:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.666890:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x15e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.667458:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x15e:0x0](ffff8bc1446b80c8) 00000008:00010000:2.0:1788201621.667489:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 394763 blocks 1 [cma]time 1788201590 1788201590 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.667530:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x15f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.667536:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.667557:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x15f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.667579:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x15f:0x0](ffff8bc1446b8908) 00000008:00010000:2.0:1788201621.667601:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 1735 blocks 1 [cma]time 1788201591 1788201591 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.667636:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x160:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.667642:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.667660:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x160:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.667694:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x160:0x0](ffff8bc1459f63c8) 00000008:00010000:2.0:1788201621.667715:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 9974 blocks 1 [cma]time 1788201591 1788201591 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096c98 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.667759:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x161:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.667765:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.667784:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x161:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.667870:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x161:0x0](ffff8bc144683248) 00000008:00010000:2.0:1788201621.667906:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 38517 blocks 1 [cma]time 1788201591 1788201591 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.667946:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x162:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.667951:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.667970:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x162:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.668033:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x162:0x0](ffff8bc1459d4b08) 00000008:00010000:2.0:1788201621.668057:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 39343 blocks 1 [cma]time 1788201591 1788201591 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096d4e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.668338:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x163:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.668344:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.668365:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x163:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.668406:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x163:0x0](ffff8bc1459f21c8) 00000008:00010000:2.0:1788201621.668432:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 15476 blocks 1 [cma]time 1788201591 1788201591 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096da9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.668470:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x164:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.668475:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.668495:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x164:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.668517:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x164:0x0](ffff8bc144683a88) 00000008:00010000:2.0:1788201621.668540:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 674 blocks 1 [cma]time 1788201591 1788201591 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000083541a8b/0xd138388016f6f040 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096e04 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.668577:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x165:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.668583:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.668944:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x165:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.668984:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x165:0x0](ffff8bc1446bf448) 00000008:00010000:2.0:1788201621.669007:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 9198 blocks 1 [cma]time 1788201591 1788201591 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6f063 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096e5f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.669047:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x166:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.669053:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.669204:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x166:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.669228:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x166:0x0](ffff8bc144680908) 00000008:00010000:2.0:1788201621.669250:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 2659 blocks 1 [cma]time 1788201591 1788201591 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096eba expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.669288:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x167:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.669293:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.669312:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x167:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.669344:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x167:0x0](ffff8bc1446863c8) 00000008:00010000:2.0:1788201621.669367:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 4207 blocks 1 [cma]time 1788201591 1788201591 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096f15 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.669411:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x168:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.669416:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.669436:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x168:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.669488:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x168:0x0](ffff8bc144684b08) 00000008:00010000:2.0:1788201621.669511:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 28245 blocks 1 [cma]time 1788201591 1788201591 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.669550:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x169:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.669555:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.669574:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x169:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.669859:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x169:0x0](ffff8bc1459d0908) 00000008:00010000:2.0:1788201621.669893:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 704 blocks 1 [cma]time 1788201591 1788201591 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000009a4e707/0xd138388016f6f0ef lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171096fcb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.669938:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x16a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.669944:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.669963:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x16a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.669986:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x16a:0x0](ffff8bc1459f3a88) 00000008:00010000:2.0:1788201621.670010:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 1754 blocks 1 [cma]time 1788201591 1788201591 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b477b91d/0xd138388016f6f112 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097026 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.670050:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x16b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.670055:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.670322:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x16b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.670357:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x16b:0x0](ffff8bc1459f42c8) 00000008:00010000:2.0:1788201621.670381:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 4915 blocks 1 [cma]time 1788201591 1788201591 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003f09d801/0xd138388016f6f135 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097081 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.670420:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x16c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.670425:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.670445:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x16c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.670469:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x16c:0x0](ffff8bc144685348) 00000008:00010000:2.0:1788201621.670491:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 1613 blocks 1 [cma]time 1788201592 1788201592 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ec3e6631/0xd138388016f6f158 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710970dc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.670530:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x16d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.670535:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.670554:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x16d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.670609:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x16d:0x0](ffff8bc1459f1988) 00000008:00010000:2.0:1788201621.670632:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 16105 blocks 1 [cma]time 1788201592 1788201592 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009b0557ef/0xd138388016f6f17b lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097137 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.670670:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x16e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.670676:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.670697:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x16e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.670720:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x16e:0x0](ffff8bc1446bb248) 00000008:00010000:2.0:1788201621.670742:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 838 blocks 1 [cma]time 1788201592 1788201592 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.671015:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x16f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.671023:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.671048:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x16f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.671079:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x16f:0x0](ffff8bc1459f1148) 00000008:00010000:2.0:1788201621.671209:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 2858 blocks 1 [cma]time 1788201592 1788201592 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002dba747d/0xd138388016f6f1c1 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710971ed expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.671249:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x170:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.671254:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.671274:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x170:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.671318:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x170:0x0](ffff8bc1459d6c08) 00000008:00010000:2.0:1788201621.671341:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 18269 blocks 1 [cma]time 1788201592 1788201592 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 1 00000080:00200000:2.0:1788201621.671381:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x171:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.671388:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.671407:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x171:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.671438:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x171:0x0](ffff8bc1446842c8) 00000008:00010000:2.0:1788201621.671461:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 4218 blocks 1 [cma]time 1788201592 1788201592 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710972a3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.671500:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x172:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.671505:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.671524:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x172:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.671545:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x172:0x0](ffff8bc1446ba1c8) 00000008:00010000:2.0:1788201621.671565:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 3006 blocks 1 [cma]time 1788201592 1788201592 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fd829a5f/0xd138388016f6f22a lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710972fe expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.671660:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x173:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.671666:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.671686:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x173:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.671708:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x173:0x0](ffff8bc1459f5348) 00000008:00010000:2.0:1788201621.671731:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 2192 blocks 1 [cma]time 1788201592 1788201592 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.671769:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x174:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.671775:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.671891:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x174:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.671919:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x174:0x0](ffff8bc1446b9988) 00000008:00010000:2.0:1788201621.671942:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 938 blocks 1 [cma]time 1788201592 1788201592 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.671981:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x175:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.671986:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.672006:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x175:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.672256:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x175:0x0](ffff8bc1446bec08) 00000008:00010000:2.0:1788201621.672279:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 55540 blocks 1 [cma]time 1788201592 1788201592 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6f293 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109740f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.672323:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x176:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.672328:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.672354:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x176:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.672385:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x176:0x0](ffff8bc1446800c8) 00000008:00010000:2.0:1788201621.672407:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 6813 blocks 1 [cma]time 1788201592 1788201592 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f2b6 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109746a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.672449:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x177:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.672454:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.672474:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x177:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.672509:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x177:0x0](ffff8bc144685b88) 00000008:00010000:2.0:1788201621.672532:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 6213 blocks 1 [cma]time 1788201592 1788201592 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.672569:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x178:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.672574:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.672989:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x178:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.673022:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x178:0x0](ffff8bc144686c08) 00000008:00010000:2.0:1788201621.673046:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 269 blocks 1 [cma]time 1788201592 1788201592 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.673168:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x179:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.673174:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.673196:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x179:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.673219:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x179:0x0](ffff8bc1446bdb88) 00000008:00010000:2.0:1788201621.673242:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 234 blocks 1 [cma]time 1788201592 1788201592 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f31f lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109757b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.673281:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.673286:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.673305:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.673337:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x17a:0x0](ffff8bc1459f6c08) 00000008:00010000:2.0:1788201621.673359:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 4117 blocks 1 [cma]time 1788201592 1788201592 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000bfd1eb34/0xd138388016f6f342 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710975d6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.673399:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.673405:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.673423:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.673447:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x17b:0x0](ffff8bc1446bcb08) 00000008:00010000:2.0:1788201621.673480:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 3079 blocks 1 [cma]time 1788201592 1788201592 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.673522:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.673527:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.673547:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.673578:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x17c:0x0](ffff8bc1446baa08) 00000008:00010000:2.0:1788201621.673616:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 4150 blocks 1 [cma]time 1788201592 1788201592 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f388 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109768c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.673658:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.673663:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.673681:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.673709:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x17d:0x0](ffff8bc1446bd348) 00000008:00010000:2.0:1788201621.674013:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 7187 blocks 1 [cma]time 1788201592 1788201592 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000069322032/0xd138388016f6f3ab lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710976e7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.674056:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.674062:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.674082:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.674260:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x17e:0x0](ffff8bc144682a08) 00000008:00010000:2.0:1788201621.674284:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 8441 blocks 1 [cma]time 1788201592 1788201592 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097742 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.674323:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x17f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.674328:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.674347:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x17f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.674371:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x17f:0x0](ffff8bc1459f3248) 00000008:00010000:2.0:1788201621.674395:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 1790 blocks 1 [cma]time 1788201593 1788201593 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000943c2caa/0xd138388016f6f3f1 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109779d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.674436:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x180:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.674441:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.674459:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x180:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.674480:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x180:0x0](ffff8bc1459f2a08) 00000008:00010000:2.0:1788201621.674504:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 1694 blocks 1 [cma]time 1788201593 1788201593 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f40fa3a5/0xd138388016f6f414 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710977f8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.674545:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x181:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.674551:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.674570:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x181:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.674898:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x181:0x0](ffff8bc1446be3c8) 00000008:00010000:2.0:1788201621.674923:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 6430 blocks 1 [cma]time 1788201593 1788201593 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097853 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.674965:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x182:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.674971:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.674990:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x182:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.675027:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x182:0x0](ffff8bc1446bba88) 00000008:00010000:2.0:1788201621.675051:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 6234 blocks 1 [cma]time 1788201593 1788201593 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.675273:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x183:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.675279:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.675300:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x183:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.675373:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x183:0x0](ffff8bc144687448) 00000008:00010000:2.0:1788201621.675394:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 111139 blocks 1 [cma]time 1788201593 1788201593 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097909 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.675446:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x184:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.675453:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.675473:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x184:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.675509:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x184:0x0](ffff8bc1446b9148) 00000008:00010000:2.0:1788201621.675529:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 35427 blocks 1 [cma]time 1788201593 1788201593 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000003039f059/0xd138388016f6f4a0 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097964 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.675567:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x185:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.675572:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.675590:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x185:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.675723:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x185:0x0](ffff8bc1459f0908) 00000008:00010000:2.0:1788201621.675748:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 13879 blocks 1 [cma]time 1788201593 1788201593 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.676002:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x186:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.676009:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.676035:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x186:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.676205:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x186:0x0](ffff8bc1459d42c8) 00000008:00010000:2.0:1788201621.676232:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 2129 blocks 1 [cma]time 1788201593 1788201593 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.676282:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x187:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.676289:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.676310:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x187:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.676409:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x187:0x0](ffff8bc1459f5b88) 00000008:00010000:2.0:1788201621.676432:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 158554 blocks 1 [cma]time 1788201593 1788201593 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.676476:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x188:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.676482:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.676502:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x188:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.676546:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x188:0x0](ffff8bc144681148) 00000008:00010000:2.0:1788201621.676568:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 37842 blocks 1 [cma]time 1788201593 1788201593 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.676868:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x189:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1788201621.677211:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.677313:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x189:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.677356:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x189:0x0](ffff8bc14592b248) 00000008:00010000:2.0:1788201621.677386:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 423 blocks 1 [cma]time 1788201593 1788201593 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.677432:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.677438:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.677457:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.677482:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x18a:0x0](ffff8bc145928908) 00000008:00010000:2.0:1788201621.677505:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 1342 blocks 1 [cma]time 1788201593 1788201593 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.677552:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.677558:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.677580:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.677771:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x18b:0x0](ffff8bc14592ec08) 00000008:00010000:2.0:1788201621.677962:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 1659 blocks 1 [cma]time 1788201593 1788201593 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.678004:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.678010:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.678033:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.678070:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x18c:0x0](ffff8bc1446821c8) 00000008:00010000:2.0:1788201621.678172:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 1753 blocks 1 [cma]time 1788201593 1788201593 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.678214:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.678220:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.678240:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.678262:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x18d:0x0](ffff8bc14592aa08) 00000008:00010000:2.0:1788201621.678282:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 1408 blocks 1 [cma]time 1788201594 1788201594 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.678317:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.678323:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.678342:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.678364:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x18e:0x0](ffff8bc14592a1c8) 00000008:00010000:2.0:1788201621.678386:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 855 blocks 1 [cma]time 1788201594 1788201594 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.678424:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x18f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.678429:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.678449:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x18f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.678473:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x18f:0x0](ffff8bc144681988) 00000008:00010000:2.0:1788201621.678497:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 1654 blocks 1 [cma]time 1788201594 1788201594 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.678536:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x190:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.678542:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.678562:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x190:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.678659:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x190:0x0](ffff8bc14592db88) 00000008:00010000:2.0:1788201621.678685:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 6548 blocks 1 [cma]time 1788201594 1788201594 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.678723:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x191:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.678728:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.678748:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x191:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.678780:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x191:0x0](ffff8bc1459b63c8) 00000008:00010000:2.0:1788201621.678839:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 4750 blocks 1 [cma]time 1788201594 1788201594 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.678894:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x192:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.678900:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.678920:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x192:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.678957:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x192:0x0](ffff8bc1459b2a08) 00000008:00010000:2.0:1788201621.678978:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 6821 blocks 1 [cma]time 1788201594 1788201594 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.679017:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x193:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.679022:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.679043:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x193:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.679397:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x193:0x0](ffff8bc1459f4b08) 00000008:00010000:2.0:1788201621.679423:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 116978 blocks 1 [cma]time 1788201594 1788201594 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.679470:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x194:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.679476:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.679499:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x194:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.679585:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x194:0x0](ffff8bc14592e3c8) 00000008:00010000:2.0:1788201621.679661:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 143467 blocks 1 [cma]time 1788201594 1788201594 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.679699:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x195:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.679705:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.679724:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x195:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.679839:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x195:0x0](ffff8bc145982a08) 00000008:00010000:2.0:1788201621.679862:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 170595 blocks 1 [cma]time 1788201594 1788201594 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.679912:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x196:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.679918:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.679937:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x196:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.679970:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x196:0x0](ffff8bc1459821c8) 00000008:00010000:2.0:1788201621.679990:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 31711 blocks 1 [cma]time 1788201594 1788201594 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.680043:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x197:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.680048:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.680278:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x197:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.680391:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x197:0x0](ffff8bc1459842c8) 00000008:00010000:2.0:1788201621.680414:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 215293 blocks 1 [cma]time 1788201594 1788201594 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.680455:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x198:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.680460:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.680480:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x198:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.680587:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x198:0x0](ffff8bc1459863c8) 00000008:00010000:2.0:1788201621.680670:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 199288 blocks 1 [cma]time 1788201594 1788201594 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.680717:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x199:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.680723:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.680745:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x199:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.681190:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x199:0x0](ffff8bc1459b4b08) 00000008:00010000:2.0:1788201621.681218:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 10934 blocks 1 [cma]time 1788201594 1788201594 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.681264:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.681270:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.681293:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.681496:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x19a:0x0](ffff8bc1459b1148) 00000008:00010000:2.0:1788201621.681520:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 227516 blocks 1 [cma]time 1788201594 1788201594 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.681563:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.681568:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.681587:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.681755:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x19b:0x0](ffff8bc1459b0908) 00000008:00010000:2.0:1788201621.681782:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 159678 blocks 1 [cma]time 1788201594 1788201594 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.681854:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.681859:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.681889:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.681957:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x19c:0x0](ffff8bc1459b5348) 00000008:00010000:2.0:1788201621.681981:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 88087 blocks 1 [cma]time 1788201594 1788201594 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.682017:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.682022:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.682042:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.682308:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x19d:0x0](ffff8bc145986c08) 00000008:00010000:2.0:1788201621.682333:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 254129 blocks 1 [cma]time 1788201595 1788201595 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.682380:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.682385:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.682405:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.682455:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x19e:0x0](ffff8bc1459b6c08) 00000008:00010000:2.0:1788201621.682480:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 42517 blocks 1 [cma]time 1788201595 1788201595 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.682517:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x19f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.682523:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.682542:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x19f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.682930:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x19f:0x0](ffff8bc1459280c8) 00000008:00010000:2.0:1788201621.682955:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 429670 blocks 1 [cma]time 1788201595 1788201595 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.683005:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.683011:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.683031:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1788201621.683384:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1a0:0x0](ffff8bc145983a88) 00000008:00010000:3.0:1788201621.683422:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 26716 blocks 1 [cma]time 1788201595 1788201595 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1788201621.683476:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1788201621.683481:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1788201621.683507:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.686053:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1a1:0x0](ffff8bc1459d5b88) 00000008:00010000:2.0:1788201621.686323:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 1181558 blocks 2051 [cma]time 1788201595 1788201595 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.686400:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a2:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.686414:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.686460:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.686502:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1a2:0x0](ffff8bc145981988) 00000008:00010000:2.0:1788201621.686527:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 5105 blocks 1 [cma]time 1788201595 1788201595 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.686571:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.686577:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.686598:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.686622:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1a3:0x0](ffff8bc145985b88) 00000008:00010000:2.0:1788201621.686644:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 2475 blocks 1 [cma]time 1788201595 1788201595 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.686697:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.686702:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.686724:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.686757:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1a4:0x0](ffff8bc145980908) 00000008:00010000:2.0:1788201621.686778:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 24288 blocks 1 [cma]time 1788201595 1788201595 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.686861:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.686866:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.686898:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.687499:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1a5:0x0](ffff8bc1459d3248) 00000008:00010000:2.0:1788201621.687532:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 1611 blocks 1 [cma]time 1788201595 1788201595 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.687614:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.687621:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.687646:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.687735:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1a6:0x0](ffff8bc1459b5b88) 00000008:00010000:2.0:1788201621.687760:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 1765 blocks 1 [cma]time 1788201595 1788201595 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.687863:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.687869:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.687901:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.688053:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1a7:0x0](ffff8bc1459b00c8) 00000008:00010000:2.0:1788201621.688197:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 317150 blocks 1 [cma]time 1788201595 1788201595 0 ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 1/0,0 mode: PW/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.688245:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1a8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1788201621.688250:0:24499:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1788201621.688271:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1a8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.688312:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1a8:0x0](ffff8bc145984b08) 00000008:00010000:2.0:1788201621.688335:0:24499:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 1 [cma]time: 0 0 0 by oinfo size 4512 blocks 1 [cma]time 1788201595 1788201595 0 ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 1/0,0 mode: PW/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x800020000020000 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1788201621.688441:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1a9:0x0](ffff8bc145987448) 00000080:00200000:2.0:1788201621.688456:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1aa:0x0](ffff8bc1459800c8) 00000080:00200000:2.0:1788201621.688466:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1ab:0x0](ffff8bc145985348) 00000080:00200000:2.0:1788201621.688475:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1ac:0x0](ffff8bc145981148) 00000080:00200000:2.0:1788201621.688484:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1ad:0x0](ffff8bc145983248) 00000080:00200000:2.0:1788201621.688501:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1ae:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.688507:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1ae:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.688515:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1ae:0x0](ffff8bc145929988) 00000080:00200000:2.0:1788201621.688547:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1af:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.688551:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1af:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.688559:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1af:0x0](ffff8bc14592cb08) 00000080:00200000:2.0:1788201621.688587:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1b0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.688591:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1b0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.688599:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1b0:0x0](ffff8bc14592f448) 00000080:00200000:2.0:1788201621.688626:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1b1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.688630:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1b1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.688638:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1b1:0x0](ffff8bc14592c2c8) 00000080:00200000:2.0:1788201621.688665:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1b2:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.688669:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1b2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.688746:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1b2:0x0](ffff8bc145929148) 00000080:00200000:2.0:1788201621.688779:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1b3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.688784:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1b3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.689433:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1b3:0x0](ffff8bc1459b42c8) 00000080:00200000:2.0:1788201621.689533:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1b4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.689540:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1b4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.689549:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1b4:0x0](ffff8bc145955b88) 00000080:00200000:2.0:1788201621.689579:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1b5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.689583:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1b5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.689591:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1b5:0x0](ffff8bc145951988) 00000080:00200000:2.0:1788201621.689618:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1b6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.689623:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1b6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.689631:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1b6:0x0](ffff8bc145953248) 00000080:00200000:2.0:1788201621.689661:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1b7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.689665:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1b7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.689754:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1b7:0x0](ffff8bc145955348) 00000080:00200000:2.0:1788201621.689810:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1b8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.689816:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1b8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.689825:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1b8:0x0](ffff8bc14592d348) 00000080:00200000:2.0:1788201621.689855:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1b9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.689859:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1b9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.689867:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1b9:0x0](ffff8bc14592ba88) 00000080:00200000:2.0:1788201621.689948:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1ba:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.689952:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1ba:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.689960:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1ba:0x0](ffff8bc144695348) 00000080:00200000:2.0:1788201621.689987:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1bb:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.689991:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1bb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.690000:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1bb:0x0](ffff8bc144691148) 00000080:00200000:2.0:1788201621.690028:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1bc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.690033:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1bc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.690041:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1bc:0x0](ffff8bc1459d1148) 00000080:00200000:2.0:1788201621.690189:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1bd:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.690194:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1bd:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.690203:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1bd:0x0](ffff8bc144690908) 00000080:00200000:2.0:1788201621.690234:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1be:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.690238:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1be:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.690245:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1be:0x0](ffff8bc1459d21c8) 00000080:00200000:2.0:1788201621.690272:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1bf:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.690276:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1bf:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.690284:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1bf:0x0](ffff8bc145957448) 00000080:00200000:2.0:1788201621.690311:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1c0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.690315:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1c0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.690324:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1c0:0x0](ffff8bc144694b08) 00000080:00200000:2.0:1788201621.690351:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1c1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.690427:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1c1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.690439:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1c1:0x0](ffff8bc144693a88) 00000080:00200000:2.0:1788201621.690473:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1c2:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.690478:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1c2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.690487:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1c2:0x0](ffff8bc145956c08) 00000080:00200000:2.0:1788201621.690520:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1c3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.690524:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1c3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.690533:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1c3:0x0](ffff8bc1459d00c8) 00000080:00200000:2.0:1788201621.690590:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1c4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.690595:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1c4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.690604:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1c4:0x0](ffff8bc1459b3248) 00000080:00200000:2.0:1788201621.690634:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1c5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.690638:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1c5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.691055:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1c5:0x0](ffff8bc1459b21c8) 00000080:00200000:2.0:1788201621.691218:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1c6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.691223:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1c6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.691233:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1c6:0x0](ffff8bc1459b1988) 00000080:00200000:2.0:1788201621.691260:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1c7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.691264:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1c7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.691273:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1c7:0x0](ffff8bc1459b7448) 00000080:00200000:2.0:1788201621.691302:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1c8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.691306:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1c8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.691316:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1c8:0x0](ffff8bc1459b3a88) 00000080:00200000:2.0:1788201621.691443:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1c9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.691448:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1c9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.691456:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1c9:0x0](ffff8bc1459faa08) 00000080:00200000:2.0:1788201621.691488:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1ca:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.691492:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1ca:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.691500:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1ca:0x0](ffff8bc1459fec08) 00000080:00200000:2.0:1788201621.691530:0:24499:0:(vvp_io.c:1826:vvp_io_init()) [0x200000bd7:0x1cb:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1788201621.691534:0:24499:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd7:0x1cb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1788201621.691542:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1cb:0x0](ffff8bc1459fd348) 00000080:00200000:2.0:1788201621.691565:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1cc:0x0](ffff8bc1459d7448) 00000080:00200000:2.0:1788201621.691576:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1cd:0x0](ffff8bc1459f9148) 00000080:00200000:2.0:1788201621.691585:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1ce:0x0](ffff8bc1459f8908) 00000080:00200000:2.0:1788201621.691594:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1cf:0x0](ffff8bc1459fcb08) 00000080:00200000:2.0:1788201621.691603:0:24499:0:(llite_lib.c:2075:ll_clear_inode()) VFS Op:inode=[0x200000bd7:0x1d0:0x0](ffff8bc1459fba88) 00000080:00200000:2.0:1788201621.691613:0:24499:0:(llite_lib.c:1697:ll_put_super()) VFS Op: cfg_instance lustre-client-ffff8bc143fc0000 (sb ffff8bc143fc0000) 00010000:00010000:2.0:1788201621.691649:0:24499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.143@tcp lock: ffff8bc1427dc200/0xd138388016f6c521 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6657e217108bc17 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201621.691661:0:24499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.143@tcp lock: ffff8bc1427dc200/0xd138388016f6c521 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6657e217108bc17 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201621.691669:0:24499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.143@tcp lock: ffff8bc1427dc200/0xd138388016f6c521 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6657e217108bc17 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201621.691746:0:24499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.143@tcp lock: ffff8bc1427dc200/0xd138388016f6c521 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6657e217108bc17 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201621.691773:0:24499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201621.691780:0:24499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.143@tcp lock: ffff8bc1427dda00/0xd138388016f6c54b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6657e217108bc1e expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201621.691787:0:24499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.143@tcp lock: ffff8bc1427dda00/0xd138388016f6c54b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6657e217108bc1e expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201621.691823:0:24499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.143@tcp lock: ffff8bc1427dda00/0xd138388016f6c54b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6657e217108bc1e expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201621.691830:0:24499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.143@tcp lock: ffff8bc1427dda00/0xd138388016f6c54b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6657e217108bc1e expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201621.691843:0:24499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788201621.691849:0:24499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.143@tcp lock: ffff8bc1427dc000/0xd138388016f6c552 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6657e217108bc25 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201621.691856:0:24499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.143@tcp lock: ffff8bc1427dc000/0xd138388016f6c552 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6657e217108bc25 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201621.691862:0:24499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.143@tcp lock: ffff8bc1427dc000/0xd138388016f6c552 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6657e217108bc25 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201621.691869:0:24499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.143@tcp lock: ffff8bc1427dc000/0xd138388016f6c552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6657e217108bc25 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201621.692018:0:24499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1788201621.692024:0:24499:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00020000:01000000:2.0:1788201621.692580:0:24499:0:(lov_obd.c:601:lov_del_target()) uuid: lustre-OST0000_UUID idx: 0 gen: 1 exp: ffff8bc146505800 active: 1 00020000:01000000:2.0:1788201621.692585:0:24499:0:(lov_obd.c:601:lov_del_target()) uuid: lustre-OST0001_UUID idx: 1 gen: 1 exp: ffff8bc146503000 active: 1 00020000:01000000:2.0:1788201621.692589:0:24499:0:(lov_obd.c:64:lov_tgts_putref()) destroying 2 lov targets 00020000:01000000:2.0:1788201621.692594:0:24499:0:(lov_obd.c:623:__lov_del_obd()) Removing tgt lustre-OST0001_UUID : lustre-OST0001-osc-ffff8bc143fc0000 00020000:01000000:2.0:1788201621.692597:0:24499:0:(lov_obd.c:248:lov_disconnect_obd()) lustre-clilov-ffff8bc143fc0000: disconnecting target lustre-OST0001-osc-ffff8bc143fc0000 00000100:00080000:2.0:1788201621.692608:0:24499:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 5dac367c-c41f-4c84-afa8-a2acd4f3ad9f->lustre-OST0001_UUID 00010000:00010000:2.0:1788201621.692624:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.692693:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.692701:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.692719:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.692730:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728059136:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.692738:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.692745:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.692749:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003eb718f8/0xd138388016f6f365 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097631 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.692768:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.692823:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.692832:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.692838:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.692843:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728059264:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.692848:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.692853:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.692856:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000261e1b5a/0xd138388016f6f7c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171098191 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.692874:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.692998:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693006:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.693012:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.693017:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728059392:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.693022:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.693026:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.693029:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000019c58379/0xd138388016f6ef4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096b87 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693045:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000069322032/0xd138388016f6f3ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e21710976e7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693071:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000069322032/0xd138388016f6f3ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710976e7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693089:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.693096:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.693100:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728059520:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.693106:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.693109:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.693113:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000069322032/0xd138388016f6f3ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710976e7 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693128:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693155:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693162:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.693167:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.693172:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728059648:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.693177:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.693180:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.693183:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000ca2e1663/0xd138388016f6f80b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171098247 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693200:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693226:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693234:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.693238:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.693242:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728059776:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.693247:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.693250:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.693253:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000662352fb/0xd138388016f6ef91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096c3d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693269:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000943c2caa/0xd138388016f6f3f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e217109779d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693294:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000943c2caa/0xd138388016f6f3f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e217109779d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693302:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.693306:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.693311:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728059904:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.693316:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.693319:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.693322:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000943c2caa/0xd138388016f6f3f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e217109779d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693338:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693363:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693371:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.693375:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.693379:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728060032:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.693384:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.693387:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.693390:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003ec3493b/0xd138388016f6f851 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710982fd expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693409:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693435:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693442:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.693447:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.693451:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728060160:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.693456:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.693459:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.693462:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000034d3db6f/0xd138388016f6efd7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096cf3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693477:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097853 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693500:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097853 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693508:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.693513:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.693517:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728060288:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.693522:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.693525:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.693528:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000000ea2bfc2/0xd138388016f6f437 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097853 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693542:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693566:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693573:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.693577:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.693581:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728060416:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.693586:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.693590:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.693592:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009dc0c329/0xd138388016f6f897 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1183743) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710983b3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693609:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171096da9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693634:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096da9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693641:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.693646:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.693650:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728060544:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.693655:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.693658:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.693661:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006da56d4a/0xd138388016f6f01d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096da9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693675:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097909 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693703:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097909 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693710:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.693715:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.693719:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728060672:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.693724:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.693727:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.693730:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004a0b8476/0xd138388016f6f47d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097909 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693744:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693770:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693778:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.693783:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.693787:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728060800:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.693818:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.693822:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.693826:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db1db7d8/0xd138388016f6f8dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171098469 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693845:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6f063 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171096e5f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693872:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6f063 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096e5f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693889:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.693896:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.693900:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728060928:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.693905:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.693909:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.693912:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000001e33027d/0xd138388016f6f063 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096e5f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693926:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693952:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693959:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.693963:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.693967:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728061056:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.693971:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.693975:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.693977:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000e250cccb/0xd138388016f6f4c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710979bf expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.693991:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694015:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694022:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.694027:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.694031:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728061184:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.694035:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.694038:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.694041:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000120128c7/0xd138388016f6f923 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171098622 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694058:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171096f15 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694079:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096f15 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694086:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.694090:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.694094:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728061312:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.694099:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.694102:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.694104:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000db2c4e2e/0xd138388016f6f0a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096f15 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694116:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694137:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694143:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.694147:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.694150:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728061440:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.694154:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.694156:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.694159:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008f54f396/0xd138388016f6f509 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097a75 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694170:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694191:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694197:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.694200:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.694203:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728061568:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.694207:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.694210:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.694212:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000064d81761/0xd138388016f6f969 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710986d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694227:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000009a4e707/0xd138388016f6f0ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171096fcb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694250:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000009a4e707/0xd138388016f6f0ef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096fcb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694257:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.694261:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.694264:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728061696:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.694269:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.694272:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.694274:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000009a4e707/0xd138388016f6f0ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096fcb expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694290:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694314:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694321:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.694325:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.694330:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728061824:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.694334:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.694338:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.694341:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007b1b7774/0xd138388016f6f54f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097b2b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694357:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003f09d801/0xd138388016f6f135 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097081 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694383:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003f09d801/0xd138388016f6f135 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097081 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694390:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.694396:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.694400:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728061952:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.694404:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.694407:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.694410:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000003f09d801/0xd138388016f6f135 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097081 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694425:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694449:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694456:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.694460:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.694464:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728062080:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.694468:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.694472:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.694475:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c037e18d/0xd138388016f6f595 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097be1 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694490:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009b0557ef/0xd138388016f6f17b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097137 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694516:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009b0557ef/0xd138388016f6f17b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097137 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694524:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.694529:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.694534:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728062208:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.694539:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.694542:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.694545:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000009b0557ef/0xd138388016f6f17b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097137 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694560:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694585:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694592:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.694597:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.694600:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728062336:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.694605:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.694608:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.694611:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000206fd42e/0xd138388016f6f5db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097c97 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694626:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002dba747d/0xd138388016f6f1c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e21710971ed expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694654:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002dba747d/0xd138388016f6f1c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710971ed expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694662:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.694667:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.694671:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728062464:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.694675:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.694679:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.694681:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002dba747d/0xd138388016f6f1c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710971ed expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694696:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694722:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694728:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.694733:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.694738:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728062592:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.694742:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.694745:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.694747:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008536026c/0xd138388016f6f621 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097d4d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694762:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e21710972a3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694788:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710972a3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694823:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.694829:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.694833:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728062720:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.694838:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.694842:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.694844:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000006c04c01f/0xd138388016f6f207 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710972a3 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694858:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694898:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694905:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.694910:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.694914:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728062848:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.694919:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.694922:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.694925:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000c437d378/0xd138388016f6f667 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097e03 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694941:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694971:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.694978:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.694983:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.694988:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728062976:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.694992:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.694996:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.694998:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 00000000af98523b/0xd138388016f6f24d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097359 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.695013:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.695038:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.695045:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.695050:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.695054:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728063104:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.695059:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.695062:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.695066:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000058e78314/0xd138388016f6f6ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097eb9 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.695082:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6f293 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e217109740f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.695109:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6f293 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e217109740f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.695116:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.695121:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.695125:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728063232:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.695130:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.695133:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.695136:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002e9b911c/0xd138388016f6f293 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e217109740f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.695150:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.695175:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.695182:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.695186:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.695190:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728063360:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.695195:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.695198:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.695200:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000004b64affc/0xd138388016f6f6f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097f6f expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.695217:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.695242:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.695248:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.695253:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.695257:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728063488:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.695262:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.695265:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.695267:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000002176ce48/0xd138388016f6f2d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710974c5 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.695282:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.695307:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.695314:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.695318:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.695322:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728063616:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.695326:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.695329:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.695332:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000007d1a2ab2/0xd138388016f6f739 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171098025 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.695350:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f31f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e217109757b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.695375:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f31f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e217109757b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.695381:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.695386:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.695389:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728063744:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.695394:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.695397:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.695400:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 000000008add94e4/0xd138388016f6f31f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e217109757b expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.695414:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.695439:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.695446:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.695451:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623180 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.695455:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728063872:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.695459:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.695463:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.695466:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8bc143fc0000 lock: 0000000020557b20/0xd138388016f6f77f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710980db expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00080000:2.0:1788201621.695547:0:24499:0:(import.c:65:import_set_state_nolock()) ffff8bc1452f7800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788201621.696301:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201621.696311:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.143@tcp lock: ffff8bc1427dc200/0xd138388016f6c521 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6657e217108bc17 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.696321:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1427dc200 already unused, calling callback (ffffffffc11fdc20) 10000000:00010000:1.0:1788201621.696326:0:20882:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.143@tcp lock: ffff8bc1427dc200/0xd138388016f6c521 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6657e217108bc17 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.696338:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.143@tcp lock: ffff8bc1427dc200/0xd138388016f6c521 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6657e217108bc17 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201621.696346:0:20882:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.143@tcp lock: ffff8bc1427dc200/0xd138388016f6c521 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6657e217108bc17 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201621.696353:0:20882:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201621.696368:0:20882:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788201621.696371:0:20882:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:1.0:1788201621.696405:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10051:1875064728064000:192.168.201.143@tcp:9:umount.0 00010000:00010000:1.0:1788201621.696551:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.143@tcp lock: ffff8bc1427dc200/0xd138388016f6c521 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6657e217108bc17 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.696559:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201621.696582:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.143@tcp lock: ffff8bc1427dc200/0xd138388016f6c521 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6657e217108bc17 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.696590:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.143@tcp lock: ffff8bc1427dc200/0xd138388016f6c521 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6657e217108bc17 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.696608:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201621.696612:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.143@tcp lock: ffff8bc1427dda00/0xd138388016f6c54b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6657e217108bc1e expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.696618:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1427dda00 already unused, calling callback (ffffffffc11fdc20) 10000000:00010000:1.0:1788201621.696622:0:20882:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.143@tcp lock: ffff8bc1427dda00/0xd138388016f6c54b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6657e217108bc1e expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.696630:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.143@tcp lock: ffff8bc1427dda00/0xd138388016f6c54b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6657e217108bc1e expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201621.696637:0:20882:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.143@tcp lock: ffff8bc1427dda00/0xd138388016f6c54b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6657e217108bc1e expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201621.696643:0:20882:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201621.696646:0:20882:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-cliir: stopping, won't requeue 10000000:01000000:1.0:1788201621.696648:0:20882:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-cliir 00010000:00010000:1.0:1788201621.696661:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.143@tcp lock: ffff8bc1427dda00/0xd138388016f6c54b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6657e217108bc1e expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.696667:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201621.696697:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.143@tcp lock: ffff8bc1427dda00/0xd138388016f6c54b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6657e217108bc1e expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.696709:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.143@tcp lock: ffff8bc1427dda00/0xd138388016f6c54b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6657e217108bc1e expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.696723:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201621.696727:0:20882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.143@tcp lock: ffff8bc1427dc000/0xd138388016f6c552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6657e217108bc25 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.696733:0:20882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bc1427dc000 already unused, calling callback (ffffffffc11fdc20) 10000000:00010000:1.0:1788201621.696736:0:20882:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.143@tcp lock: ffff8bc1427dc000/0xd138388016f6c552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6657e217108bc25 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.696743:0:20882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.143@tcp lock: ffff8bc1427dc000/0xd138388016f6c552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6657e217108bc25 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201621.696750:0:20882:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.143@tcp lock: ffff8bc1427dc000/0xd138388016f6c552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6657e217108bc25 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201621.696755:0:20882:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788201621.696758:0:20882:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788201621.696760:0:20882:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788201621.696772:0:20882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.143@tcp lock: ffff8bc1427dc000/0xd138388016f6c552 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6657e217108bc25 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.696778:0:20882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201621.696784:0:20882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.143@tcp lock: ffff8bc1427dc000/0xd138388016f6c552 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6657e217108bc25 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.696811:0:20882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.143@tcp lock: ffff8bc1427dc000/0xd138388016f6c552 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6657e217108bc25 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.696828:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201621.696830:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201621.696832:0:20882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201621.696844:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:21dcfac0-2fe1-402c-8fca-db923b83f76c:10054:1875064728064256:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201621.696912:0:10054:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201621.696919:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:21dcfac0-2fe1-402c-8fca-db923b83f76c:10054:1875064728064384:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201621.696948:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201621.696957:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:21dcfac0-2fe1-402c-8fca-db923b83f76c:10052:1875064728064128:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201621.697261:0:23027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201621.698284:0:20881:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201621.711109:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc1452f7800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788201621.711138:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10051:1875064728064000:192.168.201.143@tcp:9:umount.0 00000100:00080000:2.0:1788201621.711239:0:24499:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788201621.711244:0:24499:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8bc143fc0000: committing for last_committed 8589935329 gen 2 00000100:00100000:2.0:1788201621.711254:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc172746680 x1875064728052992/t8589935348(8589935348) o4->lustre-OST0001-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 728/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.711272:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc172745180 x1875064728052736/t8589935349(8589935349) o4->lustre-OST0001-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 6704/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.711286:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc172745c00 x1875064728053248/t8589935350(8589935350) o4->lustre-OST0001-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 3568/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.711298:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc172747100 x1875064728054016/t8589935351(8589935351) o4->lustre-OST0001-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 6920/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.711309:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc172747480 x1875064728053760/t8589935352(8589935352) o4->lustre-OST0001-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 2280/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.711319:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc172746a00 x1875064728053504/t8589935353(8589935353) o4->lustre-OST0001-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 7680/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.711330:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc172747b80 x1875064728054528/t8589935354(8589935354) o4->lustre-OST0001-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 14368/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.711366:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc172744380 x1875064728054272/t8589935355(8589935355) o4->lustre-OST0001-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 488/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.711505:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc1726cd180 x1875064728054912/t8589935356(8589935356) o4->lustre-OST0001-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 11424/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.711528:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc1726cf100 x1875064728055040/t8589935357(8589935357) o4->lustre-OST0001-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 5240/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.711542:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc17257ea00 x1875064728056704/t8589935358(8589935358) o4->lustre-OST0001-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 2152/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.711554:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc172745880 x1875064728054784/t8589935359(8589935359) o4->lustre-OST0001-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 488/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.711729:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc1726cf480 x1875064728055168/t8589935360(8589935360) o4->lustre-OST0001-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 488/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.712092:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc17257d880 x1875064728056320/t8589935361(8589935361) o4->lustre-OST0001-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 488/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.712333:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc144140000 x1875064728057600/t8589935362(8589935362) o4->lustre-OST0001-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 2144/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.712348:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc144143100 x1875064728057728/t8589935363(8589935363) o4->lustre-OST0001-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 2104/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.712362:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc17257ce00 x1875064728056576/t8589935364(8589935364) o4->lustre-OST0001-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 488/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.712731:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc1726cd500 x1875064728056832/t8589935365(8589935365) o4->lustre-OST0001-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 488/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201621.717764:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:21dcfac0-2fe1-402c-8fca-db923b83f76c:10052:1875064728064128:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788201621.721997:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc17257dc00 x1875064728056448/t8589935366(8589935366) o4->lustre-OST0001-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 488/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.722333:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc144143800 x1875064728058752/t8589935367(8589935367) o4->lustre-OST0001-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 912/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.722350:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc1726cca80 x1875064728058112/t8589935368(8589935368) o4->lustre-OST0001-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 1896/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.722553:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc1727d4000 x1875064728058240/t8589935369(8589935369) o4->lustre-OST0001-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 2968/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.722567:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc1727d4380 x1875064728057856/t8589935370(8589935370) o4->lustre-OST0001-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 488/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201621.723925:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:21dcfac0-2fe1-402c-8fca-db923b83f76c:10054:1875064728064256:192.168.201.143@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788201621.724077:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc1727d5500 x1875064728058880/t8589935371(8589935371) o4->lustre-OST0001-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 488/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.724279:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc1727d6680 x1875064728059008/t8589935372(8589935372) o4->lustre-OST0001-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 488/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.724401:0:24499:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788201621.724617:0:24499:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd138388016f6c575 00000020:00000080:2.0:1788201621.724635:0:24499:0:(genops.c:906:class_export_put()) final put ffff8bc146503000/LOV_OSC_UUID 00000020:01000000:2.0:1788201621.724703:0:24499:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-ffff8bc143fc0000 (flags='') 00000020:00000080:2.0:1788201621.724708:0:24499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201621.724718:0:24499:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-ffff8bc143fc0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788201621.724722:0:24499:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8bc14604b380) has no exports 00000020:00000080:0.0:1788201621.727415:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8bc146503000/LOV_OSC_UUID for lustre-OST0001-osc-ffff8bc143fc0000 00000008:01000000:2.0:1788201621.727868:0:24499:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-ffff8bc143fc0000: client import never connected 00000100:00080000:2.0:1788201621.727874:0:24499:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788201621.727888:0:24499:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8bc143fc0000: committing for last_committed 8589935329 gen 3 00000100:00100000:2.0:1788201621.727896:0:24499:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788201621.729066:0:24499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201621.729080:0:24499:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-ffff8bc143fc0000 (uuid 5dac367c-c41f-4c84-afa8-a2acd4f3ad9f) 00020000:01000000:2.0:1788201621.729086:0:24499:0:(lov_obd.c:623:__lov_del_obd()) Removing tgt lustre-OST0000_UUID : lustre-OST0000-osc-ffff8bc143fc0000 00020000:01000000:2.0:1788201621.729088:0:24499:0:(lov_obd.c:248:lov_disconnect_obd()) lustre-clilov-ffff8bc143fc0000: disconnecting target lustre-OST0000-osc-ffff8bc143fc0000 00000100:00080000:2.0:1788201621.729107:0:24499:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 5dac367c-c41f-4c84-afa8-a2acd4f3ad9f->lustre-OST0000_UUID 00010000:00010000:2.0:1788201621.729124:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 1 00010000:00010000:2.0:1788201621.729195:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 1 00010000:00010000:2.0:1788201621.729203:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.729222:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.729234:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728064512:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.729244:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.729252:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.729256:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000df2db5f0/0xd138388016f6ef21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096b10 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 1 00010000:00010000:2.0:1788201621.729281:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f388 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e217109768c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.729313:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f388 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e217109768c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.729320:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.729326:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.729331:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728064640:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.729336:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.729340:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.729343:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001f7f2e9e/0xd138388016f6f388 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e217109768c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.729361:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.729390:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.729398:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.729403:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.729408:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728064768:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.729413:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.729416:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.729419:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000629400aa/0xd138388016f6f7e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710981ec expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.729440:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.729465:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.729473:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.729477:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.729481:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728064896:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.729486:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.729489:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.729492:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000034e5052c/0xd138388016f6ef6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->397311) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096be2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.729506:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097742 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.729531:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097742 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.729538:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.729542:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.729546:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728065024:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.729551:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.729554:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.729557:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000226e36bd/0xd138388016f6f3ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097742 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.729572:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.729597:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.729604:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.729608:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.729612:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728065152:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.729616:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.729619:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.729623:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000069577203/0xd138388016f6f82e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710982a2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.729640:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171096c98 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.729664:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096c98 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.729671:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.729675:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.729679:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728065280:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.729684:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.729688:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.729691:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f2bd8503/0xd138388016f6efb4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096c98 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.729709:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f40fa3a5/0xd138388016f6f414 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e21710977f8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.729734:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f40fa3a5/0xd138388016f6f414 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710977f8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.729742:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.729746:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.729750:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728065408:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.729755:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.729759:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.729762:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f40fa3a5/0xd138388016f6f414 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710977f8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.729776:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00000080:0.0:1788201621.729869:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8bc1452f7800 for lustre-OST0001-osc-ffff8bc143fc0000 00000020:00000080:0.0:1788201621.729891:0:37:0:(genops.c:906:class_export_put()) final put ffff8bc1452f7000/5dac367c-c41f-4c84-afa8-a2acd4f3ad9f 00000020:00000080:0.0:1788201621.729896:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8bc1452f7000/5dac367c-c41f-4c84-afa8-a2acd4f3ad9f for lustre-OST0001-osc-ffff8bc143fc0000 00000020:01000000:0.0:1788201621.729902:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-ffff8bc143fc0000 (5dac367c-c41f-4c84-afa8-a2acd4f3ad9f) 00010000:00010000:2.0:1788201621.730582:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.730594:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.730601:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.730607:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728065536:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.730613:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.730617:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.730622:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000061c552b/0xd138388016f6f874 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171098358 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.730642:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171096d4e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.730675:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096d4e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.730682:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.730687:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.730691:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728065664:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.730695:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.730699:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.730701:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000007532dd28/0xd138388016f6effa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096d4e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.730716:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.730741:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.730748:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.730753:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.730757:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728065792:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.730761:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.730764:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.730768:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f197c86f/0xd138388016f6f45a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710978ae expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.730781:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.730872:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.730892:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.730898:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.730956:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728065920:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.730962:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.730966:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.730969:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000001b2252c1/0xd138388016f6f8ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e217109840e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.730987:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000083541a8b/0xd138388016f6f040 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171096e04 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731014:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000083541a8b/0xd138388016f6f040 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096e04 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731021:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.731027:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.731031:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728066048:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.731036:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.731039:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.731042:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000083541a8b/0xd138388016f6f040 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096e04 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731120:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000003039f059/0xd138388016f6f4a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097964 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731151:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000003039f059/0xd138388016f6f4a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097964 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731159:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.731164:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.731168:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728066176:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.731173:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.731176:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.731179:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000003039f059/0xd138388016f6f4a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097964 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731194:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731220:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731227:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.731232:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.731236:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728066304:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.731241:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.731244:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.731247:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000aec7e212/0xd138388016f6f900 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710984c4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731263:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171096eba expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731288:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096eba expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731295:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.731300:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.731305:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728066432:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.731309:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.731312:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.731314:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000084a794db/0xd138388016f6f086 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096eba expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731327:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731350:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731356:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.731361:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.731365:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728066560:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.731369:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.731372:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.731375:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000041adad6d/0xd138388016f6f4e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097a1a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731389:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731411:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731417:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.731420:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.731423:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728066688:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.731427:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.731430:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.731432:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000000b88915e/0xd138388016f6f946 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e217109867d expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731447:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731468:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731473:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.731477:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.731480:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728066816:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.731484:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.731486:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.731490:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b16c67a/0xd138388016f6f0cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171096f70 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731503:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731524:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731530:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.731533:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.731536:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728066944:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.731540:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.731543:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.731545:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009a8689a1/0xd138388016f6f52c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097ad0 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731557:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731578:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731584:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.731588:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.731591:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728067072:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.731595:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.731599:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.731602:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000319ae124/0xd138388016f6f98c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171098733 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731617:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b477b91d/0xd138388016f6f112 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097026 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731643:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b477b91d/0xd138388016f6f112 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097026 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731649:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.731654:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.731658:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728067200:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.731663:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.731666:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.731668:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b477b91d/0xd138388016f6f112 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097026 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731683:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731709:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731717:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.731722:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.731726:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728067328:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.731731:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.731734:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.731737:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e3ed1be7/0xd138388016f6f572 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097b86 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731755:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ec3e6631/0xd138388016f6f158 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e21710970dc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.731783:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ec3e6631/0xd138388016f6f158 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710970dc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.733994:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.734027:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.734042:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728067456:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.734136:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.734152:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.734160:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000ec3e6631/0xd138388016f6f158 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710970dc expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.734206:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.734304:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.734312:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.734319:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.734325:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728067584:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.734331:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.734335:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.734340:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000865ca1f0/0xd138388016f6f5b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097c3c expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.734365:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.734397:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.734405:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.734410:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.734415:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728067712:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.734420:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.734424:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.734427:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f635d174/0xd138388016f6f19e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097192 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.734446:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.734477:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.734484:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.734490:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.734495:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728067840:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.734500:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.734504:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.734507:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000005037dd06/0xd138388016f6f5fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097cf2 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.734525:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 1 00010000:00010000:2.0:1788201621.734551:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 1 00010000:00010000:2.0:1788201621.734558:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.734563:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.734567:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728067968:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.734572:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.734575:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.734579:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000073e08249/0xd138388016f6f1e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097248 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 1 00010000:00010000:2.0:1788201621.734595:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.734623:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.734630:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.734635:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.734640:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728068096:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.734644:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.734648:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.734651:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000d7e181d7/0xd138388016f6f644 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097da8 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.734668:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fd829a5f/0xd138388016f6f22a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e21710972fe expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.734692:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fd829a5f/0xd138388016f6f22a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710972fe expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.734699:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.734704:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.734708:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728068224:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.734712:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.734715:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.734718:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000fd829a5f/0xd138388016f6f22a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710972fe expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.734730:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.734752:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.734758:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.734761:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.734765:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728068352:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.734769:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.734772:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.734774:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000061a1420f/0xd138388016f6f68a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097e5e expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1788201621.734897:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:21dcfac0-2fe1-402c-8fca-db923b83f76c:10054:1875064728064384:192.168.201.143@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201621.735663:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.736441:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.736453:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.736468:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623000 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.736479:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728068480:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.736488:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.736494:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.736498:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000009b4cf729/0xd138388016f6f270 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710973b4 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.736522:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.736550:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.736557:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.736561:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623000 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.736565:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728068608:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.736570:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.736574:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.736578:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000f4f7ff6d/0xd138388016f6f6d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097f14 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.736607:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f2b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e217109746a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.736637:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f2b6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e217109746a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.736645:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.736649:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623000 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.736654:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728068736:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.736658:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.736662:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.736665:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000e99625c8/0xd138388016f6f2b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e217109746a expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.736679:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.736706:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.736714:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.736719:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623000 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.736723:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728068864:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.736728:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.736732:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.736735:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000008d8bcbbf/0xd138388016f6f716 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097fca expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.736751:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.736778:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.736785:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.736990:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623000 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.736996:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728068992:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.737002:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.737006:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.737009:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 000000004d3873ad/0xd138388016f6f2fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171097520 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.737027:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.737128:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.737137:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.737143:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623000 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.737147:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728069120:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.737153:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.737157:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.737160:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 0000000002625a0b/0xd138388016f6f75c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171098080 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.737180:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000bfd1eb34/0xd138388016f6f342 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e21710975d6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.737208:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000bfd1eb34/0xd138388016f6f342 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710975d6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.737215:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.737220:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623000 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.737224:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728069248:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.737228:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.737232:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.737235:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000bfd1eb34/0xd138388016f6f342 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e21710975d6 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.737249:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x28400020000 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.737275:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.737282:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.737286:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172623000 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.737291:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728069376:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.737295:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.737299:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.737302:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8bc143fc0000 lock: 00000000b06f576a/0xd138388016f6f7a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x4829400020020 nid: local remote: 0xe6657e2171098136 expref: -99 pid: 24470 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00080000:2.0:1788201621.737386:0:24499:0:(import.c:65:import_set_state_nolock()) ffff8bc1450ab000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788201621.737465:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10051:1875064728069504:192.168.201.143@tcp:9:umount.0 00000100:00080000:1.0:1788201621.748429:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc1450ab000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788201621.748465:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10051:1875064728069504:192.168.201.143@tcp:9:umount.0 00000100:00080000:2.0:1788201621.748842:0:24499:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788201621.748849:0:24499:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8bc143fc0000: committing for last_committed 8589935331 gen 2 00000100:00100000:2.0:1788201621.748861:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc172744700 x1875064728052864/t8589935354(8589935354) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 760/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.748890:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc172744e00 x1875064728053120/t8589935355(8589935355) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 4608/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.748989:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc172744a80 x1875064728053888/t8589935356(8589935356) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 2184/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.749006:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc172746d80 x1875064728053376/t8589935357(8589935357) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 4640/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.749043:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc172745f80 x1875064728053632/t8589935358(8589935358) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 8936/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.749074:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc172744000 x1875064728052608/t8589935359(8589935359) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 1328/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.749090:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc172745500 x1875064728054144/t8589935360(8589935360) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 6728/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.749104:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc172747800 x1875064728054656/t8589935361(8589935361) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 2624/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.749118:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc172746300 x1875064728054400/t8589935362(8589935362) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 488/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.749207:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc1726cfb80 x1875064728055680/t8589935363(8589935363) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 7312/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.749221:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc1726ced80 x1875064728055424/t8589935364(8589935364) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 2248/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.749234:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc1726ce300 x1875064728055936/t8589935365(8589935365) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 1832/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.749246:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc17257e680 x1875064728056192/t8589935366(8589935366) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 5600/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.749261:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc17257ed80 x1875064728057088/t8589935367(8589935367) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 2256/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.749274:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc144140380 x1875064728057216/t8589935368(8589935368) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 5000/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.749285:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc1726cea00 x1875064728055296/t8589935369(8589935369) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 488/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.749492:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc17257c000 x1875064728056064/t8589935370(8589935370) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 488/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.749645:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc1726ce680 x1875064728055552/t8589935371(8589935371) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 488/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.749738:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc144142300 x1875064728057472/t8589935372(8589935372) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 7040/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.749752:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc1726cdc00 x1875064728055808/t8589935373(8589935373) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 488/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.749875:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc1727d6d80 x1875064728056960/t8589935374(8589935374) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 488/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.756098:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc144141f80 x1875064728057344/t8589935375(8589935375) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 488/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.756287:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc144143b80 x1875064728058368/t8589935376(8589935376) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 488/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.756328:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc144141500 x1875064728057984/t8589935377(8589935377) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 488/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.756361:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc17257df80 x1875064728058496/t8589935378(8589935378) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 488/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.756402:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc17257f480 x1875064728058624/t8589935379(8589935379) o4->lustre-OST0000-osc-ffff8bc143fc0000@192.168.201.143@tcp:6/4 lens 1344/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201621.756422:0:24499:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788201621.756604:0:24499:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd138388016f6c56e 00000020:00000080:2.0:1788201621.756623:0:24499:0:(genops.c:906:class_export_put()) final put ffff8bc146505800/LOV_OSC_UUID 00000020:01000000:2.0:1788201621.756660:0:24499:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-ffff8bc143fc0000 (flags='') 00000020:00000080:2.0:1788201621.756665:0:24499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201621.756675:0:24499:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-ffff8bc143fc0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788201621.756679:0:24499:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff8bc151fa3380) has no exports 00000020:00000080:0.0:1788201621.757083:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8bc146505800/LOV_OSC_UUID for lustre-OST0000-osc-ffff8bc143fc0000 00000008:01000000:2.0:1788201621.763908:0:24499:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-ffff8bc143fc0000: client import never connected 00000100:00080000:2.0:1788201621.763918:0:24499:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788201621.763923:0:24499:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8bc143fc0000: committing for last_committed 8589935331 gen 3 00000100:00100000:2.0:1788201621.763932:0:24499:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788201621.764202:0:24499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201621.764212:0:24499:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-ffff8bc143fc0000 (uuid 5dac367c-c41f-4c84-afa8-a2acd4f3ad9f) 00000020:00000080:2.0:1788201621.764219:0:24499:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd138388016f6c567 00000020:00000080:2.0:1788201621.764230:0:24499:0:(genops.c:906:class_export_put()) final put ffff8bc146501000/5dac367c-c41f-4c84-afa8-a2acd4f3ad9f 00000100:00080000:2.0:1788201621.764321:0:24499:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 5dac367c-c41f-4c84-afa8-a2acd4f3ad9f->lustre-MDT0000_UUID 00010000:00010000:2.0:1788201621.764340:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6f0e1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171096fb6 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.764393:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6f0e1 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096fb6 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.764401:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.764420:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.764431:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728069632:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.764443:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.764451:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.764454:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd600/0xd138388016f6f0e1 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096fb6 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.764473:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097b16 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.764488:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097b16 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.764494:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.764498:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.764502:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728069760:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.764507:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.764511:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.764514:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778800/0xd138388016f6f541 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097b16 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.764528:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11200/0xd138388016f6f993 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a9:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e21710987db expref: -99 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201621.764543:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11200/0xd138388016f6f993 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x1a9:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e21710987db expref: -99 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201621.764549:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.764554:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.764558:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728069888:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.764563:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.764566:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.764569:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11200/0xd138388016f6f993 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x1a9:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e21710987db expref: -99 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201621.764617:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6f104 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x16a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097011 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.764635:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6f104 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x16a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097011 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.764641:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.764648:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.764652:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728070016:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.764657:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.764661:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.764664:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dca00/0xd138388016f6f104 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x16a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097011 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.764679:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097b71 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.764701:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097b71 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.764707:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.764712:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.764716:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728070144:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.764720:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.764724:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.764727:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778400/0xd138388016f6f564 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097b71 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.764740:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11000/0xd138388016f6f99a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1aa:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e217109883d expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201621.764755:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11000/0xd138388016f6f99a lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x1aa:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e217109883d expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201621.764761:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.764765:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.764769:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728070272:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.764774:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.764777:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.764779:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f11000/0xd138388016f6f99a lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x1aa:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e217109883d expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201621.764847:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6f127 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x16b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e217109706c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.764868:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6f127 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x16b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109706c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.764874:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.764891:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.764895:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728070400:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.764900:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.764903:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.764906:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd400/0xd138388016f6f127 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x16b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109706c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.764920:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097bcc expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.764935:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097bcc expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.764941:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.764946:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.764950:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728070528:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.764955:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.764958:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.764960:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e800/0xd138388016f6f587 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097bcc expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.764972:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f10600/0xd138388016f6f9a1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1ab:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e217109889f expref: -99 pid: 24476 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201621.764993:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f10600/0xd138388016f6f9a1 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x1ab:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e217109889f expref: -99 pid: 24476 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201621.764999:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.765004:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.765007:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728070656:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.765012:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.765016:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.765019:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f10600/0xd138388016f6f9a1 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x1ab:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e217109889f expref: -99 pid: 24476 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201621.765047:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491a00/0xd138388016f6c8e7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e217108d117 expref: -99 pid: 21627 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201621.765063:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491a00/0xd138388016f6c8e7 lrc: 1/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e217108d117 expref: -99 pid: 21627 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201621.765069:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.765074:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.765078:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728070784:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.765083:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.765087:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.765090:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491a00/0xd138388016f6c8e7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e217108d117 expref: -99 pid: 21627 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201621.765104:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491200/0xd138388016f6c8fc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e217108d15d expref: -99 pid: 21627 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1788201621.765125:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491200/0xd138388016f6c8fc lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e217108d15d expref: -99 pid: 21627 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1788201621.765131:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.765136:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.765140:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728070912:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.765145:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.765149:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.765151:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491200/0xd138388016f6c8fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e217108d15d expref: -99 pid: 21627 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1788201621.765165:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f14a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x16c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710970c7 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765179:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f14a lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x16c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710970c7 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765185:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.765190:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.765194:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728071040:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.765199:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.765202:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.765205:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49e00/0xd138388016f6f14a lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x16c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710970c7 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765219:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097c27 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765239:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097c27 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765246:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.765251:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.765254:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728071168:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.765259:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.765262:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.765264:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085a00/0xd138388016f6f5aa lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097c27 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765277:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a400/0xd138388016f6f9a8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1ac:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e2171098901 expref: -99 pid: 24477 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201621.765292:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a400/0xd138388016f6f9a8 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x1ac:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171098901 expref: -99 pid: 24477 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201621.765298:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.765302:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.765306:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728071296:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.765311:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.765314:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.765316:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a400/0xd138388016f6f9a8 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x1ac:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171098901 expref: -99 pid: 24477 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201621.765347:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491e00/0xd138388016f6f16d lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x16d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097122 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765366:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491e00/0xd138388016f6f16d lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x16d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097122 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765371:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.765375:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.765379:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728071424:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.765383:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.765386:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.765389:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491e00/0xd138388016f6f16d lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x16d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097122 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765402:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097c82 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765416:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097c82 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765422:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.765426:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.765429:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728071552:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.765434:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.765437:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.765440:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261ee00/0xd138388016f6f5cd lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097c82 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765453:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6f9af lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1ad:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e2171098963 expref: -99 pid: 24478 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201621.765472:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6f9af lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x1ad:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171098963 expref: -99 pid: 24478 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201621.765479:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.765483:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.765487:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728071680:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.765492:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.765495:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.765498:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12a600/0xd138388016f6f9af lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x1ad:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171098963 expref: -99 pid: 24478 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201621.765527:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490600/0xd138388016f6c8ee lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e217108d133 expref: -99 pid: 21627 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201621.765540:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490600/0xd138388016f6c8ee lrc: 1/0,0 mode: --/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e217108d133 expref: -99 pid: 21627 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201621.765547:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.765551:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.765555:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728071808:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.765559:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.765562:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.765565:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490600/0xd138388016f6c8ee lrc: 0/0,0 mode: --/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e217108d133 expref: -99 pid: 21627 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201621.765579:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e217109717d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765599:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109717d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765605:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.765610:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.765614:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728071936:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.765618:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.765622:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.765624:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd200/0xd138388016f6f190 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109717d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765638:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097cdd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765652:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097cdd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765658:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.765663:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.765666:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728072064:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.765671:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.765674:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.765677:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261e400/0xd138388016f6f5f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097cdd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765707:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490000/0xd138388016f6f1b3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710971d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765726:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490000/0xd138388016f6f1b3 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710971d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765732:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.765738:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.765741:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728072192:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.765746:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.765750:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.765753:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490000/0xd138388016f6f1b3 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710971d8 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765766:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097d38 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765780:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097d38 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765786:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.765819:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.765824:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728072320:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.765829:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.765833:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.765836:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0200/0xd138388016f6f613 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097d38 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765868:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097233 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765903:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097233 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765909:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.765914:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.765918:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728072448:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.765923:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.765926:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.765929:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0000/0xd138388016f6f1d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097233 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765944:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097d93 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765958:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097d93 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.765964:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.765968:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.765972:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728072576:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.765977:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.765980:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.765983:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f400/0xd138388016f6f636 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097d93 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766010:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201621.766031:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201621.766037:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.766041:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.766045:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728072704:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.766050:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.766053:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.766056:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0400/0xd138388016f6eebf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171096a8b expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1788201621.766070:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e217109728e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766086:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109728e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766092:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.766097:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.766101:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728072832:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.766106:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.766110:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.766113:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bde00/0xd138388016f6f1f9 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109728e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766126:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097dee expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766146:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097dee expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766152:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.766157:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.766160:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728072960:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.766165:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.766168:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.766171:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085200/0xd138388016f6f659 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097dee expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766198:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6f21c lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710972e9 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766213:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6f21c lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710972e9 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766219:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.766224:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.766228:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728073088:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.766232:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.766235:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.766237:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3ca00/0xd138388016f6f21c lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710972e9 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766249:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097e49 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766268:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097e49 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766274:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.766278:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.766281:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728073216:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.766286:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.766289:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.766291:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084c00/0xd138388016f6f67c lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097e49 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766322:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48c00/0xd138388016f6f23f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x173:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097344 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766337:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48c00/0xd138388016f6f23f lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x173:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097344 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766343:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.766348:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.766351:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728073344:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.766356:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.766359:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.766361:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48c00/0xd138388016f6f23f lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x173:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097344 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766375:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097ea4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766393:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097ea4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766399:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.766404:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.766407:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728073472:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.766411:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.766414:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.766416:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473600/0xd138388016f6f69f lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097ea4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766453:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e217109739f expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766467:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109739f expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766473:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.766477:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.766481:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728073600:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.766485:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.766488:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.766491:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d800/0xd138388016f6f262 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109739f expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766504:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097eff expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766520:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097eff expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766527:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.766531:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.766534:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728073728:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.766538:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.766541:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.766544:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f200/0xd138388016f6f6c2 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097eff expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766573:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49000/0xd138388016f6f285 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710973fa expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766588:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49000/0xd138388016f6f285 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710973fa expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766594:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.766599:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.766603:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728073856:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.766608:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.766611:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.766613:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49000/0xd138388016f6f285 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710973fa expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766626:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097f5a expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766644:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097f5a expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766649:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.766654:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.766657:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728073984:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.766661:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.766664:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.766666:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473000/0xd138388016f6f6e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097f5a expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766694:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48200/0xd138388016f6f2a8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097455 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766706:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48200/0xd138388016f6f2a8 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097455 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766712:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.766715:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.766719:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728074112:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.766723:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.766726:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.766729:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a48200/0xd138388016f6f2a8 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097455 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766741:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097fb5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766757:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097fb5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766763:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.766767:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.766770:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728074240:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.766775:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.766778:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.766780:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472e00/0xd138388016f6f708 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097fb5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766836:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710974b0 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766852:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710974b0 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.766859:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.766863:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.766867:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728074368:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.766871:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.766875:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00000020:00000080:0.0:1788201621.767922:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8bc1450ab000 for lustre-OST0000-osc-ffff8bc143fc0000 00000020:00000080:0.0:1788201621.767936:0:37:0:(genops.c:906:class_export_put()) final put ffff8bc1450a8800/5dac367c-c41f-4c84-afa8-a2acd4f3ad9f 00000020:00000080:0.0:1788201621.767939:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8bc1450a8800/5dac367c-c41f-4c84-afa8-a2acd4f3ad9f for lustre-OST0000-osc-ffff8bc143fc0000 00000020:01000000:0.0:1788201621.767948:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-ffff8bc143fc0000 (5dac367c-c41f-4c84-afa8-a2acd4f3ad9f) 00000020:00000080:0.0:1788201621.768290:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8bc146501000/5dac367c-c41f-4c84-afa8-a2acd4f3ad9f for lustre-clilov-ffff8bc143fc0000 00010000:00010000:2.0:1788201621.768449:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49c00/0xd138388016f6f2cb lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710974b0 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.768544:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171098010 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.768585:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171098010 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.768592:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.768715:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.768725:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728074496:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.768734:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.768742:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.768745:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472c00/0xd138388016f6f72b lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171098010 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.768781:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e217109750b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.768897:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109750b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.768904:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.768910:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.768914:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728074624:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.768920:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.768924:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.768927:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc143a49800/0xd138388016f6f2ee lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109750b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.768943:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e217109806b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.768963:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109806b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.768970:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.768974:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.768978:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728074752:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.768983:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.768986:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.768989:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7600/0xd138388016f6f74e lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109806b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769021:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f311 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097566 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769035:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f311 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097566 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769042:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.769046:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.769050:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728074880:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.769124:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.769129:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.769133:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3cc00/0xd138388016f6f311 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097566 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769151:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710980c6 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769173:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710980c6 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769179:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.769185:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.769189:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728075008:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.769194:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.769197:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.769201:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085c00/0xd138388016f6f771 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710980c6 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769231:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490a00/0xd138388016f6f334 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x17a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710975c1 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769244:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490a00/0xd138388016f6f334 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x17a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710975c1 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769251:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.769254:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.769259:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728075136:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.769263:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.769266:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.769269:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490a00/0xd138388016f6f334 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x17a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710975c1 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769282:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171098121 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769299:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171098121 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769306:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.769310:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.769313:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728075264:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.769318:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.769321:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.769324:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261fe00/0xd138388016f6f794 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171098121 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769353:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6ef28 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe6657e2171096b2c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201621.769369:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6ef28 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171096b2c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201621.769375:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.769379:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.769383:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728075392:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.769388:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.769392:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.769394:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd800/0xd138388016f6ef28 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x15b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe6657e2171096b2c expref: -99 pid: 24470 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1788201621.769407:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e217109761c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769426:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109761c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769433:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.769437:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.769441:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728075520:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.769446:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.769449:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.769452:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3da00/0xd138388016f6f357 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109761c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769465:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e217109817c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769477:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109817c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769484:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.769488:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.769492:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728075648:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.769497:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.769500:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.769502:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7800/0xd138388016f6f7b7 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109817c expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769531:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x15c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171096afb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769549:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x15c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096afb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769556:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.769560:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.769565:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728075776:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.769569:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.769572:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.769575:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd000/0xd138388016f6ef13 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x15c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096afb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769588:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x17c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097677 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769673:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x17c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097677 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769679:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.769684:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.769688:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728075904:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.769694:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.769697:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.769699:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc149f3d200/0xd138388016f6f37a lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x17c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097677 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769712:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710981d7 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769730:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710981d7 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769736:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.769741:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.769745:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728076032:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.769749:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.769753:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.769755:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084600/0xd138388016f6f7da lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710981d7 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769784:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ef3d lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x15d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171096b72 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769889:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ef3d lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x15d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096b72 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769896:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.769901:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.769905:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728076160:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.769910:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.769913:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.769916:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bd400/0xd138388016f6ef3d lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x15d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096b72 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769931:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490c00/0xd138388016f6f39d lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710976d2 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769955:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490c00/0xd138388016f6f39d lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710976d2 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769962:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.769966:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.769969:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728076288:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.769974:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.769977:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.769980:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490c00/0xd138388016f6f39d lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710976d2 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.769993:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171098232 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770008:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171098232 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770013:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.770018:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.770021:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728076416:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.770025:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.770028:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.770030:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7000/0xd138388016f6f7fd lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171098232 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770126:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6ef60 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171096bcd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770148:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6ef60 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096bcd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770153:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.770159:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.770163:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728076544:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.770168:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.770171:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.770174:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dd000/0xd138388016f6ef60 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096bcd expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770188:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f3c0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e217109772d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770203:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f3c0 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109772d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770208:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.770213:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.770216:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728076672:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.770221:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.770224:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.770226:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172490800/0xd138388016f6f3c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109772d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770239:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e217109828d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770257:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109828d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770263:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.770268:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.770272:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728076800:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.770276:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.770279:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.770282:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc17261f800/0xd138388016f6f820 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109828d expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770311:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc200/0xd138388016f6ef83 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x15f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171096c28 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770324:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc200/0xd138388016f6ef83 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x15f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096c28 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770331:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.770335:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.770339:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728076928:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.770344:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.770347:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.770350:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bc200/0xd138388016f6ef83 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x15f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096c28 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770364:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472a00/0xd138388016f6f3e3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097788 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770382:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472a00/0xd138388016f6f3e3 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097788 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770389:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.770393:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.770397:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728077056:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.770402:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.770405:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.770408:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472a00/0xd138388016f6f3e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097788 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770422:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710982e8 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770435:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710982e8 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770441:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.770445:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.770449:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728077184:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.770453:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.770456:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.770459:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778a00/0xd138388016f6f843 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710982e8 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770492:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dcc00/0xd138388016f6efa6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x160:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171096c83 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770511:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dcc00/0xd138388016f6efa6 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x160:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096c83 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770517:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.770521:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.770526:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728077312:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.770530:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.770533:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.770537:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dcc00/0xd138388016f6efa6 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x160:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096c83 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770550:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1800/0xd138388016f6f406 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x180:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710977e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770563:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1800/0xd138388016f6f406 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x180:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710977e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770569:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.770573:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.770576:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728077440:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.770581:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.770584:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.770586:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1800/0xd138388016f6f406 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x180:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710977e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770662:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171098343 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770684:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171098343 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770691:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.770696:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.770700:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728077568:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.770705:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.770708:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.770711:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7e00/0xd138388016f6f866 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171098343 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770740:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171096cde expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770761:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096cde expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770767:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.770771:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.770776:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728077696:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.770780:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.770783:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.770786:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c9e00/0xd138388016f6efc9 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096cde expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770943:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e217109783e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770966:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109783e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.770972:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.770978:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.770982:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728077824:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.770987:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.770990:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.770993:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779800/0xd138388016f6f429 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109783e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771009:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e217109839e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771023:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109839e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771029:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.771034:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.771037:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728077952:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.771042:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.771045:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.771048:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144021600/0xd138388016f6f889 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109839e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771155:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171096d39 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771178:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096d39 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771185:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.771190:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.771194:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728078080:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.771199:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.771203:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.771205:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a1200/0xd138388016f6efec lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096d39 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771219:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097899 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771232:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097899 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771239:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.771243:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.771247:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728078208:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.771252:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.771255:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.771258:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778c00/0xd138388016f6f44c lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097899 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771273:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710983f9 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771293:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710983f9 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771299:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.771303:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.771307:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728078336:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.771311:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.771314:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.771317:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7400/0xd138388016f6f8ac lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710983f9 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771344:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6f00f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x163:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171096d94 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771359:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6f00f lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x163:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096d94 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771365:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.771369:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.771373:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728078464:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.771378:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.771380:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.771383:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8200/0xd138388016f6f00f lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x163:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096d94 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771395:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710978f4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771411:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710978f4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771416:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.771419:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.771422:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728078592:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.771426:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.771428:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.771431:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146084000/0xd138388016f6f46f lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710978f4 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771444:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171098454 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771455:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171098454 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771460:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.771463:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.771466:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728078720:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.771470:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.771472:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.771475:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b6e00/0xd138388016f6f8cf lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171098454 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771504:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x164:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171096def expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771520:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x164:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096def expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771526:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.771529:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.771533:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728078848:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.771537:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.771540:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.771543:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8800/0xd138388016f6f032 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x164:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096def expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771554:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f492 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e217109794f expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771566:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f492 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109794f expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771571:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.771575:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.771579:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728078976:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.771584:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.771587:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.771589:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a778200/0xd138388016f6f492 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109794f expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771658:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710984af expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771679:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710984af expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771686:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.771691:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.771696:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728079104:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.771700:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.771704:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.771707:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1443b7200/0xd138388016f6f8f2 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710984af expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771738:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f055 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x165:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171096e4a expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771754:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f055 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x165:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096e4a expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1788201621.771761:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201621.771766:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1726233c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788201621.771770:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728079232:192.168.201.143@tcp:103:umount.0 00010000:00010000:2.0:1788201621.771774:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:2.0:1788201621.771778:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:2.0:1788201621.771780:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1460bce00/0xd138388016f6f055 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x165:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096e4a expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772002:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472000/0xd138388016f6f4b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710979aa expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772024:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472000/0xd138388016f6f4b5 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710979aa expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772031:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788201621.772038:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621180 going to sleep for 0 seconds 00000100:00100000:0.0:1788201621.772042:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728079360:192.168.201.143@tcp:103:umount.0 00010000:00010000:0.0:1788201621.772048:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1788201621.772052:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1788201621.772121:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172472000/0xd138388016f6f4b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710979aa expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772140:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710985e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772157:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710985e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772162:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788201621.772167:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621180 going to sleep for 0 seconds 00000100:00100000:0.0:1788201621.772171:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728079488:192.168.201.143@tcp:103:umount.0 00010000:00010000:0.0:1788201621.772176:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1788201621.772179:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1788201621.772181:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc144020c00/0xd138388016f6f915 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710985e3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772210:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6f078 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x166:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171096ea5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772224:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6f078 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x166:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096ea5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772230:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788201621.772234:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621180 going to sleep for 0 seconds 00000100:00100000:0.0:1788201621.772238:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728079616:192.168.201.143@tcp:103:umount.0 00010000:00010000:0.0:1788201621.772245:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1788201621.772248:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1788201621.772251:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1427dc600/0xd138388016f6f078 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x166:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096ea5 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772263:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097a05 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772276:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097a05 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772282:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788201621.772286:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621180 going to sleep for 0 seconds 00000100:00100000:0.0:1788201621.772289:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728079744:192.168.201.143@tcp:103:umount.0 00010000:00010000:0.0:1788201621.772294:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1788201621.772297:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1788201621.772299:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1725a0e00/0xd138388016f6f4d8 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097a05 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772311:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171098668 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772324:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171098668 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772329:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788201621.772333:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621180 going to sleep for 0 seconds 00000100:00100000:0.0:1788201621.772336:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728079872:192.168.201.143@tcp:103:umount.0 00010000:00010000:0.0:1788201621.772343:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1788201621.772347:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1788201621.772349:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc14a779200/0xd138388016f6f938 lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171098668 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772380:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8600/0xd138388016f6f09b lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171096f00 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772396:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8600/0xd138388016f6f09b lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096f00 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772402:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788201621.772407:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621180 going to sleep for 0 seconds 00000100:00100000:0.0:1788201621.772410:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728080000:192.168.201.143@tcp:103:umount.0 00010000:00010000:0.0:1788201621.772415:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1788201621.772418:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1788201621.772420:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8600/0xd138388016f6f09b lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096f00 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772434:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097a60 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772449:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097a60 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772454:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788201621.772459:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621180 going to sleep for 0 seconds 00000100:00100000:0.0:1788201621.772463:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728080128:192.168.201.143@tcp:103:umount.0 00010000:00010000:0.0:1788201621.772469:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1788201621.772472:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1788201621.772475:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172473200/0xd138388016f6f4fb lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097a60 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772489:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e21710986c3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772504:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710986c3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772510:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788201621.772515:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621180 going to sleep for 0 seconds 00000100:00100000:0.0:1788201621.772519:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728080256:192.168.201.143@tcp:103:umount.0 00010000:00010000:0.0:1788201621.772523:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1788201621.772527:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1788201621.772530:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc15c12b400/0xd138388016f6f95b lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e21710986c3 expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772560:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f0be lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x168:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171096f5b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772575:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f0be lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x168:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096f5b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772581:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788201621.772586:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621180 going to sleep for 0 seconds 00000100:00100000:0.0:1788201621.772590:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728080384:192.168.201.143@tcp:103:umount.0 00010000:00010000:0.0:1788201621.772596:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1788201621.772600:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1788201621.772602:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc1727c8400/0xd138388016f6f0be lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x168:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171096f5b expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772615:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e2171097abb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772630:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097abb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772635:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788201621.772640:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621180 going to sleep for 0 seconds 00000100:00100000:0.0:1788201621.772643:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728080512:192.168.201.143@tcp:103:umount.0 00010000:00010000:0.0:1788201621.772648:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1788201621.772651:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1788201621.772654:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc146085000/0xd138388016f6f51e lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e2171097abb expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772668:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 2/0,0 mode: PR/PR res: [0x200000bd7:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe6657e217109871e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772683:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 1/0,0 mode: --/PR res: [0x200000bd7:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109871e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1788201621.772688:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788201621.772693:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc172621180 going to sleep for 0 seconds 00000100:00100000:0.0:1788201621.772696:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job umount:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:24499:1875064728080640:192.168.201.143@tcp:103:umount.0 00010000:00010000:0.0:1788201621.772703:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1788201621.772707:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1788201621.772709:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8bc143fc0000 lock: ffff8bc172491800/0xd138388016f6f97e lrc: 0/0,0 mode: --/PR res: [0x200000bd7:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe6657e217109871e expref: -99 pid: 24470 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000100:00080000:0.0:1788201621.774778:0:24499:0:(import.c:65:import_set_state_nolock()) ffff8bc144f88000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788201621.775418:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10051:1875064728080768:192.168.201.143@tcp:39:umount.0 00000100:00080000:1.0:1788201621.777833:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc144f88000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788201621.777859:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5dac367c-c41f-4c84-afa8-a2acd4f3ad9f:10051:1875064728080768:192.168.201.143@tcp:39:umount.0 00000100:00080000:0.0:1788201621.777934:0:24499:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201621.777939:0:24499:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8bc143fc0000: committing for last_committed 8589937531 gen 2 00000100:00100000:0.0:1788201621.777949:0:24499:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8bc144143480 x1875064728080768/t8589937532(8589937532) o39->lustre-MDT0000-mdc-ffff8bc143fc0000@192.168.201.143@tcp:12/10 lens 224/224 e 0 to 0 dl 1788201631 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201621.777971:0:24499:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201621.780302:0:24499:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd138388016f6c560 00000020:00000080:1.0:1788201621.780319:0:24499:0:(genops.c:906:class_export_put()) final put ffff8bc146503800/5dac367c-c41f-4c84-afa8-a2acd4f3ad9f 00000020:00000080:1.0:1788201621.780371:0:24499:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd138388016f6c559 00000020:00000080:1.0:1788201621.780377:0:24499:0:(genops.c:906:class_export_put()) final put ffff8bc146507800/5dac367c-c41f-4c84-afa8-a2acd4f3ad9f 00000020:01000000:1.0:1788201621.780387:0:24499:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-clilov-ffff8bc143fc0000 (flags='') 00000020:00000080:1.0:1788201621.780397:0:24499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201621.780404:0:24499:0:(obd_config.c:955:class_cleanup()) lustre-clilov-ffff8bc143fc0000: forcing exports to disconnect: 0/1 00000020:00000080:0.0:1788201621.780787:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8bc146503800/5dac367c-c41f-4c84-afa8-a2acd4f3ad9f for lustre-MDT0000-mdc-ffff8bc143fc0000 00000020:00000080:0.0:1788201621.780831:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8bc146507800/5dac367c-c41f-4c84-afa8-a2acd4f3ad9f for lustre-clilmv-ffff8bc143fc0000 00000020:00080000:1.0:1788201621.782971:0:24499:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8bc151fa0000) has no exports 00000020:00000080:1.0:1788201621.783060:0:24499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201621.783071:0:24499:0:(obd_config.c:883:class_detach()) detach on obd lustre-clilov-ffff8bc143fc0000 (uuid 5dac367c-c41f-4c84-afa8-a2acd4f3ad9f) 00000020:00000080:1.0:1788201621.783075:0:24499:0:(genops.c:906:class_export_put()) final put ffff8bc147239000/5dac367c-c41f-4c84-afa8-a2acd4f3ad9f 00000020:00000080:1.0:1788201621.783079:0:24499:0:(genops.c:865:class_export_destroy()) destroying export ffff8bc147239000/5dac367c-c41f-4c84-afa8-a2acd4f3ad9f for lustre-clilov-ffff8bc143fc0000 00000020:01000000:1.0:1788201621.783085:0:24499:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-clilov-ffff8bc143fc0000 (5dac367c-c41f-4c84-afa8-a2acd4f3ad9f) 00000020:01000000:1.0:1788201621.783256:0:24499:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-clilmv-ffff8bc143fc0000 (flags='') 00000020:00000080:1.0:1788201621.783261:0:24499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201621.783267:0:24499:0:(obd_config.c:955:class_cleanup()) lustre-clilmv-ffff8bc143fc0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788201621.783270:0:24499:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff8bc151fa4d40) has no exports 00000020:00000080:1.0:1788201621.783311:0:24499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201621.783314:0:24499:0:(obd_config.c:883:class_detach()) detach on obd lustre-clilmv-ffff8bc143fc0000 (uuid 5dac367c-c41f-4c84-afa8-a2acd4f3ad9f) 00000020:00000080:1.0:1788201621.783317:0:24499:0:(genops.c:906:class_export_put()) final put ffff8bc143fc5800/5dac367c-c41f-4c84-afa8-a2acd4f3ad9f 00000020:00000080:1.0:1788201621.783319:0:24499:0:(genops.c:865:class_export_destroy()) destroying export ffff8bc143fc5800/5dac367c-c41f-4c84-afa8-a2acd4f3ad9f for lustre-clilmv-ffff8bc143fc0000 00000020:01000000:1.0:1788201621.783324:0:24499:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-clilmv-ffff8bc143fc0000 (5dac367c-c41f-4c84-afa8-a2acd4f3ad9f) 00000020:01000000:1.0:1788201621.783446:0:24499:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdc-ffff8bc143fc0000 (flags='') 00000020:00000080:1.0:1788201621.783450:0:24499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201621.783453:0:24499:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdc-ffff8bc143fc0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788201621.783455:0:24499:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff8bc151fa19c0) has no exports 00000008:01000000:1.0:1788201621.783670:0:24499:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-mdc-ffff8bc143fc0000: client import never connected 00000100:00080000:1.0:1788201621.783675:0:24499:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788201621.783680:0:24499:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8bc143fc0000: committing for last_committed 8589937531 gen 3 00000100:00100000:1.0:1788201621.783688:0:24499:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201621.788501:0:24499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201621.788516:0:24499:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdc-ffff8bc143fc0000 (uuid 5dac367c-c41f-4c84-afa8-a2acd4f3ad9f) 00000080:02000400:1.0:1788201621.788523:0:24499:0:(llite_lib.c:1748:ll_put_super()) Unmounted lustre-client 00000020:00000080:0.0:1788201621.789629:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8bc144f88000 for lustre-MDT0000-mdc-ffff8bc143fc0000 00000020:00000080:0.0:1788201621.789641:0:37:0:(genops.c:906:class_export_put()) final put ffff8bc144f8d800/5dac367c-c41f-4c84-afa8-a2acd4f3ad9f 00000020:00000080:0.0:1788201621.789645:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8bc144f8d800/5dac367c-c41f-4c84-afa8-a2acd4f3ad9f for lustre-MDT0000-mdc-ffff8bc143fc0000 00000020:01000000:0.0:1788201621.789654:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdc-ffff8bc143fc0000 (5dac367c-c41f-4c84-afa8-a2acd4f3ad9f) 00000020:01000000:1.0:1788201621.793178:0:24499:0:(obd_config.c:1197:class_del_profile()) Del profile lustre-client 00000020:01000004:1.0:1788201621.793248:0:24499:0:(obd_mount.c:897:lustre_common_put_super()) dropping sb ffff8bc143fc0000 00000100:00080000:1.0:1788201621.793258:0:24499:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 21dcfac0-2fe1-402c-8fca-db923b83f76c->MGS 00010000:00010000:1.0:1788201621.793273:0:24499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.143@tcp lock: ffff8bc149eb7e00/0xd138388016f6c51a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6657e217108bc10 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201621.793287:0:24499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.143@tcp lock: ffff8bc149eb7e00/0xd138388016f6c51a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6657e217108bc10 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201621.793294:0:24499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201621.793296:0:24499:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788201621.793299:0:24499:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788201621.793347:0:24499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.143@tcp lock: ffff8bc149eb7e00/0xd138388016f6c51a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6657e217108bc10 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.793354:0:24499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788201621.793373:0:24499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc145559300 going to sleep for 0 seconds 00000100:00100000:1.0:1788201621.793385:0:24499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job umount:21dcfac0-2fe1-402c-8fca-db923b83f76c:24499:1875064728080896:192.168.201.143@tcp:103:umount.0 00010000:00010000:1.0:1788201621.793396:0:24499:0:(ldlm_request.c:1625:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:1.0:1788201621.793406:0:24499:0:(ldlm_request.c:2491:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:1.0:1788201621.793409:0:24499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.143@tcp lock: ffff8bc149eb7e00/0xd138388016f6c51a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6657e217108bc10 expref: -99 pid: 20875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788201621.793435:0:24499:0:(import.c:65:import_set_state_nolock()) ffff8bc1452f6800 MGS: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788201621.793689:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:21dcfac0-2fe1-402c-8fca-db923b83f76c:10051:1875064728081024:192.168.201.143@tcp:251:umount.0 00000100:00080000:1.0:1788201621.801905:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc1452f6800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788201621.801915:0:10051:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788201621.801918:0:10051:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788201621.801920:0:10051:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788201621.801934:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:21dcfac0-2fe1-402c-8fca-db923b83f76c:10051:1875064728081024:192.168.201.143@tcp:251:umount.0 00000100:00080000:1.0:1788201621.801971:0:24499:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788201621.801975:0:24499:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788201621.801978:0:24499:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788201621.801980:0:24499:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788201621.801990:0:24499:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd138388016f6c513 00000020:00000080:1.0:1788201621.802000:0:24499:0:(genops.c:906:class_export_put()) final put ffff8bc147238000/21dcfac0-2fe1-402c-8fca-db923b83f76c 00000020:01000000:1.0:1788201621.802015:0:24499:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.143@tcp (flags='') 00000020:00000080:1.0:1788201621.802021:0:24499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201621.802029:0:24499:0:(obd_config.c:955:class_cleanup()) MGC192.168.201.143@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788201621.802034:0:24499:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8bc1472e0000) has no exports 00000020:00000080:1.0:1788201621.802081:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8bc147238000/21dcfac0-2fe1-402c-8fca-db923b83f76c for MGC192.168.201.143@tcp 10000000:01000000:1.0:1788201621.802106:0:20884:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788201621.802248:0:24499:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.143@tcp: client import never connected 00000100:00080000:1.0:1788201621.802251:0:24499:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788201621.802253:0:24499:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788201621.802256:0:24499:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788201621.802257:0:24499:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788201621.802322:0:24499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201621.802329:0:24499:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.143@tcp (uuid 21dcfac0-2fe1-402c-8fca-db923b83f76c) 00000020:01000004:1.0:1788201621.802335:0:24499:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bc143fc0000 1 00000020:01000004:1.0:1788201621.802338:0:24499:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8bc143fc4800 00000020:00000080:3.0:1788201621.806628:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8bc1452f6800 for MGC192.168.201.143@tcp 00000020:00000080:3.0:1788201621.806644:0:37:0:(genops.c:906:class_export_put()) final put ffff8bc143fc6800/21dcfac0-2fe1-402c-8fca-db923b83f76c 00000020:00000080:3.0:1788201621.806649:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8bc143fc6800/21dcfac0-2fe1-402c-8fca-db923b83f76c for MGC192.168.201.143@tcp 00000020:01000000:3.0:1788201621.806661:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.143@tcp (21dcfac0-2fe1-402c-8fca-db923b83f76c) 00010000:00010000:1.0:1788201621.808971:0:20882:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788201621.809446:0:23027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788201621.809691:0:20881:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788201621.809931:0:20877:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8bc14364f000:20877] 1 exiting: rc = 0 00000100:00100000:3.0:1788201621.810533:0:20876:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8bc150b50e00:20876] 0 exiting: rc = 1 00000100:00100000:3.0:1788201621.812457:0:21781:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8bc15160cc00:21781] 2 exiting: rc = 0 00000100:00100000:1.0:1788201621.812565:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201621.812990:0:20878:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8bc14364fc00:20878] 0 exiting: rc = 1 00000100:00100000:2.0:1788201621.813064:0:20880:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8bc14364e600:20880] 2 exiting: rc = 0 00000100:00100000:1.0:1788201621.816132:0:20879:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8bc14364e400:20879] 1 exiting: rc = 0 00000100:00100000:1.0:1788201621.816311:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816318:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816324:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816330:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816336:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816342:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816348:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816354:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816359:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816364:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816370:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816375:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816380:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816385:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816390:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816395:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816400:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816404:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816409:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816414:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816418:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816423:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816427:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816433:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816438:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816443:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816448:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816453:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816458:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816463:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816468:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816473:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816478:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816484:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816489:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816495:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816500:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816505:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816511:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816517:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816523:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816528:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816535:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816541:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816547:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816553:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816558:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816564:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816569:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816574:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816580:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816586:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816591:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816595:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816600:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816606:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816612:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816618:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816623:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816628:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816633:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816639:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816645:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201621.816651:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000001:02000400:1.0:1788201657.021743:0:25328:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-lfsck test 7b: non-stopped LFSCK should auto restarts after MDS remount (2) ========================================================== 14:40:55 (1788201655) 00000020:01000004:3.0:1788201691.191041:0:26422:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788201691.191045:0:26422:0:(obd_mount.c:925:lmd_print()) profile: lustre-client 00000020:01000004:3.0:1788201691.191046:0:26422:0:(obd_mount.c:926:lmd_print()) device: 192.168.201.143@tcp:/lustre 00000020:01000004:3.0:1788201691.191048:0:26422:0:(obd_mount.c:929:lmd_print()) options: user_xattr,flock 00000080:01200004:3.0:1788201691.191123:0:26422:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8bc1452f0800 00000080:01000004:3.0:1788201691.191130:0:26422:0:(super25.c:161:lustre_fill_super()) Mounting client lustre-client 00000020:01000004:3.0:1788201691.191143:0:26422:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.143@tcp' 00000020:01000004:3.0:1788201691.191163:0:26422:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.143@tcp (typ=mgc) 00000020:00000080:3.0:1788201691.191173:0:26422:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.143@tcp (ffff8bc146048000) 00000020:00000080:3.0:1788201691.192487:0:26422:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type mgc with refcount 2 00000100:00100000:3.0:1788201691.192647:0:26422:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788201691.192764:0:26422:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788201691.192769:0:26422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788201691.193201:0:26422:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788201691.193209:0:26422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788201691.194101:0:26422:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201691.194228:0:26422:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788201691.194234:0:26422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788201691.194641:0:26422:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788201691.194648:0:26422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788201691.194868:0:26422:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788201691.194875:0:26422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788201691.195389:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201691.195397:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201691.195399:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201691.195557:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201691.195559:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201691.195561:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1788201691.196042:0:26422:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bc145ede000@MGC192.168.201.143@tcp: add connection 192.168.201.143@tcp at head 00010000:00010000:1.0:1788201691.196172:0:26422:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.143@tcp-0 is initialized 00000040:01000000:1.0:1788201691.196178:0:26422:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.143@tcp ctxt 1 is initialized 00010000:00010000:2.0:1788201691.198378:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788201691.198412:0:26431:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788201691.198452:0:26422:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.143@tcp (uuid df9a72fe-77e2-4342-a886-d55a2baf9a49) 00000020:00000080:1.0:1788201691.198475:0:26422:0:(genops.c:1406:class_connect()) connect: client df9a72fe-77e2-4342-a886-d55a2baf9a49, cookie 0xd138388016f6f9c4 00000100:00080000:1.0:1788201691.198489:0:26422:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 0 00000100:00080000:1.0:1788201691.198499:0:26422:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788201691.198531:0:26422:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6300 x1875064728081152/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201691.198554:0:26422:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS 00000080:00200000:1.0:1788201691.198570:0:26422:0:(llite_lib.c:1515:ll_fill_super()) VFS Op: cfg_instance lustre-client-ffff8bc1452f0800 (sb ffff8bc1452f0800) 00000080:01000000:1.0:1788201691.198622:0:26422:0:(llite_lib.c:1241:ll_options()) Parsing opts user_xattr,flock 00000080:00000004:1.0:1788201691.198625:0:26422:0:(llite_lib.c:1251:ll_options()) next opt=user_xattr 00000080:00000004:1.0:1788201691.198630:0:26422:0:(llite_lib.c:1251:ll_options()) next opt=flock 00000080:01000000:1.0:1788201691.198637:0:26422:0:(llite_lib.c:1549:ll_fill_super()) llite sb uuid: 8c0a6615-c7c4-4483-9f31-fb19c8e5931c 00000100:00100000:2.0:1788201691.198637:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728081152:192.168.201.143@tcp:250:mount.lustre.0 10000000:01000000:1.0:1788201691.199150:0:26422:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788201691.199153:0:26422:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8bc1452f0800 10000000:01000000:1.0:1788201691.199157:0:26422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8bc146048000 10000000:01000000:1.0:1788201691.199161:0:26422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201691.199169:0:26422:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8bc146048000 from 1 10000000:01000000:1.0:1788201691.199173:0:26422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788201691.199199:0:26422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.143@tcp lock: ffff8bc149f10400/0xd138388016f6f9cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201691.199210:0:26422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.143@tcp lock: ffff8bc149f10400/0xd138388016f6f9cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201691.199222:0:26422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.143@tcp lock: ffff8bc149f10400/0xd138388016f6f9cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788201691.199237:0:26422:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8bc1727d4700 x1875064728081280/t0(0) o101->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201691.199252:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150a4fb40 going to sleep for 0 seconds 00000100:00100000:2.0:1788201691.202248:0:10051:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.143@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788201691.202273:0:10051:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.143@tcp: connect to target with instance 0 00000100:00080000:2.0:1788201691.202282:0:10051:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.143@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788201691.202289:0:10051:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788201691.202293:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788201691.202297:0:10051:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788201691.202312:0:10051:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00080000:2.0:1788201691.202322:0:10051:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000000c107909): req@ffff8bc1727d4700 x1875064728081280/t0(0) o101->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201691.203082:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150a4fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201691.203519:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728081152:192.168.201.143@tcp:250:mount.lustre.0 00000100:00100000:1.0:1788201691.209168:0:26422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df9a72fe-77e2-4342-a886-d55a2baf9a49:26422:1875064728081280:192.168.201.143@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788201691.209198:0:26422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.143@tcp lock: ffff8bc149f10400/0xd138388016f6f9cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6657e2171098d76 expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201691.209210:0:26422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.143@tcp lock: ffff8bc149f10400/0xd138388016f6f9cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6657e2171098d76 expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201691.209298:0:26422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df9a72fe-77e2-4342-a886-d55a2baf9a49:26422:1875064728081408:192.168.201.143@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788201691.209363:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150a4fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201691.211844:0:26422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df9a72fe-77e2-4342-a886-d55a2baf9a49:26422:1875064728081408:192.168.201.143@tcp:501:mount.lustre.0 10000000:01000000:1.0:1788201691.211881:0:26422:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788201691.211903:0:26422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.143@tcp lock: ffff8bc149f10400/0xd138388016f6f9cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6657e2171098d76 expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201691.211913:0:26422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.143@tcp lock: ffff8bc149f10400/0xd138388016f6f9cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6657e2171098d76 expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201691.211922:0:26422:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8bc1452f0800 10000000:01000000:1.0:1788201691.211926:0:26422:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788201691.211930:0:26422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8bc1452f0800 10000000:01000000:1.0:1788201691.211933:0:26422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201691.211937:0:26422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-cliir-ffff8bc1452f0800 10000000:01000000:1.0:1788201691.211939:0:26422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-cliir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788201691.211942:0:26422:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8bc1452f0800 from 1 10000000:01000000:1.0:1788201691.211945:0:26422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788201691.211970:0:26422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.143@tcp lock: ffff8bc149f10000/0xd138388016f6f9d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201691.211976:0:26422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.143@tcp lock: ffff8bc149f10000/0xd138388016f6f9d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201691.211985:0:26422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.143@tcp lock: ffff8bc149f10000/0xd138388016f6f9d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201691.212000:0:26422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df9a72fe-77e2-4342-a886-d55a2baf9a49:26422:1875064728081536:192.168.201.143@tcp:101:mount.lustre.0 00000100:00100000:1.0:1788201691.212051:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150a4fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201691.214711:0:26422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df9a72fe-77e2-4342-a886-d55a2baf9a49:26422:1875064728081536:192.168.201.143@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788201691.214735:0:26422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.143@tcp lock: ffff8bc149f10000/0xd138388016f6f9d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6657e2171098d7d expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201691.214748:0:26422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.143@tcp lock: ffff8bc149f10000/0xd138388016f6f9d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6657e2171098d7d expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201691.214849:0:26422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df9a72fe-77e2-4342-a886-d55a2baf9a49:26422:1875064728081664:192.168.201.143@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788201691.214906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1432a9540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201691.218593:0:26422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df9a72fe-77e2-4342-a886-d55a2baf9a49:26422:1875064728081664:192.168.201.143@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788201691.218643:0:26422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df9a72fe-77e2-4342-a886-d55a2baf9a49:26422:1875064728081792:192.168.201.143@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788201691.218729:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1432a9540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201691.223450:0:26422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df9a72fe-77e2-4342-a886-d55a2baf9a49:26422:1875064728081792:192.168.201.143@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788201691.224319:0:26435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df9a72fe-77e2-4342-a886-d55a2baf9a49:26435:1875064728081920:192.168.201.143@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788201691.224395:0:26435:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1432a9480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201691.227653:0:26435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df9a72fe-77e2-4342-a886-d55a2baf9a49:26435:1875064728081920:192.168.201.143@tcp:502:llog_process_th.0 00000020:01000000:2.0:1788201691.227705:0:26435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201691.227716:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201691.227718:0:26435:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre-clilov lov setup 00000020:01000000:2.0:1788201691.227725:0:26435:0:(obd_config.c:2005:class_config_llog_handler()) cmd cf001, instance name: lustre-clilov-ffff8bc1452f0800 00000020:00000080:2.0:1788201691.227727:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201691.227742:0:26435:0:(genops.c:413:class_newdev()) Allocate new device lustre-clilov-ffff8bc1452f0800 (ffff8bc151fa19c0) 00000020:00000080:2.0:1788201691.227759:0:26435:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type lov with refcount 2 00000020:01000000:2.0:1788201691.227763:0:26435:0:(obd_config.c:2005:class_config_llog_handler()) cmd cf003, instance name: lustre-clilov-ffff8bc1452f0800 00000020:00000080:2.0:1788201691.227765:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:00000080:2.0:1788201691.228032:0:26435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-clilov-ffff8bc1452f0800 (uuid 8c0a6615-c7c4-4483-9f31-fb19c8e5931c) 00000020:01000000:2.0:1788201691.228036:0:26435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201691.228039:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201691.228041:0:26435:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre-clilov lov setup 00000020:01000000:2.0:1788201691.228043:0:26435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201691.228045:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201691.228046:0:26435:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre-clilmv lmv setup 00000020:01000000:2.0:1788201691.228049:0:26435:0:(obd_config.c:2005:class_config_llog_handler()) cmd cf001, instance name: lustre-clilmv-ffff8bc1452f0800 00000020:00000080:2.0:1788201691.228051:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201691.228058:0:26435:0:(genops.c:413:class_newdev()) Allocate new device lustre-clilmv-ffff8bc1452f0800 (ffff8bc151fa4d40) 00000020:00000080:2.0:1788201691.228065:0:26435:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type lmv with refcount 2 00000020:01000000:2.0:1788201691.228068:0:26435:0:(obd_config.c:2005:class_config_llog_handler()) cmd cf003, instance name: lustre-clilmv-ffff8bc1452f0800 00000020:00000080:2.0:1788201691.228070:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:00000080:2.0:1788201691.228197:0:26435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-clilmv-ffff8bc1452f0800 (uuid 8c0a6615-c7c4-4483-9f31-fb19c8e5931c) 00000020:01000000:2.0:1788201691.228201:0:26435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201691.228204:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201691.228205:0:26435:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre-clilmv lmv setup 00000020:01000000:2.0:1788201691.228207:0:26435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201691.228209:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201691.228210:0:26435:0:(obd_config.c:1561:class_process_config()) marker 6 (0x1) lustre-client mount opts 00000020:00000080:2.0:1788201691.228213:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788201691.228214:0:26435:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-client osc lustre-clilov mdc lustre-clilmv 00000020:01000000:2.0:1788201691.228217:0:26435:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-client 00000020:01000000:2.0:1788201691.228221:0:26435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201691.228223:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201691.228224:0:26435:0:(obd_config.c:1561:class_process_config()) marker 6 (0x2) lustre-client mount opts 00000020:01000000:2.0:1788201691.228226:0:26435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201691.228228:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201691.228230:0:26435:0:(obd_config.c:1561:class_process_config()) marker 7 (0x1) lustre-MDT0000 add mdc 00000020:00000080:2.0:1788201691.228232:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788201691.228235:0:26435:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.143@tcp to nid 0x20000c0a8c98f (192.168.201.143@tcp) 00000020:01000000:2.0:1788201691.228253:0:26435:0:(obd_config.c:2005:class_config_llog_handler()) cmd cf001, instance name: lustre-MDT0000-mdc-ffff8bc1452f0800 00000020:00000080:2.0:1788201691.228256:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201691.228263:0:26435:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdc-ffff8bc1452f0800 (ffff8bc151fa0000) 00000020:00000080:2.0:1788201691.228269:0:26435:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mdc with refcount 2 00000020:01000000:2.0:1788201691.228273:0:26435:0:(obd_config.c:2005:class_config_llog_handler()) cmd cf003, instance name: lustre-MDT0000-mdc-ffff8bc1452f0800 00000020:00000080:2.0:1788201691.228275:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00010000:00080000:2.0:1788201691.228325:0:26435:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bc146503800@lustre-MDT0000-mdc-ffff8bc1452f0800: add connection 192.168.201.143@tcp at head 00010000:00010000:2.0:1788201691.229759:0:26435:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-mdc-ffff8bc1452f0800-1 is initialized 00000040:01000000:2.0:1788201691.229946:0:26435:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-mdc-ffff8bc1452f0800 ctxt 13 is initialized 00000020:00000080:2.0:1788201691.233186:0:26435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdc-ffff8bc1452f0800 (uuid 8c0a6615-c7c4-4483-9f31-fb19c8e5931c) 00000020:01000000:2.0:1788201691.233203:0:26435:0:(obd_config.c:2005:class_config_llog_handler()) cmd cf014, instance name: lustre-clilmv-ffff8bc1452f0800 00000020:00000080:2.0:1788201691.233208:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00800000:01000000:2.0:1788201691.233234:0:26435:0:(lmv_obd.c:442:lmv_add_target()) Target uuid: lustre-MDT0000_UUID. index 0 00000020:01000000:2.0:1788201691.233336:0:26435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201691.233341:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201691.233343:0:26435:0:(obd_config.c:1561:class_process_config()) marker 7 (0x2) lustre-MDT0000 add mdc 00000020:01000000:2.0:1788201691.233346:0:26435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201691.233348:0:26435:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1788201691.233350:0:26435:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201691.233565:0:26435:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201691.233570:0:26435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201691.233575:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201691.233576:0:26435:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788201691.233580:0:26435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788201691.233586:0:26435:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of 192.168.201.143@tcp:/lustre 00000020:00000080:2.0:1788201691.233590:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201691.233592:0:26435:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788201691.233597:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788201691.233602:0:26435:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.143@tcp to nid 0x20000c0a8c98f (192.168.201.143@tcp) 00000020:01000000:2.0:1788201691.233640:0:26435:0:(obd_config.c:2005:class_config_llog_handler()) cmd cf001, instance name: lustre-OST0000-osc-ffff8bc1452f0800 00000020:00000080:2.0:1788201691.234015:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201691.234030:0:26435:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-ffff8bc1452f0800 (ffff8bc151fa3380) 00000020:00000080:2.0:1788201691.234050:0:26435:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type osc with refcount 2 00000020:01000000:2.0:1788201691.234058:0:26435:0:(obd_config.c:2005:class_config_llog_handler()) cmd cf003, instance name: lustre-OST0000-osc-ffff8bc1452f0800 00000020:00000080:2.0:1788201691.234061:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00010000:00080000:2.0:1788201691.234138:0:26435:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bc147238000@lustre-OST0000-osc-ffff8bc1452f0800: add connection 192.168.201.143@tcp at head 00010000:00010000:2.0:1788201691.234417:0:26435:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-ffff8bc1452f0800-2 is initialized 00000020:00000080:2.0:1788201691.234737:0:26435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-ffff8bc1452f0800 (uuid 8c0a6615-c7c4-4483-9f31-fb19c8e5931c) 00000020:01000000:2.0:1788201691.234745:0:26435:0:(obd_config.c:2005:class_config_llog_handler()) cmd cf00d, instance name: lustre-clilov-ffff8bc1452f0800 00000020:00000080:2.0:1788201691.234748:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00020000:01000000:2.0:1788201691.234762:0:26435:0:(lov_obd.c:481:lov_add_target()) uuid:lustre-OST0000_UUID idx:0 gen:1 active:1 00020000:01000000:2.0:1788201691.234768:0:26435:0:(lov_obd.c:510:lov_add_target()) lustre-clilov-ffff8bc1452f0800: Adding target lustre-OST0000_UUID 00020000:01000000:2.0:1788201691.234778:0:26435:0:(lov_obd.c:532:lov_add_target()) idx=0 ltd_gen=1 ld_tgt_count=1 00000020:01000000:2.0:1788201691.234821:0:26435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201691.234825:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201691.234827:0:26435:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788201691.234831:0:26435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201691.234834:0:26435:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788201691.234835:0:26435:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201691.234836:0:26435:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201691.234838:0:26435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201691.234841:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201691.234842:0:26435:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788201691.234845:0:26435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788201691.234849:0:26435:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of 192.168.201.143@tcp:/lustre 00000020:00000080:2.0:1788201691.234852:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201691.234853:0:26435:0:(obd_config.c:1561:class_process_config()) marker 19 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788201691.234857:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788201691.234860:0:26435:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.143@tcp to nid 0x20000c0a8c98f (192.168.201.143@tcp) 00000020:01000000:2.0:1788201691.234874:0:26435:0:(obd_config.c:2005:class_config_llog_handler()) cmd cf001, instance name: lustre-OST0001-osc-ffff8bc1452f0800 00000020:00000080:2.0:1788201691.234877:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201691.234884:0:26435:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-ffff8bc1452f0800 (ffff8bc14601cd40) 00000020:00000080:2.0:1788201691.235750:0:26435:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type osc with refcount 2 00000020:01000000:2.0:1788201691.235762:0:26435:0:(obd_config.c:2005:class_config_llog_handler()) cmd cf003, instance name: lustre-OST0001-osc-ffff8bc1452f0800 00000020:00000080:2.0:1788201691.235767:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00010000:00080000:2.0:1788201691.236008:0:26435:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bc14723b800@lustre-OST0001-osc-ffff8bc1452f0800: add connection 192.168.201.143@tcp at head 00010000:00010000:2.0:1788201691.236230:0:26435:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-ffff8bc1452f0800-3 is initialized 00000020:00000080:2.0:1788201691.237049:0:26435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-ffff8bc1452f0800 (uuid 8c0a6615-c7c4-4483-9f31-fb19c8e5931c) 00000020:01000000:2.0:1788201691.237059:0:26435:0:(obd_config.c:2005:class_config_llog_handler()) cmd cf00d, instance name: lustre-clilov-ffff8bc1452f0800 00000020:00000080:2.0:1788201691.237063:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00020000:01000000:2.0:1788201691.237074:0:26435:0:(lov_obd.c:481:lov_add_target()) uuid:lustre-OST0001_UUID idx:1 gen:1 active:1 00020000:01000000:2.0:1788201691.237081:0:26435:0:(lov_obd.c:510:lov_add_target()) lustre-clilov-ffff8bc1452f0800: Adding target lustre-OST0001_UUID 00020000:01000000:2.0:1788201691.237086:0:26435:0:(lov_obd.c:532:lov_add_target()) idx=1 ltd_gen=1 ld_tgt_count=2 00000020:01000000:2.0:1788201691.237094:0:26435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201691.237099:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201691.237100:0:26435:0:(obd_config.c:1561:class_process_config()) marker 19 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788201691.237104:0:26435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201691.237108:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201691.237111:0:26435:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788201691.237114:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788201691.237117:0:26435:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788201691.237119:0:26435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201691.237122:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201691.237124:0:26435:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788201691.237126:0:26435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201691.237129:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201691.237131:0:26435:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788201691.237135:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788201691.237181:0:26435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df9a72fe-77e2-4342-a886-d55a2baf9a49:26435:1875064728082048:192.168.201.143@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788201691.237480:0:26435:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1432a9480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201691.245851:0:26435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df9a72fe-77e2-4342-a886-d55a2baf9a49:26435:1875064728082048:192.168.201.143@tcp:502:llog_process_th.0 00000020:01000000:3.0:1788201691.245891:0:26435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201691.245898:0:26435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201691.245900:0:26435:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788201691.245904:0:26435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788201691.246063:0:26422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788201691.246079:0:26422:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201691.246102:0:26422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.143@tcp lock: ffff8bc149f10000/0xd138388016f6f9d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6657e2171098d7d expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201691.246113:0:26422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.143@tcp lock: ffff8bc149f10000/0xd138388016f6f9d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6657e2171098d7d expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201691.246120:0:26422:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-cliir-ffff8bc1452f0800 from 1 10000000:01000000:0.0:1788201691.246123:0:26422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-cliir (res 0x65727473756c) 00010000:00010000:0.0:1788201691.246158:0:26422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.143@tcp lock: ffff8bc149eb7000/0xd138388016f6f9fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201691.246166:0:26422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.143@tcp lock: ffff8bc149eb7000/0xd138388016f6f9fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201691.246176:0:26422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.143@tcp lock: ffff8bc149eb7000/0xd138388016f6f9fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201691.246195:0:26422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df9a72fe-77e2-4342-a886-d55a2baf9a49:26422:1875064728082176:192.168.201.143@tcp:101:mount.lustre.0 00000100:00100000:0.0:1788201691.246261:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1667ee300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201691.251635:0:26422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df9a72fe-77e2-4342-a886-d55a2baf9a49:26422:1875064728082176:192.168.201.143@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788201691.251662:0:26422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.143@tcp lock: ffff8bc149eb7000/0xd138388016f6f9fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6657e2171098d84 expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201691.251685:0:26422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.143@tcp lock: ffff8bc149eb7000/0xd138388016f6f9fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6657e2171098d84 expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201691.252690:0:26422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df9a72fe-77e2-4342-a886-d55a2baf9a49:26422:1875064728082304:192.168.201.143@tcp:256:mount.lustre.0 00000100:00100000:0.0:1788201691.252829:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1667ee300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201691.256618:0:26422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df9a72fe-77e2-4342-a886-d55a2baf9a49:26422:1875064728082304:192.168.201.143@tcp:256:mount.lustre.0 10000000:01000000:0.0:1788201691.257917:0:26422:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.143@tcp: configuration from log 'lustre-cliir' succeeded (0). 00010000:00010000:0.0:1788201691.258365:0:26422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.143@tcp lock: ffff8bc149eb7000/0xd138388016f6f9fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6657e2171098d84 expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201691.258377:0:26422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.143@tcp lock: ffff8bc149eb7000/0xd138388016f6f9fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6657e2171098d84 expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201691.258441:0:26422:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8bc1452f0800 from 1 10000000:01000000:1.0:1788201691.258445:0:26422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201691.258484:0:26422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.143@tcp lock: ffff8bc149f10c00/0xd138388016f6fa03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201691.258491:0:26422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.143@tcp lock: ffff8bc149f10c00/0xd138388016f6fa03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201691.258499:0:26422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.143@tcp lock: ffff8bc149f10c00/0xd138388016f6fa03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201691.258521:0:26422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df9a72fe-77e2-4342-a886-d55a2baf9a49:26422:1875064728082432:192.168.201.143@tcp:101:mount.lustre.0 00000100:00100000:1.0:1788201691.258899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150a4f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201691.261521:0:26422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df9a72fe-77e2-4342-a886-d55a2baf9a49:26422:1875064728082432:192.168.201.143@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788201691.261547:0:26422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.143@tcp lock: ffff8bc149f10c00/0xd138388016f6fa03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6657e2171098d8b expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201691.261569:0:26422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.143@tcp lock: ffff8bc149f10c00/0xd138388016f6fa03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6657e2171098d8b expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201691.261640:0:26422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df9a72fe-77e2-4342-a886-d55a2baf9a49:26422:1875064728082560:192.168.201.143@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788201691.261713:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150a4f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201691.265045:0:26422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df9a72fe-77e2-4342-a886-d55a2baf9a49:26422:1875064728082560:192.168.201.143@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788201691.265098:0:26422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df9a72fe-77e2-4342-a886-d55a2baf9a49:26422:1875064728082688:192.168.201.143@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788201691.265223:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc150a4f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201691.267237:0:26422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:df9a72fe-77e2-4342-a886-d55a2baf9a49:26422:1875064728082688:192.168.201.143@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788201691.267547:0:26440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df9a72fe-77e2-4342-a886-d55a2baf9a49:26440:1875064728082816:192.168.201.143@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788201691.267617:0:26440:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201691.269475:0:26440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df9a72fe-77e2-4342-a886-d55a2baf9a49:26440:1875064728082816:192.168.201.143@tcp:502:llog_process_th.0 00000020:01000000:3.0:1788201691.269511:0:26440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201691.269521:0:26440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201691.269523:0:26440:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788201691.269531:0:26440:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bc1452f0800 00000020:00000080:3.0:1788201691.269534:0:26440:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201691.269543:0:26440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201691.269546:0:26440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201691.269547:0:26440:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788201691.269549:0:26440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201691.269564:0:26440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201691.269566:0:26440:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788201691.269570:0:26440:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bc1452f0800 00000020:00000080:3.0:1788201691.269573:0:26440:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788201691.269692:0:26440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df9a72fe-77e2-4342-a886-d55a2baf9a49:26440:1875064728082944:192.168.201.143@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788201691.269765:0:26440:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201691.271886:0:26440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:df9a72fe-77e2-4342-a886-d55a2baf9a49:26440:1875064728082944:192.168.201.143@tcp:502:llog_process_th.0 00000020:01000000:0.0:1788201691.271919:0:26440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201691.271925:0:26440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201691.271927:0:26440:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788201691.271930:0:26440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788201691.272070:0:26422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1788201691.272089:0:26422:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201691.272110:0:26422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.143@tcp lock: ffff8bc149f10c00/0xd138388016f6fa03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6657e2171098d8b expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201691.272121:0:26422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.143@tcp lock: ffff8bc149f10c00/0xd138388016f6fa03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6657e2171098d8b expref: -99 pid: 26422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:01000000:3.0:1788201691.272142:0:26422:0:(llite_lib.c:1623:ll_fill_super()) Found profile lustre-client: mdc=lustre-clilmv osc=lustre-clilov 00000020:00000080:3.0:1788201691.272164:0:26422:0:(genops.c:1406:class_connect()) connect: client 8c0a6615-c7c4-4483-9f31-fb19c8e5931c, cookie 0xd138388016f6fa0a 00800000:01000000:3.0:1788201691.272184:0:26422:0:(lmv_obd.c:515:lmv_check_connect()) Time to connect 8c0a6615-c7c4-4483-9f31-fb19c8e5931c to lustre-clilmv-ffff8bc1452f0800 00800000:01000000:3.0:1788201691.272191:0:26422:0:(lmv_obd.c:338:lmv_connect_mdc()) connect to lustre-MDT0000-mdc-ffff8bc1452f0800(8c0a6615-c7c4-4483-9f31-fb19c8e5931c) - lustre-MDT0000_UUID, 8c0a6615-c7c4-4483-9f31-fb19c8e5931c 00000020:00000080:3.0:1788201691.272200:0:26422:0:(genops.c:1406:class_connect()) connect: client 8c0a6615-c7c4-4483-9f31-fb19c8e5931c, cookie 0xd138388016f6fa11 00000100:00080000:3.0:1788201691.272208:0:26422:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 0 00000100:00080000:3.0:1788201691.272214:0:26422:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788201691.272224:0:26422:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788201691.272246:0:26422:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728083072/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201691.273963:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728083072:192.168.201.143@tcp:38:mount.lustre.0 00000100:00080000:3.0:1788201691.274881:0:26422:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID 00800000:01000000:3.0:1788201691.274957:0:26422:0:(lmv_obd.c:392:lmv_connect_mdc()) Connected to lustre-MDT0000-mdc-ffff8bc1452f0800(8c0a6615-c7c4-4483-9f31-fb19c8e5931c) successfully (5) 00800000:00000004:3.0:1788201691.274962:0:26422:0:(obd_class.h:1057:obd_statfs_async()) lustre-MDT0000-mdc-ffff8bc1452f0800: age -23, max_age 0 00000080:00000004:3.0:1788201691.275007:0:26422:0:(obd_class.h:1091:obd_statfs()) lustre-clilmv-ffff8bc1452f0800: age -23, max_age 976 00800000:00000004:3.0:1788201691.275011:0:26422:0:(obd_class.h:1091:obd_statfs()) lustre-MDT0000-mdc-ffff8bc1452f0800: age -23, max_age 976 00000100:00080000:3.0:1788201691.275027:0:26422:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8bc1726cc000 x1875064728083328/t0(0) o41->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201691.275037:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00100000:3.0:1788201691.275066:0:10053:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:3.0:1788201691.275073:0:10053:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8bc1726cd880 x1875064728083200/t0(0) o41->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788201692.228084:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201692.291984:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788201693.251979:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201693.315932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201694.275931:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201694.339882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788201695.299961:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201695.363957:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201696.323948:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201696.387906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788201696.515978:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201696.515983:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788201696.516038:0:10052:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201696.516058:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df9a72fe-77e2-4342-a886-d55a2baf9a49:10052:1875064728083456:192.168.201.143@tcp:400:kworker.0 00010000:00010000:2.0:1788201697.347936:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201697.411938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201698.371900:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201698.435936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788201699.395901:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201699.459929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201700.419915:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201700.483938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788201701.443945:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201701.507939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00100000:3.0:1788201701.636015:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201691/real 1788201691] req@ffff8bc1726cc380 x1875064728083072/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201701 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201701.636038:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788201701.636048:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788201701.636061:0:10054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df9a72fe-77e2-4342-a886-d55a2baf9a49:10054:1875064728083584:192.168.201.143@tcp:400:kworker.0 00000100:00100000:3.0:1788201701.636065:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728083072/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201701 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201701.636094:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201701.636124:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788201701.636131:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728083072:192.168.201.143@tcp:38:mount.lustre.0 00000100:00080000:3.0:1788201701.636174:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201701.636181:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201701.636185:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201701.636197:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 977 00000100:00080000:3.0:1788201701.636212:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201701.636228:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788201701.636248:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788201701.636278:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728083712/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201701.636338:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728083712:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201702.467970:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201702.531950:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788201703.491948:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201703.555890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201704.515932:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201704.579889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788201705.539937:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201705.603936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201706.563924:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201706.627947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201706.755978:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788201706.755987:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788201706.755998:0:10055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:df9a72fe-77e2-4342-a886-d55a2baf9a49:10055:1875064728083840:192.168.201.143@tcp:400:kworker.0 00010000:00010000:2.0:1788201707.587941:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201707.651946:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201708.611915:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201708.675935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788201709.635944:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201709.699918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201710.659937:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201710.723961:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788201711.683897:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201711.747925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788201711.875981:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1788201711.875988:0:10052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df9a72fe-77e2-4342-a886-d55a2baf9a49:10052:1875064728083968:192.168.201.143@tcp:400:kworker.0 00000100:00080000:0.0:1788201711.875989:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788201712.707903:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201712.771963:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00000400:3.0:1788201712.899948:0:10052:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201696/real 1788201696] req@ffff8bc17257df80 x1875064728083456/t0(0) o400->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 224/224 e 0 to 1 dl 1788201712 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201712.906127:0:10052:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8bc17257df80 x1875064728083456/t0(0) o400->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 224/224 e 0 to 1 dl 1788201712 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201712.906138:0:10052:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788201712.906141:0:10052:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.143@tcp: Connection to MGS (at 192.168.201.143@tcp) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788201712.908462:0:10052:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@192.168.201.143@tcp for MGC192.168.201.143@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788201712.908465:0:10052:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788201712.908469:0:10052:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff8bc17257df80 x1875064728083456/t0(0) o400->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 224/224 e 0 to 1 dl 1788201712 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201712.908477:0:10052:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff8bc17257c000 x1875064728083584/t0(0) o400->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 224/224 e 0 to 0 dl 1788201717 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201712.908488:0:10052:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff8bc1726cce00 x1875064728083840/t0(0) o400->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 224/224 e 0 to 0 dl 1788201722 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201712.908502:0:10052:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff8bc144143480 x1875064728083968/t0(0) o400->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 224/224 e 0 to 0 dl 1788201727 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788201712.908509:0:10052:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788201712.908512:0:10052:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788201712.908513:0:10052:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788201712.908514:0:10052:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:1.0:1788201712.908539:0:10054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:df9a72fe-77e2-4342-a886-d55a2baf9a49:10054:1875064728083584:192.168.201.143@tcp:400:kworker.0 00000100:00100000:3.0:1788201712.908549:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df9a72fe-77e2-4342-a886-d55a2baf9a49:10052:1875064728083968:192.168.201.143@tcp:400:kworker.0 00000100:00100000:0.0:1788201712.908555:0:10055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:df9a72fe-77e2-4342-a886-d55a2baf9a49:10055:1875064728083840:192.168.201.143@tcp:400:kworker.0 00000100:00100000:3.0:1788201712.908562:0:10052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:df9a72fe-77e2-4342-a886-d55a2baf9a49:10052:1875064728083456:192.168.201.143@tcp:400:kworker.0 00000100:00080000:1.0:1788201712.908575:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201712.908580:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788201712.908583:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201712.908589:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 977 00000100:00080000:1.0:1788201712.908602:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788201712.908627:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5c00 x1875064728084096/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201712.908652:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788201712.908657:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788201712.908673:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728084096:192.168.201.143@tcp:250:kworker.0 00010000:00010000:2.0:1788201713.731910:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201713.795866:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201714.755905:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201714.819913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788201715.779898:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201715.843849:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201716.803967:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201716.867932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00100000:3.0:1788201716.995905:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201701/real 1788201701] req@ffff8bc1726cc380 x1875064728083712/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201716 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201716.995942:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728083712/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201716 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201716.995965:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201716.995993:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788201716.995997:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728083712:192.168.201.143@tcp:38:kworker.0 00000100:00080000:2.0:1788201716.996034:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201716.996042:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201716.996044:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788201716.996048:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201716.996052:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201716.996059:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 988 00000100:00080000:2.0:1788201716.996071:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788201716.996079:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788201716.996092:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788201716.996127:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ed80 x1875064728084224/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201716.996176:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728084224:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788201717.827946:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201717.891906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788201718.019937:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201718.019949:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201718.019952:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788201718.019955:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788201718.851972:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201718.915926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788201719.875973:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201719.939846:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201720.899947:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201720.963963:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788201721.923998:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201721.987867:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00100000:3.0:1788201722.115973:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201712/real 1788201712] req@ffff8bc1727d5c00 x1875064728084096/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201722 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201722.116012:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5c00 x1875064728084096/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201722 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201722.116043:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201722.116072:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788201722.116077:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728084096:192.168.201.143@tcp:250:kworker.0 00000100:00080000:2.0:1788201722.116162:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201722.116168:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788201722.116172:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201722.116179:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 999 00000100:00080000:2.0:1788201722.116191:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788201722.116200:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788201722.116241:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e680 x1875064728084352/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201722.116263:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788201722.116266:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788201722.116305:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728084352:192.168.201.143@tcp:250:kworker.0 00010000:00010000:1.0:1788201722.947920:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201723.011945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788201723.971987:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201724.035930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201724.995878:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201725.059937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788201726.019933:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201726.083934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201727.043915:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201727.107896:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201727.235914:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201727.235923:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201727.235926:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201727.235929:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788201728.068061:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201728.131947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201729.091917:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201729.155908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788201730.115981:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201730.179900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201731.139907:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201731.203936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788201732.164009:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201732.227936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201732.355905:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201732.355914:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201732.355916:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201732.355920:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788201733.187901:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201733.251907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788201734.211968:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201734.275922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201735.235924:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201735.299868:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788201736.259969:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201736.323916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201736.451875:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201716/real 1788201716] req@ffff8bc17257ed80 x1875064728084224/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201736 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201736.451922:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ed80 x1875064728084224/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201736 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201736.451943:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201736.451962:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201736.451965:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728084224:192.168.201.143@tcp:38:kworker.0 00000100:00080000:3.0:1788201736.452020:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201736.452028:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201736.452031:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201736.452034:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201736.452038:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201736.452046:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1003 00000100:00080000:3.0:1788201736.452057:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788201736.452064:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788201736.452076:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788201736.452112:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728084480/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201736.452181:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728084480:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201737.283870:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201737.347977:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201737.475926:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201722/real 1788201722] req@ffff8bc17257e680 x1875064728084352/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201737 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201737.475959:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e680 x1875064728084352/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201737 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201737.475978:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201737.476001:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201737.476004:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728084352:192.168.201.143@tcp:250:kworker.0 00000100:00080000:3.0:1788201737.476058:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201737.476067:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201737.476070:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201737.476078:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1008 00000100:00080000:3.0:1788201737.476091:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788201737.476099:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788201737.476152:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728084608/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201737.476180:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201737.476185:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788201737.476220:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728084608:192.168.201.143@tcp:250:kworker.0 00010000:00010000:2.0:1788201738.307930:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201738.371931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201739.331875:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201739.395935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788201740.355900:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201740.419903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201741.379894:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201741.443935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788201742.403894:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201742.467917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201742.595888:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201742.595897:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201742.595899:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201742.595902:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788201743.427863:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201743.491865:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788201744.451899:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201744.515936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201745.475913:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201745.539913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000800:00000100:1.0:1788201746.051898:0:10044:0:(socklnd_cb.c:2247:ksocknal_find_timed_out_conn()) A connection with 12345-192.168.201.143@tcp (192.168.201.143:988) timed out; the network or node may be down. 00010000:00010000:2.0:1788201746.499958:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201746.563889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201747.523892:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201747.587908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788201747.715901:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201747.715910:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201747.715912:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788201747.715915:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788201748.547941:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201748.611908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201749.571880:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201749.635897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788201750.595956:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201750.659885:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201751.619889:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201751.683930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788201752.643953:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201752.707872:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201752.835897:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201752.835908:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201752.835912:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201752.835916:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788201753.667897:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201753.731934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788201754.691950:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201754.755903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201755.715891:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201755.779918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788201756.739940:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201756.803862:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201757.763902:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201757.827934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201757.891903:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201737/real 1788201737] req@ffff8bc1726cdc00 x1875064728084608/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201757 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201757.891938:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728084608/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201757 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201757.891960:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201757.891978:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201757.891981:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728084608:192.168.201.143@tcp:250:kworker.0 00000100:00080000:3.0:1788201757.892016:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201757.892021:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201757.892025:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201757.892031:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1023 00000100:00080000:3.0:1788201757.892039:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788201757.892045:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788201757.892073:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728084736/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201757.892091:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201757.892094:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788201757.892128:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728084736:192.168.201.143@tcp:250:kworker.0 00010000:00010000:3.0:1788201758.787966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201758.851926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201759.811922:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201759.875899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201760.835941:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201760.899868:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788201760.964021:0:10041:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1021 -> 192.168.201.143:988 00000400:00000100:1.0:1788201760.964058:0:10041:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788201760.964071:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788201760.964132:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201757/real 1788201760] req@ffff8bc1726ce680 x1875064728084736/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201782 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201760.964153:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728084736/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201782 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201760.964161:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201760.964164:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201760.964167:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728084736:192.168.201.143@tcp:250:kworker.0 00010000:00010000:1.0:1788201761.859935:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201761.923891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00100000:2.0:1788201761.987888:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201736/real 1788201736] req@ffff8bc1726cc380 x1875064728084480/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201761 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201761.987917:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728084480/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201761 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201761.987933:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201761.987951:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201761.987955:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728084480:192.168.201.143@tcp:38:kworker.0 00000100:00080000:3.0:1788201761.988022:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201761.988027:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201761.988030:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201761.988035:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1044 00000100:00080000:3.0:1788201761.988042:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201761.988050:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788201761.988082:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728084864/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201761.988111:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201761.988114:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201761.988116:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201761.988120:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1022 00000100:00080000:3.0:1788201761.988124:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201761.988128:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788201761.988138:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788201761.988153:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728084992/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201761.988156:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728084864:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788201761.988298:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728084992:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201762.883964:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201762.947906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201763.907911:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201763.971912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788201764.036188:0:10042:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1021 -> 192.168.201.143:988 00000400:00000100:1.0:1788201764.036250:0:10042:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788201764.036272:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788201764.036322:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788201764.036397:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201761/real 1788201764] req@ffff8bc1726ce300 x1875064728084992/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201764.036443:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728084992/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201764.036459:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201764.036465:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201764.036470:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728084992:192.168.201.143@tcp:38:kworker.0 00000100:00100000:2.0:1788201764.036487:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201761/real 1788201764] req@ffff8bc1726cea00 x1875064728084864/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201764.036503:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728084864/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201764.036513:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201764.036518:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201764.036522:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728084864:192.168.201.143@tcp:250:kworker.0 00010000:00010000:3.0:1788201764.931903:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201764.995907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201765.955905:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201766.019889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201766.979975:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201767.043886:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201767.171874:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201767.171883:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201767.171887:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201767.171896:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1048 00000100:00080000:3.0:1788201767.171904:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201767.171911:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788201767.171949:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728085120/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201767.171972:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201767.171975:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201767.171977:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201767.171979:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1048 00000100:00080000:3.0:1788201767.171981:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201767.171984:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788201767.171992:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788201767.172001:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728085248/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201767.172022:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728085120:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788201767.172127:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728085248:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201768.003901:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201768.067967:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201769.027899:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201769.091899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201770.051917:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201770.115891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:3.0:1788201770.244146:0:10043:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1021 -> 192.168.201.143:988 00000400:00000100:3.0:1788201770.244213:0:10043:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:3.0:1788201770.244232:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:3.0:1788201770.244273:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788201770.244384:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201767/real 1788201770] req@ffff8bc1726ced80 x1875064728085120/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201792 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201770.244435:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728085120/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201792 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201770.244450:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201770.244457:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201770.244462:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728085120:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788201770.244473:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201767/real 1788201770] req@ffff8bc1726cfb80 x1875064728085248/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201792 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201770.244486:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728085248/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201792 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201770.244496:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201770.244500:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201770.244504:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728085248:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201771.075921:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201771.139919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201772.099874:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201772.163898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201772.291873:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201772.291881:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201772.291884:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201772.291892:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1053 00000100:00080000:3.0:1788201772.291901:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201772.291907:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788201772.291938:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728085376/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201772.291966:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201772.291969:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201772.291970:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201772.291973:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1053 00000100:00080000:3.0:1788201772.291975:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201772.291977:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788201772.291984:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788201772.291992:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728085504/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201772.292062:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728085376:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788201772.292188:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201772.292316:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201772/real 1788201772] req@ffff8bc1726cca80 x1875064728085376/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201797 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201772.292344:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728085376/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201797 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201772.292358:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201772.292365:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201772.292369:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728085376:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788201772.292380:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728085504:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788201772.292411:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201772.292427:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201772/real 1788201772] req@ffff8bc1726cd500 x1875064728085504/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201797 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201772.292442:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728085504/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201797 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201772.292451:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201772.292455:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201772.292459:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728085504:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201773.123949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201773.188056:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201774.147911:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201774.211871:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201775.171937:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201775.235939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201776.195898:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201776.259887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201777.220018:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201777.283951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788201777.411889:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201777.411900:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788201777.411904:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201777.411916:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1058 00000100:00080000:2.0:1788201777.411928:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201777.411936:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788201777.411982:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e680 x1875064728085632/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201777.412015:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788201777.412018:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201777.412020:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201777.412023:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1058 00000100:00080000:2.0:1788201777.412026:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201777.412029:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788201777.412039:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788201777.412049:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ed80 x1875064728085760/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201777.412078:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728085632:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201777.412239:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728085760:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201778.243912:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201778.307933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201779.267938:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201779.331892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201780.291890:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201780.355879:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:3.0:1788201780.484061:0:10040:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1021 -> 192.168.201.143:988 00000400:00000100:3.0:1788201780.484107:0:10040:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:3.0:1788201780.484138:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:3.0:1788201780.484177:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:0.0:1788201780.484259:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201777/real 1788201780] req@ffff8bc17257e680 x1875064728085632/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201802 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201780.484300:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e680 x1875064728085632/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201802 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201780.484317:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201780.484323:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201780.484329:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728085632:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201780.484341:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201777/real 1788201780] req@ffff8bc17257ed80 x1875064728085760/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201802 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201780.484356:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ed80 x1875064728085760/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201802 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201780.484366:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201780.484370:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201780.484374:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728085760:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201781.315949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201781.379901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201782.339910:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201782.403886:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788201782.531918:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201782.531930:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788201782.531934:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201782.531946:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1063 00000100:00080000:1.0:1788201782.531956:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788201782.531963:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788201782.531997:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4e00 x1875064728085888/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201782.532030:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788201782.532034:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201782.532036:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201782.532040:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1063 00000100:00080000:1.0:1788201782.532044:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788201782.532048:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788201782.532058:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788201782.532070:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6a00 x1875064728086016/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201782.532081:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728085888:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788201782.532162:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201782.532218:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201782/real 1788201782] req@ffff8bc1727d4e00 x1875064728085888/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201807 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201782.532237:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4e00 x1875064728085888/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201807 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201782.532248:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201782.532252:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201782.532256:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728085888:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201782.532283:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728086016:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788201782.532309:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201782.532338:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201782/real 1788201782] req@ffff8bc1727d6a00 x1875064728086016/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201807 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201782.532353:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6a00 x1875064728086016/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201807 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201782.532361:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201782.532364:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201782.532367:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728086016:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201783.363905:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201783.427892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201784.387906:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201784.451945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201785.411916:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201785.475905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201786.435908:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201786.499942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201787.459962:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201787.523906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788201787.651918:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201787.651932:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788201787.651938:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201787.651952:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1069 00000100:00080000:2.0:1788201787.651965:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201787.651975:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788201787.652037:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ce00 x1875064728086144/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201787.652070:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788201787.652074:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201787.652076:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201787.652080:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1069 00000100:00080000:2.0:1788201787.652085:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201787.652090:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788201787.652104:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788201787.652125:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d880 x1875064728086272/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201787.652126:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728086144:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201787.652273:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728086272:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201788.483922:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201788.548016:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:3.0:1788201789.188194:0:10041:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1021 -> 192.168.201.143:988 00000400:00000100:3.0:1788201789.188260:0:10041:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:3.0:1788201789.188278:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:3.0:1788201789.188325:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:0.0:1788201789.188379:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201787/real 1788201789] req@ffff8bc17257d880 x1875064728086272/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201812 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201789.188412:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d880 x1875064728086272/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201812 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201789.188427:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201789.188434:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201789.188440:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728086272:192.168.201.143@tcp:38:kworker.0 00000100:00100000:0.0:1788201789.188450:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201787/real 1788201789] req@ffff8bc17257ce00 x1875064728086144/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201812 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201789.188474:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ce00 x1875064728086144/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201812 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201789.188483:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201789.188488:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201789.188492:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728086144:192.168.201.143@tcp:250:kworker.0 00010000:00010000:3.0:1788201789.507957:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201789.571908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201790.531934:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201790.595957:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201791.555943:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201791.619877:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201792.579926:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201792.643984:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201792.771904:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201792.771933:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201792.771938:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201792.771953:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1074 00000100:00080000:3.0:1788201792.771967:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201792.771976:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788201792.772024:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728086400/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201792.772053:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201792.772056:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201792.772058:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201792.772061:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1074 00000100:00080000:3.0:1788201792.772064:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201792.772067:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788201792.772077:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788201792.772088:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728086528/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201792.772105:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728086400:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788201792.772179:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201792.772231:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201792/real 1788201792] req@ffff8bc1726cf480 x1875064728086400/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201817 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201792.772262:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728086400/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201817 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201792.772276:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201792.772281:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201792.772285:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728086400:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201792.772309:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728086528:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788201792.772329:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201792.772338:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201792/real 1788201792] req@ffff8bc1726cf100 x1875064728086528/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201817 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201792.772348:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728086528/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201817 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201792.772359:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201792.772361:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201792.772364:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728086528:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201793.603925:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201793.667987:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201794.627892:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201794.691921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201795.651977:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201795.715917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201796.675917:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201796.739917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201797.699920:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201797.763965:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201797.891900:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201797.891911:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201797.891915:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201797.891927:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1079 00000100:00080000:3.0:1788201797.891940:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201797.891948:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788201797.891995:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728086656/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201797.892025:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201797.892028:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201797.892029:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201797.892032:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1079 00000100:00080000:3.0:1788201797.892035:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201797.892038:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788201797.892047:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788201797.892057:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728086784/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201797.892076:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728086656:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788201797.892145:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201797.892204:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201797/real 1788201797] req@ffff8bc1726cd180 x1875064728086656/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201822 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201797.892220:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728086656/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201822 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201797.892230:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201797.892235:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201797.892239:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728086656:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201797.892265:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728086784:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788201797.892281:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201797.892290:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201797/real 1788201797] req@ffff8bc1726cc700 x1875064728086784/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201822 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201797.892299:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728086784/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201822 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201797.892305:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201797.892307:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201797.892310:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728086784:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201798.723926:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201798.787964:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201799.747938:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201799.811858:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201800.771888:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201800.835895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201801.795910:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201801.859890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201802.819890:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201802.883880:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788201803.011886:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201803.011897:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788201803.011902:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201803.011913:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1084 00000100:00080000:0.0:1788201803.011924:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201803.011931:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788201803.011973:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142a00 x1875064728086912/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201803.012001:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788201803.012004:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201803.012005:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201803.012009:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1084 00000100:00080000:0.0:1788201803.012011:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201803.012014:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788201803.012024:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788201803.012037:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140e00 x1875064728087040/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201803.012039:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728086912:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788201803.012118:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201803.012196:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201803/real 1788201803] req@ffff8bc144142a00 x1875064728086912/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201803.012214:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142a00 x1875064728086912/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201803.012222:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201803.012226:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201803.012229:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728086912:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788201803.012252:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728087040:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788201803.012270:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201803.012280:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201803/real 1788201803] req@ffff8bc144140e00 x1875064728087040/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201803.012289:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140e00 x1875064728087040/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201803.012295:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201803.012297:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201803.012300:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728087040:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201803.843958:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201803.907993:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201804.867903:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201804.931951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201805.891947:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201805.955922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201806.915891:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201806.979871:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201807.939938:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201808.003867:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788201808.131878:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201808.131889:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788201808.131894:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201808.131905:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1089 00000100:00080000:0.0:1788201808.131918:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201808.131926:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788201808.131988:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141c00 x1875064728087168/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201808.132027:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788201808.132033:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201808.132035:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201808.132040:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1089 00000100:00080000:0.0:1788201808.132044:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201808.132049:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788201808.132061:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788201808.132078:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140700 x1875064728087296/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201808.132084:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728087168:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788201808.132204:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728087296:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201808.963887:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201809.028018:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201809.987945:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201810.051882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201811.011892:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201811.075842:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788201811.204069:0:10042:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788201811.204119:0:10042:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788201811.204135:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788201811.204178:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788201811.204238:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201808/real 1788201811] req@ffff8bc144140700 x1875064728087296/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201811.204270:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140700 x1875064728087296/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201811.204284:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201811.204291:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201811.204295:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728087296:192.168.201.143@tcp:38:kworker.0 00000100:00100000:2.0:1788201811.204306:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201808/real 1788201811] req@ffff8bc144141c00 x1875064728087168/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201811.204321:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141c00 x1875064728087168/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201811.204331:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201811.204336:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201811.204340:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728087168:192.168.201.143@tcp:250:kworker.0 00010000:00010000:3.0:1788201812.035929:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201812.099947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201813.059921:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201813.123856:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788201813.251936:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201813.251950:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788201813.251955:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201813.251977:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1094 00000100:00080000:0.0:1788201813.251992:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201813.252002:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788201813.252048:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141c00 x1875064728087424/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201813.252090:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788201813.252094:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201813.252097:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201813.252101:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1094 00000100:00080000:0.0:1788201813.252105:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201813.252109:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788201813.252123:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788201813.252147:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140700 x1875064728087552/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201813.252195:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728087424:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788201813.252280:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201813.252378:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201813/real 1788201813] req@ffff8bc144141c00 x1875064728087424/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201838 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201813.252409:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141c00 x1875064728087424/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201838 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201813.252423:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201813.252428:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201813.252433:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728087424:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788201813.252443:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728087552:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788201813.252468:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201813.252482:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201813/real 1788201813] req@ffff8bc144140700 x1875064728087552/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201838 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201813.252496:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140700 x1875064728087552/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201838 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201813.252505:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201813.252508:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201813.252512:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728087552:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201814.083912:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201814.147913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201815.107913:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201815.171872:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201816.131948:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201816.195928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201817.155886:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201817.219868:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201818.179934:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201818.243955:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788201818.371926:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201818.371941:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788201818.371946:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201818.371969:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1099 00000100:00080000:2.0:1788201818.371985:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201818.371994:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788201818.372044:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ea00 x1875064728087680/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201818.372077:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788201818.372081:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201818.372083:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201818.372089:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1099 00000100:00080000:2.0:1788201818.372092:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201818.372097:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788201818.372109:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788201818.372110:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728087680:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788201818.372128:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257fb80 x1875064728087808/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788201818.372191:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201818.372253:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201818/real 1788201818] req@ffff8bc17257ea00 x1875064728087680/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201843 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201818.372276:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ea00 x1875064728087680/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201843 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201818.372288:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201818.372293:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201818.372298:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728087680:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201818.372327:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728087808:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788201818.372348:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201818.372358:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201818/real 1788201818] req@ffff8bc17257fb80 x1875064728087808/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201843 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201818.372367:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257fb80 x1875064728087808/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201843 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201818.372373:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201818.372376:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201818.372378:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728087808:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201819.203927:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201819.267930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201820.227939:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201820.291957:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201821.251911:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201821.315882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201822.275962:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201822.339911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201823.299895:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201823.363908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788201823.491901:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201823.491909:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788201823.491913:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201823.491921:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1104 00000100:00080000:2.0:1788201823.491929:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201823.491942:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788201823.491978:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ca80 x1875064728087936/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201823.492009:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788201823.492013:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201823.492014:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201823.492018:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1104 00000100:00080000:2.0:1788201823.492020:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201823.492023:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788201823.492031:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788201823.492042:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e300 x1875064728088064/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201823.492095:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728087936:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788201823.492188:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201823.492251:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201823/real 1788201823] req@ffff8bc17257ca80 x1875064728087936/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201848 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201823.492268:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ca80 x1875064728087936/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201848 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201823.492278:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201823.492281:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201823.492285:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728087936:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201823.492291:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728088064:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788201823.492310:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201823.492319:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201823/real 1788201823] req@ffff8bc17257e300 x1875064728088064/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201848 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201823.492327:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e300 x1875064728088064/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201848 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201823.492333:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201823.492335:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201823.492337:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728088064:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201824.323933:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201824.387922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201825.347898:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201825.411862:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201826.371957:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201826.435850:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201827.395926:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201827.459904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201828.419947:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201828.483863:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201828.611947:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201828.611962:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201828.611968:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201828.611981:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1109 00000100:00080000:3.0:1788201828.611996:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201828.612006:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788201828.612059:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728088192/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201828.612099:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201828.612109:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201828.612111:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201828.612117:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1109 00000100:00080000:3.0:1788201828.612123:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201828.612129:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788201828.612141:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788201828.612151:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728088192:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788201828.612160:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728088320/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788201828.612238:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201828.612313:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201828/real 1788201828] req@ffff8bc1726cf800 x1875064728088192/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201853 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201828.612337:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728088192/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201853 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201828.612350:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201828.612356:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201828.612361:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728088192:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201828.612391:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728088320:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788201828.612418:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201828.612433:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201828/real 1788201828] req@ffff8bc1726cdf80 x1875064728088320/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201853 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201828.612448:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728088320/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201853 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201828.612458:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201828.612462:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201828.612474:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728088320:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201829.445305:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201829.507953:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201830.467903:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201830.531834:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201831.491902:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201831.555952:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201832.515997:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201832.579901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201833.539908:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201833.603860:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201833.731883:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201833.731895:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201833.731900:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201833.731912:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1115 00000100:00080000:3.0:1788201833.731923:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201833.732062:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788201833.732103:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728088448/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201833.732129:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201833.732134:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201833.732137:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201833.732142:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1115 00000100:00080000:3.0:1788201833.732153:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201833.732160:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788201833.732171:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728088448:192.168.201.143@tcp:250:kworker.0 00000008:00100000:3.0:1788201833.732185:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788201833.732213:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728088576/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788201833.732265:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201833.732304:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201833/real 1788201833] req@ffff8bc1726cdf80 x1875064728088448/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201858 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201833.732318:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728088448/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201858 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201833.732332:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201833.732335:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201833.732338:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728088448:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201833.732385:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728088576:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788201833.732403:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201833.732412:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201833/real 1788201833] req@ffff8bc1726cf800 x1875064728088576/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201858 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201833.732420:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728088576/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201858 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201833.732426:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201833.732428:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201833.732430:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728088576:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201834.563936:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201834.627988:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201835.587901:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201835.651897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201836.611922:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201836.675957:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201837.635908:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201837.699907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201838.659915:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201838.723858:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788201838.851959:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201838.851967:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788201838.851971:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201838.851979:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1120 00000100:00080000:2.0:1788201838.851988:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201838.852001:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788201838.852034:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c380 x1875064728088704/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201838.852055:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788201838.852058:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201838.852059:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201838.852062:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1120 00000100:00080000:2.0:1788201838.852064:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201838.852066:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788201838.852074:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788201838.852084:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d500 x1875064728088832/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201838.852106:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728088704:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788201838.852178:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201838.852223:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201838/real 1788201838] req@ffff8bc17257c380 x1875064728088704/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201863 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201838.852240:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c380 x1875064728088704/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201863 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201838.852249:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201838.852252:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201838.852256:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728088704:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201838.852263:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728088832:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788201838.852281:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201838.852291:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201838/real 1788201838] req@ffff8bc17257d500 x1875064728088832/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201863 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201838.852301:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d500 x1875064728088832/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201863 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201838.852309:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201838.852312:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201838.852315:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728088832:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201839.683877:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201839.747918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201840.707957:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201840.771922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201841.731930:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201841.795967:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201842.755941:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201842.819860:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201843.779924:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201843.843873:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788201843.971893:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201843.971902:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788201843.971906:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201843.971914:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1125 00000100:00080000:2.0:1788201843.971923:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201843.971929:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788201843.971960:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f100 x1875064728088960/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201843.971983:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788201843.971986:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201843.971987:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201843.971990:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1125 00000100:00080000:2.0:1788201843.971992:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201843.971995:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788201843.972002:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788201843.972010:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d180 x1875064728089088/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201843.972090:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728088960:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201843.972200:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728089088:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201844.803979:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201844.867976:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201845.827923:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201845.891919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201846.852021:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201846.915949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:3.0:1788201847.044037:0:10043:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:3.0:1788201847.044080:0:10043:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:3.0:1788201847.044093:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:3.0:1788201847.044124:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:0.0:1788201847.044227:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201843/real 1788201847] req@ffff8bc17257f100 x1875064728088960/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201868 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201847.044281:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f100 x1875064728088960/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201868 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201847.044296:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201847.044302:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201847.044307:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728088960:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201847.044318:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201843/real 1788201847] req@ffff8bc17257d180 x1875064728089088/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201868 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201847.044340:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d180 x1875064728089088/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201868 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201847.044350:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201847.044354:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201847.044358:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728089088:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201847.875948:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201847.939894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201848.900022:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201848.963942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201849.091992:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201849.092003:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201849.092008:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201849.092019:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1130 00000100:00080000:3.0:1788201849.092031:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201849.092039:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788201849.092077:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728089216/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201849.092104:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201849.092108:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201849.092109:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201849.092113:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1130 00000100:00080000:3.0:1788201849.092117:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201849.092123:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788201849.092136:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788201849.092153:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728089344/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201849.092170:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728089216:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788201849.092264:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201849.092332:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201849/real 1788201849] req@ffff8bc1726cc700 x1875064728089216/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201849.092354:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728089216/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201849.092367:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201849.092373:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201849.092378:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728089216:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201849.092407:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728089344:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788201849.092434:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201849.092449:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201849/real 1788201849] req@ffff8bc1726cd180 x1875064728089344/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201849.092463:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728089344/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201849.092477:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201849.092480:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201849.092484:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728089344:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201849.923989:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201849.987982:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201850.947992:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201851.011926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201851.971938:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201852.035923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201852.996018:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201853.059933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201854.019938:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201854.083913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201854.211898:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201854.211906:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201854.211909:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201854.211918:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1135 00000100:00080000:3.0:1788201854.211931:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201854.211937:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788201854.211970:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728089472/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201854.211996:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201854.211999:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201854.212000:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201854.212003:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1135 00000100:00080000:3.0:1788201854.212006:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201854.212008:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788201854.212016:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788201854.212024:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728089600/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201854.212056:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728089472:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788201854.212113:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201854.212173:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201854/real 1788201854] req@ffff8bc1726cf100 x1875064728089472/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201879 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201854.212194:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728089472/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201879 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201854.212205:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201854.212210:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201854.212214:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728089472:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201854.212221:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728089600:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788201854.212246:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201854.212262:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201854/real 1788201854] req@ffff8bc1726cf480 x1875064728089600/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201879 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201854.212271:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728089600/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201879 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201854.212286:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201854.212288:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201854.212290:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728089600:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201855.044018:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201855.107949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201856.067998:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201856.131865:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201857.091939:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201857.155893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201858.115951:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201858.179874:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201859.139994:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201859.203876:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201859.331890:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201859.331901:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201859.331905:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201859.331926:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1140 00000100:00080000:3.0:1788201859.331938:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201859.331946:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788201859.331991:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728089728/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201859.332019:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201859.332022:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201859.332023:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201859.332026:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1140 00000100:00080000:3.0:1788201859.332029:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201859.332031:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788201859.332041:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788201859.332053:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728089856/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201859.332091:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728089728:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788201859.332170:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201859.332215:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201859/real 1788201859] req@ffff8bc1726cd500 x1875064728089728/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201884 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201859.332230:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728089728/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201884 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201859.332238:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201859.332241:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201859.332244:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728089728:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201859.332250:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728089856:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788201859.332265:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201859.332273:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201859/real 1788201859] req@ffff8bc1726cca80 x1875064728089856/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201884 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201859.332281:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728089856/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201884 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201859.332286:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201859.332288:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201859.332290:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728089856:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201860.163967:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201860.227986:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201861.187939:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201861.251886:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201862.211913:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201862.275905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201863.235979:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201863.299853:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201864.259976:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201864.323880:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201864.451909:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201864.451924:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201864.451930:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201864.451944:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1145 00000100:00080000:3.0:1788201864.451959:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201864.451969:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788201864.452031:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728089984/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201864.452068:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201864.452073:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201864.452075:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201864.452079:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1145 00000100:00080000:3.0:1788201864.452083:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201864.452089:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788201864.452102:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788201864.452116:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728090112/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201864.452142:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728089984:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788201864.452220:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201864.452266:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201864/real 1788201864] req@ffff8bc1726cfb80 x1875064728089984/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201889 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201864.452282:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728089984/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201889 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201864.452291:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201864.452295:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201864.452298:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728089984:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201864.452321:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728090112:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788201864.452337:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201864.452346:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201864/real 1788201864] req@ffff8bc1726ced80 x1875064728090112/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201889 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201864.452354:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728090112/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201889 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201864.452360:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201864.452362:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201864.452364:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728090112:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201865.284014:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201865.347932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201866.307913:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201866.371842:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201867.331954:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201867.395867:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201868.355994:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201868.419852:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201869.380019:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201869.443931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788201869.571898:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201869.571910:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788201869.571915:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201869.571925:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1150 00000100:00080000:2.0:1788201869.571936:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201869.571944:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788201869.571977:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c700 x1875064728090240/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201869.572005:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788201869.572008:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201869.572009:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201869.572011:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1150 00000100:00080000:2.0:1788201869.572013:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201869.572016:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788201869.572023:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788201869.572032:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d180 x1875064728090368/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201869.572098:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728090240:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788201869.572188:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201869.572251:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201869/real 1788201869] req@ffff8bc17257c700 x1875064728090240/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201894 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201869.572269:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c700 x1875064728090240/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201894 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201869.572279:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201869.572282:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201869.572286:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728090240:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201869.572292:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728090368:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788201869.572308:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201869.572317:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201869/real 1788201869] req@ffff8bc17257d180 x1875064728090368/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201894 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201869.572326:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d180 x1875064728090368/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201894 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201869.572332:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201869.572336:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201869.572339:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728090368:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201870.403967:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201870.467972:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201871.427968:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201871.491868:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201872.451965:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201872.515976:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201873.476010:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201873.539857:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201874.499888:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201874.563859:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201874.691916:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201874.691924:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201874.691928:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201874.691937:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1156 00000100:00080000:3.0:1788201874.691948:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201874.691954:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788201874.691989:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728090496/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201874.692010:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201874.692013:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201874.692014:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201874.692017:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1156 00000100:00080000:3.0:1788201874.692019:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201874.692021:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788201874.692028:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788201874.692037:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728090624/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201874.692060:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728090496:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788201874.692119:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201874.692166:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201874/real 1788201874] req@ffff8bc1726cea00 x1875064728090496/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201899 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201874.692181:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728090496/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201899 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201874.692188:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201874.692191:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201874.692195:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728090496:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201874.692200:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728090624:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788201874.692216:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201874.692224:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201874/real 1788201874] req@ffff8bc1726ce300 x1875064728090624/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201899 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201874.692232:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728090624/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201899 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201874.692238:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201874.692240:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201874.692242:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728090624:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201875.523987:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201875.587924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201876.547881:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201876.611889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201877.571974:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201877.635860:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201878.595946:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201878.659893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201879.619979:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201879.683925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788201879.811949:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201879.811959:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788201879.811964:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201879.811976:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1161 00000100:00080000:0.0:1788201879.811989:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201879.811996:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788201879.812041:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140e00 x1875064728090752/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201879.812074:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788201879.812077:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201879.812078:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201879.812081:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1161 00000100:00080000:0.0:1788201879.812084:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201879.812086:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788201879.812097:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788201879.812107:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142a00 x1875064728090880/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201879.812153:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728090752:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788201879.812225:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201879.812272:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201879/real 1788201879] req@ffff8bc144140e00 x1875064728090752/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201904 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201879.812287:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140e00 x1875064728090752/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201904 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201879.812296:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201879.812299:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201879.812302:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728090752:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788201879.812308:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728090880:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788201879.812326:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201879.812335:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201879/real 1788201879] req@ffff8bc144142a00 x1875064728090880/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201904 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201879.812353:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142a00 x1875064728090880/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201904 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201879.812362:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201879.812364:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201879.812367:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728090880:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201880.643968:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201880.707957:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201881.668019:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201881.731953:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201882.691913:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201882.755949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201883.715948:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201883.779898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201884.739902:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201884.803853:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201884.931939:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201884.931952:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201884.931956:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201884.931965:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1166 00000100:00080000:3.0:1788201884.931974:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201884.931981:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788201884.932013:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728091008/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201884.932040:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201884.932044:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201884.932046:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201884.932050:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1166 00000100:00080000:3.0:1788201884.932054:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201884.932059:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788201884.932068:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788201884.932083:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728091136/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201884.932102:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728091008:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788201884.932164:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201884.932204:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201884/real 1788201884] req@ffff8bc1726cc380 x1875064728091008/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201909 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201884.932219:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728091008/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201909 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201884.932226:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201884.932229:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201884.932232:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728091008:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788201884.932251:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728091136:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788201884.932267:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201884.932275:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201884/real 1788201884] req@ffff8bc1726ce680 x1875064728091136/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201909 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201884.932289:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728091136/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201909 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201884.932294:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201884.932296:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201884.932298:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728091136:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201885.764007:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201885.828004:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201886.787942:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201886.851869:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201887.811959:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201887.875892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201888.835924:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201888.899844:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201889.859932:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201889.923925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201890.051892:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201890.051905:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201890.051911:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201890.051924:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1171 00000100:00080000:3.0:1788201890.051939:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201890.051948:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788201890.052000:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728091264/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201890.052040:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201890.052045:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201890.052047:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201890.052052:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1171 00000100:00080000:3.0:1788201890.052056:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201890.052062:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788201890.052074:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788201890.052092:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728091392/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201890.052099:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728091264:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788201890.052173:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201890.052249:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201890/real 1788201890] req@ffff8bc1726cdc00 x1875064728091264/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201890.052266:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728091264/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201890.052275:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201890.052278:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201890.052282:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728091264:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788201890.052308:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728091392:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788201890.052327:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201890.052336:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201890/real 1788201890] req@ffff8bc1726cce00 x1875064728091392/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201890.052345:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728091392/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201890.052357:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201890.052359:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201890.052361:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728091392:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201890.883961:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201890.947905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201891.907983:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201891.971931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201892.931992:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201892.995934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201893.955993:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201894.019940:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201894.980001:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201895.043913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201895.171930:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201895.171940:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201895.171945:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201895.171956:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1176 00000100:00080000:3.0:1788201895.171969:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201895.171976:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788201895.172036:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728091520/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201895.172071:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201895.172075:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201895.172077:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201895.172080:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1176 00000100:00080000:3.0:1788201895.172083:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201895.172087:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788201895.172097:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788201895.172111:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728091648/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201895.172157:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728091520:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788201895.172224:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201895.172279:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201895/real 1788201895] req@ffff8bc1726cce00 x1875064728091520/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201895.172294:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728091520/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201895.172303:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201895.172306:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201895.172310:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728091520:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788201895.172317:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728091648:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788201895.172332:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201895.172339:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201895/real 1788201895] req@ffff8bc1726cdc00 x1875064728091648/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201895.172347:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728091648/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201895.172352:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201895.172355:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201895.172357:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728091648:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201896.004000:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201896.067963:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201897.027867:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201897.091933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201898.052027:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201898.115917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201899.075953:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201899.139900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201900.099949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201900.163891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788201900.291926:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201900.291935:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788201900.291939:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201900.291948:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1181 00000100:00080000:0.0:1788201900.291957:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201900.291964:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788201900.291997:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143480 x1875064728091776/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201900.292018:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788201900.292021:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201900.292023:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201900.292025:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1181 00000100:00080000:0.0:1788201900.292028:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201900.292030:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788201900.292037:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788201900.292061:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141880 x1875064728091904/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201900.292137:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728091776:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788201900.292223:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201900.292299:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201900/real 1788201900] req@ffff8bc144143480 x1875064728091776/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201925 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201900.292321:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143480 x1875064728091776/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201925 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201900.292334:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201900.292339:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201900.292343:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728091776:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788201900.292352:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728091904:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788201900.292379:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201900.292394:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201900/real 1788201900] req@ffff8bc144141880 x1875064728091904/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201925 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201900.292408:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141880 x1875064728091904/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201925 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201900.292417:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201900.292421:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201900.292425:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728091904:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201901.123985:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201901.188043:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201902.147965:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201902.211899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201903.171974:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201903.235969:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201904.195922:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201904.259946:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201905.219928:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201905.283897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788201905.411888:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201905.411899:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788201905.411903:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201905.411911:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1186 00000100:00080000:0.0:1788201905.411920:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201905.411927:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788201905.411972:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141500 x1875064728092032/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201905.412002:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788201905.412006:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201905.412008:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201905.412013:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1186 00000100:00080000:0.0:1788201905.412017:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201905.412024:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788201905.412033:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788201905.412046:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143b80 x1875064728092160/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201905.412062:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728092032:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788201905.412160:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201905.412235:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201905/real 1788201905] req@ffff8bc144141500 x1875064728092032/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201930 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201905.412254:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141500 x1875064728092032/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201930 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201905.412264:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201905.412267:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201905.412271:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728092032:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788201905.412302:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728092160:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788201905.412320:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201905.412329:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201905/real 1788201905] req@ffff8bc144143b80 x1875064728092160/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201930 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201905.412338:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143b80 x1875064728092160/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201930 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201905.412344:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201905.412346:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201905.412348:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728092160:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201906.244039:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201906.307969:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201907.267968:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201907.331907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201908.292047:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201908.355926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201909.315938:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201909.379944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201910.340021:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201910.403919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788201910.531933:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201910.531944:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788201910.531949:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201910.531961:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1191 00000100:00080000:2.0:1788201910.531973:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201910.531981:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788201910.532027:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f100 x1875064728092288/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201910.532064:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788201910.532068:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201910.532069:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201910.532072:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1191 00000100:00080000:2.0:1788201910.532074:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201910.532077:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788201910.532088:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788201910.532104:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d500 x1875064728092416/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201910.532125:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728092288:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201910.532278:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728092416:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201911.363957:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201911.427962:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201912.387996:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201912.451891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201913.411929:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201913.475960:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:0.0:1788201913.604160:0:10040:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:0.0:1788201913.604205:0:10040:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:0.0:1788201913.604222:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:0.0:1788201913.604262:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788201913.604341:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201910/real 1788201913] req@ffff8bc17257d500 x1875064728092416/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201935 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201913.604383:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d500 x1875064728092416/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201935 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201913.604399:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201913.604406:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201913.604411:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728092416:192.168.201.143@tcp:38:kworker.0 00000100:00100000:2.0:1788201913.604422:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201910/real 1788201913] req@ffff8bc17257f100 x1875064728092288/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201935 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201913.604439:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f100 x1875064728092288/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201935 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201913.604449:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201913.604454:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201913.604458:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728092288:192.168.201.143@tcp:250:kworker.0 00010000:00010000:3.0:1788201914.435978:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201914.499887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201915.459966:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201915.523883:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788201915.651896:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201915.651904:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788201915.651907:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201915.651916:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1197 00000100:00080000:0.0:1788201915.651925:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201915.651931:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788201915.651961:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141f80 x1875064728092544/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201915.651986:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788201915.651989:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201915.651990:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201915.651993:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1197 00000100:00080000:0.0:1788201915.651996:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201915.652000:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788201915.652008:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788201915.652023:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142300 x1875064728092672/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201915.652034:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728092544:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788201915.652139:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201915.652211:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201915/real 1788201915] req@ffff8bc144141f80 x1875064728092544/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201940 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201915.652237:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141f80 x1875064728092544/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201940 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201915.652251:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201915.652256:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201915.652262:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728092544:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788201915.652306:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728092672:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788201915.652339:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201915.652356:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201915/real 1788201915] req@ffff8bc144142300 x1875064728092672/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201940 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201915.652369:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142300 x1875064728092672/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201940 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201915.652380:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201915.652384:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201915.652388:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728092672:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201916.483980:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201916.547928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201917.507897:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201917.571886:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201918.532019:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201918.595924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201919.555934:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201919.619884:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201920.580005:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201920.643913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788201920.771970:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201920.771980:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788201920.771984:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201920.771995:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1202 00000100:00080000:2.0:1788201920.772006:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201920.772014:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788201920.772049:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f100 x1875064728092800/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201920.772087:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788201920.772092:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201920.772094:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201920.772098:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1202 00000100:00080000:2.0:1788201920.772102:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201920.772107:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788201920.772117:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788201920.772132:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d500 x1875064728092928/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201920.772140:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728092800:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788201920.772198:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201920.772236:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201920/real 1788201920] req@ffff8bc17257f100 x1875064728092800/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201945 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201920.772250:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f100 x1875064728092800/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201945 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201920.772258:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201920.772260:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201920.772263:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728092800:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201920.772283:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728092928:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788201920.772298:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201920.772305:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201920/real 1788201920] req@ffff8bc17257d500 x1875064728092928/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201945 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201920.772314:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d500 x1875064728092928/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201945 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201920.772320:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201920.772322:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201920.772324:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728092928:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201921.603967:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201921.668007:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201922.627993:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201922.691942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201923.651906:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201923.715866:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201924.676018:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201924.739890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201925.699866:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201925.763861:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201925.891901:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201925.891909:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201925.891913:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201925.891921:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1207 00000100:00080000:3.0:1788201925.891930:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201925.891936:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788201925.891969:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728093056/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201925.891991:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201925.891994:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201925.891995:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201925.891998:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1207 00000100:00080000:3.0:1788201925.892000:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201925.892003:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788201925.892011:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788201925.892019:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728093184/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201925.892071:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728093056:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788201925.892149:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201925.892214:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201925/real 1788201925] req@ffff8bc1726ce680 x1875064728093056/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201950 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201925.892231:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728093056/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201950 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201925.892241:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201925.892245:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201925.892249:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728093056:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201925.892255:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728093184:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788201925.892274:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201925.892283:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201925/real 1788201925] req@ffff8bc1726cc380 x1875064728093184/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201950 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201925.892291:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728093184/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201950 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201925.892297:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201925.892299:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201925.892301:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728093184:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201926.724004:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201926.787988:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201927.747997:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201927.811891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201928.772002:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201928.835892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201929.795913:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201929.859858:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201930.819989:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201930.883869:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201931.011870:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201931.011882:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201931.011887:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201931.011897:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1212 00000100:00080000:3.0:1788201931.011907:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201931.011913:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788201931.011946:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728093312/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201931.011978:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201931.011983:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201931.011986:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201931.011990:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1212 00000100:00080000:3.0:1788201931.011995:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201931.012000:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788201931.012010:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788201931.012022:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728093440/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201931.012032:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728093312:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788201931.012090:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201931.012146:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201931/real 1788201931] req@ffff8bc1726ce300 x1875064728093312/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201931.012161:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728093312/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201931.012168:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201931.012171:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201931.012200:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728093312:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201931.012224:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728093440:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788201931.012242:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201931.012251:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201931/real 1788201931] req@ffff8bc1726cea00 x1875064728093440/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201931.012260:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728093440/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201931.012267:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201931.012269:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201931.012272:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728093440:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201931.843914:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201931.907906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201932.867955:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201932.931915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201933.891949:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201933.955881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201934.915949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201934.979877:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201935.939946:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201936.003934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788201936.131907:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201936.131918:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788201936.131923:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201936.131937:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1217 00000100:00080000:1.0:1788201936.131953:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788201936.131962:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788201936.132015:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4a80 x1875064728093568/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201936.132069:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788201936.132074:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201936.132076:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201936.132082:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1217 00000100:00080000:1.0:1788201936.132087:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788201936.132092:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788201936.132104:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788201936.132118:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7800 x1875064728093696/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201936.132161:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728093568:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788201936.132234:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201936.132300:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201936/real 1788201936] req@ffff8bc1727d4a80 x1875064728093568/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201936.132317:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4a80 x1875064728093568/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201936.132331:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201936.132335:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201936.132338:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728093568:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201936.132343:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728093696:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788201936.132369:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201936.132377:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201936/real 1788201936] req@ffff8bc1727d7800 x1875064728093696/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201936.132385:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7800 x1875064728093696/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201936.132390:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201936.132392:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201936.132394:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728093696:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201936.963945:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201937.027947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201937.987934:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201938.051956:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201939.011976:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201939.075879:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201940.035933:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201940.099960:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201941.059945:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201941.123884:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788201941.251949:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201941.251965:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788201941.251970:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201941.251984:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1222 00000100:00080000:0.0:1788201941.251999:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201941.252008:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788201941.252056:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140380 x1875064728093824/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201941.252094:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788201941.252101:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201941.252103:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201941.252108:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1222 00000100:00080000:0.0:1788201941.252111:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201941.252116:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788201941.252128:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788201941.252143:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143800 x1875064728093952/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201941.252151:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728093824:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788201941.252244:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201941.252309:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201941/real 1788201941] req@ffff8bc144140380 x1875064728093824/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201966 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201941.252344:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140380 x1875064728093824/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201966 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201941.252354:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201941.252358:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201941.252361:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728093824:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788201941.252388:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728093952:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788201941.252408:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201941.252417:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201941/real 1788201941] req@ffff8bc144143800 x1875064728093952/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201966 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201941.252425:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143800 x1875064728093952/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201966 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201941.252432:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201941.252435:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201941.252437:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728093952:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201942.083928:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201942.147999:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201943.107983:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201943.171863:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201944.131971:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201944.195980:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201945.155985:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201945.219939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201946.179941:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201946.243923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788201946.371872:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201946.371884:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788201946.371890:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201946.371902:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1227 00000100:00080000:0.0:1788201946.371916:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201946.371924:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788201946.371978:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143100 x1875064728094080/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201946.372026:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788201946.372031:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201946.372033:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201946.372037:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1227 00000100:00080000:0.0:1788201946.372041:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201946.372045:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788201946.372057:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788201946.372071:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140000 x1875064728094208/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201946.372148:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728094080:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788201946.372282:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201946.372374:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201946/real 1788201946] req@ffff8bc144143100 x1875064728094080/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201971 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201946.372395:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143100 x1875064728094080/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201971 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201946.372406:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201946.372410:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201946.372413:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728094080:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788201946.372428:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728094208:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788201946.372452:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201946.372464:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201946/real 1788201946] req@ffff8bc144140000 x1875064728094208/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201971 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201946.372474:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140000 x1875064728094208/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201971 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201946.372484:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201946.372489:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201946.372493:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728094208:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201947.204044:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201947.267918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201948.227968:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201948.291959:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201949.252024:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201949.315896:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201950.275919:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201950.339934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201951.299993:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201951.363909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788201951.491945:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201951.491963:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788201951.491985:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201951.491999:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1232 00000100:00080000:1.0:1788201951.492013:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788201951.492022:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788201951.492073:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7100 x1875064728094336/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201951.492106:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788201951.492111:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201951.492113:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201951.492117:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1232 00000100:00080000:1.0:1788201951.492121:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788201951.492127:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788201951.492139:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788201951.492172:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7b80 x1875064728094464/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201951.492204:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728094336:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788201951.492277:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201951.492334:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201951/real 1788201951] req@ffff8bc1727d7100 x1875064728094336/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201976 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201951.492361:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7100 x1875064728094336/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201976 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201951.492371:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201951.492374:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201951.492378:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728094336:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788201951.492383:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728094464:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788201951.492399:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201951.492407:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201951/real 1788201951] req@ffff8bc1727d7b80 x1875064728094464/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201976 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201951.492415:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7b80 x1875064728094464/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201976 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201951.492421:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201951.492423:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201951.492426:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728094464:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201952.323931:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201952.387965:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201953.348003:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201953.411958:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201954.371899:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201954.435930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201955.396019:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201955.459869:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201956.419921:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201956.483935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788201956.611917:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201956.611927:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788201956.611931:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201956.611939:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1237 00000100:00080000:0.0:1788201956.611948:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201956.611955:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788201956.611989:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140a80 x1875064728094592/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201956.612020:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788201956.612023:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201956.612024:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201956.612027:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1237 00000100:00080000:0.0:1788201956.612029:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201956.612032:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788201956.612039:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788201956.612048:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142680 x1875064728094720/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201956.612138:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728094592:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788201956.612238:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201956.612317:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201956/real 1788201956] req@ffff8bc144140a80 x1875064728094592/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201981 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201956.612355:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140a80 x1875064728094592/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201981 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201956.612367:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201956.612371:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201956.612374:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728094592:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788201956.612398:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728094720:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788201956.612425:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788201956.612441:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201956/real 1788201956] req@ffff8bc144142680 x1875064728094720/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201981 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201956.612455:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142680 x1875064728094720/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201981 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201956.612462:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201956.612464:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788201956.612467:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728094720:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201957.444010:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201957.507954:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201958.467927:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201958.531939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201959.491932:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201959.555932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201960.515908:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201960.579971:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201961.539959:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201961.604010:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788201961.731934:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201961.731948:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788201961.731954:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201961.731969:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1243 00000100:00080000:2.0:1788201961.732014:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201961.732024:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788201961.732078:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c380 x1875064728094848/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201961.732116:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788201961.732121:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201961.732123:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201961.732128:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1243 00000100:00080000:2.0:1788201961.732133:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201961.732138:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788201961.732152:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788201961.732169:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e300 x1875064728094976/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201961.732190:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728094848:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788201961.732269:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201961.732317:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201961/real 1788201961] req@ffff8bc17257c380 x1875064728094848/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201986 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201961.732333:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c380 x1875064728094848/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201986 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201961.732342:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201961.732346:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201961.732349:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728094848:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201961.732371:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728094976:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788201961.732388:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201961.732397:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201961/real 1788201961] req@ffff8bc17257e300 x1875064728094976/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201986 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201961.732405:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e300 x1875064728094976/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201986 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201961.732411:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201961.732413:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201961.732415:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728094976:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201962.563903:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201962.627976:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201963.588058:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201963.651967:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201964.612013:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201964.675960:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201965.635981:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201965.699983:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201966.659960:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201966.723920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201966.851971:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201966.851980:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201966.851983:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201966.851992:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1248 00000100:00080000:3.0:1788201966.852000:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201966.852007:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788201966.852047:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728095104/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201966.852078:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201966.852082:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201966.852083:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201966.852086:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1248 00000100:00080000:3.0:1788201966.852089:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201966.852093:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788201966.852101:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788201966.852111:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728095232/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201966.852121:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728095104:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788201966.852175:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201966.852214:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201966/real 1788201966] req@ffff8bc1726ced80 x1875064728095104/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201991 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201966.852234:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728095104/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201991 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201966.852246:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201966.852250:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201966.852255:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728095104:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201966.852281:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728095232:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788201966.852304:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201966.852318:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201966/real 1788201966] req@ffff8bc1726cfb80 x1875064728095232/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201991 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201966.852333:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728095232/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201991 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201966.852340:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201966.852343:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201966.852345:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728095232:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201967.683993:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201967.747987:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201968.707997:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201968.771949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201969.732046:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201969.795931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201970.756010:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201970.819895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201971.780002:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201971.843901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201971.971907:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201971.971918:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201971.971922:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201971.971941:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1253 00000100:00080000:3.0:1788201971.971952:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201971.971960:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788201971.972005:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728095360/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201971.972031:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201971.972034:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201971.972036:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201971.972039:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1253 00000100:00080000:3.0:1788201971.972041:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201971.972044:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788201971.972053:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788201971.972068:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728095488/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201971.972103:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728095360:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788201971.972211:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201971.972268:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201971/real 1788201971] req@ffff8bc1726cca80 x1875064728095360/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201996 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201971.972285:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728095360/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788201996 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201971.972296:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201971.972299:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201971.972302:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728095360:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201971.972308:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728095488:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788201971.972325:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201971.972334:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201971/real 1788201971] req@ffff8bc1726cd500 x1875064728095488/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201996 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201971.972342:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728095488/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788201996 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201971.972347:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201971.972350:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201971.972352:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728095488:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201972.803938:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201972.867914:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201973.827982:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201973.891888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201974.851978:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201974.915935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201975.875914:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201975.939927:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201976.899938:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201976.963915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201977.091905:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201977.091923:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201977.091928:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201977.091940:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1258 00000100:00080000:3.0:1788201977.091951:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201977.091959:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788201977.092005:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728095616/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201977.092034:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201977.092037:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201977.092039:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201977.092042:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1258 00000100:00080000:3.0:1788201977.092044:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201977.092047:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788201977.092056:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788201977.092066:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728095744/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201977.092091:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728095616:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201977.092200:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728095744:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201977.923943:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201977.987952:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201978.947936:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201979.011897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201979.971916:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201980.035864:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:3.0:1788201980.164153:0:10041:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:3.0:1788201980.164202:0:10041:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:3.0:1788201980.164219:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:3.0:1788201980.164261:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:0.0:1788201980.164345:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201977/real 1788201980] req@ffff8bc1726cf480 x1875064728095616/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201980.164381:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728095616/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201980.164401:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201980.164408:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201980.164413:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728095616:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201980.164423:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201977/real 1788201980] req@ffff8bc1726cf100 x1875064728095744/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201980.164436:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728095744/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201980.164444:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201980.164448:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201980.164452:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728095744:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201980.995966:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201981.059877:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201982.019972:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201982.083945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201982.212007:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201982.212017:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201982.212022:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201982.212033:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1263 00000100:00080000:3.0:1788201982.212045:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201982.212051:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788201982.212091:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728095872/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201982.212138:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201982.212142:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201982.212144:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201982.212149:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1263 00000100:00080000:3.0:1788201982.212154:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201982.212159:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788201982.212172:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788201982.212198:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728096000/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201982.212214:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728095872:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788201982.212317:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201982.212413:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201982/real 1788201982] req@ffff8bc1726cd180 x1875064728095872/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202007 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201982.212439:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728095872/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202007 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201982.212454:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201982.212461:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201982.212466:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728095872:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201982.212507:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728096000:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788201982.212536:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201982.212552:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201982/real 1788201982] req@ffff8bc1726cc700 x1875064728096000/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202007 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201982.212565:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728096000/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202007 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201982.212575:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201982.212579:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201982.212584:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728096000:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201983.043923:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201983.107957:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201984.068022:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201984.131943:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201985.091935:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201985.155955:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201986.116024:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201986.179927:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201987.139871:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201987.203912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201987.331916:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201987.331926:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201987.331931:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201987.331942:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1268 00000100:00080000:3.0:1788201987.331954:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201987.331962:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788201987.332017:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728096128/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201987.332048:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201987.332055:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201987.332057:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201987.332060:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1268 00000100:00080000:3.0:1788201987.332064:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201987.332068:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788201987.332079:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788201987.332092:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728096256/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201987.332097:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728096128:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788201987.332180:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201987.332239:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201987/real 1788201987] req@ffff8bc1726cf800 x1875064728096128/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202012 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201987.332255:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728096128/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202012 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201987.332264:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201987.332268:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201987.332272:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728096128:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201987.332297:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728096256:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788201987.332314:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201987.332323:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201987/real 1788201987] req@ffff8bc1726cdf80 x1875064728096256/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202012 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201987.332331:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728096256/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202012 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201987.332337:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201987.332339:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201987.332342:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728096256:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201988.164029:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201988.228082:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201989.187941:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201989.251944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201990.212022:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201990.275869:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201991.235911:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201991.299896:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201992.259931:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201992.323904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788201992.451938:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201992.451946:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788201992.451949:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201992.451957:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1273 00000100:00080000:2.0:1788201992.451966:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201992.451972:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788201992.452005:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ca80 x1875064728096384/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201992.452030:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788201992.452033:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201992.452034:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201992.452037:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1273 00000100:00080000:2.0:1788201992.452039:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201992.452041:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788201992.452049:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788201992.452058:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257fb80 x1875064728096512/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201992.452081:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728096384:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788201992.452135:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201992.452180:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201992/real 1788201992] req@ffff8bc17257ca80 x1875064728096384/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202017 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201992.452195:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ca80 x1875064728096384/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202017 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201992.452204:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201992.452207:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201992.452210:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728096384:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201992.452215:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728096512:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788201992.452231:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201992.452238:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201992/real 1788201992] req@ffff8bc17257fb80 x1875064728096512/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202017 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201992.452247:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257fb80 x1875064728096512/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202017 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201992.452253:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201992.452254:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201992.452257:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728096512:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788201993.283959:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201993.347933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201994.307990:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201994.371930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201995.331894:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201995.395854:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788201996.355943:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201996.419862:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201997.379894:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201997.443856:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788201997.571917:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201997.571931:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201997.571937:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201997.571951:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1278 00000100:00080000:3.0:1788201997.571965:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201997.571981:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788201997.572028:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728096640/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201997.572055:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201997.572059:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201997.572061:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201997.572065:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1278 00000100:00080000:3.0:1788201997.572069:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201997.572074:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788201997.572087:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788201997.572103:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728096768/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201997.572109:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728096640:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788201997.572190:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201997.572249:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201997/real 1788201997] req@ffff8bc1726cdf80 x1875064728096640/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202022 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201997.572270:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728096640/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202022 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201997.572283:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201997.572287:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201997.572292:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728096640:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788201997.572329:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728096768:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788201997.572366:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788201997.572381:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788201997/real 1788201997] req@ffff8bc1726cf800 x1875064728096768/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202022 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201997.572395:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728096768/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202022 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201997.572412:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201997.572416:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788201997.572420:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728096768:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788201998.404004:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201998.467910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788201999.427963:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201999.491877:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202000.451967:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202000.515848:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202001.475877:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202001.539873:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202002.499884:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202002.563898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202002.691954:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202002.691969:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202002.691975:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202002.691988:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1284 00000100:00080000:2.0:1788202002.692001:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202002.692011:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202002.692051:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ea00 x1875064728096896/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202002.692083:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202002.692087:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202002.692089:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202002.692093:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1284 00000100:00080000:2.0:1788202002.692096:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202002.692100:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202002.692110:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202002.692122:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ce00 x1875064728097024/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202002.692153:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728096896:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788202002.692220:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202002.692307:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202002/real 1788202002] req@ffff8bc17257ea00 x1875064728096896/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202027 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202002.692326:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ea00 x1875064728096896/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202027 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202002.692336:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202002.692340:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202002.692344:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728096896:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202002.692351:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728097024:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202002.692373:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202002.692384:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202002/real 1788202002] req@ffff8bc17257ce00 x1875064728097024/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202027 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202002.692394:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ce00 x1875064728097024/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202027 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202002.692401:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202002.692404:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202002.692406:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728097024:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202003.523919:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202003.587900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202004.547982:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202004.611920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202005.571876:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202005.635890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202006.595926:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202006.659921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202007.619934:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202007.683906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202007.811884:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202007.811892:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202007.811895:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202007.811903:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1289 00000100:00080000:2.0:1788202007.811913:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202007.811920:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202007.811960:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d880 x1875064728097152/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202007.811987:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202007.812002:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202007.812004:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202007.812006:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1289 00000100:00080000:2.0:1788202007.812009:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202007.812012:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202007.812020:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202007.812031:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ed80 x1875064728097280/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202007.812051:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728097152:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788202007.812105:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202007.812154:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202007/real 1788202007] req@ffff8bc17257d880 x1875064728097152/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202032 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202007.812187:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d880 x1875064728097152/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202032 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202007.812211:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202007.812216:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202007.812221:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728097152:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202007.812227:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728097280:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202007.812247:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202007.812257:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202007/real 1788202007] req@ffff8bc17257ed80 x1875064728097280/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202032 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202007.812266:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ed80 x1875064728097280/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202032 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202007.812273:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202007.812275:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202007.812285:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728097280:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202008.643986:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202008.707991:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202009.667979:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202009.731919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202010.691971:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202010.755865:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202011.715930:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202011.779890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202012.739960:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202012.803894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202012.931961:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202012.931970:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202012.931973:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202012.931982:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1294 00000100:00080000:0.0:1788202012.931999:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202012.932006:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202012.932058:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142d80 x1875064728097408/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202012.932111:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202012.932115:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202012.932117:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202012.932122:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1294 00000100:00080000:0.0:1788202012.932126:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202012.932131:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202012.932141:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202012.932168:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728097408:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202012.932170:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141180 x1875064728097536/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788202012.932249:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202012.932308:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202012/real 1788202012] req@ffff8bc144142d80 x1875064728097408/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202037 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202012.932331:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142d80 x1875064728097408/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202037 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202012.932343:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202012.932348:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202012.932353:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728097408:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202012.932380:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728097536:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202012.932406:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202012.932421:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202012/real 1788202012] req@ffff8bc144141180 x1875064728097536/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202037 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202012.932436:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141180 x1875064728097536/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202037 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202012.932446:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202012.932450:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202012.932454:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728097536:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202013.763935:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202013.827947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202014.787954:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202014.851939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202015.811899:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202015.875896:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202016.835951:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202016.899864:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202017.859961:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202017.923877:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202018.051900:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202018.051912:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202018.051917:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202018.051927:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1299 00000100:00080000:3.0:1788202018.051936:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202018.051942:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202018.051978:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728097664/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202018.052036:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202018.052040:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202018.052043:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202018.052046:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1299 00000100:00080000:3.0:1788202018.052050:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202018.052054:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202018.052063:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202018.052075:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728097792/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202018.052081:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728097664:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202018.052152:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202018.052207:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202018/real 1788202018] req@ffff8bc1726cc700 x1875064728097664/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202018.052227:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728097664/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202018.052238:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202018.052242:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202018.052247:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728097664:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202018.052271:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728097792:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202018.052294:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202018.052306:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202018/real 1788202018] req@ffff8bc1726cd180 x1875064728097792/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202018.052319:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728097792/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202018.052328:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202018.052332:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202018.052336:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728097792:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202018.883953:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202018.947897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202019.907921:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202019.971913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202020.932012:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202020.995932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202021.955905:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202022.019904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202022.979977:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202023.043928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202023.171976:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202023.171990:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202023.171996:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202023.172009:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1304 00000100:00080000:2.0:1788202023.172024:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202023.172033:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202023.172085:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e680 x1875064728097920/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202023.172117:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202023.172121:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202023.172122:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202023.172125:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1304 00000100:00080000:2.0:1788202023.172128:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202023.172131:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202023.172142:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202023.172160:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257df80 x1875064728098048/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202023.172168:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728097920:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788202023.172246:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202023.172305:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202023/real 1788202023] req@ffff8bc17257e680 x1875064728097920/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202023.172327:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e680 x1875064728097920/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202023.172341:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202023.172346:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202023.172351:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728097920:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202023.172382:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728098048:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202023.172407:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202023.172420:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202023/real 1788202023] req@ffff8bc17257df80 x1875064728098048/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202023.172435:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257df80 x1875064728098048/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202023.172445:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202023.172449:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202023.172453:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728098048:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202024.003939:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202024.067963:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202025.027999:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202025.091918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202026.051947:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202026.115956:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202027.076017:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202027.139946:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202028.099963:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202028.163933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202028.291941:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202028.291951:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202028.291956:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202028.291967:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1309 00000100:00080000:2.0:1788202028.291980:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202028.291987:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202028.292033:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c000 x1875064728098176/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202028.292062:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202028.292065:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202028.292066:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202028.292070:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1309 00000100:00080000:2.0:1788202028.292072:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202028.292074:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202028.292083:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202028.292093:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f480 x1875064728098304/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202028.292123:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728098176:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788202028.292199:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202028.292263:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202028/real 1788202028] req@ffff8bc17257c000 x1875064728098176/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202053 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202028.292278:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c000 x1875064728098176/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202053 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202028.292288:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202028.292292:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202028.292296:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728098176:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202028.292302:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728098304:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202028.292324:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202028.292337:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202028/real 1788202028] req@ffff8bc17257f480 x1875064728098304/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202053 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202028.292351:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f480 x1875064728098304/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202053 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202028.292361:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202028.292365:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202028.292369:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728098304:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202029.124062:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202029.188046:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202030.147986:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202030.211916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202031.172075:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202031.235938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202032.195934:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202032.259912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202033.220060:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202033.283916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202033.411897:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202033.411908:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202033.411911:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202033.411920:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1314 00000100:00080000:2.0:1788202033.411929:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202033.411936:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202033.411972:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257dc00 x1875064728098432/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202033.412005:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202033.412013:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202033.412015:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202033.412020:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1314 00000100:00080000:2.0:1788202033.412024:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202033.412029:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202033.412038:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202033.412061:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728098432:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202033.412064:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f800 x1875064728098560/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788202033.412119:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202033.412169:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202033/real 1788202033] req@ffff8bc17257dc00 x1875064728098432/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202058 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202033.412187:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257dc00 x1875064728098432/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202058 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202033.412195:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202033.412198:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202033.412201:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728098432:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202033.412221:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728098560:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202033.412237:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202033.412245:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202033/real 1788202033] req@ffff8bc17257f800 x1875064728098560/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202058 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202033.412253:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f800 x1875064728098560/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202058 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202033.412259:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202033.412260:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202033.412262:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728098560:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202034.243951:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202034.308028:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202035.268042:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202035.332006:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202036.291902:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202036.355953:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202037.316041:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202037.379955:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202038.339940:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202038.403904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202038.531912:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202038.531921:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202038.531924:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202038.531933:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1319 00000100:00080000:3.0:1788202038.531942:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202038.531954:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202038.531988:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728098688/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202038.532015:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202038.532020:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202038.532022:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202038.532026:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1319 00000100:00080000:3.0:1788202038.532030:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202038.532035:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202038.532045:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202038.532056:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728098688:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202038.532063:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728098816/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788202038.532114:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202038.532150:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202038/real 1788202038] req@ffff8bc1726cf100 x1875064728098688/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202063 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202038.532164:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728098688/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202063 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202038.532172:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202038.532175:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202038.532178:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728098688:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202038.532200:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728098816:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202038.532215:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202038.532222:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202038/real 1788202038] req@ffff8bc1726cf480 x1875064728098816/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202063 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202038.532239:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728098816/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202063 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202038.532248:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202038.532250:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202038.532252:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728098816:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202039.364025:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202039.427912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202040.388014:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202040.451931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202041.412001:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202041.475891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202042.435969:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202042.499882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202043.459918:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202043.523901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202043.651912:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202043.651924:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202043.651928:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202043.651939:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1325 00000100:00080000:3.0:1788202043.651951:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202043.651959:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202043.652000:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728098944/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202043.652031:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202043.652035:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202043.652037:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202043.652040:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1325 00000100:00080000:3.0:1788202043.652043:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202043.652046:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202043.652054:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202043.652065:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728099072/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202043.652080:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728098944:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202043.652182:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728099072:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202044.483888:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202044.547926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202045.507898:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202045.571876:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202046.531935:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202046.595893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788202046.724154:0:10042:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788202046.724204:0:10042:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788202046.724220:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:0.0:1788202046.726730:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202043/real 1788202046] req@ffff8bc1726cd500 x1875064728098944/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202068 ref 2 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000800:00000100:1.0:1788202046.726745:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:0.0:1788202046.726773:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728098944/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202068 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202046.726874:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202046.726895:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202046.726900:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728098944:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202046.726926:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202043/real 1788202046] req@ffff8bc1726cca80 x1875064728099072/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202068 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202046.726939:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728099072/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202068 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202046.726946:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202046.726949:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202046.726951:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728099072:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202047.556000:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202047.619930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202048.579991:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202048.643908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202048.771913:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202048.771927:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202048.771931:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202048.771942:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1330 00000100:00080000:3.0:1788202048.771953:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202048.771963:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202048.772004:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728099200/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202048.772034:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202048.772039:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202048.772041:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202048.772046:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1330 00000100:00080000:3.0:1788202048.772051:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202048.772056:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202048.772068:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202048.772076:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728099200:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202048.772085:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728099328/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788202048.772132:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202048.772182:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202048/real 1788202048] req@ffff8bc1726cfb80 x1875064728099200/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202073 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202048.772203:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728099200/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202073 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202048.772214:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202048.772219:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202048.772230:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728099200:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202048.772263:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728099328:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202048.772287:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202048.772300:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202048/real 1788202048] req@ffff8bc1726ced80 x1875064728099328/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202073 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202048.772312:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728099328/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202073 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202048.772321:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202048.772324:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202048.772327:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728099328:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202049.604042:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202049.667937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202050.628008:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202050.691949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202051.652023:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202051.715923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202052.675953:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202052.739961:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202053.699999:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202053.763878:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202053.891980:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202053.891993:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202053.892004:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202053.892022:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1335 00000100:00080000:0.0:1788202053.892037:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202053.892046:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202053.892105:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141180 x1875064728099456/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202053.892141:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202053.892147:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202053.892149:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202053.892152:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1335 00000100:00080000:0.0:1788202053.892155:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202053.892160:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202053.892171:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202053.892184:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142d80 x1875064728099584/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202053.892189:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728099456:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202053.892264:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202053.892334:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202053/real 1788202053] req@ffff8bc144141180 x1875064728099456/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202078 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202053.892364:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141180 x1875064728099456/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202078 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202053.892413:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202053.892418:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202053.892422:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728099456:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202053.892454:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728099584:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202053.892480:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202053.892495:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202053/real 1788202053] req@ffff8bc144142d80 x1875064728099584/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202078 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202053.892510:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142d80 x1875064728099584/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202078 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202053.892527:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202053.892529:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202053.892532:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728099584:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202054.724006:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202054.787951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202055.747984:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202055.811938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202056.771949:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202056.835984:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202057.795951:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202057.859920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202058.819946:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202058.883953:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202059.011907:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202059.011922:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202059.011927:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202059.011939:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1340 00000100:00080000:2.0:1788202059.011952:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202059.011960:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202059.012015:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f800 x1875064728099712/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202059.012045:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202059.012049:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202059.012051:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202059.012056:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1340 00000100:00080000:2.0:1788202059.012060:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202059.012065:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202059.012076:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202059.012086:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728099712:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202059.012091:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257dc00 x1875064728099840/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788202059.012164:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202059.012214:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202059/real 1788202059] req@ffff8bc17257f800 x1875064728099712/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202059.012229:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f800 x1875064728099712/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202059.012237:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202059.012241:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202059.012244:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728099712:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202059.012274:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728099840:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202059.012304:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202059.012314:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202059/real 1788202059] req@ffff8bc17257dc00 x1875064728099840/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202059.012322:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257dc00 x1875064728099840/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202059.012329:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202059.012331:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202059.012333:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728099840:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202059.844027:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202059.907972:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202060.868010:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202060.931909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202061.892039:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202061.955889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202062.915937:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202062.979851:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202063.940008:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202064.003886:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202064.131887:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202064.131896:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202064.131900:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202064.131910:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1345 00000100:00080000:2.0:1788202064.131919:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202064.131929:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202064.131962:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f480 x1875064728099968/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202064.131986:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202064.131995:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202064.131996:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202064.131999:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1345 00000100:00080000:2.0:1788202064.132001:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202064.132005:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202064.132013:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202064.132022:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c000 x1875064728100096/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202064.132034:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728099968:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788202064.132107:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202064.132163:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202064/real 1788202064] req@ffff8bc17257f480 x1875064728099968/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202064.132181:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f480 x1875064728099968/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202064.132190:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202064.132194:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202064.132212:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728099968:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202064.132232:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728100096:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202064.132251:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202064.132261:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202064/real 1788202064] req@ffff8bc17257c000 x1875064728100096/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202064.132269:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c000 x1875064728100096/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202064.132280:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202064.132282:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202064.132285:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728100096:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202064.963876:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202065.027926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202065.988032:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202066.051850:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202067.011958:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202067.075861:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202068.036069:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202068.099837:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202069.059962:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202069.123900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202069.251879:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202069.251891:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202069.251895:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202069.251906:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1350 00000100:00080000:2.0:1788202069.251918:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202069.251927:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202069.251967:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257df80 x1875064728100224/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202069.252024:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202069.252030:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202069.252032:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788202069.252039:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728100224:192.168.201.143@tcp:250:kworker.0 00000100:00080000:2.0:1788202069.252039:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1350 00000100:00080000:2.0:1788202069.252049:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202069.252057:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202069.252067:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202069.252084:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e680 x1875064728100352/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788202069.252099:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202069.252163:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202069/real 1788202069] req@ffff8bc17257df80 x1875064728100224/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202094 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202069.252178:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257df80 x1875064728100224/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202094 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202069.252186:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202069.252189:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202069.252192:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728100224:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202069.252212:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728100352:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202069.252230:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202069.252238:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202069/real 1788202069] req@ffff8bc17257e680 x1875064728100352/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202094 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202069.252246:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e680 x1875064728100352/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202094 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202069.252252:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202069.252254:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202069.252256:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728100352:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202070.083995:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202070.147942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202071.107921:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202071.171920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202072.131921:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202072.195902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202073.155944:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202073.219871:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202074.179986:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202074.243962:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202074.371930:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202074.371940:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202074.371944:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202074.371955:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1355 00000100:00080000:3.0:1788202074.371965:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202074.371973:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202074.372010:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728100480/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202074.372069:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202074.372073:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202074.372074:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202074.372077:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1355 00000100:00080000:3.0:1788202074.372080:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202074.372084:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202074.372092:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202074.372104:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728100608/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202074.372109:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728100480:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788202074.372177:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202074.372229:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202074/real 1788202074] req@ffff8bc1726cea00 x1875064728100480/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202099 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202074.372243:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728100480/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202099 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202074.372257:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202074.372260:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202074.372263:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728100480:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202074.372287:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728100608:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202074.372306:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202074.372319:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202074/real 1788202074] req@ffff8bc1726ce300 x1875064728100608/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202099 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202074.372332:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728100608/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202099 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202074.372341:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202074.372345:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202074.372349:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728100608:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202075.203893:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202075.267973:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202076.227982:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202076.291918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202077.252028:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202077.315921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202078.276002:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202078.339971:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202079.299990:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202079.363961:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202079.491874:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202079.491882:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202079.491885:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202079.491893:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1360 00000100:00080000:2.0:1788202079.491901:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202079.491906:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202079.491966:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ed80 x1875064728100736/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202079.491992:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202079.491996:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202079.491997:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202079.492001:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1360 00000100:00080000:2.0:1788202079.492004:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202079.492006:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202079.492014:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202079.492024:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d880 x1875064728100864/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202079.492035:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728100736:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788202079.492096:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202079.492146:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202079/real 1788202079] req@ffff8bc17257ed80 x1875064728100736/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202104 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202079.492165:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ed80 x1875064728100736/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202104 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202079.492175:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202079.492179:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202079.492183:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728100736:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202079.492204:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728100864:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202079.492223:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202079.492233:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202079/real 1788202079] req@ffff8bc17257d880 x1875064728100864/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202104 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202079.492244:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d880 x1875064728100864/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202104 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202079.492252:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202079.492255:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202079.492258:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728100864:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202080.324017:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202080.387973:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202081.347945:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202081.411939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202082.372012:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202082.435946:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202083.395983:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202083.459926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202084.419979:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202084.483931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202084.611949:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202084.611959:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202084.611963:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202084.611974:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1365 00000100:00080000:0.0:1788202084.611987:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202084.611995:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202084.612045:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142680 x1875064728100992/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202084.612074:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202084.612076:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202084.612078:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202084.612080:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1365 00000100:00080000:0.0:1788202084.612083:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202084.612086:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202084.612096:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202084.612111:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140a80 x1875064728101120/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202084.612114:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728100992:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202084.612186:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202084.612238:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202084/real 1788202084] req@ffff8bc144142680 x1875064728100992/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202109 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202084.612253:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142680 x1875064728100992/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202109 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202084.612261:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202084.612264:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202084.612267:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728100992:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202084.612289:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728101120:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202084.612303:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202084.612311:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202084/real 1788202084] req@ffff8bc144140a80 x1875064728101120/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202109 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202084.612318:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140a80 x1875064728101120/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202109 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202084.612323:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202084.612325:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202084.612327:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728101120:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202085.443985:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202085.507911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202086.467980:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202086.531929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202087.491899:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202087.555900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202088.515972:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202088.579910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202089.539901:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202089.603947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202089.731918:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202089.731930:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202089.731935:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202089.731947:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1371 00000100:00080000:2.0:1788202089.731960:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202089.731978:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202089.732023:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ce00 x1875064728101248/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202089.732051:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202089.732055:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202089.732057:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202089.732061:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1371 00000100:00080000:2.0:1788202089.732065:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202089.732070:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202089.732081:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202089.732086:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728101248:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202089.732099:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ea00 x1875064728101376/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788202089.732157:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202089.732208:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202089/real 1788202089] req@ffff8bc17257ce00 x1875064728101248/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202114 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202089.732223:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ce00 x1875064728101248/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202114 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202089.732232:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202089.732235:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202089.732239:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728101248:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202089.732262:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728101376:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202089.732277:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202089.732284:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202089/real 1788202089] req@ffff8bc17257ea00 x1875064728101376/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202114 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202089.732292:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ea00 x1875064728101376/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202114 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202089.732297:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202089.732299:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202089.732301:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728101376:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202090.563978:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202090.627941:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202091.587988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202091.651946:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202092.611997:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202092.675876:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202093.635950:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202093.699930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202094.659962:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202094.723949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202094.851950:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202094.851963:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202094.851969:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202094.851980:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1376 00000100:00080000:0.0:1788202094.851994:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202094.852002:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202094.852048:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140000 x1875064728101504/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202094.852082:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202094.852086:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202094.852089:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202094.852094:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1376 00000100:00080000:0.0:1788202094.852098:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202094.852103:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202094.852113:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728101504:192.168.201.143@tcp:250:kworker.0 00000008:00100000:0.0:1788202094.852116:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202094.852132:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143100 x1875064728101632/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788202094.852180:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202094.852231:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202094/real 1788202094] req@ffff8bc144140000 x1875064728101504/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202119 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202094.852247:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140000 x1875064728101504/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202119 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202094.852255:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202094.852258:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202094.852262:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728101504:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202094.852282:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728101632:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202094.852296:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202094.852304:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202094/real 1788202094] req@ffff8bc144143100 x1875064728101632/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202119 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202094.852315:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143100 x1875064728101632/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202119 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202094.852323:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202094.852326:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202094.852330:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728101632:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202095.683967:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202095.747994:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202096.707971:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202096.771952:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202097.731909:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202097.795882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202098.755994:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202098.819955:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202099.779942:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202099.843939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202099.971966:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202099.971979:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202099.971985:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202099.972005:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1381 00000100:00080000:3.0:1788202099.972020:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202099.972029:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202099.972076:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728101760/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202099.972109:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202099.972113:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202099.972115:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202099.972119:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1381 00000100:00080000:3.0:1788202099.972123:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202099.972127:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202099.972138:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202099.972151:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728101888/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202099.972159:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728101760:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202099.972226:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202099.972279:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202099/real 1788202099] req@ffff8bc1726cc380 x1875064728101760/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202124 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202099.972295:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728101760/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202124 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202099.972303:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202099.972306:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202099.972309:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728101760:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202099.972337:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728101888:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202099.972352:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202099.972360:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202099/real 1788202099] req@ffff8bc1726ce680 x1875064728101888/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202124 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202099.972368:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728101888/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202124 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202099.972373:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202099.972375:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202099.972377:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728101888:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202100.804046:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202100.868044:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202101.827901:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202101.891887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202102.851983:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202102.915854:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202103.875988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202103.939926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202104.899973:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202104.963907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202105.091967:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202105.091981:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202105.091986:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202105.091999:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1386 00000100:00080000:2.0:1788202105.092012:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202105.092019:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202105.092064:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257fb80 x1875064728102016/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202105.092095:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202105.092099:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202105.092101:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202105.092105:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1386 00000100:00080000:2.0:1788202105.092107:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202105.092111:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202105.092121:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202105.092132:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ca80 x1875064728102144/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202105.092157:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728102016:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788202105.092235:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202105.092293:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202105/real 1788202105] req@ffff8bc17257fb80 x1875064728102016/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202105.092313:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257fb80 x1875064728102016/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202105.092324:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202105.092329:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202105.092333:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728102016:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202105.092362:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728102144:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202105.092385:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202105.092398:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202105/real 1788202105] req@ffff8bc17257ca80 x1875064728102144/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202105.092411:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ca80 x1875064728102144/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202105.092420:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202105.092424:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202105.092427:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728102144:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202105.923916:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202105.987948:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202106.948021:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202107.011923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202107.971917:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202108.035907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202108.995958:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202109.059947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202110.019948:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202110.083889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202110.211913:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202110.211930:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202110.211934:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202110.211942:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1391 00000100:00080000:2.0:1788202110.211953:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202110.211961:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202110.212001:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e300 x1875064728102272/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202110.212029:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202110.212032:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202110.212033:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202110.212037:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1391 00000100:00080000:2.0:1788202110.212040:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202110.212045:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202110.212055:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202110.212070:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c380 x1875064728102400/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202110.212089:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728102272:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202110.212194:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728102400:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202111.044011:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202111.107939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202112.067889:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202112.131879:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202113.092037:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202113.155944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788202113.284237:0:10043:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788202113.284298:0:10043:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788202113.284329:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788202113.284392:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:0.0:1788202113.284479:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202110/real 1788202113] req@ffff8bc17257c380 x1875064728102400/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202135 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202113.284527:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c380 x1875064728102400/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202135 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202113.284544:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202113.284550:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202113.284555:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728102400:192.168.201.143@tcp:38:kworker.0 00000100:00100000:0.0:1788202113.284565:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202110/real 1788202113] req@ffff8bc17257e300 x1875064728102272/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202135 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202113.284580:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e300 x1875064728102272/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202135 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202113.284589:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202113.284593:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202113.284596:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728102272:192.168.201.143@tcp:250:kworker.0 00010000:00010000:1.0:1788202114.116012:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202114.179872:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202115.140032:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202115.203902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202115.331922:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202115.331936:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202115.331940:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202115.331948:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1396 00000100:00080000:2.0:1788202115.331958:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202115.331964:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202115.331995:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d500 x1875064728102528/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202115.332014:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202115.332018:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202115.332020:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202115.332024:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1396 00000100:00080000:2.0:1788202115.332028:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202115.332033:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202115.332043:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202115.332054:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728102528:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202115.332061:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f100 x1875064728102656/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788202115.332141:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202115.332204:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202115/real 1788202115] req@ffff8bc17257d500 x1875064728102528/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202140 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202115.332228:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d500 x1875064728102528/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202140 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202115.332242:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202115.332246:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202115.332250:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728102528:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202115.332282:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728102656:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202115.332335:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202115.332353:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202115/real 1788202115] req@ffff8bc17257f100 x1875064728102656/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202140 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202115.332368:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f100 x1875064728102656/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202140 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202115.332378:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202115.332382:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202115.332386:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728102656:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202116.163974:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202116.227956:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202117.188028:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202117.251925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202118.211963:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202118.275903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202119.235985:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202119.299915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202120.259925:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202120.323893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202120.451953:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202120.451965:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202120.451969:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202120.451980:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1401 00000100:00080000:0.0:1788202120.451990:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202120.451998:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202120.452036:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143800 x1875064728102784/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202120.452066:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202120.452070:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202120.452072:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202120.452076:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1401 00000100:00080000:0.0:1788202120.452080:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202120.452084:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202120.452093:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202120.452107:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140380 x1875064728102912/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202120.452116:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728102784:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202120.452176:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202120.452242:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202120/real 1788202120] req@ffff8bc144143800 x1875064728102784/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202145 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202120.452263:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143800 x1875064728102784/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202145 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202120.452274:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202120.452279:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202120.452283:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728102784:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202120.452305:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728102912:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202120.452324:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202120.452333:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202120/real 1788202120] req@ffff8bc144140380 x1875064728102912/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202145 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202120.452342:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140380 x1875064728102912/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202145 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202120.452348:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202120.452350:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202120.452352:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728102912:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202121.283966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202121.347941:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202122.307939:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202122.371860:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202123.331987:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202123.395888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202124.355986:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202124.419917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202125.379993:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202125.443930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202125.571898:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202125.571909:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202125.571913:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202125.571924:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1406 00000100:00080000:0.0:1788202125.571935:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202125.571943:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202125.571980:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142300 x1875064728103040/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202125.572008:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202125.572012:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202125.572014:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202125.572018:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1406 00000100:00080000:0.0:1788202125.572023:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202125.572028:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202125.572038:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202125.572053:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141f80 x1875064728103168/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202125.572067:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728103040:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202125.572154:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202125.572214:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202125/real 1788202125] req@ffff8bc144142300 x1875064728103040/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202150 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202125.572235:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142300 x1875064728103040/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202150 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202125.572246:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202125.572251:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202125.572256:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728103040:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202125.572282:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728103168:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202125.572307:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202125.572321:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202125/real 1788202125] req@ffff8bc144141f80 x1875064728103168/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202150 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202125.572335:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141f80 x1875064728103168/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202150 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202125.572344:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202125.572347:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202125.572351:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728103168:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202126.403976:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202126.467983:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202127.427987:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202127.491871:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202128.451943:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202128.515894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202129.475951:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202129.539879:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202130.499947:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202130.563856:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202130.691905:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202130.691913:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202130.691917:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202130.691925:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1412 00000100:00080000:3.0:1788202130.691934:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202130.691941:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202130.691973:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728103296/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202130.692001:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202130.692005:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202130.692007:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202130.692011:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1412 00000100:00080000:3.0:1788202130.692015:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202130.692019:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202130.692029:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202130.692077:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728103424/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202130.692123:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728103296:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202130.692188:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202130.692251:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202130/real 1788202130] req@ffff8bc1726cdc00 x1875064728103296/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202155 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202130.692273:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728103296/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202155 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202130.692284:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202130.692288:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202130.692293:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728103296:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202130.692301:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728103424:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202130.692325:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202130.692336:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202130/real 1788202130] req@ffff8bc1726cce00 x1875064728103424/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202155 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202130.692346:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728103424/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202155 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202130.692356:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202130.692359:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202130.692363:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728103424:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202131.523922:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202131.587932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202132.547903:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202132.611852:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202133.571915:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202133.635889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202134.595901:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202134.659882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202135.619998:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202135.683896:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202135.811944:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202135.811968:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202135.811972:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202135.811983:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1417 00000100:00080000:2.0:1788202135.811994:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202135.812002:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202135.812045:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d180 x1875064728103552/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202135.812075:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202135.812080:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202135.812082:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202135.812086:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1417 00000100:00080000:2.0:1788202135.812089:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202135.812094:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202135.812103:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202135.812116:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c700 x1875064728103680/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202135.812140:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728103552:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788202135.812203:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202135.812273:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202135/real 1788202135] req@ffff8bc17257d180 x1875064728103552/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202160 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202135.812295:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d180 x1875064728103552/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202160 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202135.812306:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202135.812311:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202135.812316:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728103552:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202135.812340:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728103680:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202135.812365:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202135.812378:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202135/real 1788202135] req@ffff8bc17257c700 x1875064728103680/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202160 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202135.812397:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c700 x1875064728103680/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202160 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202135.812406:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202135.812409:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202135.812412:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728103680:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202136.643882:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202136.707929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202137.667975:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202137.731895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202138.691915:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202138.755929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202139.716012:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202139.779940:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202140.739931:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202140.803909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202140.931876:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202140.931887:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202140.931892:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202140.931904:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1422 00000100:00080000:2.0:1788202140.931915:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202140.931924:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202140.931972:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c700 x1875064728103808/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202140.932000:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202140.932003:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202140.932005:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202140.932008:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1422 00000100:00080000:2.0:1788202140.932013:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202140.932018:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202140.932028:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202140.932045:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d180 x1875064728103936/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202140.932047:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728103808:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788202140.932110:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202140.932154:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202140/real 1788202140] req@ffff8bc17257c700 x1875064728103808/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202140.932170:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c700 x1875064728103808/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202140.932184:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202140.932187:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202140.932190:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728103808:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202140.932215:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728103936:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202140.932231:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202140.932240:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202140/real 1788202140] req@ffff8bc17257d180 x1875064728103936/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202140.932249:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d180 x1875064728103936/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202140.932255:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202140.932257:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202140.932259:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728103936:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202141.764000:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202141.828244:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202142.787910:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202142.851944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202143.812046:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202143.875906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202144.835979:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202144.899912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202145.860031:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202145.923939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202146.051936:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202146.051947:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202146.051951:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202146.051969:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1427 00000100:00080000:3.0:1788202146.051981:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202146.051988:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202146.052040:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728104064/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202146.052083:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202146.052087:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202146.052089:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202146.052093:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1427 00000100:00080000:3.0:1788202146.052097:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202146.052101:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202146.052112:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202146.052129:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728104192/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202146.052145:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728104064:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788202146.052215:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202146.052276:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202146/real 1788202146] req@ffff8bc1726cce00 x1875064728104064/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202146.052292:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728104064/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202146.052301:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202146.052305:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202146.052310:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728104064:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202146.052343:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728104192:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202146.052370:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202146.052385:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202146/real 1788202146] req@ffff8bc1726cdc00 x1875064728104192/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202146.052401:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728104192/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202146.052419:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202146.052423:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202146.052426:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728104192:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202146.883925:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202146.947945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202147.908013:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202147.971934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202148.931908:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202148.995894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202149.955973:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202150.019945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202150.979922:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202151.043864:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202151.171912:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202151.171924:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202151.171928:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202151.171939:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1432 00000100:00080000:2.0:1788202151.171952:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202151.171958:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202151.172015:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f100 x1875064728104320/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202151.172041:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202151.172044:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202151.172045:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202151.172048:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1432 00000100:00080000:2.0:1788202151.172051:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202151.172054:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202151.172063:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202151.172072:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d500 x1875064728104448/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202151.172113:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728104320:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788202151.172182:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202151.172231:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202151/real 1788202151] req@ffff8bc17257f100 x1875064728104320/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202151.172247:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f100 x1875064728104320/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202151.172256:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202151.172259:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202151.172262:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728104320:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202151.172268:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728104448:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202151.172284:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202151.172292:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202151/real 1788202151] req@ffff8bc17257d500 x1875064728104448/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202151.172300:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d500 x1875064728104448/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202151.172306:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202151.172308:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202151.172310:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728104448:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202152.004026:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202152.067949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202153.027932:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202153.091855:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202154.051982:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202154.115939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202155.076007:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202155.139921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202156.100009:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202156.163955:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202156.291960:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202156.291974:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202156.291980:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202156.291995:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1437 00000100:00080000:0.0:1788202156.292009:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202156.292018:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202156.292071:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143b80 x1875064728104576/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202156.292109:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202156.292113:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202156.292116:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202156.292121:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1437 00000100:00080000:0.0:1788202156.292126:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202156.292133:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202156.292146:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202156.292146:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728104576:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202156.292167:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141500 x1875064728104704/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788202156.292228:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202156.292294:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202156/real 1788202156] req@ffff8bc144143b80 x1875064728104576/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202181 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202156.292313:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143b80 x1875064728104576/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202181 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202156.292322:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202156.292326:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202156.292329:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728104576:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202156.292354:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728104704:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202156.292373:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202156.292387:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202156/real 1788202156] req@ffff8bc144141500 x1875064728104704/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202181 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202156.292401:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141500 x1875064728104704/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202181 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202156.292410:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202156.292414:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202156.292418:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728104704:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202157.123941:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202157.187929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202158.147968:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202158.211944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202159.171972:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202159.235880:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202160.195934:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202160.259854:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202161.219970:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202161.283886:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202161.411945:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202161.411956:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202161.411962:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202161.411975:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1442 00000100:00080000:2.0:1788202161.411989:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202161.411999:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202161.412051:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e300 x1875064728104832/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202161.412080:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202161.412083:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202161.412085:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202161.412088:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1442 00000100:00080000:2.0:1788202161.412091:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202161.412095:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202161.412106:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202161.412120:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c380 x1875064728104960/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202161.412123:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728104832:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788202161.412212:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202161.412269:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202161/real 1788202161] req@ffff8bc17257e300 x1875064728104832/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202186 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202161.412291:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e300 x1875064728104832/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202186 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202161.412312:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202161.412316:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202161.412321:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728104832:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202161.412350:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728104960:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202161.412373:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202161.412386:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202161/real 1788202161] req@ffff8bc17257c380 x1875064728104960/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202186 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202161.412400:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c380 x1875064728104960/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202186 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202161.412410:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202161.412414:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202161.412418:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728104960:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202162.243974:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202162.307961:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202163.267928:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202163.331869:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202164.291996:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202164.355932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202165.315987:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202165.379897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202166.339989:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202166.403869:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202166.531910:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202166.531919:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202166.531922:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202166.531931:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1447 00000100:00080000:3.0:1788202166.531940:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202166.531948:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202166.531987:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728105088/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202166.532019:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202166.532023:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202166.532025:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202166.532029:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1447 00000100:00080000:3.0:1788202166.532033:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202166.532038:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202166.532048:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202166.532062:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728105216/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202166.532073:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728105088:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788202166.532136:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202166.532182:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202166/real 1788202166] req@ffff8bc1726ce680 x1875064728105088/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202191 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202166.532202:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728105088/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202191 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202166.532213:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202166.532218:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202166.532222:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728105088:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202166.532249:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728105216:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202166.532271:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202166.532283:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202166/real 1788202166] req@ffff8bc1726cc380 x1875064728105216/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202191 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202166.532298:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728105216/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202191 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202166.532308:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202166.532312:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202166.532316:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728105216:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202167.363962:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202167.427937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202168.387941:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202168.451872:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202169.411928:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202169.475893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202170.435975:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202170.499869:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202171.459925:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202171.523856:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202171.651877:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202171.651888:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202171.651893:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202171.651905:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1453 00000100:00080000:3.0:1788202171.651918:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202171.651927:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202171.651979:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728105344/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202171.652009:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202171.652012:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202171.652014:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202171.652017:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1453 00000100:00080000:3.0:1788202171.652020:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202171.652024:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202171.652034:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202171.652045:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728105472/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202171.652071:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728105344:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788202171.652152:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202171.652221:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202171/real 1788202171] req@ffff8bc1726ce300 x1875064728105344/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202196 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202171.652242:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728105344/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202196 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202171.652254:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202171.652259:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202171.652263:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728105344:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202171.652271:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728105472:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202171.652294:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202171.652306:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202171/real 1788202171] req@ffff8bc1726cea00 x1875064728105472/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202196 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202171.652319:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728105472/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202196 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202171.652342:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202171.652346:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202171.652350:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728105472:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202172.484004:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202172.547941:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202173.507954:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202173.571876:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202174.531964:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202174.595908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202175.555940:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202175.619958:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202176.579998:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202176.643952:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202176.771973:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202176.771986:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202176.771990:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202176.772001:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1458 00000100:00080000:0.0:1788202176.772012:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202176.772020:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202176.772074:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141880 x1875064728105600/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202176.772110:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202176.772122:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202176.772124:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202176.772129:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1458 00000100:00080000:0.0:1788202176.772133:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202176.772138:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202176.772149:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202176.772165:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143480 x1875064728105728/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202176.772198:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728105600:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202176.772381:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728105728:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202177.603908:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202177.667912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202178.627979:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202178.691924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202179.651942:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202179.715936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:0.0:1788202179.844064:0:10040:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:0.0:1788202179.844103:0:10040:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:0.0:1788202179.844116:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:0.0:1788202179.844150:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788202179.844257:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202176/real 1788202179] req@ffff8bc144143480 x1875064728105728/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202201 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202179.844278:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143480 x1875064728105728/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202201 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202179.844289:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202179.844295:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202179.844300:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728105728:192.168.201.143@tcp:38:kworker.0 00000100:00100000:2.0:1788202179.844308:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202176/real 1788202179] req@ffff8bc144141880 x1875064728105600/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202201 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202179.844322:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141880 x1875064728105600/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202201 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202179.844331:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202179.844334:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202179.844337:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728105600:192.168.201.143@tcp:250:kworker.0 00010000:00010000:3.0:1788202180.676040:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202180.739922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202181.699969:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202181.763934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202181.891946:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202181.891956:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202181.891959:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202181.891970:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1463 00000100:00080000:0.0:1788202181.891980:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202181.891986:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202181.892029:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142a00 x1875064728105856/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202181.892069:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202181.892074:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202181.892076:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202181.892080:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1463 00000100:00080000:0.0:1788202181.892083:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202181.892088:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202181.892104:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202181.892115:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140e00 x1875064728105984/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202181.892292:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728105856:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202181.892378:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202181.892449:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202181/real 1788202181] req@ffff8bc144142a00 x1875064728105856/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202206 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202181.892468:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142a00 x1875064728105856/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202206 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202181.892486:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202181.892490:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202181.892494:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728105856:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202181.892502:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728105984:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202181.892527:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202181.892541:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202181/real 1788202181] req@ffff8bc144140e00 x1875064728105984/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202206 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202181.892552:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140e00 x1875064728105984/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202206 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202181.892560:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202181.892564:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202181.892567:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728105984:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202182.724031:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202182.787899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202183.747936:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202183.811890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202184.771970:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202184.835900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202185.795903:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202185.859881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202186.819988:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202186.883881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202187.011915:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202187.011929:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202187.011935:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202187.011947:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1468 00000100:00080000:0.0:1788202187.011959:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202187.011966:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202187.012014:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140700 x1875064728106112/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202187.012044:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202187.012048:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202187.012050:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202187.012054:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1468 00000100:00080000:0.0:1788202187.012058:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202187.012075:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202187.012087:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202187.012102:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141c00 x1875064728106240/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202187.012116:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728106112:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202187.012175:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202187.012226:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202187/real 1788202187] req@ffff8bc144140700 x1875064728106112/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202187.012246:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140700 x1875064728106112/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202187.012257:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202187.012260:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202187.012263:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728106112:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202187.012281:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728106240:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202187.012297:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202187.012306:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202187/real 1788202187] req@ffff8bc144141c00 x1875064728106240/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202187.012313:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141c00 x1875064728106240/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202187.012318:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202187.012320:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202187.012322:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728106240:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202187.843946:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202187.907944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202188.867964:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202188.931925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202189.891862:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202189.955859:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202190.915973:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202190.979916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202191.940018:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202192.003897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202192.131929:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202192.131939:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202192.131944:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202192.131954:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1473 00000100:00080000:3.0:1788202192.131964:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202192.131999:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202192.132040:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728106368/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202192.132066:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202192.132072:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202192.132074:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202192.132078:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1473 00000100:00080000:3.0:1788202192.132081:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202192.132085:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202192.132095:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202192.132107:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728106496/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202192.132117:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728106368:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202192.132188:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202192.132245:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202192/real 1788202192] req@ffff8bc1726ced80 x1875064728106368/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202192.132259:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728106368/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202192.132268:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202192.132271:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202192.132275:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728106368:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202192.132301:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728106496:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202192.132317:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202192.132325:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202192/real 1788202192] req@ffff8bc1726cfb80 x1875064728106496/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202192.132332:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728106496/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202192.132337:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202192.132339:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202192.132341:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728106496:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202192.963945:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202193.027955:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202193.987960:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202194.051847:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202195.011978:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202195.075882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202196.035972:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202196.099865:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202197.059928:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202197.123875:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202197.251935:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202197.251947:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202197.251951:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202197.251961:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1478 00000100:00080000:2.0:1788202197.251971:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202197.251978:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202197.252027:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ca80 x1875064728106624/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202197.252056:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202197.252059:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202197.252061:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202197.252065:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1478 00000100:00080000:2.0:1788202197.252068:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202197.252073:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202197.252082:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202197.252095:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728106624:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202197.252096:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257fb80 x1875064728106752/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788202197.252156:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202197.252198:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202197/real 1788202197] req@ffff8bc17257ca80 x1875064728106624/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202222 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202197.252215:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ca80 x1875064728106624/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202222 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202197.252224:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202197.252228:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202197.252232:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728106624:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202197.252254:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728106752:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202197.252272:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202197.252280:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202197/real 1788202197] req@ffff8bc17257fb80 x1875064728106752/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202222 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202197.252287:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257fb80 x1875064728106752/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202222 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202197.252292:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202197.252294:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202197.252296:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728106752:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202198.083933:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202198.147891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202199.107965:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202199.171846:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202200.131954:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202200.195889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202201.155970:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202201.219925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202202.179969:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202202.244010:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202202.371971:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202202.371982:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202202.371986:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202202.371996:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1483 00000100:00080000:0.0:1788202202.372010:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202202.372018:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202202.372069:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141c00 x1875064728106880/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202202.372100:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202202.372103:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202202.372104:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202202.372107:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1483 00000100:00080000:0.0:1788202202.372110:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202202.372114:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202202.372125:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202202.372135:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140700 x1875064728107008/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202202.372170:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728106880:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202202.372264:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202202.372308:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202202/real 1788202202] req@ffff8bc144141c00 x1875064728106880/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202227 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202202.372322:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141c00 x1875064728106880/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202227 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202202.372331:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202202.372334:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202202.372337:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728106880:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202202.372343:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728107008:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202202.372367:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202202.372382:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202202/real 1788202202] req@ffff8bc144140700 x1875064728107008/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202227 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202202.372396:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140700 x1875064728107008/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202227 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202202.372403:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202202.372406:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202202.372408:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728107008:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202203.203989:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202203.267981:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202204.227953:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202204.291930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202205.251949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202205.315917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202206.275914:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202206.339903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202207.299945:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202207.363890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202207.491920:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202207.491932:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202207.491937:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202207.491949:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1488 00000100:00080000:2.0:1788202207.491961:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202207.491969:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202207.492006:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ea00 x1875064728107136/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202207.492035:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202207.492038:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202207.492040:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202207.492043:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1488 00000100:00080000:2.0:1788202207.492046:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202207.492049:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202207.492057:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202207.492068:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ce00 x1875064728107264/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202207.492085:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728107136:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788202207.492150:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202207.492197:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202207/real 1788202207] req@ffff8bc17257ea00 x1875064728107136/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202232 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202207.492215:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ea00 x1875064728107136/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202232 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202207.492226:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202207.492230:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202207.492233:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728107136:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202207.492259:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728107264:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202207.492282:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202207.492296:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202207/real 1788202207] req@ffff8bc17257ce00 x1875064728107264/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202232 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202207.492309:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ce00 x1875064728107264/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202232 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202207.492318:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202207.492321:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202207.492325:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728107264:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202208.323923:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202208.388028:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202209.347918:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202209.411887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202210.371919:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202210.435943:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202211.395955:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202211.459903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202212.419941:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202212.483910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202212.612422:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202212.612431:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202212.612436:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202212.612446:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1493 00000100:00080000:3.0:1788202212.612456:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202212.612464:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202212.612500:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728107392/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202212.612527:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202212.612531:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202212.612533:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202212.612537:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1493 00000100:00080000:3.0:1788202212.612551:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202212.612557:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202212.612566:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202212.612573:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728107392:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202212.612583:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728107520/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788202212.612663:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202212.612710:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202212/real 1788202212] req@ffff8bc1726cca80 x1875064728107392/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202237 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202212.612731:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728107392/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202237 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202212.612743:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202212.612747:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202212.612752:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728107392:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202212.612780:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728107520:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202212.612829:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202212.612851:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202212/real 1788202212] req@ffff8bc1726cd500 x1875064728107520/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202237 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202212.612881:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728107520/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202237 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202212.612890:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202212.612893:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202212.612895:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728107520:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202213.443984:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202213.507906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202214.467921:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202214.531872:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202215.491972:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202215.555876:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202216.515881:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202216.579912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202217.539956:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202217.603906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202217.731918:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202217.731928:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202217.731932:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202217.731943:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1499 00000100:00080000:3.0:1788202217.731955:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202217.731961:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202217.732014:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728107648/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202217.732040:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202217.732043:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202217.732044:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202217.732047:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1499 00000100:00080000:3.0:1788202217.732049:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202217.732051:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202217.732060:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202217.732068:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728107776/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202217.732126:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728107648:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788202217.732194:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202217.732243:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202217/real 1788202217] req@ffff8bc1726cf480 x1875064728107648/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202242 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202217.732258:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728107648/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202242 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202217.732266:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202217.732269:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202217.732272:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728107648:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202217.732277:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728107776:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202217.732290:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202217.732297:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202217/real 1788202217] req@ffff8bc1726cf100 x1875064728107776/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202242 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202217.732304:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728107776/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202242 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202217.732309:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202217.732311:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202217.732312:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728107776:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202218.563913:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202218.627973:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202219.588007:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202219.651894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202220.611914:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202220.675885:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202221.636016:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202221.699912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202222.659945:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202222.723946:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202222.851943:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202222.851951:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202222.851955:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202222.851963:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1504 00000100:00080000:2.0:1788202222.851972:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202222.851978:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202222.852016:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d880 x1875064728107904/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202222.852053:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202222.852056:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202222.852058:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202222.852061:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1504 00000100:00080000:2.0:1788202222.852064:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202222.852067:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202222.852075:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202222.852090:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ed80 x1875064728108032/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202222.852112:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728107904:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788202222.852190:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202222.852253:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202222/real 1788202222] req@ffff8bc17257d880 x1875064728107904/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202247 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202222.852270:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d880 x1875064728107904/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202247 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202222.852284:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202222.852287:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202222.852290:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728107904:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202222.852313:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728108032:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202222.852330:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202222.852338:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202222/real 1788202222] req@ffff8bc17257ed80 x1875064728108032/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202247 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202222.852346:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ed80 x1875064728108032/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202247 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202222.852351:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202222.852352:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202222.852354:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728108032:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202223.683950:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202223.748003:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202224.707922:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202224.771891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202225.732038:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202225.795907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202226.755920:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202226.819913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202227.779987:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202227.843905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202227.971866:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202227.971877:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202227.971881:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202227.971892:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1509 00000100:00080000:2.0:1788202227.971904:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202227.971910:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202227.971957:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e680 x1875064728108160/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202227.971988:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202227.971992:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202227.971994:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202227.971998:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1509 00000100:00080000:2.0:1788202227.972001:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202227.972005:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202227.972016:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202227.972031:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257df80 x1875064728108288/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202227.972063:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728108160:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788202227.972127:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202227.972181:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202227/real 1788202227] req@ffff8bc17257e680 x1875064728108160/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202252 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202227.972194:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e680 x1875064728108160/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202252 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202227.972202:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202227.972206:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202227.972209:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728108160:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202227.972216:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728108288:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202227.972233:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202227.972252:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202227/real 1788202227] req@ffff8bc17257df80 x1875064728108288/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202252 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202227.972261:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257df80 x1875064728108288/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202252 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202227.972267:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202227.972269:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202227.972271:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728108288:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202228.803888:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202228.867907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202229.828017:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202229.891956:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202230.851922:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202230.915939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202231.875960:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202231.939946:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202232.899965:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202232.963876:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202233.091915:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202233.091925:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202233.091930:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202233.091940:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1514 00000100:00080000:2.0:1788202233.091953:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202233.091959:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202233.092004:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c000 x1875064728108416/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202233.092031:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202233.092033:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202233.092035:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202233.092037:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1514 00000100:00080000:2.0:1788202233.092039:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202233.092043:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202233.092053:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202233.092064:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f480 x1875064728108544/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202233.092085:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728108416:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788202233.092152:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202233.092200:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202233/real 1788202233] req@ffff8bc17257c000 x1875064728108416/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202233.092215:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c000 x1875064728108416/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202233.092224:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202233.092227:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202233.092230:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728108416:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202233.092234:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728108544:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202233.092248:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202233.092255:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202233/real 1788202233] req@ffff8bc17257f480 x1875064728108544/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202233.092279:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f480 x1875064728108544/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202233.092285:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202233.092287:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202233.092289:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728108544:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202233.923969:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202233.987930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202234.947958:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202235.011916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202235.971950:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202236.035929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202236.995929:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202237.059887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202238.019954:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202238.083924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202238.211907:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202238.211917:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202238.211922:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202238.211932:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1519 00000100:00080000:3.0:1788202238.211943:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202238.211949:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202238.211995:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728108672/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202238.212024:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202238.212028:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202238.212029:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202238.212032:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1519 00000100:00080000:3.0:1788202238.212036:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202238.212039:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202238.212049:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202238.212061:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728108672:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202238.212062:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728108800/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788202238.212130:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202238.212191:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202238/real 1788202238] req@ffff8bc1726cd180 x1875064728108672/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202263 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202238.212210:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728108672/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202263 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202238.212221:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202238.212225:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202238.212229:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728108672:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202238.212257:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728108800:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202238.212275:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202238.212284:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202238/real 1788202238] req@ffff8bc1726cc700 x1875064728108800/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202263 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202238.212292:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728108800/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202263 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202238.212298:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202238.212300:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202238.212302:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728108800:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202239.043959:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202239.108001:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202240.068012:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202240.131884:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202241.091939:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202241.155855:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202242.115940:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202242.179888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202243.139987:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202243.203894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202243.331954:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202243.331968:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202243.331974:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202243.331986:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1524 00000100:00080000:2.0:1788202243.332007:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202243.332016:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202243.332066:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257dc00 x1875064728108928/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202243.332113:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202243.332118:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202243.332121:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202243.332125:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1524 00000100:00080000:2.0:1788202243.332129:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202243.332134:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202243.332147:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202243.332163:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f800 x1875064728109056/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202243.332206:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728108928:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202243.332325:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728109056:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202244.163950:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202244.227939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202245.187920:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202245.251902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202246.211969:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202246.275882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:3.0:1788202246.404136:0:10041:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:3.0:1788202246.404192:0:10041:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:3.0:1788202246.404211:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:3.0:1788202246.404252:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:0.0:1788202246.404282:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202243/real 1788202246] req@ffff8bc17257dc00 x1875064728108928/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202268 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202246.404308:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257dc00 x1875064728108928/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202268 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202246.404318:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202246.404322:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202246.404325:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728108928:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202246.404334:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202243/real 1788202246] req@ffff8bc17257f800 x1875064728109056/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202268 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202246.404343:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f800 x1875064728109056/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202268 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202246.404348:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202246.404350:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202246.404353:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728109056:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202247.235950:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202247.299924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202248.259949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202248.323857:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202248.451925:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202248.451935:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202248.451938:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202248.451950:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1529 00000100:00080000:2.0:1788202248.451964:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202248.451981:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202248.452031:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f800 x1875064728109184/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202248.452063:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202248.452067:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202248.452068:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202248.452072:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1529 00000100:00080000:2.0:1788202248.452075:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202248.452080:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202248.452091:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202248.452105:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257dc00 x1875064728109312/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202248.452125:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728109184:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788202248.452207:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202248.452265:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202248/real 1788202248] req@ffff8bc17257f800 x1875064728109184/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202273 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202248.452290:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f800 x1875064728109184/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202273 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202248.452300:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202248.452304:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202248.452307:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728109184:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202248.452338:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728109312:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202248.452364:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202248.452376:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202248/real 1788202248] req@ffff8bc17257dc00 x1875064728109312/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202273 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202248.452387:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257dc00 x1875064728109312/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202273 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202248.452395:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202248.452398:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202248.452401:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728109312:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202249.283905:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202249.347998:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202250.307976:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202250.371913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202251.331939:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202251.395880:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202252.356028:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202252.419894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202253.379950:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202253.443898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202253.571886:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202253.571897:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202253.571902:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202253.571931:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1534 00000100:00080000:3.0:1788202253.571942:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202253.571949:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202253.571992:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728109440/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202253.572018:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202253.572021:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202253.572023:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202253.572026:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1534 00000100:00080000:3.0:1788202253.572029:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202253.572032:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202253.572041:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202253.572051:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728109568/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202253.572073:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728109440:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788202253.572154:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202253.572216:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202253/real 1788202253] req@ffff8bc1726cf800 x1875064728109440/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202278 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202253.572238:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728109440/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202278 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202253.572246:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202253.572250:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202253.572253:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728109440:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202253.572259:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728109568:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202253.572279:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202253.572288:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202253/real 1788202253] req@ffff8bc1726cdf80 x1875064728109568/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202278 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202253.572297:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728109568/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202278 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202253.572303:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202253.572305:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202253.572307:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728109568:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202254.404037:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202254.467982:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202255.427973:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202255.491968:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202256.452012:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202256.515960:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202257.475954:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202257.539925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202258.500002:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202258.563872:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202258.691978:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202258.691991:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202258.691997:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202258.692011:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1540 00000100:00080000:3.0:1788202258.692025:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202258.692034:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202258.692088:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728109696/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202258.692123:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202258.692128:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202258.692131:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202258.692137:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1540 00000100:00080000:3.0:1788202258.692142:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202258.692148:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202258.692161:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202258.692162:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728109696:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202258.692189:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728109824/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788202258.692228:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202258.692265:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202258/real 1788202258] req@ffff8bc1726cdf80 x1875064728109696/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202283 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202258.692278:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728109696/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202283 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202258.692286:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202258.692288:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202258.692291:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728109696:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202258.692313:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728109824:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202258.692327:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202258.692334:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202258/real 1788202258] req@ffff8bc1726cf800 x1875064728109824/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202283 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202258.692341:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728109824/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202283 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202258.692346:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202258.692348:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202258.692349:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728109824:192.168.201.143@tcp:38:kworker.0 00010000:00010000:1.0:1788202259.523970:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202259.587975:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202260.547909:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202260.611872:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202261.571891:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202261.635848:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202262.595989:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202262.659844:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202263.619866:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202263.683866:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202263.811958:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202263.811970:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202263.811974:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202263.811985:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1545 00000100:00080000:0.0:1788202263.811996:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202263.812005:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202263.812041:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140e00 x1875064728109952/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202263.812073:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202263.812075:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202263.812077:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202263.812080:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1545 00000100:00080000:0.0:1788202263.812082:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202263.812086:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202263.812093:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202263.812102:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142a00 x1875064728110080/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202263.812122:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728109952:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202263.812179:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202263.812227:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202263/real 1788202263] req@ffff8bc144140e00 x1875064728109952/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202288 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202263.812248:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140e00 x1875064728109952/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202288 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202263.812260:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202263.812265:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202263.812270:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728109952:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202263.812278:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728110080:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202263.812302:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202263.812316:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202263/real 1788202263] req@ffff8bc144142a00 x1875064728110080/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202288 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202263.812330:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142a00 x1875064728110080/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202288 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202263.812339:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202263.812343:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202263.812346:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728110080:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202264.643983:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202264.707942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202265.667937:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202265.731862:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202266.691983:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202266.755935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:1.0:1788202267.715900:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202267.779916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202268.739985:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202268.803942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202268.931957:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202268.931967:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202268.931972:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202268.931982:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1550 00000100:00080000:3.0:1788202268.931993:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202268.932007:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202268.932054:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728110208/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202268.932084:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202268.932087:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202268.932089:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202268.932092:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1550 00000100:00080000:3.0:1788202268.932095:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202268.932097:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202268.932109:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202268.932128:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728110208:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202268.932128:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728110336/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788202268.932203:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202268.932252:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202268/real 1788202268] req@ffff8bc1726cc700 x1875064728110208/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202293 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202268.932267:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728110208/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202293 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202268.932277:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202268.932281:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202268.932284:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728110208:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202268.932308:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728110336:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202268.932323:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202268.932331:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202268/real 1788202268] req@ffff8bc1726cd180 x1875064728110336/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202293 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202268.932341:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728110336/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202293 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202268.932347:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202268.932349:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202268.932351:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728110336:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202269.764050:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202269.827919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202270.788011:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202270.851926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202271.812036:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202271.875945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202272.835947:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202272.899945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202273.859999:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202273.923910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202274.051947:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202274.051958:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202274.051963:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202274.051974:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1555 00000100:00080000:0.0:1788202274.051988:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202274.051996:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202274.052048:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141880 x1875064728110464/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202274.052076:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202274.052079:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202274.052081:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202274.052084:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1555 00000100:00080000:0.0:1788202274.052086:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202274.052089:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202274.052099:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202274.052110:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143480 x1875064728110592/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202274.052149:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728110464:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202274.052224:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202274.052289:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202274/real 1788202274] req@ffff8bc144141880 x1875064728110464/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202299 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202274.052321:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141880 x1875064728110464/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202299 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202274.052334:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202274.052339:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202274.052342:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728110464:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202274.052349:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728110592:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202274.052369:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202274.052380:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202274/real 1788202274] req@ffff8bc144143480 x1875064728110592/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202299 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202274.052389:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143480 x1875064728110592/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202299 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202274.052396:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202274.052398:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202274.052400:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728110592:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202274.883958:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202274.947944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202275.908061:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202275.971900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202276.932024:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202276.995919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202277.956022:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202278.019893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202278.979966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202279.043935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202279.171913:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202279.171927:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202279.171933:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202279.171948:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1560 00000100:00080000:2.0:1788202279.171962:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202279.171972:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202279.172025:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f480 x1875064728110720/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202279.172071:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202279.172076:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202279.172078:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202279.172083:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1560 00000100:00080000:2.0:1788202279.172087:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202279.172093:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202279.172105:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202279.172116:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728110720:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202279.172122:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c000 x1875064728110848/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788202279.172211:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202279.172268:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202279/real 1788202279] req@ffff8bc17257f480 x1875064728110720/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202304 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202279.172284:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f480 x1875064728110720/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202304 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202279.172293:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202279.172297:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202279.172300:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728110720:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202279.172328:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728110848:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788202279.172347:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788202279.172357:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202279/real 1788202279] req@ffff8bc17257c000 x1875064728110848/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202304 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202279.172365:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c000 x1875064728110848/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202304 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202279.172371:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202279.172373:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202279.172376:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728110848:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202280.003931:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202280.067961:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202281.027983:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202281.091887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202282.051952:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202282.115900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202283.075949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202283.139899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202284.099966:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202284.163910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202284.291947:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202284.291965:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202284.291970:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202284.291981:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1565 00000100:00080000:0.0:1788202284.291995:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202284.292004:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202284.292057:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141500 x1875064728110976/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202284.292101:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202284.292105:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202284.292108:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202284.292112:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1565 00000100:00080000:0.0:1788202284.292117:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202284.292123:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202284.292136:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202284.292157:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143b80 x1875064728111104/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202284.292160:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728110976:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202284.292249:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202284.292324:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202284/real 1788202284] req@ffff8bc144141500 x1875064728110976/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202309 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202284.292347:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141500 x1875064728110976/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202309 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202284.292359:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202284.292365:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202284.292369:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728110976:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202284.292414:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728111104:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202284.292441:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202284.292456:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202284/real 1788202284] req@ffff8bc144143b80 x1875064728111104/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202309 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202284.292472:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143b80 x1875064728111104/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202309 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202284.292483:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202284.292487:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202284.292491:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728111104:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202285.123964:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202285.187957:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202286.148008:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202286.211976:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202287.171919:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202287.235899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202288.196047:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202288.259948:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202289.220032:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202289.283892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202289.411943:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202289.411956:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202289.411962:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202289.411976:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1570 00000100:00080000:0.0:1788202289.411989:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202289.411998:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202289.412058:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141f80 x1875064728111232/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202289.412094:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202289.412099:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202289.412101:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202289.412106:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1570 00000100:00080000:0.0:1788202289.412110:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202289.412114:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202289.412127:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202289.412140:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142300 x1875064728111360/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202289.412217:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728111232:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202289.412281:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202289.412340:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202289/real 1788202289] req@ffff8bc144141f80 x1875064728111232/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202314 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202289.412355:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141f80 x1875064728111232/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202314 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202289.412364:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202289.412367:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202289.412370:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728111232:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202289.412375:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728111360:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202289.412391:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202289.412398:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202289/real 1788202289] req@ffff8bc144142300 x1875064728111360/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202314 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202289.412406:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142300 x1875064728111360/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202314 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202289.412417:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202289.412419:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202289.412421:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728111360:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202290.244018:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202290.307936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202291.268027:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202291.331987:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202292.291961:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202292.355949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202293.316000:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202293.379897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202294.339951:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202294.403913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788202294.531901:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788202294.531910:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788202294.531914:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202294.531922:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1575 00000100:00080000:1.0:1788202294.531931:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202294.531937:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788202294.531970:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7b80 x1875064728111488/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788202294.531992:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788202294.531994:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788202294.531996:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202294.531999:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1575 00000100:00080000:1.0:1788202294.532001:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202294.532004:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788202294.532010:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788202294.532019:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7100 x1875064728111616/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202294.532072:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728111488:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202294.532161:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202294.532251:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202294/real 1788202294] req@ffff8bc1727d7b80 x1875064728111488/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202319 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202294.532268:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7b80 x1875064728111488/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202319 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202294.532278:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202294.532281:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202294.532285:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728111488:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202294.532292:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728111616:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202294.532312:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202294.532322:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202294/real 1788202294] req@ffff8bc1727d7100 x1875064728111616/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202319 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202294.532336:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7100 x1875064728111616/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202319 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202294.532343:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202294.532345:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202294.532348:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728111616:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202295.363983:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202295.427930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202296.388026:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202296.451954:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202297.412045:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202297.475895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202298.435984:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202298.499884:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202299.459978:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202299.523908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788202299.651910:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788202299.651925:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788202299.651930:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202299.651942:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1581 00000100:00080000:1.0:1788202299.651955:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202299.651962:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788202299.652009:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7800 x1875064728111744/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788202299.652040:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788202299.652043:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788202299.652044:0:8:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202299.652048:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1581 00000100:00080000:1.0:1788202299.652050:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202299.652052:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788202299.652061:0:8:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788202299.652074:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4a80 x1875064728111872/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202299.652100:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728111744:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202299.652196:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202299.652248:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202299/real 1788202299] req@ffff8bc1727d7800 x1875064728111744/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202324 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202299.652272:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7800 x1875064728111744/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202324 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202299.652281:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202299.652286:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202299.652290:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728111744:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202299.652299:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728111872:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202299.652332:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202299.652346:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202299/real 1788202299] req@ffff8bc1727d4a80 x1875064728111872/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202324 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202299.652357:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4a80 x1875064728111872/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202324 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202299.652363:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202299.652373:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202299.652376:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728111872:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202300.483937:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202300.547947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202301.508065:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202301.571863:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202302.531963:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202302.595901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202303.556002:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202303.619940:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202304.579938:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202304.643854:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202304.771948:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202304.771957:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202304.771961:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202304.771969:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1586 00000100:00080000:0.0:1788202304.771978:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202304.771984:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202304.772037:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140380 x1875064728112000/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202304.772060:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202304.772062:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202304.772064:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202304.772066:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1586 00000100:00080000:0.0:1788202304.772069:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202304.772072:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202304.772079:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202304.772088:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143800 x1875064728112128/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202304.772120:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728112000:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202304.772181:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202304.772237:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202304/real 1788202304] req@ffff8bc144140380 x1875064728112000/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202329 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202304.772257:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140380 x1875064728112000/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202329 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202304.772269:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202304.772273:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202304.772278:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728112000:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202304.772286:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728112128:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202304.772308:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202304.772321:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202304/real 1788202304] req@ffff8bc144143800 x1875064728112128/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202329 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202304.772333:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143800 x1875064728112128/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202329 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202304.772341:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202304.772345:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202304.772349:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728112128:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202305.603987:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202305.667996:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202306.627976:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202306.691935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202307.652010:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202307.715904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202308.676037:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202308.739928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202309.699928:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202309.763890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202309.891911:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202309.891919:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202309.891924:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202309.891965:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1591 00000100:00080000:2.0:1788202309.891974:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202309.891980:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202309.892013:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257df80 x1875064728112256/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202309.892039:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202309.892042:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202309.892044:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202309.892046:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1591 00000100:00080000:2.0:1788202309.892049:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202309.892051:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202309.892059:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202309.892067:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e680 x1875064728112384/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788202309.892094:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728112256:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202309.892183:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728112384:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202310.724046:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202310.788007:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202311.747940:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202311.811909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202312.772025:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202312.835909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788202312.964136:0:10042:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788202312.964184:0:10042:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788202312.964200:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788202312.964239:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:0.0:1788202312.964338:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202309/real 1788202312] req@ffff8bc17257df80 x1875064728112256/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202334 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202312.964384:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257df80 x1875064728112256/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202334 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202312.964399:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202312.964406:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202312.964412:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728112256:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202312.964422:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202309/real 1788202312] req@ffff8bc17257e680 x1875064728112384/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202334 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788202312.964437:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e680 x1875064728112384/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202334 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788202312.964446:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788202312.964451:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788202312.964455:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728112384:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202313.795989:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202313.859929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202314.820042:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202314.883872:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202315.011956:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202315.011970:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202315.011974:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202315.011985:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1596 00000100:00080000:0.0:1788202315.011998:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202315.012006:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202315.012049:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143100 x1875064728112512/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202315.012088:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202315.012092:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202315.012095:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202315.012099:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1596 00000100:00080000:0.0:1788202315.012103:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202315.012114:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202315.012128:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202315.012133:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728112512:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202315.012147:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140000 x1875064728112640/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788202315.012228:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202315.012312:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202315/real 1788202315] req@ffff8bc144143100 x1875064728112512/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202340 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202315.012338:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143100 x1875064728112512/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202340 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202315.012352:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202315.012357:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202315.012365:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728112512:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202315.012400:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728112640:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202315.012427:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202315.012445:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202315/real 1788202315] req@ffff8bc144140000 x1875064728112640/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202340 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202315.012459:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140000 x1875064728112640/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202340 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202315.012468:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202315.012471:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202315.012475:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728112640:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202315.844055:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202315.907928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202316.868046:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202316.931901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202317.891997:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202317.955888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202318.915971:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202318.979925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202319.939992:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202320.003907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202320.131950:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202320.131965:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202320.131971:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202320.131981:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1601 00000100:00080000:0.0:1788202320.131994:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202320.132002:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202320.132054:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140a80 x1875064728112768/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202320.132088:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202320.132092:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202320.132093:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202320.132097:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1601 00000100:00080000:0.0:1788202320.132100:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202320.132103:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202320.132114:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202320.132126:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142680 x1875064728112896/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202320.132146:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728112768:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202320.132227:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202320.132288:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202320/real 1788202320] req@ffff8bc144140a80 x1875064728112768/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202345 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202320.132305:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140a80 x1875064728112768/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202345 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202320.132314:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202320.132317:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202320.132321:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728112768:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202320.132356:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728112896:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202320.132375:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202320.132389:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202320/real 1788202320] req@ffff8bc144142680 x1875064728112896/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202345 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202320.132404:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142680 x1875064728112896/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202345 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202320.132421:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202320.132424:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202320.132429:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728112896:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202320.964042:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202321.027908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202321.987950:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202322.051887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202323.011988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202323.075923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202324.035936:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202324.099873:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202325.059954:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202325.123916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202325.251943:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202325.251953:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202325.251958:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202325.251970:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1606 00000100:00080000:0.0:1788202325.251981:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202325.251989:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202325.252030:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142d80 x1875064728113024/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202325.252059:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202325.252062:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202325.252064:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202325.252068:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1606 00000100:00080000:0.0:1788202325.252070:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202325.252074:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202325.252085:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202325.252100:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141180 x1875064728113152/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202325.252101:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728113024:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202325.252191:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202325.252256:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202325/real 1788202325] req@ffff8bc144142d80 x1875064728113024/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202350 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202325.252292:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142d80 x1875064728113024/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202350 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202325.252303:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202325.252306:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202325.252310:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728113024:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202325.252334:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728113152:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202325.252369:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202325.252378:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202325/real 1788202325] req@ffff8bc144141180 x1875064728113152/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202350 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202325.252387:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141180 x1875064728113152/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202350 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202325.252392:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202325.252394:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202325.252396:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728113152:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202326.083956:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202326.147947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202327.108056:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202327.171887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202328.131957:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202328.195857:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202329.155960:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202329.219884:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202330.179956:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202330.243945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202330.371968:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202330.371977:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202330.371981:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202330.371989:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1611 00000100:00080000:2.0:1788202330.371999:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202330.372005:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202330.372039:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ed80 x1875064728113280/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202330.372064:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202330.372067:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202330.372068:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202330.372070:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1611 00000100:00080000:2.0:1788202330.372073:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202330.372075:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202330.372082:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202330.372092:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d880 x1875064728113408/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202330.372139:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728113280:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202330.372240:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202330.372295:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202330/real 1788202330] req@ffff8bc17257ed80 x1875064728113280/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202355 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202330.372311:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ed80 x1875064728113280/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202355 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202330.372322:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202330.372326:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202330.372337:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728113280:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202330.372344:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728113408:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202330.372362:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202330.372371:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202330/real 1788202330] req@ffff8bc17257d880 x1875064728113408/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202355 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202330.372380:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d880 x1875064728113408/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202355 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202330.372386:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202330.372389:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202330.372391:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728113408:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202331.203958:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202331.267966:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202332.228032:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202332.291884:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202333.251935:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202333.315954:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202334.276010:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202334.339871:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202335.300009:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202335.363929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202335.491923:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202335.491935:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202335.491941:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202335.491952:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1616 00000100:00080000:3.0:1788202335.491965:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202335.491972:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202335.492017:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728113536/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202335.492046:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202335.492050:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202335.492051:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202335.492054:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1616 00000100:00080000:3.0:1788202335.492057:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202335.492059:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202335.492069:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202335.492079:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728113664/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202335.492098:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728113536:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202335.492169:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202335.492229:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202335/real 1788202335] req@ffff8bc1726cf100 x1875064728113536/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202360 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202335.492246:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728113536/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202360 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202335.492256:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202335.492260:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202335.492264:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728113536:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202335.492286:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728113664:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202335.492303:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202335.492312:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202335/real 1788202335] req@ffff8bc1726cf480 x1875064728113664/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202360 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202335.492320:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728113664/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202360 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202335.492327:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202335.492330:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202335.492334:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728113664:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202336.324040:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202336.387945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202337.348025:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202337.411945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202338.372010:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202338.435982:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202339.395950:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202339.459878:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202340.419988:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202340.483971:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202340.611898:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202340.611910:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202340.611914:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202340.611925:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1621 00000100:00080000:3.0:1788202340.611943:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202340.611951:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202340.612010:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728113792/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202340.612046:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202340.612050:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202340.612053:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202340.612058:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1621 00000100:00080000:3.0:1788202340.612063:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202340.612069:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202340.612081:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202340.612089:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728113792:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202340.612102:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728113920/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788202340.612157:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202340.612209:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202340/real 1788202340] req@ffff8bc1726cd500 x1875064728113792/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202365 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202340.612223:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728113792/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202365 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202340.612232:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202340.612235:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202340.612238:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728113792:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202340.612263:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728113920:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202340.612283:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202340.612297:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202340/real 1788202340] req@ffff8bc1726cca80 x1875064728113920/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202365 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202340.612311:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728113920/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202365 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202340.612321:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202340.612324:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202340.612328:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728113920:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202341.443918:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202341.507910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202342.468034:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202342.531923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202343.492036:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202343.555928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202344.515952:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202344.579866:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202345.539940:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202345.603889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202345.731901:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202345.731912:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202345.731916:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202345.731926:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1627 00000100:00080000:3.0:1788202345.731937:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202345.731944:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202345.731985:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728114048/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202345.732023:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202345.732028:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202345.732030:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202345.732034:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1627 00000100:00080000:3.0:1788202345.732039:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202345.732044:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202345.732053:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202345.732075:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728114176/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202345.732085:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728114048:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202345.732162:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202345.732212:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202345/real 1788202345] req@ffff8bc1726cfb80 x1875064728114048/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202370 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202345.732233:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728114048/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202370 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202345.732252:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202345.732256:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202345.732260:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728114048:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202345.732287:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728114176:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202345.732344:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202345.732359:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202345/real 1788202345] req@ffff8bc1726ced80 x1875064728114176/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202370 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202345.732373:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728114176/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202370 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202345.732383:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202345.732386:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202345.732390:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728114176:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202346.564004:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202346.628011:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202347.587930:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202347.651893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202348.611996:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202348.675920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202349.636016:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202349.699945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202350.659936:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202350.723899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202350.851929:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202350.851941:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202350.851945:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202350.851957:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1632 00000100:00080000:2.0:1788202350.851969:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202350.851977:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202350.852022:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ce00 x1875064728114304/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202350.852045:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202350.852051:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202350.852052:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202350.852055:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1632 00000100:00080000:2.0:1788202350.852058:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202350.852061:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202350.852070:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202350.852080:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ea00 x1875064728114432/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202350.852085:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728114304:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202350.852143:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202350.852181:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202350/real 1788202350] req@ffff8bc17257ce00 x1875064728114304/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202375 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202350.852195:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ce00 x1875064728114304/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202375 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202350.852203:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202350.852206:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202350.852209:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728114304:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202350.852249:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728114432:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202350.852268:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202350.852277:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202350/real 1788202350] req@ffff8bc17257ea00 x1875064728114432/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202375 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202350.852285:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ea00 x1875064728114432/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202375 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202350.852296:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202350.852298:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202350.852300:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728114432:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202351.683968:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202351.747925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202352.707963:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202352.771907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202353.732003:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202353.795877:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202354.756023:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202354.819964:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202355.779987:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202355.843883:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202355.971946:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202355.971957:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202355.971962:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202355.971982:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1637 00000100:00080000:3.0:1788202355.971994:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202355.972002:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202355.972057:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728114560/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202355.972087:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202355.972092:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202355.972094:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202355.972098:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1637 00000100:00080000:3.0:1788202355.972103:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202355.972108:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202355.972121:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202355.972149:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728114688/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202355.972156:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728114560:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202355.972237:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202355.972291:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202355/real 1788202355] req@ffff8bc1726cea00 x1875064728114560/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202380 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202355.972313:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728114560/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202380 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202355.972326:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202355.972331:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202355.972335:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728114560:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202355.972363:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728114688:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202355.972383:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202355.972393:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202355/real 1788202355] req@ffff8bc1726ce300 x1875064728114688/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202380 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202355.972401:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728114688/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202380 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202355.972408:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202355.972410:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202355.972413:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728114688:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202356.804021:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202356.867938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202357.828007:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202357.891946:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202358.852015:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202358.915862:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202359.875989:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202359.939910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202360.899923:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202360.963860:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202361.091899:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202361.091908:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202361.091911:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202361.091920:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1642 00000100:00080000:3.0:1788202361.091929:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202361.091935:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202361.091970:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728114816/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202361.091995:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202361.091998:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202361.091999:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202361.092002:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1642 00000100:00080000:3.0:1788202361.092004:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202361.092007:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202361.092014:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202361.092022:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728114944/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202361.092073:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728114816:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202361.092137:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202361.092185:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202361/real 1788202361] req@ffff8bc1726cc380 x1875064728114816/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202386 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202361.092206:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728114816/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202386 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202361.092217:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202361.092221:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202361.092225:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728114816:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202361.092233:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728114944:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202361.092256:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202361.092271:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202361/real 1788202361] req@ffff8bc1726ce680 x1875064728114944/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202386 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202361.092284:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728114944/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202386 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202361.092293:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202361.092296:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202361.092313:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728114944:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202361.923961:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202361.987929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202362.947983:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202363.011853:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202363.971953:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202364.035875:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202364.996085:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202365.059903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202366.019964:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202366.083932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202366.211892:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202366.211906:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202366.211911:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202366.211925:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1647 00000100:00080000:3.0:1788202366.211941:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202366.211962:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202366.212015:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728115072/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202366.212048:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202366.212051:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202366.212053:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202366.212056:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1647 00000100:00080000:3.0:1788202366.212059:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202366.212063:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202366.212073:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202366.212084:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728115200/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202366.212128:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728115072:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202366.212193:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202366.212236:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202366/real 1788202366] req@ffff8bc1726cdc00 x1875064728115072/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202391 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202366.212250:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728115072/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202391 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202366.212259:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202366.212262:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202366.212266:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728115072:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202366.212271:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728115200:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202366.212285:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202366.212294:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202366/real 1788202366] req@ffff8bc1726cce00 x1875064728115200/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202391 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202366.212302:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728115200/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202391 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202366.212307:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202366.212309:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202366.212311:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728115200:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202367.044055:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202367.108029:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202368.067964:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202368.131952:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202369.091966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202369.155946:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202370.115950:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202370.180006:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202371.140059:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202371.203936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202371.331949:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202371.331961:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202371.331965:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202371.331977:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1652 00000100:00080000:3.0:1788202371.331989:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202371.331996:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202371.332051:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728115328/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202371.332085:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202371.332089:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202371.332091:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202371.332094:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1652 00000100:00080000:3.0:1788202371.332097:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202371.332101:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202371.332111:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202371.332122:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728115456/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202371.332170:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728115328:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202371.332233:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202371.332277:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202371/real 1788202371] req@ffff8bc1726cce00 x1875064728115328/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202396 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202371.332293:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728115328/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202396 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202371.332301:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202371.332304:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202371.332307:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728115328:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202371.332312:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728115456:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202371.332327:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202371.332335:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202371/real 1788202371] req@ffff8bc1726cdc00 x1875064728115456/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202396 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202371.332343:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728115456/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202396 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202371.332348:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202371.332350:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202371.332352:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728115456:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202372.164058:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202372.227993:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202373.187973:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202373.251870:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202374.212072:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202374.275959:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202375.236032:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202375.299956:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202376.260027:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202376.323915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202376.451954:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202376.451969:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202376.451973:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202376.451985:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1657 00000100:00080000:2.0:1788202376.451999:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202376.452008:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202376.452067:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257fb80 x1875064728115584/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202376.452109:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202376.452113:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202376.452115:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202376.452119:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1657 00000100:00080000:2.0:1788202376.452122:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202376.452126:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202376.452135:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202376.452148:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ca80 x1875064728115712/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202376.452165:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728115584:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202376.452287:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728115712:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202377.283997:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202377.347938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202378.307980:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202378.371872:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202379.332048:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202379.395930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788202379.524137:0:10043:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788202379.524201:0:10043:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788202379.524221:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788202379.524270:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:3.0:1788202379.524427:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202376/real 1788202379] req@ffff8bc17257ca80 x1875064728115712/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202401 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202379.524460:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ca80 x1875064728115712/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202401 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202379.524477:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202379.524485:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202379.524490:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728115712:192.168.201.143@tcp:38:kworker.0 00000100:00100000:3.0:1788202379.524499:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202376/real 1788202379] req@ffff8bc17257fb80 x1875064728115584/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202401 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202379.524513:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257fb80 x1875064728115584/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202401 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202379.524520:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202379.524524:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202379.524528:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728115584:192.168.201.143@tcp:250:kworker.0 00010000:00010000:0.0:1788202380.355975:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202380.419884:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202381.379982:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202381.443904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202381.571855:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202381.571864:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202381.571867:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202381.571876:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1662 00000100:00080000:2.0:1788202381.571886:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202381.571892:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202381.571922:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c380 x1875064728115840/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202381.571949:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202381.571952:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202381.571953:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202381.571955:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1662 00000100:00080000:2.0:1788202381.571958:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202381.571960:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202381.571968:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202381.571978:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e300 x1875064728115968/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202381.571998:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728115840:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202381.572060:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202381.572105:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202381/real 1788202381] req@ffff8bc17257c380 x1875064728115840/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202406 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202381.572124:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c380 x1875064728115840/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202406 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202381.572136:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202381.572140:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202381.572145:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728115840:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202381.572171:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728115968:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202381.572193:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202381.572205:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202381/real 1788202381] req@ffff8bc17257e300 x1875064728115968/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202406 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202381.572218:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e300 x1875064728115968/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202406 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202381.572227:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202381.572231:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202381.572234:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728115968:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202382.403965:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202382.467939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202383.428043:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202383.491963:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202384.452055:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202384.515963:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202385.475962:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202385.539959:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202386.499955:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202386.563904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202386.691936:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202386.691945:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202386.691949:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202386.691957:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1668 00000100:00080000:3.0:1788202386.691966:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202386.691972:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202386.692005:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728116096/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202386.692028:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202386.692031:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202386.692032:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202386.692035:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1668 00000100:00080000:3.0:1788202386.692038:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202386.692041:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202386.692049:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202386.692058:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728116224/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202386.692063:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728116096:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202386.692118:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202386.692155:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202386/real 1788202386] req@ffff8bc1726ce680 x1875064728116096/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202411 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202386.692169:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728116096/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202411 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202386.692176:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202386.692179:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202386.692182:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728116096:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202386.692203:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728116224:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202386.692218:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202386.692226:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202386/real 1788202386] req@ffff8bc1726cc380 x1875064728116224/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202411 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202386.692235:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728116224/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202411 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202386.692241:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202386.692243:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202386.692245:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728116224:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202387.523910:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202387.587911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202388.548028:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202388.611919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202389.571953:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202389.635864:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202390.595924:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202390.659869:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202391.619940:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202391.683897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202391.811895:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202391.811904:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202391.811907:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202391.811915:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1673 00000100:00080000:0.0:1788202391.811924:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202391.811930:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202391.811961:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141180 x1875064728116352/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202391.811986:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202391.811988:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202391.811990:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202391.811992:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1673 00000100:00080000:0.0:1788202391.811994:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202391.811996:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202391.812005:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202391.812014:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142d80 x1875064728116480/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202391.812044:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728116352:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202391.812100:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202391.812148:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202391/real 1788202391] req@ffff8bc144141180 x1875064728116352/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202416 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202391.812162:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141180 x1875064728116352/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202416 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202391.812170:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202391.812173:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202391.812177:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728116352:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202391.812182:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728116480:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202391.812196:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202391.812204:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202391/real 1788202391] req@ffff8bc144142d80 x1875064728116480/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202416 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202391.812212:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142d80 x1875064728116480/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202416 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202391.812217:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202391.812219:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202391.812221:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728116480:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202392.643917:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202392.707915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202393.667962:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202393.731883:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202394.691991:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202394.755889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202395.716015:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202395.779885:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202396.740008:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202396.803912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202396.931929:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202396.931944:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202396.931950:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202396.931963:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1678 00000100:00080000:3.0:1788202396.931978:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202396.931987:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202396.932042:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728116608/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202396.932072:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202396.932077:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202396.932079:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202396.932083:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1678 00000100:00080000:3.0:1788202396.932087:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202396.932093:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202396.932104:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202396.932119:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728116736/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202396.932130:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728116608:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202396.932202:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202396.932257:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202396/real 1788202396] req@ffff8bc1726ce300 x1875064728116608/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202421 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202396.932272:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728116608/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202421 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202396.932281:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202396.932284:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202396.932288:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728116608:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202396.932311:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728116736:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202396.932327:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202396.932335:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202396/real 1788202396] req@ffff8bc1726cea00 x1875064728116736/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202421 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202396.932344:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728116736/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202421 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202396.932350:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202396.932351:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202396.932353:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728116736:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202397.763985:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202397.827976:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202398.788026:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202398.851890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202399.811957:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202399.875890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202400.835996:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202400.899941:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202401.859947:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202401.923931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202402.051912:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202402.051923:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202402.051927:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202402.051938:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1683 00000100:00080000:0.0:1788202402.051950:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202402.051957:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202402.052011:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142680 x1875064728116864/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202402.052040:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202402.052043:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202402.052046:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202402.052049:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1683 00000100:00080000:0.0:1788202402.052052:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202402.052055:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202402.052066:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202402.052079:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140a80 x1875064728116992/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202402.052100:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728116864:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202402.052182:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202402.052241:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202402/real 1788202402] req@ffff8bc144142680 x1875064728116864/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202427 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202402.052264:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142680 x1875064728116864/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202427 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202402.052277:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202402.052282:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202402.052286:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728116864:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202402.052317:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728116992:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202402.052360:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202402.052375:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202402/real 1788202402] req@ffff8bc144140a80 x1875064728116992/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202427 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202402.052390:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140a80 x1875064728116992/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202427 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202402.052400:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202402.052404:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202402.052408:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728116992:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202402.883989:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202402.947964:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202403.908016:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202403.971948:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202404.931965:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202404.995894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202405.956010:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202406.019879:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202406.979950:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202407.043896:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202407.171912:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202407.171923:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202407.171928:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202407.171938:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1688 00000100:00080000:0.0:1788202407.171948:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202407.171956:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202407.172007:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140000 x1875064728117120/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202407.172036:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202407.172040:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202407.172042:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202407.172046:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1688 00000100:00080000:0.0:1788202407.172050:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202407.172055:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202407.172064:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202407.172078:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143100 x1875064728117248/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202407.172117:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728117120:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202407.172181:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202407.172220:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202407/real 1788202407] req@ffff8bc144140000 x1875064728117120/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202432 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202407.172260:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140000 x1875064728117120/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202432 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202407.172268:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202407.172271:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202407.172274:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728117120:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202407.172280:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728117248:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202407.172296:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202407.172305:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202407/real 1788202407] req@ffff8bc144143100 x1875064728117248/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202432 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202407.172313:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143100 x1875064728117248/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202432 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202407.172318:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202407.172320:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202407.172322:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728117248:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202408.003949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202408.067923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202409.027929:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202409.091933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202410.052003:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202410.115890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202411.075994:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202411.139951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202412.100076:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202412.163860:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788202412.291956:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788202412.291970:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788202412.291975:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202412.291989:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1693 00000100:00080000:1.0:1788202412.292008:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202412.292018:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788202412.292075:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6a00 x1875064728117376/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788202412.292114:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788202412.292117:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788202412.292119:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202412.292123:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1693 00000100:00080000:1.0:1788202412.292126:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202412.292130:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788202412.292140:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788202412.292172:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4e00 x1875064728117504/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202412.292207:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728117376:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202412.292281:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202412.292324:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202412/real 1788202412] req@ffff8bc1727d6a00 x1875064728117376/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202437 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202412.292339:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6a00 x1875064728117376/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202437 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202412.292347:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202412.292351:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202412.292360:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728117376:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202412.292366:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728117504:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202412.292382:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202412.292391:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202412/real 1788202412] req@ffff8bc1727d4e00 x1875064728117504/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202437 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202412.292399:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4e00 x1875064728117504/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202437 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202412.292405:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202412.292408:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202412.292410:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728117504:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202413.124029:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202413.188008:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202414.147980:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202414.211937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202415.171980:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202415.235912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202416.195970:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202416.259902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202417.219941:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202417.283911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202417.411912:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202417.411921:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202417.411924:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202417.411933:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1698 00000100:00080000:3.0:1788202417.411942:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202417.411948:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202417.411982:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728117632/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202417.412016:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202417.412024:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202417.412026:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202417.412030:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1698 00000100:00080000:3.0:1788202417.412034:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202417.412040:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202417.412053:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202417.412081:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728117632:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202417.412084:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728117760/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788202417.412140:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202417.412190:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202417/real 1788202417] req@ffff8bc1726ced80 x1875064728117632/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202442 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202417.412217:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728117632/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202442 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202417.412229:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202417.412233:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202417.412238:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728117632:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202417.412266:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728117760:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202417.412289:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202417.412304:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202417/real 1788202417] req@ffff8bc1726cfb80 x1875064728117760/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202442 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202417.412317:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728117760/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202442 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202417.412336:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202417.412340:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202417.412344:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728117760:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202418.244021:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202418.308091:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202419.267917:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202419.331881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202420.292006:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202420.355942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202421.316036:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202421.379947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202422.340040:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202422.403987:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202422.531902:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202422.531915:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202422.531921:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202422.531935:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1703 00000100:00080000:3.0:1788202422.531949:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202422.531959:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202422.532035:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728117888/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202422.532071:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202422.532076:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202422.532079:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202422.532085:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1703 00000100:00080000:3.0:1788202422.532090:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202422.532096:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202422.532109:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202422.532128:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728118016/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202422.532129:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728117888:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202422.532218:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202422.532286:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202422/real 1788202422] req@ffff8bc1726cca80 x1875064728117888/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202447 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202422.532303:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728117888/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202447 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202422.532312:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202422.532315:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202422.532319:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728117888:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202422.532344:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728118016:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202422.532363:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202422.532374:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202422/real 1788202422] req@ffff8bc1726cd500 x1875064728118016/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202447 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202422.532382:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728118016/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202447 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202422.532388:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202422.532391:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202422.532393:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728118016:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202423.364126:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202423.427978:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202424.387990:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202424.451919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202425.412048:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202425.475931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202426.435967:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202426.499932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202427.460098:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202427.523902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788202427.651917:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788202427.651926:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788202427.651930:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202427.651939:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1709 00000100:00080000:1.0:1788202427.651949:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202427.651957:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788202427.651993:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5c00 x1875064728118144/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788202427.652019:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788202427.652022:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788202427.652024:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202427.652028:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1709 00000100:00080000:1.0:1788202427.652031:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202427.652036:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788202427.652044:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788202427.652057:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4700 x1875064728118272/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202427.652111:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728118144:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202427.652192:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202427.652254:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202427/real 1788202427] req@ffff8bc1727d5c00 x1875064728118144/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202452 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202427.652282:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5c00 x1875064728118144/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202452 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202427.652294:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202427.652299:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202427.652304:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728118144:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202427.652312:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728118272:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202427.652335:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202427.652349:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202427/real 1788202427] req@ffff8bc1727d4700 x1875064728118272/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202452 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202427.652361:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4700 x1875064728118272/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202452 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202427.652370:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202427.652373:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202427.652376:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728118272:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202428.483966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202428.547971:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202429.508021:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202429.571866:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202430.531947:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202430.595928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202431.555955:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202431.619876:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202432.579954:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202432.643903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788202432.771863:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788202432.771871:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788202432.771875:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202432.771883:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1714 00000100:00080000:1.0:1788202432.771891:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202432.771897:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788202432.771927:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6300 x1875064728118400/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788202432.771945:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788202432.771948:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788202432.771949:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202432.771951:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1714 00000100:00080000:1.0:1788202432.771953:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202432.771955:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788202432.771962:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788202432.771970:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6d80 x1875064728118528/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202432.771981:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728118400:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202432.772038:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202432.772082:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202432/real 1788202432] req@ffff8bc1727d6300 x1875064728118400/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202457 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202432.772099:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6300 x1875064728118400/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202457 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202432.772109:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202432.772113:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202432.772117:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728118400:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202432.772138:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728118528:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202432.772159:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202432.772171:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202432/real 1788202432] req@ffff8bc1727d6d80 x1875064728118528/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202457 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202432.772183:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6d80 x1875064728118528/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202457 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202432.772191:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202432.772194:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202432.772197:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728118528:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202433.603995:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202433.667961:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202434.627946:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202434.691923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202435.651979:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202435.715903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202436.675990:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202436.739887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202437.699986:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202437.763953:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202437.891906:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202437.891917:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202437.891922:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202437.891933:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1719 00000100:00080000:2.0:1788202437.891946:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202437.891953:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202437.891997:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d500 x1875064728118656/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202437.892028:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202437.892031:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202437.892033:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202437.892036:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1719 00000100:00080000:2.0:1788202437.892038:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202437.892041:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202437.892049:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202437.892059:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f100 x1875064728118784/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202437.892087:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728118656:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202437.892157:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202437.892214:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202437/real 1788202437] req@ffff8bc17257d500 x1875064728118656/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202462 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202437.892232:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d500 x1875064728118656/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202462 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202437.892242:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202437.892246:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202437.892250:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728118656:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202437.892256:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728118784:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202437.892273:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202437.892281:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202437/real 1788202437] req@ffff8bc17257f100 x1875064728118784/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202462 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202437.892290:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f100 x1875064728118784/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202462 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202437.892297:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202437.892299:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202437.892301:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728118784:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202438.723986:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202438.787918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202439.747998:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202439.811936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202440.771923:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202440.835970:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202441.795955:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202441.859921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202442.820025:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202442.883910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202443.011923:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202443.011932:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202443.011936:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202443.011944:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1724 00000100:00080000:2.0:1788202443.011954:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202443.011960:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202443.011994:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d180 x1875064728118912/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202443.012019:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202443.012022:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202443.012023:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202443.012026:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1724 00000100:00080000:2.0:1788202443.012029:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202443.012032:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202443.012039:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202443.012047:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c700 x1875064728119040/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202443.012107:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728118912:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202443.012263:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728119040:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202443.843950:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202443.907911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202444.868065:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202444.931939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202445.892004:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202445.955908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:0.0:1788202446.084086:0:10040:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:0.0:1788202446.084136:0:10040:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:0.0:1788202446.084152:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:0.0:1788202446.084198:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:3.0:1788202446.084372:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202443/real 1788202446] req@ffff8bc17257d180 x1875064728118912/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202468 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202446.084401:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d180 x1875064728118912/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202468 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202446.084414:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202446.084420:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202446.084425:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728118912:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202446.084434:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202443/real 1788202446] req@ffff8bc17257c700 x1875064728119040/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202468 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202446.084448:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c700 x1875064728119040/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202468 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202446.084456:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202446.084460:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202446.084463:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728119040:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202446.916000:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202446.979919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202447.939978:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202448.003891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202448.131907:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202448.131920:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202448.131926:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202448.131940:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1729 00000100:00080000:2.0:1788202448.131954:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202448.131963:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202448.132007:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c700 x1875064728119168/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202448.132041:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202448.132046:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202448.132048:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202448.132052:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1729 00000100:00080000:2.0:1788202448.132055:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202448.132059:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202448.132071:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202448.132084:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d180 x1875064728119296/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202448.132147:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728119168:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202448.132234:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202448.132325:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202448/real 1788202448] req@ffff8bc17257c700 x1875064728119168/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202473 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202448.132350:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c700 x1875064728119168/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202473 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202448.132364:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202448.132369:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202448.132374:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728119168:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202448.132384:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728119296:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202448.132411:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202448.132435:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202448/real 1788202448] req@ffff8bc17257d180 x1875064728119296/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202473 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202448.132447:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d180 x1875064728119296/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202473 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202448.132455:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202448.132459:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202448.132463:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728119296:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202448.964028:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202449.027927:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202449.988036:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202450.051942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202451.011965:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202451.075906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202452.035947:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202452.099910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202453.060002:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202453.123919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202453.251931:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202453.251943:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202453.251948:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202453.251959:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1734 00000100:00080000:2.0:1788202453.251972:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202453.251979:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202453.252024:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f100 x1875064728119424/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202453.252058:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202453.252062:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202453.252063:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202453.252066:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1734 00000100:00080000:2.0:1788202453.252069:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202453.252071:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202453.252082:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202453.252092:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d500 x1875064728119552/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202453.252127:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728119424:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202453.252212:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202453.252277:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202453/real 1788202453] req@ffff8bc17257f100 x1875064728119424/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202478 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202453.252299:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f100 x1875064728119424/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202478 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202453.252312:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202453.252316:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202453.252319:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728119424:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202453.252325:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728119552:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202453.252345:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202453.252355:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202453/real 1788202453] req@ffff8bc17257d500 x1875064728119552/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202478 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202453.252364:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d500 x1875064728119552/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202478 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202453.252370:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202453.252372:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202453.252375:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728119552:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202454.083951:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202454.147968:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202455.108012:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202455.171940:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202456.131949:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202456.195897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202457.156001:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202457.219949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202458.179921:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202458.243899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202458.371962:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202458.371981:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202458.371986:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202458.371997:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1739 00000100:00080000:0.0:1788202458.372009:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202458.372016:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202458.372060:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143800 x1875064728119680/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202458.372085:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202458.372089:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202458.372091:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202458.372094:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1739 00000100:00080000:0.0:1788202458.372097:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202458.372100:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202458.372110:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202458.372120:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140380 x1875064728119808/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202458.372138:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728119680:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202458.372208:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202458.372282:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202458/real 1788202458] req@ffff8bc144143800 x1875064728119680/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202483 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202458.372302:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143800 x1875064728119680/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202483 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202458.372312:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202458.372315:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202458.372318:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728119680:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202458.372342:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728119808:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202458.372375:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202458.372385:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202458/real 1788202458] req@ffff8bc144140380 x1875064728119808/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202483 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202458.372400:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140380 x1875064728119808/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202483 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202458.372406:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202458.372409:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202458.372411:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728119808:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202459.204041:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202459.268042:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202460.227997:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202460.291885:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202461.251970:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202461.315904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202462.275978:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202462.339843:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202463.299959:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202463.363896:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202463.491905:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202463.491913:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202463.491917:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202463.491925:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1744 00000100:00080000:2.0:1788202463.491935:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202463.491941:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202463.491972:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e300 x1875064728119936/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202463.491994:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202463.491997:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202463.491998:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202463.492004:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1744 00000100:00080000:2.0:1788202463.492006:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202463.492009:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202463.492017:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202463.492027:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c380 x1875064728120064/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202463.492042:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728119936:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202463.492094:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202463.492145:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202463/real 1788202463] req@ffff8bc17257e300 x1875064728119936/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202488 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202463.492166:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e300 x1875064728119936/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202488 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202463.492177:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202463.492180:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202463.492183:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728119936:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202463.492205:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728120064:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202463.492223:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202463.492232:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202463/real 1788202463] req@ffff8bc17257c380 x1875064728120064/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202488 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202463.492245:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c380 x1875064728120064/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202488 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202463.492250:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202463.492252:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202463.492255:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728120064:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202464.323964:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202464.387901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202465.347963:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202465.411853:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202466.372046:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202466.435906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202467.396020:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202467.459991:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202468.420028:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202468.483913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202468.611953:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202468.611964:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202468.611969:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202468.611981:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1749 00000100:00080000:2.0:1788202468.611993:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202468.612001:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202468.612048:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257fb80 x1875064728120192/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202468.612075:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202468.612079:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202468.612080:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202468.612083:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1749 00000100:00080000:2.0:1788202468.612085:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202468.612088:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202468.612098:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202468.612109:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ca80 x1875064728120320/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202468.612128:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728120192:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202468.612223:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202468.612273:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202468/real 1788202468] req@ffff8bc17257fb80 x1875064728120192/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202493 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202468.612289:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257fb80 x1875064728120192/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202493 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202468.612298:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202468.612301:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202468.612305:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728120192:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202468.612328:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728120320:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202468.612346:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202468.612354:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202468/real 1788202468] req@ffff8bc17257ca80 x1875064728120320/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202493 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202468.612363:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ca80 x1875064728120320/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202493 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202468.612370:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202468.612372:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202468.612374:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728120320:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202469.444006:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202469.507939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202470.468029:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202470.531892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202471.492012:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202471.555952:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202472.516069:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202472.579995:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202473.539946:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202473.603897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202473.731974:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202473.731984:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202473.731988:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202473.731997:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1755 00000100:00080000:0.0:1788202473.732015:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202473.732026:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202473.732067:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142300 x1875064728120448/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202473.732105:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202473.732110:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202473.732111:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202473.732114:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1755 00000100:00080000:0.0:1788202473.732117:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202473.732120:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202473.732129:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202473.732140:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141f80 x1875064728120576/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202473.732152:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728120448:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202473.732223:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202473.732284:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202473/real 1788202473] req@ffff8bc144142300 x1875064728120448/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202498 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202473.732308:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142300 x1875064728120448/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202498 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202473.732320:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202473.732325:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202473.732329:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728120448:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202473.732364:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728120576:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202473.732390:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202473.732405:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202473/real 1788202473] req@ffff8bc144141f80 x1875064728120576/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202498 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202473.732419:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141f80 x1875064728120576/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202498 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202473.732436:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202473.732440:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202473.732444:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728120576:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202474.563989:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202474.627940:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202475.587931:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202475.651867:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202476.612001:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202476.675916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202477.635926:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202477.699913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202478.659971:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202478.723900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202478.851887:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202478.851895:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202478.851898:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202478.851905:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1760 00000100:00080000:0.0:1788202478.851914:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202478.851918:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202478.851951:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143b80 x1875064728120704/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202478.851977:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202478.851979:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202478.851981:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202478.851983:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1760 00000100:00080000:0.0:1788202478.851986:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202478.851989:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202478.852009:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202478.852019:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141500 x1875064728120832/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202478.852041:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728120704:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202478.852095:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202478.852148:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202478/real 1788202478] req@ffff8bc144143b80 x1875064728120704/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202503 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202478.852167:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143b80 x1875064728120704/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202503 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202478.852177:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202478.852181:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202478.852185:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728120704:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202478.852193:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728120832:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202478.852214:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202478.852226:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202478/real 1788202478] req@ffff8bc144141500 x1875064728120832/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202503 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202478.852237:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141500 x1875064728120832/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202503 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202478.852245:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202478.852249:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202478.852252:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728120832:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202479.683950:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202479.747962:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202480.707988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202480.771926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202481.732019:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202481.795937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202482.755960:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202482.819940:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202483.779998:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202483.843901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202483.971936:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202483.971950:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202483.971955:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202483.971976:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1765 00000100:00080000:0.0:1788202483.971989:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202483.971996:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202483.972037:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143480 x1875064728120960/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202483.972062:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202483.972066:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202483.972068:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202483.972072:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1765 00000100:00080000:0.0:1788202483.972075:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202483.972081:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202483.972092:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202483.972105:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141880 x1875064728121088/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202483.972117:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728120960:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202483.972186:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202483.972241:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202483/real 1788202483] req@ffff8bc144143480 x1875064728120960/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202508 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202483.972256:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143480 x1875064728120960/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202508 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202483.972264:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202483.972267:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202483.972270:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728120960:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202483.972292:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728121088:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202483.972307:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202483.972315:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202483/real 1788202483] req@ffff8bc144141880 x1875064728121088/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202508 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202483.972322:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141880 x1875064728121088/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202508 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202483.972327:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202483.972329:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202483.972330:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728121088:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202484.803942:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202484.867959:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202485.827972:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202485.891844:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202486.851960:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202486.915892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202487.876028:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202487.939870:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202488.899999:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202488.963933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202489.091899:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202489.091909:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202489.091913:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202489.091923:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1770 00000100:00080000:2.0:1788202489.091933:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202489.091939:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202489.091990:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ea00 x1875064728121216/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202489.092021:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202489.092025:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202489.092026:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202489.092031:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1770 00000100:00080000:2.0:1788202489.092039:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202489.092044:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202489.092055:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202489.092069:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728121216:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202489.092070:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ce00 x1875064728121344/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1788202489.092140:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202489.092207:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202489/real 1788202489] req@ffff8bc17257ea00 x1875064728121216/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202514 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202489.092224:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ea00 x1875064728121216/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202514 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202489.092233:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202489.092236:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202489.092239:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728121216:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202489.092261:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728121344:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202489.092277:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202489.092285:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202489/real 1788202489] req@ffff8bc17257ce00 x1875064728121344/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202514 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202489.092292:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ce00 x1875064728121344/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202514 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202489.092298:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202489.092300:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202489.092302:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728121344:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202489.924028:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202489.987990:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202490.947967:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202491.011906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202491.971970:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202492.035893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202492.995942:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202493.059910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202494.019978:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202494.083922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202494.211878:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202494.211886:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202494.211890:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202494.211899:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1775 00000100:00080000:2.0:1788202494.211909:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202494.211917:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202494.211955:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d880 x1875064728121472/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202494.211976:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202494.211979:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202494.211980:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202494.211982:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1775 00000100:00080000:2.0:1788202494.211985:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202494.211987:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202494.211996:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202494.212005:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ed80 x1875064728121600/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202494.212030:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728121472:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202494.212083:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202494.212126:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202494/real 1788202494] req@ffff8bc17257d880 x1875064728121472/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202519 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202494.212141:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d880 x1875064728121472/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202519 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202494.212150:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202494.212153:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202494.212156:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728121472:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202494.212162:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728121600:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202494.212178:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202494.212186:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202494/real 1788202494] req@ffff8bc17257ed80 x1875064728121600/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202519 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202494.212194:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ed80 x1875064728121600/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202519 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202494.212200:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202494.212202:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202494.212205:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728121600:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202495.043941:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202495.107892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202496.067962:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202496.131905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202497.091896:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202497.155861:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202498.115944:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202498.179897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202499.139985:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202499.203869:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202499.331892:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202499.331901:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202499.331904:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202499.331913:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1780 00000100:00080000:2.0:1788202499.331921:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202499.331929:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202499.331968:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e680 x1875064728121728/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202499.331997:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202499.332000:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202499.332001:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202499.332004:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1780 00000100:00080000:2.0:1788202499.332007:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202499.332010:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202499.332018:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202499.332028:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257df80 x1875064728121856/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202499.332085:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728121728:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202499.332175:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202499.332242:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202499/real 1788202499] req@ffff8bc17257e680 x1875064728121728/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202524 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202499.332263:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e680 x1875064728121728/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202524 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202499.332273:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202499.332277:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202499.332280:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728121728:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202499.332286:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728121856:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202499.332303:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202499.332313:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202499/real 1788202499] req@ffff8bc17257df80 x1875064728121856/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202524 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202499.332321:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257df80 x1875064728121856/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202524 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202499.332328:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202499.332330:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202499.332332:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728121856:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202500.163934:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202500.227917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202501.188046:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202501.251934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202502.211946:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202502.275948:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202503.236022:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202503.299944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202504.259964:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202504.323957:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202504.451959:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202504.451973:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202504.451979:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202504.452004:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1785 00000100:00080000:2.0:1788202504.452018:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202504.452026:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202504.452072:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c000 x1875064728121984/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202504.452103:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202504.452106:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202504.452108:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202504.452111:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1785 00000100:00080000:2.0:1788202504.452113:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202504.452117:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202504.452129:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202504.452146:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f480 x1875064728122112/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202504.452154:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728121984:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202504.452238:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202504.452287:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202504/real 1788202504] req@ffff8bc17257c000 x1875064728121984/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202529 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202504.452303:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c000 x1875064728121984/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202529 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202504.452312:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202504.452315:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202504.452318:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728121984:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202504.452341:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728122112:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202504.452357:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202504.452365:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202504/real 1788202504] req@ffff8bc17257f480 x1875064728122112/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202529 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202504.452373:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f480 x1875064728122112/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202529 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202504.452379:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202504.452381:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202504.452383:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728122112:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202505.284024:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202505.348015:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202506.307971:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202506.371904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202507.331991:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202507.395911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202508.356014:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202508.419899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202509.380057:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202509.443948:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202509.571882:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202509.571893:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202509.571898:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202509.571909:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1790 00000100:00080000:2.0:1788202509.571921:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202509.571928:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202509.571984:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257dc00 x1875064728122240/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202509.572019:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202509.572023:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202509.572032:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202509.572037:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1790 00000100:00080000:2.0:1788202509.572040:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202509.572044:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202509.572054:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202509.572067:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f800 x1875064728122368/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202509.572094:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728122240:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202509.572244:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728122368:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202510.403943:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202510.468016:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202511.427966:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202511.491902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202512.451927:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202512.515863:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788202512.644059:0:10041:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788202512.644097:0:10041:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788202512.644110:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788202512.644147:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:3.0:1788202512.644221:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202509/real 1788202512] req@ffff8bc17257f800 x1875064728122368/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202534 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202512.644266:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f800 x1875064728122368/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202534 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202512.644284:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202512.644292:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202512.644301:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728122368:192.168.201.143@tcp:38:kworker.0 00000100:00100000:3.0:1788202512.644311:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202509/real 1788202512] req@ffff8bc17257dc00 x1875064728122240/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202534 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202512.644327:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257dc00 x1875064728122240/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202534 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202512.644336:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202512.644340:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202512.644344:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728122240:192.168.201.143@tcp:250:kworker.0 00010000:00010000:0.0:1788202513.476009:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202513.539943:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202514.499904:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202514.563881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202514.691962:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202514.691990:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202514.691994:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202514.692007:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1796 00000100:00080000:0.0:1788202514.692022:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202514.692031:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202514.692079:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142a00 x1875064728122496/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202514.692119:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202514.692123:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202514.692125:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202514.692131:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1796 00000100:00080000:0.0:1788202514.692135:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202514.692140:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202514.692151:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202514.692166:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140e00 x1875064728122624/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202514.692242:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728122496:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202514.692336:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202514.692426:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202514/real 1788202514] req@ffff8bc144142a00 x1875064728122496/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202539 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202514.692452:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142a00 x1875064728122496/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202539 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202514.692467:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202514.692474:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202514.692478:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728122496:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202514.692487:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728122624:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202514.692517:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202514.692532:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202514/real 1788202514] req@ffff8bc144140e00 x1875064728122624/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202539 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202514.692545:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140e00 x1875064728122624/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202539 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202514.692553:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202514.692556:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202514.692559:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728122624:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202515.523928:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202515.588102:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202516.548043:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202516.611967:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202517.572003:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202517.635884:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202518.596035:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202518.659925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202519.619948:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202519.683938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202519.811926:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202519.811937:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202519.811942:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202519.811953:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1801 00000100:00080000:0.0:1788202519.811965:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202519.811972:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202519.812017:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140700 x1875064728122752/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202519.812043:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202519.812047:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202519.812048:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202519.812051:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1801 00000100:00080000:0.0:1788202519.812054:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202519.812057:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202519.812066:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202519.812078:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141c00 x1875064728122880/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202519.812118:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728122752:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202519.812198:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202519.812244:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202519/real 1788202519] req@ffff8bc144140700 x1875064728122752/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202544 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202519.812258:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140700 x1875064728122752/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202544 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202519.812266:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202519.812269:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202519.812273:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728122752:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202519.812305:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728122880:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202519.812325:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202519.812333:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202519/real 1788202519] req@ffff8bc144141c00 x1875064728122880/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202544 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202519.812341:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141c00 x1875064728122880/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202544 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202519.812346:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202519.812349:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202519.812351:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728122880:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202520.643955:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202520.707938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202521.667922:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202521.731932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202522.691964:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202522.755872:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202523.715972:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202523.779944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202524.739935:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202524.803870:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202524.931877:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202524.931884:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202524.931887:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202524.931895:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1806 00000100:00080000:0.0:1788202524.931903:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202524.931908:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202524.931949:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141c00 x1875064728123008/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202524.931977:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202524.931981:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202524.931982:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202524.931985:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1806 00000100:00080000:0.0:1788202524.931988:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202524.931991:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202524.931998:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202524.932008:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140700 x1875064728123136/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202524.932031:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728123008:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202524.932091:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202524.932134:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202524/real 1788202524] req@ffff8bc144141c00 x1875064728123008/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202549 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202524.932152:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141c00 x1875064728123008/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202549 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202524.932161:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202524.932165:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202524.932168:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728123008:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202524.932175:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728123136:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202524.932221:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202524.932233:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202524/real 1788202524] req@ffff8bc144140700 x1875064728123136/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202549 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202524.932244:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140700 x1875064728123136/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202549 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202524.932252:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202524.932255:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202524.932259:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728123136:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202525.763988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202525.827911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202526.787950:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202526.851860:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202527.811922:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202527.875907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202528.835938:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202528.899845:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202529.859936:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202529.923872:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202530.051859:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202530.051868:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202530.051871:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202530.051879:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1811 00000100:00080000:2.0:1788202530.051887:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202530.051893:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202530.051923:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257dc00 x1875064728123264/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202530.051943:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202530.051946:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202530.051948:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202530.051955:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1811 00000100:00080000:2.0:1788202530.051959:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202530.051962:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202530.051971:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202530.051980:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728123264:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202530.051982:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f800 x1875064728123392/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1788202530.052045:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202530.052095:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202530/real 1788202530] req@ffff8bc17257dc00 x1875064728123264/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202555 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202530.052140:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257dc00 x1875064728123264/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202555 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202530.052147:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202530.052149:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202530.052152:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728123264:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202530.052171:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728123392:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202530.052186:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202530.052194:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202530/real 1788202530] req@ffff8bc17257f800 x1875064728123392/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202555 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202530.052202:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f800 x1875064728123392/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202555 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202530.052207:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202530.052209:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202530.052211:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728123392:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202530.883987:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202530.948034:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202531.907996:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202531.971858:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202532.932035:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202532.995954:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202533.955996:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202534.019919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202534.980015:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202535.043927:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202535.171917:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202535.171931:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202535.171937:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202535.171950:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1816 00000100:00080000:2.0:1788202535.171964:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202535.171973:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202535.172048:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f480 x1875064728123520/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202535.172085:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202535.172089:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202535.172092:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202535.172096:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1816 00000100:00080000:2.0:1788202535.172100:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202535.172105:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202535.172118:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202535.172134:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c000 x1875064728123648/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202535.172146:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728123520:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202535.172239:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202535.172317:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202535/real 1788202535] req@ffff8bc17257f480 x1875064728123520/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202560 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202535.172341:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f480 x1875064728123520/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202560 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202535.172355:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202535.172360:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202535.172365:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728123520:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202535.172397:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728123648:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202535.172424:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202535.172440:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202535/real 1788202535] req@ffff8bc17257c000 x1875064728123648/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202560 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202535.172464:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c000 x1875064728123648/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202560 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202535.172475:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202535.172479:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202535.172483:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728123648:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202536.004031:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202536.067963:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202537.027926:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202537.091894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202538.052006:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202538.115908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202539.075994:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202539.139900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202540.100006:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202540.163886:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202540.291894:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202540.291905:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202540.291910:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202540.291921:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1821 00000100:00080000:2.0:1788202540.291952:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202540.291959:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202540.291994:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257df80 x1875064728123776/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202540.292016:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202540.292019:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202540.292021:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202540.292023:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1821 00000100:00080000:2.0:1788202540.292025:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202540.292028:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202540.292040:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202540.292050:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e680 x1875064728123904/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202540.292068:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728123776:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202540.292124:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202540.292161:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202540/real 1788202540] req@ffff8bc17257df80 x1875064728123776/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202565 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202540.292175:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257df80 x1875064728123776/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202565 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202540.292191:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202540.292194:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202540.292197:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728123776:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202540.292218:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728123904:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202540.292233:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202540.292241:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202540/real 1788202540] req@ffff8bc17257e680 x1875064728123904/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202565 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202540.292249:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e680 x1875064728123904/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202565 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202540.292255:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202540.292257:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202540.292259:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728123904:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202541.123958:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202541.187957:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202542.147969:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202542.211965:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202543.171969:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202543.235905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202544.196020:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202544.259866:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202545.219992:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202545.283959:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202545.411905:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202545.411917:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202545.411921:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202545.411932:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1826 00000100:00080000:0.0:1788202545.411944:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202545.411952:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202545.411996:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140e00 x1875064728124032/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202545.412029:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202545.412032:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202545.412033:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202545.412036:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1826 00000100:00080000:0.0:1788202545.412039:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202545.412043:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202545.412056:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202545.412080:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142a00 x1875064728124160/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202545.412085:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728124032:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202545.412169:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202545.412244:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202545/real 1788202545] req@ffff8bc144140e00 x1875064728124032/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202570 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202545.412267:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140e00 x1875064728124032/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202570 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202545.412280:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202545.412285:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202545.412289:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728124032:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202545.412322:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728124160:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202545.412343:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202545.412352:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202545/real 1788202545] req@ffff8bc144142a00 x1875064728124160/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202570 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202545.412362:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142a00 x1875064728124160/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202570 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202545.412368:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202545.412371:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202545.412373:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728124160:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202546.244004:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202546.307914:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202547.267994:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202547.331883:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202548.291995:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202548.355962:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202549.315918:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202549.379863:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202550.339957:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202550.403912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202550.531868:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202550.531878:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202550.531883:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202550.531893:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1831 00000100:00080000:0.0:1788202550.531903:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202550.531911:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202550.531946:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141880 x1875064728124288/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202550.531973:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202550.531976:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202550.531979:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202550.531983:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1831 00000100:00080000:0.0:1788202550.531987:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202550.531991:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202550.532000:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202550.532017:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728124288:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202550.532024:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143480 x1875064728124416/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:3.0:1788202550.532079:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202550.532121:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202550/real 1788202550] req@ffff8bc144141880 x1875064728124288/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202575 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202550.532136:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141880 x1875064728124288/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202575 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202550.532144:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202550.532147:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202550.532150:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728124288:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202550.532171:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728124416:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202550.532187:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202550.532195:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202550/real 1788202550] req@ffff8bc144143480 x1875064728124416/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202575 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202550.532203:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143480 x1875064728124416/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202575 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202550.532209:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202550.532211:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202550.532213:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728124416:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202551.363961:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202551.427945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202552.387973:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202552.451898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202553.411935:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202553.475888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202554.436058:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202554.499915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202555.460026:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202555.523978:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202555.651898:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202555.651913:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202555.651919:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202555.651933:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1837 00000100:00080000:0.0:1788202555.651948:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202555.651958:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202555.652013:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141500 x1875064728124544/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202555.652049:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202555.652053:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202555.652055:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202555.652059:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1837 00000100:00080000:0.0:1788202555.652063:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202555.652067:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202555.652080:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202555.652098:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143b80 x1875064728124672/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202555.652098:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728124544:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202555.652177:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202555.652238:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202555/real 1788202555] req@ffff8bc144141500 x1875064728124544/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202580 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202555.652253:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141500 x1875064728124544/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202580 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202555.652262:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202555.652266:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202555.652270:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728124544:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202555.652299:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728124672:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202555.652316:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202555.652325:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202555/real 1788202555] req@ffff8bc144143b80 x1875064728124672/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202580 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202555.652334:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143b80 x1875064728124672/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202580 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202555.652345:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202555.652347:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202555.652349:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728124672:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202556.483985:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202556.547948:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202557.507980:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202557.571883:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202558.532004:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202558.595923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202559.555948:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202559.619889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202560.579938:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202560.643918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202560.771907:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202560.771919:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202560.771924:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202560.771935:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1842 00000100:00080000:0.0:1788202560.771946:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202560.771953:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202560.771990:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141f80 x1875064728124800/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202560.772024:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202560.772028:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202560.772030:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202560.772035:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1842 00000100:00080000:0.0:1788202560.772038:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202560.772041:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202560.772050:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202560.772062:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142300 x1875064728124928/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202560.772080:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728124800:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202560.772151:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202560.772207:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202560/real 1788202560] req@ffff8bc144141f80 x1875064728124800/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202585 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202560.772227:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141f80 x1875064728124800/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202585 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202560.772238:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202560.772241:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202560.772245:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728124800:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202560.772273:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728124928:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202560.772296:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202560.772324:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202560/real 1788202560] req@ffff8bc144142300 x1875064728124928/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202585 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202560.772340:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142300 x1875064728124928/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202585 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202560.772348:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202560.772352:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202560.772356:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728124928:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202561.603975:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202561.668023:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202562.627994:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202562.691940:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202563.651983:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202563.715934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202564.676023:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202564.739889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202565.699982:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202565.763848:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202565.891929:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202565.891941:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202565.891946:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202565.891957:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1847 00000100:00080000:3.0:1788202565.891968:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202565.891976:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202565.892014:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728125056/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202565.892039:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202565.892042:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202565.892043:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202565.892046:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1847 00000100:00080000:3.0:1788202565.892049:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202565.892051:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202565.892059:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202565.892068:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728125184/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202565.892083:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728125056:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202565.892137:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202565.892174:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202565/real 1788202565] req@ffff8bc1726cf480 x1875064728125056/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202590 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202565.892199:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728125056/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202590 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202565.892210:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202565.892215:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202565.892220:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728125056:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202565.892247:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728125184:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202565.892271:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202565.892285:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202565/real 1788202565] req@ffff8bc1726cf100 x1875064728125184/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202590 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202565.892296:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728125184/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202590 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202565.892303:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202565.892305:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202565.892307:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728125184:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202566.723948:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202566.787937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202567.748016:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202567.811912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202568.772016:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202568.835889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202569.796008:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202569.859925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202570.820015:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202570.883876:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202571.011945:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202571.011956:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202571.011970:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202571.011982:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1852 00000100:00080000:3.0:1788202571.011995:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202571.012002:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202571.012049:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728125312/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202571.012077:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202571.012081:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202571.012082:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202571.012085:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1852 00000100:00080000:3.0:1788202571.012087:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202571.012090:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202571.012099:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202571.012109:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728125440/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202571.012154:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728125312:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202571.012234:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202571.012292:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202571/real 1788202571] req@ffff8bc1726cd180 x1875064728125312/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202596 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202571.012313:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728125312/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202596 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202571.012330:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202571.012335:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202571.012339:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728125312:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202571.012346:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728125440:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202571.012368:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202571.012380:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202571/real 1788202571] req@ffff8bc1726cc700 x1875064728125440/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202596 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202571.012406:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728125440/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202596 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202571.012416:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202571.012420:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202571.012423:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728125440:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202571.843959:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202571.907999:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202572.868006:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202572.931942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202573.891967:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202573.955943:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202574.915941:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202574.979885:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202575.940039:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202576.003919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202576.131882:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202576.131893:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202576.131898:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202576.131909:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1857 00000100:00080000:3.0:1788202576.131920:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202576.131929:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202576.131966:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728125568/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202576.131996:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202576.132000:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202576.132002:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202576.132006:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1857 00000100:00080000:3.0:1788202576.132010:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202576.132015:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202576.132025:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202576.132038:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728125568:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202576.132040:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728125696/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202576.132133:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728125696:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202576.963955:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202577.027882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202577.988004:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202578.051899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202579.011987:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202579.075853:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788202579.204073:0:10042:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788202579.204131:0:10042:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788202579.204165:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788202579.204213:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788202579.204492:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202576/real 1788202579] req@ffff8bc1726cdf80 x1875064728125696/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202601 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202579.204521:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728125696/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202601 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202579.204536:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202579.204542:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202579.204547:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728125696:192.168.201.143@tcp:38:kworker.0 00000100:00100000:2.0:1788202579.204555:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202576/real 1788202579] req@ffff8bc1726cf800 x1875064728125568/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202601 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202579.204570:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728125568/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202601 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202579.204578:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202579.204582:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202579.204585:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728125568:192.168.201.143@tcp:250:kworker.0 00010000:00010000:3.0:1788202580.035941:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202580.099844:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202581.059956:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202581.123916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202581.251932:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202581.251944:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202581.251949:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202581.251959:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1862 00000100:00080000:3.0:1788202581.251969:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202581.251976:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202581.252014:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728125824/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202581.252051:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202581.252055:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202581.252057:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202581.252061:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1862 00000100:00080000:3.0:1788202581.252064:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202581.252069:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202581.252079:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202581.252094:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728125952/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202581.252104:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728125824:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202581.252182:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202581.252246:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202581/real 1788202581] req@ffff8bc1726cf800 x1875064728125824/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202606 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202581.252266:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728125824/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202606 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202581.252279:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202581.252283:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202581.252288:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728125824:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202581.252316:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728125952:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202581.252355:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202581.252370:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202581/real 1788202581] req@ffff8bc1726cdf80 x1875064728125952/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202606 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202581.252390:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728125952/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202606 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202581.252399:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202581.252402:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202581.252405:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728125952:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202582.083995:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202582.147923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202583.107960:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202583.171876:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202584.131954:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202584.195891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202585.155963:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202585.219867:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202586.179949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202586.243893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202586.371881:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202586.371890:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202586.371893:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202586.371902:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1867 00000100:00080000:2.0:1788202586.371911:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202586.371917:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202586.371948:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ed80 x1875064728126080/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202586.371971:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202586.371974:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202586.371975:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202586.371978:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1867 00000100:00080000:2.0:1788202586.371980:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202586.371983:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202586.371991:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202586.372000:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d880 x1875064728126208/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202586.372010:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728126080:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202586.372074:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202586.372136:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202586/real 1788202586] req@ffff8bc17257ed80 x1875064728126080/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202611 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202586.372158:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ed80 x1875064728126080/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202611 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202586.372169:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202586.372173:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202586.372178:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728126080:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202586.372202:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728126208:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202586.372224:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202586.372236:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202586/real 1788202586] req@ffff8bc17257d880 x1875064728126208/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202611 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202586.372250:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d880 x1875064728126208/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202611 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202586.372259:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202586.372262:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202586.372266:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728126208:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202587.204037:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202587.267910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202588.227937:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202588.291896:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202589.252018:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202589.315928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202590.275949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202590.339920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202591.300005:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202591.363971:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202591.491925:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202591.491939:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202591.491944:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202591.491957:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1872 00000100:00080000:3.0:1788202591.491970:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202591.491978:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202591.492050:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728126336/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202591.492087:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202591.492091:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202591.492093:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202591.492098:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1872 00000100:00080000:3.0:1788202591.492103:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202591.492109:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202591.492120:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202591.492135:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728126336:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202591.492138:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728126464/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788202591.492211:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202591.492265:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202591/real 1788202591] req@ffff8bc1726cc700 x1875064728126336/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202616 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202591.492282:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728126336/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202616 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202591.492294:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202591.492299:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202591.492304:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728126336:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202591.492333:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728126464:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202591.492368:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202591.492379:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202591/real 1788202591] req@ffff8bc1726cd180 x1875064728126464/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202616 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202591.492389:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728126464/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202616 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202591.492398:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202591.492402:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202591.492405:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728126464:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202592.323951:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202592.387935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202593.348047:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202593.411890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202594.372060:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202594.435894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202595.396035:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202595.459878:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202596.420052:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202596.483869:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202596.611932:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202596.611958:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202596.611964:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202596.611978:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1877 00000100:00080000:0.0:1788202596.611992:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202596.612001:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202596.612050:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140380 x1875064728126592/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202596.612083:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202596.612087:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202596.612090:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202596.612094:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1877 00000100:00080000:0.0:1788202596.612098:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202596.612104:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202596.612117:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202596.612131:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143800 x1875064728126720/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202596.612138:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728126592:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202596.612220:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202596.612294:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202596/real 1788202596] req@ffff8bc144140380 x1875064728126592/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202621 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202596.612315:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140380 x1875064728126592/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202621 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202596.612327:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202596.612331:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202596.612336:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728126592:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202596.612367:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728126720:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202596.612400:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202596.612414:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202596/real 1788202596] req@ffff8bc144143800 x1875064728126720/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202621 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202596.612427:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143800 x1875064728126720/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202621 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202596.612436:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202596.612440:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202596.612444:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728126720:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202597.443988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202597.507920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202598.468051:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202598.531870:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202599.491938:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202599.555920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202600.516567:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202600.579875:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202601.540060:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202601.603929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202601.731966:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202601.731982:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202601.731989:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202601.732003:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1883 00000100:00080000:2.0:1788202601.732019:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202601.732028:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202601.732076:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ce00 x1875064728126848/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202601.732109:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202601.732113:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202601.732114:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202601.732117:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1883 00000100:00080000:2.0:1788202601.732120:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202601.732123:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202601.732133:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202601.732143:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ea00 x1875064728126976/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202601.732192:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728126848:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202601.732255:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202601.732304:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202601/real 1788202601] req@ffff8bc17257ce00 x1875064728126848/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202626 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202601.732319:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ce00 x1875064728126848/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202626 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202601.732328:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202601.732331:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202601.732334:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728126848:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202601.732341:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728126976:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202601.732355:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202601.732365:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202601/real 1788202601] req@ffff8bc17257ea00 x1875064728126976/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202626 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202601.732372:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ea00 x1875064728126976/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202626 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202601.732378:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202601.732380:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202601.732382:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728126976:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202602.563978:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202602.627964:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202603.588045:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202603.651948:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202604.612064:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202604.675941:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202605.635974:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202605.699915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202606.659978:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202606.723936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202606.851955:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202606.851966:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202606.851971:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202606.851983:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1888 00000100:00080000:3.0:1788202606.851995:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202606.852001:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202606.852054:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728127104/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202606.852087:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202606.852092:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202606.852094:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202606.852099:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1888 00000100:00080000:3.0:1788202606.852104:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202606.852110:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202606.852123:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202606.852133:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728127104:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202606.852143:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728127232/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788202606.852216:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202606.852285:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202606/real 1788202606] req@ffff8bc1726cf100 x1875064728127104/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202631 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202606.852307:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728127104/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202631 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202606.852319:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202606.852325:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202606.852330:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728127104:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202606.852358:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728127232:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202606.852382:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202606.852394:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202606/real 1788202606] req@ffff8bc1726cf480 x1875064728127232/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202631 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202606.852407:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728127232/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202631 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202606.852415:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202606.852419:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202606.852422:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728127232:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202607.684010:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202607.747962:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202608.707959:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202608.771904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202609.731962:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202609.795930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202610.756014:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202610.819941:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202611.779958:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202611.843959:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202611.971966:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202611.971977:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202611.971981:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202611.971993:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1893 00000100:00080000:0.0:1788202611.972005:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202611.972013:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202611.972057:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143100 x1875064728127360/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202611.972082:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202611.972085:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202611.972087:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202611.972090:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1893 00000100:00080000:0.0:1788202611.972092:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202611.972095:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202611.972105:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202611.972115:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140000 x1875064728127488/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202611.972167:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728127360:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202611.972231:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202611.972275:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202611/real 1788202611] req@ffff8bc144143100 x1875064728127360/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202636 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202611.972289:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143100 x1875064728127360/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202636 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202611.972298:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202611.972301:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202611.972304:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728127360:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202611.972311:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728127488:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202611.972325:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202611.972333:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202611/real 1788202611] req@ffff8bc144140000 x1875064728127488/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202636 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202611.972341:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140000 x1875064728127488/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202636 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202611.972347:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202611.972349:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202611.972351:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728127488:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202612.804010:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202612.867951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202613.827963:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202613.891941:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202614.851946:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202614.915927:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202615.876035:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202615.939943:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202616.899936:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202616.963932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202617.091903:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202617.091917:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202617.091922:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202617.091934:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1898 00000100:00080000:2.0:1788202617.091945:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202617.091953:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202617.091996:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ca80 x1875064728127616/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202617.092026:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202617.092029:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202617.092031:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202617.092033:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1898 00000100:00080000:2.0:1788202617.092036:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202617.092040:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202617.092050:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202617.092061:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257fb80 x1875064728127744/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202617.092106:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728127616:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202617.092185:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202617.092234:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202617/real 1788202617] req@ffff8bc17257ca80 x1875064728127616/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202642 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202617.092254:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ca80 x1875064728127616/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202642 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202617.092266:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202617.092271:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202617.092276:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728127616:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202617.092284:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728127744:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202617.092305:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202617.092317:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202617/real 1788202617] req@ffff8bc17257fb80 x1875064728127744/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202642 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202617.092330:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257fb80 x1875064728127744/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202642 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202617.092346:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202617.092350:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202617.092353:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728127744:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202617.924033:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202617.987902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202618.947961:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202619.011910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202619.971986:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202620.035907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202620.995995:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202621.059943:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202622.019993:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202622.083898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202622.211935:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202622.211949:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202622.211955:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202622.211970:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1903 00000100:00080000:0.0:1788202622.211984:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202622.211994:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202622.212045:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140a80 x1875064728127872/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202622.212080:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202622.212085:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202622.212087:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202622.212092:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1903 00000100:00080000:0.0:1788202622.212096:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202622.212101:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202622.212113:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202622.212130:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142680 x1875064728128000/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202622.212147:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728127872:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202622.212223:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202622.212279:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202622/real 1788202622] req@ffff8bc144140a80 x1875064728127872/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202647 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202622.212301:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140a80 x1875064728127872/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202647 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202622.212314:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202622.212317:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202622.212321:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728127872:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202622.212345:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728128000:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202622.212365:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202622.212374:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202622/real 1788202622] req@ffff8bc144142680 x1875064728128000/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202647 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202622.212382:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142680 x1875064728128000/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202647 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202622.212388:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202622.212391:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202622.212393:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728128000:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202623.044016:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202623.107942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202624.067941:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202624.131882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202625.091983:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202625.155898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202626.115997:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202626.179908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202627.139989:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202627.203888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202627.331995:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202627.332011:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202627.332017:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202627.332031:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1908 00000100:00080000:3.0:1788202627.332058:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202627.332069:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202627.332125:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728128128/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202627.332163:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202627.332168:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202627.332170:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202627.332175:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1908 00000100:00080000:3.0:1788202627.332179:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202627.332184:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202627.332197:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202627.332213:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728128256/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202627.332221:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728128128:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202627.332291:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202627.332351:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202627/real 1788202627] req@ffff8bc1726cd500 x1875064728128128/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202652 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202627.332367:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728128128/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202652 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202627.332376:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202627.332379:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202627.332382:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728128128:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202627.332405:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728128256:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202627.332438:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202627.332448:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202627/real 1788202627] req@ffff8bc1726cca80 x1875064728128256/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202652 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202627.332457:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728128256/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202652 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202627.332464:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202627.332466:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202627.332469:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728128256:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202628.164010:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202628.227965:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202629.187920:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202629.251885:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202630.211963:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202630.275898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202631.235946:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202631.299873:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202632.259949:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202632.323908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202632.451895:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202632.451906:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202632.451917:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202632.451929:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1913 00000100:00080000:3.0:1788202632.451940:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202632.451949:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202632.451987:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728128384/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202632.452019:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202632.452023:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202632.452026:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202632.452031:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1913 00000100:00080000:3.0:1788202632.452035:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202632.452040:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202632.452050:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202632.452065:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728128512/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202632.452071:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728128384:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202632.452126:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202632.452175:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202632/real 1788202632] req@ffff8bc1726cfb80 x1875064728128384/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202657 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202632.452193:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728128384/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202657 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202632.452204:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202632.452209:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202632.452213:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728128384:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202632.452234:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728128512:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202632.452252:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202632.452261:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202632/real 1788202632] req@ffff8bc1726ced80 x1875064728128512/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202657 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202632.452269:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728128512/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202657 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202632.452275:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202632.452277:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202632.452280:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728128512:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202633.284060:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202633.347966:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202634.307932:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202634.371909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202635.331988:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202635.395939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202636.355970:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202636.419919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202637.380002:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202637.443920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202637.571911:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202637.571922:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202637.571928:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202637.571940:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1918 00000100:00080000:3.0:1788202637.571955:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202637.571964:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202637.572020:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728128640/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202637.572050:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202637.572054:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202637.572055:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202637.572059:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1918 00000100:00080000:3.0:1788202637.572062:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202637.572065:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202637.572075:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202637.572085:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728128768/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202637.572098:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728128640:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202637.572174:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202637.572227:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202637/real 1788202637] req@ffff8bc1726cea00 x1875064728128640/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202662 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202637.572257:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728128640/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202662 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202637.572266:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202637.572269:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202637.572273:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728128640:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202637.572298:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728128768:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202637.572317:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202637.572326:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202637/real 1788202637] req@ffff8bc1726ce300 x1875064728128768/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202662 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202637.572334:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728128768/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202662 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202637.572340:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202637.572343:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202637.572345:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728128768:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202638.403920:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202638.467923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202639.428010:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202639.491898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202640.452033:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202640.515926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202641.475992:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202641.539884:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202642.499996:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202642.563890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202642.691917:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202642.691932:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202642.691938:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202642.691952:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1924 00000100:00080000:2.0:1788202642.691966:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202642.691976:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202642.692026:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c380 x1875064728128896/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202642.692061:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202642.692066:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202642.692069:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202642.692075:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1924 00000100:00080000:2.0:1788202642.692079:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202642.692084:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202642.692094:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728128896:192.168.201.143@tcp:250:kworker.0 00000008:00100000:2.0:1788202642.692097:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202642.692117:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e300 x1875064728129024/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202642.692229:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728129024:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202643.523902:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202643.587963:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202644.547937:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202644.611878:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202645.571908:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202645.635904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:3.0:1788202645.764192:0:10043:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:3.0:1788202645.764264:0:10043:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:3.0:1788202645.764287:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:3.0:1788202645.764348:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788202645.764422:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202642/real 1788202645] req@ffff8bc17257e300 x1875064728129024/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202667 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202645.764474:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e300 x1875064728129024/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202667 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202645.764490:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202645.764496:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202645.764502:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728129024:192.168.201.143@tcp:38:kworker.0 00000100:00100000:2.0:1788202645.764512:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202642/real 1788202645] req@ffff8bc17257c380 x1875064728128896/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202667 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202645.764529:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c380 x1875064728128896/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202667 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202645.764537:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202645.764541:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202645.764544:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728128896:192.168.201.143@tcp:250:kworker.0 00010000:00010000:0.0:1788202646.595925:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202646.659856:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202647.619986:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202647.683861:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788202647.811941:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788202647.811949:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788202647.811953:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202647.811962:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1929 00000100:00080000:1.0:1788202647.811971:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202647.811977:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788202647.812008:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6680 x1875064728129152/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788202647.812027:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788202647.812031:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788202647.812032:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202647.812035:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1929 00000100:00080000:1.0:1788202647.812037:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202647.812040:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788202647.812048:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202647.812085:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728129152:192.168.201.143@tcp:250:kworker.0 00000100:00100000:1.0:1788202647.812096:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5500 x1875064728129280/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788202647.812144:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202647.812186:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202647/real 1788202647] req@ffff8bc1727d6680 x1875064728129152/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202672 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202647.812201:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6680 x1875064728129152/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202672 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202647.812215:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202647.812220:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202647.812224:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728129152:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202647.812249:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728129280:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202647.812273:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202647.812287:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202647/real 1788202647] req@ffff8bc1727d5500 x1875064728129280/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202672 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202647.812300:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5500 x1875064728129280/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202672 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202647.812309:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202647.812312:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202647.812315:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728129280:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202648.643932:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202648.707927:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202649.667988:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202649.731928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202650.691928:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202650.755881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202651.716100:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202651.781070:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202652.739913:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202652.803887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788202652.931997:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788202652.932110:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788202652.932114:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202652.932123:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1934 00000100:00080000:1.0:1788202652.932132:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202652.932139:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788202652.932175:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5f80 x1875064728129408/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788202652.932204:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788202652.932207:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788202652.932208:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202652.932211:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1934 00000100:00080000:1.0:1788202652.932213:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202652.932215:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788202652.932222:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788202652.932231:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4380 x1875064728129536/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202652.932287:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728129408:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202652.932392:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202652.932450:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202652/real 1788202652] req@ffff8bc1727d5f80 x1875064728129408/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202677 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202652.932474:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5f80 x1875064728129408/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202677 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202652.932486:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202652.932491:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202652.932496:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728129408:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202652.932504:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728129536:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202652.932529:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202652.932543:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202652/real 1788202652] req@ffff8bc1727d4380 x1875064728129536/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202677 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202652.932558:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4380 x1875064728129536/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202677 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202652.932568:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202652.932572:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202652.932575:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728129536:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202653.763996:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202653.827977:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202654.788005:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202654.851875:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202655.811918:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202655.875894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202656.836008:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202656.899891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202657.859996:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202657.923964:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788202658.051867:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788202658.051877:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788202658.051906:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202658.051915:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1939 00000100:00080000:1.0:1788202658.051924:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202658.051930:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788202658.051969:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4000 x1875064728129664/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788202658.052001:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788202658.052005:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788202658.052007:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202658.052012:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1939 00000100:00080000:1.0:1788202658.052016:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202658.052021:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788202658.052031:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788202658.052049:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5180 x1875064728129792/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202658.052066:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728129664:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202658.052120:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202658.052172:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202658/real 1788202658] req@ffff8bc1727d4000 x1875064728129664/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202683 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202658.052194:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4000 x1875064728129664/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202683 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202658.052206:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202658.052211:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202658.052216:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728129664:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202658.052241:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728129792:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202658.052260:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202658.052270:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202658/real 1788202658] req@ffff8bc1727d5180 x1875064728129792/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202683 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202658.052279:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5180 x1875064728129792/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202683 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202658.052285:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202658.052287:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202658.052289:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728129792:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202658.883949:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202658.947956:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202659.908030:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202659.971926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202660.932033:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202660.995881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202661.956004:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202662.019863:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202662.980029:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202663.043886:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202663.171959:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202663.171971:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202663.171976:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202663.171987:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1944 00000100:00080000:0.0:1788202663.172000:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202663.172132:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202663.172177:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142d80 x1875064728129920/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202663.172211:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202663.172215:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202663.172217:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202663.172221:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1944 00000100:00080000:0.0:1788202663.172229:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202663.172233:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202663.172241:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202663.172251:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141180 x1875064728130048/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202663.172284:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728129920:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202663.172353:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202663.172402:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202663/real 1788202663] req@ffff8bc144142d80 x1875064728129920/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202688 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202663.172422:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142d80 x1875064728129920/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202688 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202663.172433:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202663.172437:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202663.172442:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728129920:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202663.172450:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728130048:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202663.172473:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202663.172486:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202663/real 1788202663] req@ffff8bc144141180 x1875064728130048/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202688 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202663.172500:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141180 x1875064728130048/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202688 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202663.172510:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202663.172513:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202663.172517:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728130048:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202664.003973:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202664.067950:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202665.028004:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202665.091852:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202666.051918:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202666.115865:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202667.075968:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202667.139952:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202668.099929:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202668.163858:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202668.291987:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202668.291997:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202668.292002:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202668.292012:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1949 00000100:00080000:0.0:1788202668.292024:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202668.292032:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202668.292078:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141180 x1875064728130176/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202668.292109:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202668.292114:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202668.292117:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202668.292121:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1949 00000100:00080000:0.0:1788202668.292125:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202668.292129:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202668.292143:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202668.292159:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142d80 x1875064728130304/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202668.292184:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728130176:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202668.292255:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202668.292309:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202668/real 1788202668] req@ffff8bc144141180 x1875064728130176/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202693 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202668.292330:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141180 x1875064728130176/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202693 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202668.292340:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202668.292343:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202668.292346:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728130176:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202668.292370:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728130304:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202668.292390:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202668.292399:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202668/real 1788202668] req@ffff8bc144142d80 x1875064728130304/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202693 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202668.292412:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142d80 x1875064728130304/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202693 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202668.292427:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202668.292431:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202668.292434:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728130304:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202669.123977:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202669.187930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202670.147922:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202670.211858:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202671.171980:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202671.235907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202672.195969:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202672.259895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202673.219943:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202673.283873:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788202673.411931:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788202673.411942:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788202673.411946:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202673.411956:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1954 00000100:00080000:1.0:1788202673.411966:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202673.411974:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788202673.412016:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7480 x1875064728130432/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788202673.412044:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788202673.412049:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788202673.412051:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202673.412055:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1954 00000100:00080000:1.0:1788202673.412058:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202673.412062:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788202673.412072:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788202673.412085:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5880 x1875064728130560/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202673.412103:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728130432:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202673.412160:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202673.412199:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202673/real 1788202673] req@ffff8bc1727d7480 x1875064728130432/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202698 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202673.412213:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7480 x1875064728130432/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202698 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202673.412221:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202673.412225:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202673.412227:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728130432:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202673.412245:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728130560:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202673.412260:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202673.412267:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202673/real 1788202673] req@ffff8bc1727d5880 x1875064728130560/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202698 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202673.412275:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5880 x1875064728130560/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202698 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202673.412281:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202673.412283:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202673.412285:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728130560:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202674.243997:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202674.307935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202675.267943:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202675.331905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202676.291990:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202676.355907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202677.315943:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202677.379929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202678.339985:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202678.403920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202678.531907:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202678.531916:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202678.531919:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202678.531928:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1959 00000100:00080000:0.0:1788202678.531937:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202678.531944:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202678.531982:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142680 x1875064728130688/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202678.532007:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202678.532010:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202678.532012:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202678.532015:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1959 00000100:00080000:0.0:1788202678.532018:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202678.532021:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202678.532030:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202678.532042:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140a80 x1875064728130816/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202678.532060:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728130688:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202678.532116:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202678.532162:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202678/real 1788202678] req@ffff8bc144142680 x1875064728130688/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202703 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202678.532178:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142680 x1875064728130688/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202703 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202678.532187:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202678.532190:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202678.532194:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728130688:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202678.532212:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728130816:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202678.532227:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202678.532235:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202678/real 1788202678] req@ffff8bc144140a80 x1875064728130816/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202703 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202678.532244:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140a80 x1875064728130816/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202703 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202678.532249:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202678.532252:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202678.532254:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728130816:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202679.363969:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202679.427932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202680.387993:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202680.451883:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202681.411979:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202681.475899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202682.436007:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202682.499934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202683.459905:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202683.523884:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202683.651933:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202683.651944:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202683.651948:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202683.651958:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1965 00000100:00080000:3.0:1788202683.651968:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202683.651975:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202683.652012:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728130944/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202683.652041:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202683.652044:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202683.652045:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202683.652048:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1965 00000100:00080000:3.0:1788202683.652051:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202683.652054:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202683.652062:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202683.652074:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728131072/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202683.652083:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728130944:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202683.652139:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202683.652174:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202683/real 1788202683] req@ffff8bc1726cc380 x1875064728130944/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202708 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202683.652188:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728130944/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202708 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202683.652195:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202683.652198:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202683.652201:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728130944:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202683.652220:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728131072:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202683.652234:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202683.652242:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202683/real 1788202683] req@ffff8bc1726ce680 x1875064728131072/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202708 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202683.652251:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728131072/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202708 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202683.652256:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202683.652259:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202683.652261:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728131072:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202684.483969:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202684.547936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202685.507946:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202685.571906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202686.531990:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202686.595924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202687.555934:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202687.619870:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202688.579938:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202688.643888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202688.771884:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202688.771893:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202688.771896:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202688.771905:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1970 00000100:00080000:3.0:1788202688.771915:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202688.771923:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202688.771959:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728131200/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202688.771997:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202688.772005:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202688.772008:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202688.772012:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1970 00000100:00080000:3.0:1788202688.772017:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202688.772022:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202688.772030:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202688.772041:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728131328/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202688.772049:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728131200:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202688.772110:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202688.772174:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202688/real 1788202688] req@ffff8bc1726cdc00 x1875064728131200/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202713 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202688.772189:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728131200/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202713 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202688.772202:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202688.772205:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202688.772208:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728131200:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202688.772228:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728131328:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202688.772244:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202688.772254:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202688/real 1788202688] req@ffff8bc1726cce00 x1875064728131328/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202713 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202688.772262:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728131328/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202713 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202688.772268:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202688.772270:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202688.772272:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728131328:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202689.603989:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202689.668061:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202690.627983:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202690.691843:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202691.651965:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202691.715899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202692.675911:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202692.739898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202693.699983:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202693.763887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202693.891929:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202693.891938:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202693.891942:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202693.891950:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1975 00000100:00080000:2.0:1788202693.891959:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202693.891966:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202693.892009:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c380 x1875064728131456/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202693.892032:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202693.892036:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202693.892038:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202693.892040:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1975 00000100:00080000:2.0:1788202693.892043:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202693.892045:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202693.892053:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202693.892063:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e300 x1875064728131584/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202693.892076:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728131456:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202693.892139:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202693.892208:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202693/real 1788202693] req@ffff8bc17257c380 x1875064728131456/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202718 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202693.892229:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c380 x1875064728131456/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202718 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202693.892240:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202693.892245:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202693.892249:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728131456:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202693.892304:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728131584:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202693.892323:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202693.892333:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202693/real 1788202693] req@ffff8bc17257e300 x1875064728131584/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202718 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202693.892342:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e300 x1875064728131584/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202718 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202693.892348:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202693.892350:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202693.892352:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728131584:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202694.723931:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202694.787930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202695.748024:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202695.811948:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202696.771966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202696.835975:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202697.796042:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202697.859894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202698.819994:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202698.883934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788202699.011960:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788202699.011971:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788202699.011976:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202699.011987:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1980 00000100:00080000:1.0:1788202699.011999:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202699.012006:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788202699.012052:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5880 x1875064728131712/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788202699.012081:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788202699.012085:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788202699.012088:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202699.012092:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1980 00000100:00080000:1.0:1788202699.012096:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202699.012100:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788202699.012113:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788202699.012130:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7480 x1875064728131840/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202699.012148:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728131712:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202699.012242:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202699.012305:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202699/real 1788202699] req@ffff8bc1727d5880 x1875064728131712/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202724 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202699.012327:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5880 x1875064728131712/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202724 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202699.012340:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202699.012344:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202699.012349:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728131712:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202699.012379:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728131840:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202699.012401:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202699.012414:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202699/real 1788202699] req@ffff8bc1727d7480 x1875064728131840/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202724 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202699.012428:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7480 x1875064728131840/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202724 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202699.012437:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202699.012440:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202699.012445:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728131840:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202699.844049:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202699.907909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202700.867946:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202700.931878:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202701.891973:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202701.955931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202702.915986:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202702.979900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202703.939974:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202704.003904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788202704.131929:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788202704.131943:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788202704.131949:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202704.131962:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1985 00000100:00080000:1.0:1788202704.131976:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202704.131985:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788202704.132038:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5180 x1875064728131968/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788202704.132073:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788202704.132077:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788202704.132092:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202704.132097:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1985 00000100:00080000:1.0:1788202704.132102:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202704.132107:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788202704.132120:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788202704.132136:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4000 x1875064728132096/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202704.132163:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728131968:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202704.132237:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202704.132289:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202704/real 1788202704] req@ffff8bc1727d5180 x1875064728131968/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202729 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202704.132304:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5180 x1875064728131968/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202729 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202704.132312:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202704.132315:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202704.132318:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728131968:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202704.132358:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728132096:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202704.132381:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202704.132392:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202704/real 1788202704] req@ffff8bc1727d4000 x1875064728132096/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202729 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202704.132401:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4000 x1875064728132096/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202729 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202704.132407:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202704.132409:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202704.132411:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728132096:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202704.963935:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202705.027914:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202705.987992:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202706.051907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202707.012001:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202707.075896:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202708.035965:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202708.099968:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202709.059935:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202709.123877:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202709.251911:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202709.251922:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202709.251926:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202709.251943:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1990 00000100:00080000:3.0:1788202709.251953:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202709.251960:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202709.252007:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728132224/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202709.252037:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202709.252041:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202709.252042:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202709.252046:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1990 00000100:00080000:3.0:1788202709.252050:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202709.252054:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202709.252063:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202709.252077:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728132224:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202709.252078:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728132352/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202709.252167:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728132352:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202710.083975:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202710.147951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202711.107975:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202711.171891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202712.131968:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202712.195879:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:0.0:1788202712.324121:0:10040:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:0.0:1788202712.324174:0:10040:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:0.0:1788202712.324194:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:0.0:1788202712.324242:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788202712.324606:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202709/real 1788202712] req@ffff8bc1726cdc00 x1875064728132352/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202734 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202712.324639:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728132352/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202734 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202712.324655:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202712.324662:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202712.324668:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728132352:192.168.201.143@tcp:38:kworker.0 00000100:00100000:2.0:1788202712.324677:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202709/real 1788202712] req@ffff8bc1726cce00 x1875064728132224/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202734 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202712.324699:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728132224/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202734 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202712.324705:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202712.324709:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202712.324712:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728132224:192.168.201.143@tcp:250:kworker.0 00010000:00010000:3.0:1788202713.155981:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202713.219882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202714.179979:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202714.243945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202714.372060:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202714.372073:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202714.372077:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202714.372090:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 1995 00000100:00080000:0.0:1788202714.372102:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202714.372111:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202714.372152:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140000 x1875064728132480/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202714.372192:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202714.372196:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202714.372198:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202714.372202:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 1995 00000100:00080000:0.0:1788202714.372205:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202714.372209:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202714.372220:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202714.372231:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143100 x1875064728132608/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202714.372323:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728132480:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202714.372405:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202714.372470:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202714/real 1788202714] req@ffff8bc144140000 x1875064728132480/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202739 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202714.372489:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140000 x1875064728132480/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202739 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202714.372502:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202714.372507:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202714.372511:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728132480:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202714.372519:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728132608:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202714.372554:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202714.372567:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202714/real 1788202714] req@ffff8bc144143100 x1875064728132608/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202739 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202714.372579:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143100 x1875064728132608/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202739 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202714.372589:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202714.372592:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202714.372596:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728132608:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202715.203956:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202715.267990:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202716.227913:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202716.291906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202717.252067:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202717.315872:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202718.275952:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202718.339884:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202719.300040:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202719.363868:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202719.491972:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202719.491986:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202719.491992:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202719.492005:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2000 00000100:00080000:0.0:1788202719.492016:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202719.492027:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202719.492069:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143800 x1875064728132736/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202719.492100:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202719.492105:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202719.492107:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202719.492112:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2000 00000100:00080000:0.0:1788202719.492117:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202719.492124:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202719.492136:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202719.492157:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140380 x1875064728132864/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202719.492159:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728132736:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202719.492260:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202719.492316:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202719/real 1788202719] req@ffff8bc144143800 x1875064728132736/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202744 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202719.492337:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143800 x1875064728132736/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202744 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202719.492348:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202719.492351:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202719.492354:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728132736:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202719.492379:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728132864:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202719.492396:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202719.492405:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202719/real 1788202719] req@ffff8bc144140380 x1875064728132864/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202744 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202719.492413:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140380 x1875064728132864/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202744 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202719.492420:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202719.492422:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202719.492426:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728132864:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202720.323966:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202720.387963:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202721.347973:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202721.411929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202722.371993:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202722.435915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202723.396002:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202723.459933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202724.419985:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202724.483858:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202724.611983:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202724.611998:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202724.612004:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202724.612018:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2005 00000100:00080000:3.0:1788202724.612031:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202724.612041:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202724.612090:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728132992/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202724.612120:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202724.612123:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202724.612125:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202724.612128:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2005 00000100:00080000:3.0:1788202724.612131:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202724.612134:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202724.612146:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202724.612162:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728133120/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202724.612173:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728132992:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202724.612245:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202724.612302:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202724/real 1788202724] req@ffff8bc1726ce680 x1875064728132992/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202749 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202724.612318:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728132992/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202749 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202724.612334:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202724.612338:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202724.612344:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728132992:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202724.612368:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728133120:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202724.612385:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202724.612394:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202724/real 1788202724] req@ffff8bc1726cc380 x1875064728133120/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202749 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202724.612402:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728133120/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202749 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202724.612414:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202724.612418:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202724.612422:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728133120:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202725.444051:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202725.507958:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202726.467950:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202726.531844:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202727.491975:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202727.555859:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202728.515996:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202728.579845:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202729.540004:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202729.603841:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202729.731892:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202729.731910:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202729.731914:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202729.731926:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2011 00000100:00080000:0.0:1788202729.731938:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202729.731946:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202729.731998:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142300 x1875064728133248/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202729.732031:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202729.732034:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202729.732036:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202729.732040:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2011 00000100:00080000:0.0:1788202729.732043:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202729.732046:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202729.732057:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202729.732069:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141f80 x1875064728133376/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202729.732083:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728133248:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202729.732164:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202729.732228:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202729/real 1788202729] req@ffff8bc144142300 x1875064728133248/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202754 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202729.732251:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142300 x1875064728133248/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202754 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202729.732264:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202729.732270:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202729.732274:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728133248:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202729.732303:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728133376:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202729.732327:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202729.732341:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202729/real 1788202729] req@ffff8bc144141f80 x1875064728133376/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202754 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202729.732355:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141f80 x1875064728133376/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202754 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202729.732364:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202729.732368:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202729.732372:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728133376:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202730.564010:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202730.627918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202731.587962:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202731.651864:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202732.612030:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202732.675898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202733.635956:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202733.699890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202734.659994:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202734.723917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202734.851897:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202734.851910:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202734.851913:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202734.851925:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2016 00000100:00080000:0.0:1788202734.851934:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202734.851939:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202734.851971:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143b80 x1875064728133504/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202734.851994:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202734.851997:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202734.851999:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202734.852001:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2016 00000100:00080000:0.0:1788202734.852003:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202734.852006:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202734.852014:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202734.852024:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141500 x1875064728133632/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202734.852062:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728133504:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202734.852140:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202734.852206:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202734/real 1788202734] req@ffff8bc144143b80 x1875064728133504/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202759 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202734.852222:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143b80 x1875064728133504/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202759 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202734.852232:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202734.852235:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202734.852238:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728133504:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202734.852244:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728133632:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202734.852261:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202734.852270:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202734/real 1788202734] req@ffff8bc144141500 x1875064728133632/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202759 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202734.852278:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141500 x1875064728133632/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202759 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202734.852284:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202734.852286:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202734.852288:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728133632:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202735.683966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202735.747972:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202736.707960:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202736.771901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202737.731976:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202737.795910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202738.755988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202738.819855:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202739.779949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202739.843921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202739.971901:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202739.971912:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202739.971916:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202739.971928:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2021 00000100:00080000:0.0:1788202739.971940:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202739.971947:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202739.971991:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143480 x1875064728133760/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202739.972020:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202739.972024:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202739.972025:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202739.972028:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2021 00000100:00080000:0.0:1788202739.972031:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202739.972033:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202739.972043:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202739.972055:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141880 x1875064728133888/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202739.972079:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728133760:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202739.972156:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202739.972218:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202739/real 1788202739] req@ffff8bc144143480 x1875064728133760/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202764 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202739.972238:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143480 x1875064728133760/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202764 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202739.972250:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202739.972255:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202739.972260:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728133760:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202739.972289:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728133888:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202739.972311:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202739.972323:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202739/real 1788202739] req@ffff8bc144141880 x1875064728133888/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202764 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202739.972336:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141880 x1875064728133888/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202764 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202739.972345:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202739.972349:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202739.972353:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728133888:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202740.804000:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202740.867930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202741.827963:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202741.891905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202742.851999:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202742.915951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202743.875947:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202743.939900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202744.899990:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202744.963958:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202745.091927:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202745.091941:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202745.091946:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202745.091958:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2026 00000100:00080000:3.0:1788202745.091970:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202745.091978:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202745.092023:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728134016/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202745.092052:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202745.092055:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202745.092057:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202745.092060:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2026 00000100:00080000:3.0:1788202745.092062:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202745.092064:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202745.092074:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202745.092083:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728134144/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202745.092099:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728134016:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202745.092176:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202745.092242:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202745/real 1788202745] req@ffff8bc1726ce300 x1875064728134016/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202770 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202745.092262:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728134016/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202770 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202745.092274:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202745.092278:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202745.092282:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728134016:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202745.092314:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728134144:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202745.092336:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202745.092350:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202745/real 1788202745] req@ffff8bc1726cea00 x1875064728134144/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202770 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202745.092363:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728134144/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202770 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202745.092385:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202745.092388:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202745.092392:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728134144:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202745.923959:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202745.987970:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202746.947974:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202747.011948:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202747.971932:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202748.035921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202748.995953:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202749.059909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202750.019999:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202750.083931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202750.211956:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202750.211969:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202750.211975:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202750.211988:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2031 00000100:00080000:0.0:1788202750.212003:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202750.212013:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202750.212061:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142a00 x1875064728134272/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202750.212087:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202750.212090:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202750.212091:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202750.212094:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2031 00000100:00080000:0.0:1788202750.212097:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202750.212100:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202750.212111:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202750.212123:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140e00 x1875064728134400/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202750.212135:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728134272:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202750.212205:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202750.212265:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202750/real 1788202750] req@ffff8bc144142a00 x1875064728134272/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202775 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202750.212320:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142a00 x1875064728134272/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202775 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202750.212333:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202750.212337:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202750.212340:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728134272:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202750.212366:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728134400:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202750.212386:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202750.212396:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202750/real 1788202750] req@ffff8bc144140e00 x1875064728134400/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202775 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202750.212405:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140e00 x1875064728134400/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202775 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202750.212412:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202750.212414:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202750.212416:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728134400:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202751.043924:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202751.107931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202752.068000:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202752.131873:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202753.091988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202753.155913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202754.116012:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202754.179909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202755.139977:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202755.203935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202755.331933:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202755.331946:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202755.331952:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202755.331966:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2036 00000100:00080000:3.0:1788202755.331981:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202755.331991:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202755.332040:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728134528/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202755.332074:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202755.332079:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202755.332083:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202755.332088:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2036 00000100:00080000:3.0:1788202755.332092:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202755.332098:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202755.332110:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202755.332119:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728134528:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202755.332126:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728134656/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788202755.332186:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202755.332265:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202755/real 1788202755] req@ffff8bc1726ced80 x1875064728134528/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202780 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202755.332288:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728134528/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202780 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202755.332297:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202755.332300:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202755.332303:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728134528:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202755.332336:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728134656:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202755.332353:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202755.332362:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202755/real 1788202755] req@ffff8bc1726cfb80 x1875064728134656/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202780 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202755.332371:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728134656/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202780 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202755.332377:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202755.332379:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202755.332381:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728134656:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202756.163963:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202756.227944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202757.187970:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202757.251911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202758.211980:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202758.275882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202759.236003:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202759.299919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202760.260024:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202760.323967:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202760.451870:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202760.451881:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202760.451885:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202760.451896:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2041 00000100:00080000:3.0:1788202760.451908:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202760.451916:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202760.451949:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728134784/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202760.451975:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202760.451978:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202760.451980:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202760.451982:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2041 00000100:00080000:3.0:1788202760.451985:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202760.451988:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202760.451996:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202760.452005:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728134912/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202760.452058:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728134784:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202760.452143:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202760.452185:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202760/real 1788202760] req@ffff8bc1726cca80 x1875064728134784/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202785 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202760.452199:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728134784/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202785 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202760.452212:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202760.452215:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202760.452218:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728134784:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202760.452223:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728134912:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202760.452239:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202760.452247:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202760/real 1788202760] req@ffff8bc1726cd500 x1875064728134912/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202785 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202760.452260:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728134912/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202785 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202760.452268:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202760.452271:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202760.452275:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728134912:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202761.284023:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202761.347949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202762.308039:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202762.371969:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202763.332006:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202763.395916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202764.355948:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202764.419938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202765.379999:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202765.443907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202765.571910:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202765.571925:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202765.571930:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202765.571944:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2046 00000100:00080000:3.0:1788202765.571958:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202765.571968:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202765.572036:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728135040/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202765.572073:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202765.572078:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202765.572080:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202765.572086:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2046 00000100:00080000:3.0:1788202765.572090:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202765.572095:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202765.572107:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202765.572125:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728135168/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202765.572139:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728135040:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202765.572218:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202765.572288:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202765/real 1788202765] req@ffff8bc1726cf480 x1875064728135040/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202790 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202765.572310:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728135040/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202790 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202765.572322:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202765.572326:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202765.572331:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728135040:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202765.572361:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728135168:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202765.572387:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202765.572401:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202765/real 1788202765] req@ffff8bc1726cf100 x1875064728135168/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202790 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202765.572413:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728135168/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202790 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202765.572421:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202765.572425:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202765.572428:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728135168:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202766.403947:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202766.468063:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202767.428002:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202767.491921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202768.452007:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202768.515937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202769.475920:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202769.539980:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202770.500011:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202770.563869:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202770.691908:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202770.691917:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202770.691921:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202770.691944:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2052 00000100:00080000:3.0:1788202770.691953:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202770.691959:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202770.691990:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728135296/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202770.692013:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202770.692016:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202770.692017:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202770.692020:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2052 00000100:00080000:3.0:1788202770.692022:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202770.692024:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202770.692032:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202770.692040:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728135424/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202770.692068:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728135296:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202770.692126:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202770.692182:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202770/real 1788202770] req@ffff8bc1726cd180 x1875064728135296/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202795 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202770.692202:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728135296/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202795 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202770.692213:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202770.692217:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202770.692222:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728135296:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202770.692230:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728135424:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202770.692253:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202770.692266:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202770/real 1788202770] req@ffff8bc1726cc700 x1875064728135424/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202795 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202770.692278:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728135424/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202795 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202770.692286:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202770.692288:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202770.692291:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728135424:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202771.523947:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202771.587900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202772.548002:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202772.611933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202773.571967:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202773.635951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202774.596006:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202774.659949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202775.620014:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202775.683908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202775.811974:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202775.811987:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202775.811992:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202775.812005:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2057 00000100:00080000:3.0:1788202775.812019:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202775.812029:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202775.812087:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728135552/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202775.812118:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202775.812123:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202775.812125:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202775.812129:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2057 00000100:00080000:3.0:1788202775.812133:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202775.812138:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202775.812150:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202775.812174:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728135680/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202775.812188:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728135552:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202775.812318:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728135680:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202776.643987:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202776.708015:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202777.667990:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202777.731945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202778.691938:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202778.755919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788202778.884045:0:10041:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788202778.884086:0:10041:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788202778.884100:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788202778.884144:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788202778.884187:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202775/real 1788202778] req@ffff8bc1726cf800 x1875064728135680/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202800 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202778.884214:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728135680/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202800 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202778.884224:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202778.884228:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202778.884233:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728135680:192.168.201.143@tcp:38:kworker.0 00000100:00100000:2.0:1788202778.884239:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202775/real 1788202778] req@ffff8bc1726cdf80 x1875064728135552/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202800 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202778.884250:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728135552/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202800 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202778.884259:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202778.884263:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202778.884267:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728135552:192.168.201.143@tcp:250:kworker.0 00010000:00010000:0.0:1788202779.715978:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202779.779928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202780.739973:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202780.803909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202780.931892:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202780.931905:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202780.931910:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202780.931923:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2062 00000100:00080000:0.0:1788202780.931937:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202780.931948:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202780.931992:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140700 x1875064728135808/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202780.932021:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202780.932024:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202780.932026:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202780.932030:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2062 00000100:00080000:0.0:1788202780.932033:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202780.932036:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202780.932046:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202780.932056:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141c00 x1875064728135936/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202780.932088:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728135808:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202780.932160:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202780.932234:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202780/real 1788202780] req@ffff8bc144140700 x1875064728135808/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202805 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202780.932259:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140700 x1875064728135808/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202805 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202780.932273:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202780.932280:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202780.932284:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728135808:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202780.932295:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728135936:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202780.932322:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202780.932338:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202780/real 1788202780] req@ffff8bc144141c00 x1875064728135936/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202805 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202780.932358:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141c00 x1875064728135936/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202805 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202780.932367:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202780.932371:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202780.932374:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728135936:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202781.763989:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202781.827957:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202782.787983:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202782.851925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202783.812017:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202783.875896:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202784.835918:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202784.899881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202785.859937:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202785.923910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202786.051900:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202786.051908:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202786.051912:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202786.051919:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2067 00000100:00080000:3.0:1788202786.051928:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202786.051934:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202786.051967:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728136064/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202786.052004:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202786.052013:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202786.052016:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202786.052021:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2067 00000100:00080000:3.0:1788202786.052025:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202786.052030:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202786.052038:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202786.052052:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728136192/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202786.052054:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728136064:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202786.052126:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202786.052178:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202786/real 1788202786] req@ffff8bc1726cdf80 x1875064728136064/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202811 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202786.052197:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728136064/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202811 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202786.052205:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202786.052208:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202786.052211:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728136064:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202786.052232:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728136192:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202786.052251:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202786.052260:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202786/real 1788202786] req@ffff8bc1726cf800 x1875064728136192/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202811 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202786.052269:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728136192/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202811 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202786.052279:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202786.052281:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202786.052284:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728136192:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202786.883894:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202786.947918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202787.907996:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202787.971946:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202788.932012:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202788.995905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202789.955997:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202790.019933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202790.979972:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202791.043870:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202791.171870:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202791.171881:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202791.171885:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202791.171895:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2072 00000100:00080000:3.0:1788202791.171907:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202791.171915:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202791.171953:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728136320/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202791.171985:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202791.171989:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202791.171991:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202791.171996:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2072 00000100:00080000:3.0:1788202791.171999:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202791.172003:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202791.172012:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202791.172027:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728136320:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202791.172028:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728136448/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788202791.172088:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202791.172125:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202791/real 1788202791] req@ffff8bc1726cc700 x1875064728136320/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202816 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202791.172139:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728136320/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202816 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202791.172147:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202791.172149:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202791.172160:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728136320:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202791.172179:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728136448:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202791.172195:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202791.172204:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202791/real 1788202791] req@ffff8bc1726cd180 x1875064728136448/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202816 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202791.172212:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728136448/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202816 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202791.172218:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202791.172220:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202791.172222:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728136448:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202792.003946:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202792.067927:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202793.027941:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202793.091858:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202794.051970:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202794.115869:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202795.075999:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202795.139868:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202796.100084:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202796.163870:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202796.291852:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202796.291862:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202796.291867:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202796.291879:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2077 00000100:00080000:3.0:1788202796.291891:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202796.291899:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202796.291942:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728136576/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202796.291971:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202796.291974:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202796.291976:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202796.291978:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2077 00000100:00080000:3.0:1788202796.291981:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202796.291983:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202796.291993:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202796.292002:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728136704/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202796.292049:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728136576:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202796.292120:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202796.292178:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202796/real 1788202796] req@ffff8bc1726cf100 x1875064728136576/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202821 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202796.292195:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728136576/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202821 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202796.292205:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202796.292208:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202796.292211:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728136576:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202796.292217:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728136704:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202796.292234:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202796.292241:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202796/real 1788202796] req@ffff8bc1726cf480 x1875064728136704/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202821 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202796.292249:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728136704/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202821 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202796.292255:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202796.292257:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202796.292259:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728136704:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202797.123997:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202797.187990:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202798.147979:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202798.211909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202799.172108:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202799.235963:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202800.195967:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202800.259885:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202801.220007:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202801.283947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202801.411934:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202801.411946:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202801.411950:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202801.411963:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2082 00000100:00080000:0.0:1788202801.411976:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202801.411992:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202801.412044:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141c00 x1875064728136832/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202801.412073:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202801.412075:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202801.412077:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202801.412080:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2082 00000100:00080000:0.0:1788202801.412083:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202801.412087:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202801.412097:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202801.412111:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140700 x1875064728136960/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202801.412111:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728136832:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202801.412192:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202801.412248:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202801/real 1788202801] req@ffff8bc144141c00 x1875064728136832/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202826 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202801.412263:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141c00 x1875064728136832/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202826 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202801.412272:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202801.412275:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202801.412278:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728136832:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202801.412305:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728136960:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202801.412321:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202801.412330:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202801/real 1788202801] req@ffff8bc144140700 x1875064728136960/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202826 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202801.412338:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140700 x1875064728136960/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202826 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202801.412344:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202801.412346:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202801.412347:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728136960:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202802.243925:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202802.308002:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202803.268003:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202803.331938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202804.291931:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202804.355886:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202805.316051:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202805.379935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202806.340015:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202806.403916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202806.531961:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202806.531972:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202806.531977:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202806.531988:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2087 00000100:00080000:3.0:1788202806.532001:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202806.532009:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202806.532060:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728137088/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202806.532084:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202806.532087:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202806.532089:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202806.532092:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2087 00000100:00080000:3.0:1788202806.532095:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202806.532098:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202806.532107:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202806.532118:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728137216/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202806.532133:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728137088:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202806.532201:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202806.532259:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202806/real 1788202806] req@ffff8bc1726cd500 x1875064728137088/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202831 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202806.532276:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728137088/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202831 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202806.532285:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202806.532288:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202806.532292:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728137088:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202806.532331:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728137216:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202806.532351:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202806.532360:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202806/real 1788202806] req@ffff8bc1726cca80 x1875064728137216/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202831 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202806.532369:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728137216/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202831 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202806.532375:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202806.532378:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202806.532380:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728137216:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202807.363983:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202807.427928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202808.388003:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202808.451915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202809.411973:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202809.475958:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202810.436036:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202810.499884:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202811.459949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202811.523929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202811.651907:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202811.651921:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202811.651926:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202811.651940:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2093 00000100:00080000:3.0:1788202811.651956:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202811.651966:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202811.652019:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728137344/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202811.652059:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202811.652063:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202811.652065:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202811.652070:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2093 00000100:00080000:3.0:1788202811.652074:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202811.652079:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202811.652092:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202811.652107:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728137472/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202811.652120:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728137344:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202811.652202:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202811.652281:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202811/real 1788202811] req@ffff8bc1726cfb80 x1875064728137344/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202836 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202811.652297:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728137344/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202836 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202811.652312:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202811.652315:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202811.652318:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728137344:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202811.652343:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728137472:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202811.652361:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202811.652370:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202811/real 1788202811] req@ffff8bc1726ced80 x1875064728137472/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202836 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202811.652379:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728137472/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202836 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202811.652385:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202811.652387:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202811.652390:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728137472:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202812.484025:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202812.547920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202813.508068:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202813.571926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202814.531994:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202814.595989:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202815.556398:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202815.619951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202816.579967:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202816.643902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202816.771912:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202816.771923:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202816.771928:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202816.771938:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2098 00000100:00080000:0.0:1788202816.771948:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202816.771955:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202816.772005:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140e00 x1875064728137600/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202816.772034:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202816.772038:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202816.772040:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202816.772045:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2098 00000100:00080000:0.0:1788202816.772049:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202816.772054:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202816.772064:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202816.772078:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142a00 x1875064728137728/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202816.772087:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728137600:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202816.772184:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202816.772227:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202816/real 1788202816] req@ffff8bc144140e00 x1875064728137600/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202841 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202816.772247:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140e00 x1875064728137600/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202841 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202816.772258:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202816.772262:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202816.772266:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728137600:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202816.772293:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728137728:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202816.772314:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202816.772329:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202816/real 1788202816] req@ffff8bc144142a00 x1875064728137728/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202841 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202816.772342:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142a00 x1875064728137728/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202841 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202816.772352:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202816.772355:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202816.772359:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728137728:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202817.603935:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202817.667898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202818.627979:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202818.691949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202819.651942:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202819.715864:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202820.675976:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202820.739879:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202821.699934:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202821.763887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202821.891984:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202821.891999:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202821.892006:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202821.892021:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2103 00000100:00080000:3.0:1788202821.892065:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202821.892077:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202821.892129:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728137856/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202821.892157:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202821.892160:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202821.892162:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202821.892165:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2103 00000100:00080000:3.0:1788202821.892168:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202821.892172:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202821.892182:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202821.892193:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728137984/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202821.892210:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728137856:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202821.892292:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202821.892353:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202821/real 1788202821] req@ffff8bc1726cea00 x1875064728137856/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202846 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202821.892376:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728137856/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202846 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202821.892389:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202821.892394:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202821.892399:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728137856:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202821.892433:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728137984:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202821.892458:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202821.892473:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202821/real 1788202821] req@ffff8bc1726ce300 x1875064728137984/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202846 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202821.892488:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728137984/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202846 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202821.892498:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202821.892502:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202821.892506:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728137984:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202822.723976:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202822.787950:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202823.747958:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202823.811935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202824.771951:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202824.835919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202825.796002:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202825.859894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202826.820032:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202826.883946:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202827.011942:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202827.011980:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202827.011985:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202827.012000:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2108 00000100:00080000:3.0:1788202827.012014:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202827.012024:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202827.012071:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728138112/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202827.012111:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202827.012114:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202827.012116:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202827.012119:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2108 00000100:00080000:3.0:1788202827.012121:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202827.012125:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202827.012134:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202827.012144:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728138240/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202827.012177:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728138112:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202827.012256:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202827.012307:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202827/real 1788202827] req@ffff8bc1726cc380 x1875064728138112/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202852 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202827.012323:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728138112/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202852 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202827.012332:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202827.012335:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202827.012339:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728138112:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202827.012344:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728138240:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202827.012359:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202827.012367:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202827/real 1788202827] req@ffff8bc1726ce680 x1875064728138240/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202852 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202827.012376:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728138240/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202852 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202827.012397:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202827.012400:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202827.012402:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728138240:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202827.843976:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202827.907926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202828.867947:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202828.931957:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202829.892035:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202829.955955:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202830.916024:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202830.979960:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202831.940088:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202832.003952:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202832.131948:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202832.131959:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202832.131964:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202832.131976:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2113 00000100:00080000:3.0:1788202832.131989:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202832.131997:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202832.132045:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728138368/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202832.132076:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202832.132079:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202832.132080:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202832.132083:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2113 00000100:00080000:3.0:1788202832.132087:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202832.132090:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202832.132100:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202832.132109:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728138496/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202832.132151:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728138368:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202832.132227:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202832.132294:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202832/real 1788202832] req@ffff8bc1726cce00 x1875064728138368/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202857 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202832.132317:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728138368/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202857 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202832.132330:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202832.132335:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202832.132340:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728138368:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202832.132349:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728138496:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202832.132373:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202832.132387:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202832/real 1788202832] req@ffff8bc1726cdc00 x1875064728138496/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202857 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202832.132401:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728138496/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202857 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202832.132411:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202832.132415:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202832.132419:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728138496:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202832.963978:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202833.027915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202833.988066:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202834.051930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202835.012011:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202835.075919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202836.036020:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202836.099939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202837.059987:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202837.123870:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202837.251914:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202837.251927:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202837.251931:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202837.251942:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2118 00000100:00080000:3.0:1788202837.251953:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202837.251961:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202837.252003:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728138624/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202837.252032:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202837.252037:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202837.252039:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202837.252043:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2118 00000100:00080000:3.0:1788202837.252047:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202837.252051:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202837.252061:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202837.252076:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728138752/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202837.252093:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728138624:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202837.252162:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202837.252221:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202837/real 1788202837] req@ffff8bc1726cdc00 x1875064728138624/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202862 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202837.252241:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728138624/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202862 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202837.252262:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202837.252268:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202837.252273:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728138624:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202837.252298:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728138752:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202837.252318:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202837.252328:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202837/real 1788202837] req@ffff8bc1726cce00 x1875064728138752/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202862 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202837.252338:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728138752/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202862 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202837.252343:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202837.252346:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202837.252348:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728138752:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202838.084006:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202838.147941:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202839.107986:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202839.171902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202840.132023:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202840.195943:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202841.155926:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202841.219892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202842.179973:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202842.243911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788202842.371900:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788202842.371908:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788202842.371912:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202842.371921:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2123 00000100:00080000:1.0:1788202842.371929:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202842.371935:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788202842.371972:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4380 x1875064728138880/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788202842.372002:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788202842.372006:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788202842.372008:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202842.372012:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2123 00000100:00080000:1.0:1788202842.372016:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202842.372022:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788202842.372032:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788202842.372048:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5f80 x1875064728139008/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202842.372053:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728138880:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202842.372180:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728139008:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788202843.203983:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202843.267908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202844.227967:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202844.291903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788202845.252029:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202845.315957:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788202845.444165:0:10042:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788202845.444226:0:10042:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788202845.444246:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788202845.444307:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788202845.444424:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202842/real 1788202845] req@ffff8bc1727d5f80 x1875064728139008/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202867 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202845.444460:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5f80 x1875064728139008/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202867 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202845.444477:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202845.444485:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202845.444491:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728139008:192.168.201.143@tcp:38:kworker.0 00000100:00100000:2.0:1788202845.444500:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202842/real 1788202845] req@ffff8bc1727d4380 x1875064728138880/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202867 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202845.444516:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4380 x1875064728138880/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202867 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202845.444525:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202845.444530:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202845.444534:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728138880:192.168.201.143@tcp:250:kworker.0 00010000:00010000:3.0:1788202846.275986:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202846.339963:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202847.299982:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202847.363913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202847.491974:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202847.491989:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202847.491995:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202847.492010:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2128 00000100:00080000:0.0:1788202847.492025:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202847.492036:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202847.492084:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141880 x1875064728139136/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202847.492122:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202847.492126:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202847.492128:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202847.492132:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2128 00000100:00080000:0.0:1788202847.492136:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202847.492141:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202847.492153:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202847.492167:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143480 x1875064728139264/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202847.492172:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728139136:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202847.492272:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202847.492362:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202847/real 1788202847] req@ffff8bc144141880 x1875064728139136/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202872 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202847.492390:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141880 x1875064728139136/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202872 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202847.492412:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202847.492418:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202847.492424:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728139136:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202847.492470:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728139264:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202847.492500:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202847.492515:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202847/real 1788202847] req@ffff8bc144143480 x1875064728139264/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202872 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202847.492527:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143480 x1875064728139264/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202872 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202847.492537:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202847.492541:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202847.492545:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728139264:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202848.323998:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202848.388025:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202849.348008:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202849.411903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202850.371965:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202850.435980:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202851.396035:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202851.459867:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202852.420023:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202852.483951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202852.611913:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202852.611924:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202852.611929:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202852.611940:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2133 00000100:00080000:3.0:1788202852.611952:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202852.611960:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202852.612006:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728139392/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202852.612031:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202852.612034:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202852.612036:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202852.612039:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2133 00000100:00080000:3.0:1788202852.612041:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202852.612044:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202852.612053:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202852.612063:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728139520/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202852.612093:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728139392:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202852.612178:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202852.612240:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202852/real 1788202852] req@ffff8bc1726ce680 x1875064728139392/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202877 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202852.612257:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728139392/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202877 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202852.612266:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202852.612270:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202852.612273:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728139392:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202852.612279:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728139520:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202852.612296:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202852.612305:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202852/real 1788202852] req@ffff8bc1726cc380 x1875064728139520/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202877 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202852.612313:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728139520/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202877 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202852.612319:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202852.612321:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202852.612323:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728139520:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202853.443988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202853.508005:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202854.468051:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202854.531923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202855.492036:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202855.555941:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202856.516012:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202856.579947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202857.539994:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202857.603912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202857.731909:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202857.731918:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202857.731922:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202857.731931:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2139 00000100:00080000:3.0:1788202857.731940:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202857.731947:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202857.731981:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728139648/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202857.732011:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202857.732015:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202857.732017:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202857.732027:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2139 00000100:00080000:3.0:1788202857.732031:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202857.732037:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202857.732047:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202857.732071:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728139776/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202857.732085:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728139648:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202857.732155:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202857.732204:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202857/real 1788202857] req@ffff8bc1726ce300 x1875064728139648/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202882 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202857.732224:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728139648/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202882 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202857.732236:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202857.732241:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202857.732245:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728139648:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202857.732270:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728139776:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202857.732293:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202857.732306:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202857/real 1788202857] req@ffff8bc1726cea00 x1875064728139776/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202882 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202857.732320:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728139776/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202882 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202857.732330:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202857.732333:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202857.732337:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728139776:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202858.563956:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202858.627955:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202859.588019:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202859.651876:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202860.612051:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202860.675873:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202861.635958:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202861.699919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202862.659970:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202862.723877:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202862.851929:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202862.851940:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202862.851944:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202862.851955:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2144 00000100:00080000:0.0:1788202862.851966:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202862.851973:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202862.852010:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141500 x1875064728139904/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202862.852038:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202862.852042:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202862.852044:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202862.852048:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2144 00000100:00080000:0.0:1788202862.852052:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202862.852056:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202862.852066:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202862.852081:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728139904:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202862.852082:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143b80 x1875064728140032/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788202862.852158:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202862.852207:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202862/real 1788202862] req@ffff8bc144141500 x1875064728139904/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202887 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202862.852224:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141500 x1875064728139904/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202887 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202862.852233:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202862.852236:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202862.852239:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728139904:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202862.852260:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728140032:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202862.852277:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202862.852286:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202862/real 1788202862] req@ffff8bc144143b80 x1875064728140032/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202887 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202862.852294:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143b80 x1875064728140032/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202887 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202862.852300:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202862.852302:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202862.852304:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728140032:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202863.684016:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202863.747863:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202864.707986:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202864.771842:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202865.731932:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202865.795984:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202866.755920:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202866.820017:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202867.779932:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202867.843951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202867.971934:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202867.971944:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202867.971948:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202867.971959:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2149 00000100:00080000:0.0:1788202867.971971:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202867.971977:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202867.972020:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141f80 x1875064728140160/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202867.972049:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202867.972052:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202867.972054:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202867.972056:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2149 00000100:00080000:0.0:1788202867.972058:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202867.972061:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202867.972071:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202867.972082:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142300 x1875064728140288/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202867.972105:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728140160:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202867.972169:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202867.972217:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202867/real 1788202867] req@ffff8bc144141f80 x1875064728140160/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202892 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202867.972234:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141f80 x1875064728140160/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202892 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202867.972275:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202867.972280:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202867.972284:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728140160:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202867.972290:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728140288:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202867.972308:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202867.972318:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202867/real 1788202867] req@ffff8bc144142300 x1875064728140288/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202892 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202867.972326:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142300 x1875064728140288/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202892 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202867.972331:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202867.972333:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202867.972336:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728140288:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202868.804083:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202868.867962:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202869.828001:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202869.891953:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202870.851966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202870.915932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202871.875975:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202871.939931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202872.899978:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202872.963931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202873.091946:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202873.091957:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202873.091963:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202873.091974:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2154 00000100:00080000:0.0:1788202873.091985:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202873.091992:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202873.092033:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140380 x1875064728140416/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202873.092067:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202873.092072:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202873.092074:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202873.092078:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2154 00000100:00080000:0.0:1788202873.092082:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202873.092087:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202873.092097:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202873.092112:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143800 x1875064728140544/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202873.092158:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728140416:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202873.092247:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202873.092318:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202873/real 1788202873] req@ffff8bc144140380 x1875064728140416/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202898 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202873.092335:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140380 x1875064728140416/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202898 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202873.092344:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202873.092348:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202873.092352:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728140416:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202873.092358:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728140544:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202873.092375:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202873.092383:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202873/real 1788202873] req@ffff8bc144143800 x1875064728140544/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202898 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202873.092391:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143800 x1875064728140544/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202898 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202873.092396:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202873.092398:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202873.092399:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728140544:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202873.924013:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202873.987947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202874.948017:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202875.011908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202875.971950:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202876.035893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202876.996008:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202877.059915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202878.019972:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202878.083929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788202878.211971:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788202878.211994:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788202878.211999:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202878.212012:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2159 00000100:00080000:1.0:1788202878.212027:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202878.212035:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788202878.212116:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5500 x1875064728140672/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788202878.212148:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788202878.212153:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788202878.212155:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202878.212159:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2159 00000100:00080000:1.0:1788202878.212164:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202878.212169:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788202878.212180:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202878.212195:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728140672:192.168.201.143@tcp:250:kworker.0 00000100:00100000:1.0:1788202878.212196:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6680 x1875064728140800/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788202878.212259:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202878.212304:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202878/real 1788202878] req@ffff8bc1727d5500 x1875064728140672/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202903 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202878.212318:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5500 x1875064728140672/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202903 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202878.212329:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202878.212333:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202878.212336:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728140672:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202878.212365:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728140800:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202878.212385:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202878.212394:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202878/real 1788202878] req@ffff8bc1727d6680 x1875064728140800/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202903 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202878.212402:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6680 x1875064728140800/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202903 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202878.212408:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202878.212409:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202878.212412:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728140800:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202879.044040:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202879.107989:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202880.067957:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202880.131933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202881.091988:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202881.155932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202882.115987:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202882.179915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202883.139966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202883.203882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788202883.331926:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788202883.331939:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788202883.331943:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202883.331955:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2164 00000100:00080000:1.0:1788202883.331965:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202883.331988:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788202883.332030:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6d80 x1875064728140928/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788202883.332061:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788202883.332066:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788202883.332068:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202883.332072:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2164 00000100:00080000:1.0:1788202883.332076:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202883.332081:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788202883.332100:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788202883.332118:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6300 x1875064728141056/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202883.332137:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728140928:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202883.332213:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202883.332300:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202883/real 1788202883] req@ffff8bc1727d6d80 x1875064728140928/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202908 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202883.332324:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6d80 x1875064728140928/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202908 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202883.332337:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202883.332342:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202883.332346:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728140928:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202883.332377:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728141056:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202883.332400:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202883.332410:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202883/real 1788202883] req@ffff8bc1727d6300 x1875064728141056/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202908 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202883.332418:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6300 x1875064728141056/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202908 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202883.332424:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202883.332426:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202883.332428:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728141056:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202884.163975:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202884.227966:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202885.187982:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202885.251911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202886.212073:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202886.275951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202887.235935:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202887.299977:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202888.260030:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202888.323900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202888.451986:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202888.452000:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202888.452005:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202888.452019:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2169 00000100:00080000:3.0:1788202888.452033:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202888.452041:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202888.452093:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728141184/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202888.452127:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202888.452131:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202888.452133:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202888.452137:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2169 00000100:00080000:3.0:1788202888.452140:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202888.452145:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202888.452157:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202888.452170:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728141184:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202888.452173:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728141312/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788202888.452249:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202888.452310:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202888/real 1788202888] req@ffff8bc1726ced80 x1875064728141184/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202913 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202888.452325:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728141184/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202913 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202888.452334:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202888.452337:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202888.452340:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728141184:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202888.452364:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728141312:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202888.452380:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202888.452389:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202888/real 1788202888] req@ffff8bc1726cfb80 x1875064728141312/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202913 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202888.452397:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728141312/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202913 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202888.452402:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202888.452404:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202888.452405:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728141312:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202889.283931:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202889.347982:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202890.308018:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202890.371882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202891.332013:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202891.395908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202892.356021:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202892.419926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202893.379999:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202893.443905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202893.571950:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202893.571961:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202893.571968:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202893.571980:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2174 00000100:00080000:0.0:1788202893.571990:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202893.571999:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202893.572037:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143100 x1875064728141440/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202893.572058:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202893.572061:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202893.572062:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202893.572065:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2174 00000100:00080000:0.0:1788202893.572067:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202893.572070:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202893.572077:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202893.572086:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140000 x1875064728141568/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202893.572113:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728141440:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202893.572171:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202893.572219:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202893/real 1788202893] req@ffff8bc144143100 x1875064728141440/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202918 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202893.572239:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143100 x1875064728141440/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202918 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202893.572250:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202893.572254:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202893.572258:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728141440:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202893.572267:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728141568:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202893.572292:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202893.572307:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202893/real 1788202893] req@ffff8bc144140000 x1875064728141568/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202918 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202893.572329:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140000 x1875064728141568/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202918 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202893.572338:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202893.572342:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202893.572346:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728141568:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202894.403979:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202894.468137:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202895.427967:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202895.491908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202896.451974:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202896.515923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202897.475937:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202897.539858:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202898.499986:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202898.563904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202898.691864:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202898.691875:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202898.691879:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202898.691890:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2180 00000100:00080000:0.0:1788202898.691902:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202898.691910:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202898.691946:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140a80 x1875064728141696/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202898.691978:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202898.691982:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202898.691984:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202898.691989:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2180 00000100:00080000:0.0:1788202898.691994:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202898.692000:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202898.692011:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202898.692020:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728141696:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202898.692029:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142680 x1875064728141824/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788202898.692086:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202898.692131:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202898/real 1788202898] req@ffff8bc144140a80 x1875064728141696/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202923 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202898.692146:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140a80 x1875064728141696/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202923 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202898.692154:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202898.692156:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202898.692159:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728141696:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202898.692179:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728141824:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202898.692196:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202898.692205:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202898/real 1788202898] req@ffff8bc144142680 x1875064728141824/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202923 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202898.692218:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142680 x1875064728141824/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202923 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202898.692224:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202898.692226:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202898.692228:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728141824:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202899.523946:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202899.587958:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202900.547965:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202900.611922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202901.572013:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202901.635951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202902.595989:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202902.659915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202903.620029:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202903.683896:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788202903.811929:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788202903.811939:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788202903.811944:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202903.811954:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2185 00000100:00080000:1.0:1788202903.811966:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202903.811973:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788202903.812017:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4700 x1875064728141952/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788202903.812040:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788202903.812043:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788202903.812044:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202903.812047:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2185 00000100:00080000:1.0:1788202903.812049:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202903.812052:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788202903.812061:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788202903.812070:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5c00 x1875064728142080/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202903.812090:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728141952:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202903.812163:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202903.812211:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202903/real 1788202903] req@ffff8bc1727d4700 x1875064728141952/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202928 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202903.812225:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4700 x1875064728141952/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202928 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202903.812233:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202903.812236:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202903.812239:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728141952:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202903.812262:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728142080:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202903.812276:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202903.812284:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202903/real 1788202903] req@ffff8bc1727d5c00 x1875064728142080/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202928 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202903.812291:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5c00 x1875064728142080/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202928 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202903.812298:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202903.812300:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202903.812302:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728142080:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202904.644008:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202904.708033:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202905.667986:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202905.731925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202906.691913:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202906.755931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202907.715972:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202907.779917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202908.739980:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202908.803907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202908.931960:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202908.931975:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202908.931981:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202908.931998:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2190 00000100:00080000:3.0:1788202908.932013:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202908.932020:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202908.932068:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728142208/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202908.932098:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202908.932101:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202908.932103:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202908.932106:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2190 00000100:00080000:3.0:1788202908.932107:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202908.932110:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202908.932119:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202908.932129:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728142336/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202908.932149:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728142208:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202908.932259:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728142336:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202909.763913:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202909.827958:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202910.787984:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202910.851911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202911.812012:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202911.875933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:3.0:1788202912.004106:0:10043:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:3.0:1788202912.004147:0:10043:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:3.0:1788202912.004164:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:3.0:1788202912.004213:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788202912.004286:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202908/real 1788202912] req@ffff8bc1726cca80 x1875064728142208/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202933 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202912.004318:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728142208/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202933 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202912.004330:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202912.004335:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202912.004340:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728142208:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202912.004347:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202908/real 1788202912] req@ffff8bc1726cd500 x1875064728142336/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202933 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202912.004361:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728142336/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202933 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202912.004367:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202912.004369:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202912.004371:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728142336:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202912.835980:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202912.899890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202913.859975:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202913.923917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202914.051943:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202914.051952:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202914.051957:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202914.051972:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2195 00000100:00080000:3.0:1788202914.051985:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202914.051992:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202914.052028:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728142464/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202914.052062:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202914.052067:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202914.052069:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202914.052073:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2195 00000100:00080000:3.0:1788202914.052077:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202914.052082:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202914.052095:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202914.052110:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728142592/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202914.052111:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728142464:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202914.052187:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202914.052260:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202914/real 1788202914] req@ffff8bc1726cf480 x1875064728142464/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202939 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202914.052284:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728142464/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202939 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202914.052300:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202914.052306:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202914.052310:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728142464:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202914.052347:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728142592:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202914.052373:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202914.052387:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202914/real 1788202914] req@ffff8bc1726cf100 x1875064728142592/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202939 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202914.052398:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728142592/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202939 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202914.052413:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202914.052417:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202914.052420:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728142592:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202914.884000:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202914.947966:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202915.908022:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202915.971925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202916.931950:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202916.995908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202917.956010:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202918.019930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202918.979918:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202919.043897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788202919.171926:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788202919.171936:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788202919.171940:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202919.171950:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2200 00000100:00080000:1.0:1788202919.171959:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202919.171967:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788202919.172004:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4e00 x1875064728142720/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788202919.172034:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788202919.172037:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788202919.172039:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202919.172043:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2200 00000100:00080000:1.0:1788202919.172046:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202919.172050:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788202919.172059:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788202919.172072:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6a00 x1875064728142848/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202919.172082:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728142720:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202919.172138:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202919.172184:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202919/real 1788202919] req@ffff8bc1727d4e00 x1875064728142720/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202944 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202919.172200:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4e00 x1875064728142720/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202944 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202919.172208:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202919.172212:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202919.172215:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728142720:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202919.172231:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728142848:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202919.172245:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202919.172253:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202919/real 1788202919] req@ffff8bc1727d6a00 x1875064728142848/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202944 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202919.172260:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6a00 x1875064728142848/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202944 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202919.172269:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202919.172271:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202919.172273:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728142848:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202920.003949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202920.067924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202921.027935:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202921.091907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202922.051972:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202922.115921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202923.075953:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202923.139921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202924.099917:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202924.163902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202924.291918:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202924.291926:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202924.291930:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202924.291937:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2205 00000100:00080000:3.0:1788202924.291946:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202924.291951:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202924.291980:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728142976/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202924.292000:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202924.292003:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202924.292004:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202924.292007:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2205 00000100:00080000:3.0:1788202924.292009:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202924.292011:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202924.292017:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202924.292024:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728143104/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202924.292055:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728142976:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202924.292119:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202924.292171:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202924/real 1788202924] req@ffff8bc1726cd180 x1875064728142976/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202949 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202924.292189:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728142976/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202949 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202924.292199:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202924.292202:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202924.292206:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728142976:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202924.292213:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728143104:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202924.292244:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202924.292283:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202924/real 1788202924] req@ffff8bc1726cc700 x1875064728143104/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202949 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202924.292297:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728143104/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202949 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202924.292305:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202924.292308:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202924.292311:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728143104:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202925.123981:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202925.187982:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202926.147983:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202926.211855:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202927.172027:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202927.235874:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202928.195951:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202928.259918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202929.219974:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202929.283853:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202929.411955:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202929.411967:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202929.411972:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202929.411985:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2210 00000100:00080000:2.0:1788202929.411998:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202929.412006:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202929.412052:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d500 x1875064728143232/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202929.412088:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202929.412092:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202929.412094:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202929.412098:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2210 00000100:00080000:2.0:1788202929.412102:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202929.412106:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202929.412117:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202929.412132:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f100 x1875064728143360/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202929.412166:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728143232:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202929.412255:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202929.412319:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202929/real 1788202929] req@ffff8bc17257d500 x1875064728143232/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202954 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202929.412339:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d500 x1875064728143232/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202954 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202929.412350:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202929.412355:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202929.412359:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728143232:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202929.412366:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728143360:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202929.412387:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202929.412400:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202929/real 1788202929] req@ffff8bc17257f100 x1875064728143360/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202954 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202929.412410:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f100 x1875064728143360/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202954 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202929.412418:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202929.412421:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202929.412424:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728143360:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202930.243974:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202930.307916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202931.267973:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202931.331867:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202932.291914:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202932.355885:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202933.315961:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202933.379887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202934.339976:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788202934.403927:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202934.531911:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202934.531919:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202934.531922:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202934.531930:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2215 00000100:00080000:3.0:1788202934.531939:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202934.531944:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202934.531983:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728143488/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202934.532006:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202934.532009:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202934.532010:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202934.532012:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2215 00000100:00080000:3.0:1788202934.532015:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202934.532017:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202934.532024:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202934.532032:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728143616/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202934.532037:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728143488:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202934.532107:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202934.532161:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202934/real 1788202934] req@ffff8bc1726cf800 x1875064728143488/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202959 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202934.532178:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728143488/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202959 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202934.532188:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202934.532192:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202934.532196:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728143488:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202934.532220:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728143616:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202934.532252:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202934.532265:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202934/real 1788202934] req@ffff8bc1726cdf80 x1875064728143616/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202959 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202934.532274:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728143616/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202959 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202934.532279:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202934.532281:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202934.532283:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728143616:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202935.363959:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202935.427974:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202936.387889:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202936.451869:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202937.411945:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202937.475895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202938.435966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202938.499893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202939.459950:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202939.523889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202939.651887:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202939.651897:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202939.651902:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202939.651914:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2221 00000100:00080000:0.0:1788202939.651925:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202939.651932:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202939.651968:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142d80 x1875064728143744/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202939.652006:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202939.652010:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202939.652012:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202939.652016:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2221 00000100:00080000:0.0:1788202939.652020:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202939.652025:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202939.652035:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202939.652048:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728143744:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788202939.652051:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141180 x1875064728143872/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788202939.652108:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202939.652153:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202939/real 1788202939] req@ffff8bc144142d80 x1875064728143744/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202964 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202939.652182:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142d80 x1875064728143744/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202964 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202939.652194:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202939.652198:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202939.652202:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728143744:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202939.652232:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728143872:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202939.652257:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202939.652271:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202939/real 1788202939] req@ffff8bc144141180 x1875064728143872/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202964 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202939.652285:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141180 x1875064728143872/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202964 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202939.652295:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202939.652298:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202939.652302:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728143872:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202940.483968:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202940.547913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202941.507947:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202941.571873:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202942.531988:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202942.595909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202943.555937:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202943.619891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202944.579977:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202944.643864:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202944.771892:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202944.771913:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202944.771917:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202944.771927:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2226 00000100:00080000:0.0:1788202944.771935:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202944.771941:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202944.771975:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141180 x1875064728144000/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202944.771999:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202944.772002:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202944.772004:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202944.772006:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2226 00000100:00080000:0.0:1788202944.772008:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202944.772015:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202944.772023:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202944.772034:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142d80 x1875064728144128/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202944.772074:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728144000:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202944.772143:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202944.772191:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202944/real 1788202944] req@ffff8bc144141180 x1875064728144000/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202969 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202944.772211:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141180 x1875064728144000/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202969 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202944.772220:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202944.772223:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202944.772226:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728144000:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202944.772232:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728144128:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202944.772248:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202944.772256:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202944/real 1788202944] req@ffff8bc144142d80 x1875064728144128/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202969 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202944.772264:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142d80 x1875064728144128/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202969 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202944.772270:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202944.772271:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202944.772273:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728144128:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202945.603923:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202945.667937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202946.628001:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202946.691865:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202947.651961:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202947.715941:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202948.675965:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202948.739944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202949.699945:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202949.763883:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788202949.891924:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788202949.891936:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788202949.891940:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202949.891951:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2231 00000100:00080000:1.0:1788202949.891963:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202949.891972:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788202949.892012:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4a80 x1875064728144256/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788202949.892043:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788202949.892048:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788202949.892050:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202949.892054:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2231 00000100:00080000:1.0:1788202949.892058:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202949.892063:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788202949.892074:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788202949.892091:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7800 x1875064728144384/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202949.892101:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728144256:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202949.892167:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202949.892205:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202949/real 1788202949] req@ffff8bc1727d4a80 x1875064728144256/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202974 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202949.892225:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4a80 x1875064728144256/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202974 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202949.892233:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202949.892235:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202949.892238:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728144256:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202949.892256:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728144384:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202949.892271:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202949.892279:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202949/real 1788202949] req@ffff8bc1727d7800 x1875064728144384/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202974 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202949.892288:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7800 x1875064728144384/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202974 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202949.892293:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202949.892295:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202949.892297:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728144384:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202950.723976:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202950.787921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202951.747981:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202951.811903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202952.771968:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202952.835926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202953.795945:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202953.859875:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202954.819977:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202954.883903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202955.011887:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202955.011896:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202955.011900:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202955.011908:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2236 00000100:00080000:2.0:1788202955.011918:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202955.011923:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202955.011960:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d180 x1875064728144512/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202955.011983:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202955.011987:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202955.011989:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202955.011993:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2236 00000100:00080000:2.0:1788202955.011996:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202955.012001:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202955.012010:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788202955.012029:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c700 x1875064728144640/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202955.012030:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728144512:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202955.012092:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202955.012142:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202955/real 1788202955] req@ffff8bc17257d180 x1875064728144512/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202980 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202955.012162:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d180 x1875064728144512/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202980 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202955.012175:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202955.012180:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202955.012185:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728144512:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202955.012205:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728144640:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202955.012224:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202955.012233:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202955/real 1788202955] req@ffff8bc17257c700 x1875064728144640/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202980 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202955.012246:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c700 x1875064728144640/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202980 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202955.012254:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202955.012257:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202955.012261:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728144640:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202955.843918:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202955.907902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202956.867983:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202956.931944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202957.891962:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202957.955937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202958.915978:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202958.979954:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202959.939954:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202960.003885:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788202960.131926:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788202960.131935:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788202960.131939:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202960.131947:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2241 00000100:00080000:1.0:1788202960.131955:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202960.131961:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788202960.131999:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7100 x1875064728144768/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788202960.132019:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788202960.132021:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788202960.132022:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788202960.132025:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2241 00000100:00080000:1.0:1788202960.132028:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788202960.132031:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788202960.132039:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788202960.132049:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7b80 x1875064728144896/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202960.132066:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728144768:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202960.132125:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202960.132175:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202960/real 1788202960] req@ffff8bc1727d7100 x1875064728144768/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202985 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202960.132202:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7100 x1875064728144768/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202985 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202960.132213:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202960.132217:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202960.132220:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728144768:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202960.132241:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728144896:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202960.132262:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202960.132271:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202960/real 1788202960] req@ffff8bc1727d7b80 x1875064728144896/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202985 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202960.132280:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7b80 x1875064728144896/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202985 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202960.132286:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202960.132288:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202960.132291:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728144896:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202960.963979:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202961.027940:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202961.988016:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202962.051891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202963.011965:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202963.075924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202964.035965:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202964.099889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202965.059970:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202965.123884:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202965.251934:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202965.251950:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202965.251956:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202965.251970:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2246 00000100:00080000:3.0:1788202965.251984:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202965.251992:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202965.252043:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728145024/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202965.252076:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202965.252080:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202965.252082:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202965.252086:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2246 00000100:00080000:3.0:1788202965.252089:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202965.252095:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202965.252106:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202965.252119:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728145152/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202965.252128:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728145024:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202965.252202:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202965.252273:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202965/real 1788202965] req@ffff8bc1726cdf80 x1875064728145024/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202990 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202965.252299:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728145024/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202990 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202965.252312:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202965.252318:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202965.252324:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728145024:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202965.252356:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728145152:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202965.252382:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202965.252398:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202965/real 1788202965] req@ffff8bc1726cf800 x1875064728145152/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202990 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202965.252412:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728145152/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202990 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202965.252421:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202965.252425:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202965.252428:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728145152:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202966.084010:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202966.147949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202967.107969:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202967.171882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202968.131936:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202968.195852:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202969.155995:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202969.219917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202970.180002:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202970.243922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202970.371915:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202970.371925:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202970.371929:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202970.371940:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2251 00000100:00080000:3.0:1788202970.371953:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202970.371961:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202970.372014:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728145280/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202970.372047:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202970.372050:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202970.372052:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202970.372055:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2251 00000100:00080000:3.0:1788202970.372058:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202970.372062:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202970.372072:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202970.372083:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728145408/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202970.372108:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728145280:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202970.372190:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202970.372261:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202970/real 1788202970] req@ffff8bc1726cc700 x1875064728145280/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202995 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202970.372285:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728145280/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788202995 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202970.372297:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202970.372301:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202970.372305:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728145280:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202970.372313:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728145408:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202970.372338:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202970.372351:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202970/real 1788202970] req@ffff8bc1726cd180 x1875064728145408/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202995 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202970.372363:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728145408/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788202995 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202970.372372:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202970.372376:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202970.372379:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728145408:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202971.203937:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202971.267939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202972.227917:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202972.291894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202973.251964:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202973.315871:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202974.275950:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202974.339921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202975.299904:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202975.363864:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788202975.491942:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788202975.491953:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788202975.491958:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202975.491968:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2256 00000100:00080000:2.0:1788202975.491986:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202975.491994:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788202975.492030:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c700 x1875064728145536/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788202975.492053:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788202975.492056:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788202975.492058:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788202975.492061:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2256 00000100:00080000:2.0:1788202975.492065:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788202975.492069:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788202975.492076:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202975.492083:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728145536:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202975.492088:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d180 x1875064728145664/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202975.492187:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728145664:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202976.323944:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788202976.387932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202977.347998:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202977.411920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202978.371960:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202978.435905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:0.0:1788202978.564026:0:10040:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:0.0:1788202978.564069:0:10040:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:0.0:1788202978.564087:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:0.0:1788202978.564123:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:3.0:1788202978.564182:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202975/real 1788202978] req@ffff8bc17257d180 x1875064728145664/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203000 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202978.564217:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d180 x1875064728145664/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203000 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202978.564231:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202978.564236:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202978.564241:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728145664:192.168.201.143@tcp:38:kworker.0 00000100:00100000:3.0:1788202978.564250:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202975/real 1788202978] req@ffff8bc17257c700 x1875064728145536/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203000 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202978.564265:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c700 x1875064728145536/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203000 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202978.564273:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202978.564277:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202978.564281:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728145536:192.168.201.143@tcp:250:kworker.0 00010000:00010000:3.0:1788202979.395963:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202979.459932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202980.419954:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202980.483921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202980.611967:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202980.611979:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202980.611983:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202980.611992:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2261 00000100:00080000:0.0:1788202980.612003:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202980.612010:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202980.612042:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142680 x1875064728145792/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202980.612074:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202980.612078:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202980.612080:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202980.612084:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2261 00000100:00080000:0.0:1788202980.612087:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202980.612091:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202980.612105:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202980.612119:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140a80 x1875064728145920/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202980.612138:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728145792:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202980.612208:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202980.612267:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202980/real 1788202980] req@ffff8bc144142680 x1875064728145792/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203005 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202980.612300:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142680 x1875064728145792/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203005 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202980.612311:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202980.612315:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202980.612319:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728145792:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202980.612346:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728145920:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202980.612371:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202980.612384:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202980/real 1788202980] req@ffff8bc144140a80 x1875064728145920/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203005 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202980.612398:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140a80 x1875064728145920/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203005 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202980.612406:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202980.612408:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202980.612412:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728145920:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202981.443958:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202981.507992:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202982.467951:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202982.531908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202983.492002:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202983.555889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202984.515958:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202984.579944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202985.540030:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202985.603889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788202985.731932:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788202985.731943:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788202985.731948:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202985.731959:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2267 00000100:00080000:0.0:1788202985.731972:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202985.731981:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788202985.732032:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140000 x1875064728146048/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788202985.732062:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788202985.732065:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788202985.732066:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788202985.732070:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2267 00000100:00080000:0.0:1788202985.732073:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788202985.732077:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788202985.732087:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788202985.732098:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143100 x1875064728146176/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788202985.732116:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728146048:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788202985.732209:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202985.732263:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202985/real 1788202985] req@ffff8bc144140000 x1875064728146048/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203010 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202985.732279:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140000 x1875064728146048/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203010 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202985.732288:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202985.732291:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202985.732295:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728146048:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788202985.732318:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728146176:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788202985.732338:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788202985.732352:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202985/real 1788202985] req@ffff8bc144143100 x1875064728146176/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203010 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788202985.732365:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143100 x1875064728146176/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203010 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788202985.732375:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788202985.732379:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788202985.732383:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728146176:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202986.563998:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202986.627927:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202987.587954:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202987.651898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202988.611940:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202988.675894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202989.635989:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202989.699861:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202990.659949:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202990.723876:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202990.851877:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202990.851885:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202990.851889:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202990.851897:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2272 00000100:00080000:3.0:1788202990.851906:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202990.851911:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202990.851943:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728146304/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202990.851967:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202990.851970:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202990.851972:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202990.851981:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2272 00000100:00080000:3.0:1788202990.851983:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202990.851986:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202990.851994:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202990.852004:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728146432/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202990.852031:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728146304:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202990.852099:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202990.852173:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202990/real 1788202990] req@ffff8bc1726cf100 x1875064728146304/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203015 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202990.852194:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728146304/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203015 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202990.852215:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202990.852221:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202990.852225:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728146304:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202990.852235:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728146432:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202990.852261:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202990.852275:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202990/real 1788202990] req@ffff8bc1726cf480 x1875064728146432/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203015 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202990.852288:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728146432/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203015 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202990.852297:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202990.852301:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202990.852305:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728146432:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788202991.683996:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202991.747995:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202992.707959:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202992.771857:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202993.732020:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202993.795831:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202994.755913:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202994.819846:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202995.779951:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788202995.843858:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788202995.971928:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788202995.971940:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788202995.971946:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202995.971966:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2277 00000100:00080000:3.0:1788202995.971979:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202995.971988:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788202995.972064:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728146560/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788202995.972096:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788202995.972101:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788202995.972103:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788202995.972107:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2277 00000100:00080000:3.0:1788202995.972111:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788202995.972115:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788202995.972126:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788202995.972137:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728146688/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788202995.972155:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728146560:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788202995.972230:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202995.972287:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202995/real 1788202995] req@ffff8bc1726cd500 x1875064728146560/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203020 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202995.972308:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728146560/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203020 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202995.972320:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202995.972324:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202995.972329:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728146560:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788202995.972359:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728146688:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788202995.972380:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788202995.972392:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788202995/real 1788202995] req@ffff8bc1726cca80 x1875064728146688/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203020 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788202995.972405:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728146688/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203020 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788202995.972415:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788202995.972418:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788202995.972422:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728146688:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788202996.803992:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202996.868085:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202997.827962:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202997.891877:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788202998.852014:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202998.915915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788202999.875988:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788202999.939970:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203000.900007:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203000.963902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203001.091920:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203001.091957:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203001.091961:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203001.091970:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2282 00000100:00080000:3.0:1788203001.091980:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203001.091987:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203001.092025:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728146816/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203001.092053:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203001.092057:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203001.092059:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203001.092064:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2282 00000100:00080000:3.0:1788203001.092068:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203001.092071:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203001.092079:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203001.092091:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728146944/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203001.092118:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728146816:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203001.092190:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203001.092236:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203001/real 1788203001] req@ffff8bc1726cfb80 x1875064728146816/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203026 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203001.092256:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728146816/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203026 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203001.092267:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203001.092272:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203001.092276:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728146816:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203001.092284:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728146944:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203001.092302:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203001.092312:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203001/real 1788203001] req@ffff8bc1726ced80 x1875064728146944/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203026 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203001.092320:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728146944/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203026 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203001.092326:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203001.092328:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203001.092330:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728146944:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203001.923920:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203001.987947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203002.948012:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203003.011869:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203003.971901:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203004.035933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203004.995955:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203005.059881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203006.019938:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203006.083891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203006.211888:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203006.211896:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203006.211899:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203006.211908:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2287 00000100:00080000:0.0:1788203006.211918:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203006.211923:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203006.211956:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143800 x1875064728147072/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203006.211990:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203006.211994:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203006.211996:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203006.212001:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2287 00000100:00080000:0.0:1788203006.212005:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203006.212011:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203006.212022:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203006.212036:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728147072:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203006.212038:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140380 x1875064728147200/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788203006.212104:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203006.212162:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203006/real 1788203006] req@ffff8bc144143800 x1875064728147072/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203031 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203006.212183:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143800 x1875064728147072/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203031 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203006.212191:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203006.212194:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203006.212197:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728147072:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203006.212217:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728147200:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203006.212235:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203006.212244:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203006/real 1788203006] req@ffff8bc144140380 x1875064728147200/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203031 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203006.212252:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140380 x1875064728147200/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203031 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203006.212259:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203006.212261:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203006.212263:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728147200:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203007.043950:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203007.107908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203008.067981:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203008.131888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203009.091962:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203009.155966:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203010.115960:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203010.179912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203011.139993:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203011.203939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203011.331896:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203011.331905:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203011.331909:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203011.331918:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2292 00000100:00080000:2.0:1788203011.331927:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203011.331933:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203011.331974:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f100 x1875064728147328/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203011.331999:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203011.332005:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203011.332006:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203011.332009:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2292 00000100:00080000:2.0:1788203011.332012:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203011.332014:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203011.332022:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203011.332031:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d500 x1875064728147456/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788203011.332043:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728147328:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788203011.332099:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788203011.332169:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203011/real 1788203011] req@ffff8bc17257f100 x1875064728147328/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203036 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788203011.332191:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f100 x1875064728147328/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203036 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788203011.332199:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788203011.332202:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788203011.332206:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728147328:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788203011.332227:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728147456:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788203011.332245:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788203011.332255:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203011/real 1788203011] req@ffff8bc17257d500 x1875064728147456/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203036 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788203011.332264:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d500 x1875064728147456/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203036 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788203011.332271:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788203011.332293:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788203011.332296:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728147456:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203012.163923:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203012.227874:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203013.187977:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203013.251955:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203014.211953:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203014.275888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203015.236066:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203015.299949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203016.260016:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203016.323908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788203016.451948:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788203016.451962:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788203016.451968:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203016.451982:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2297 00000100:00080000:1.0:1788203016.451996:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203016.452005:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788203016.452054:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7b80 x1875064728147584/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788203016.452087:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788203016.452091:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788203016.452093:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203016.452099:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2297 00000100:00080000:1.0:1788203016.452103:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203016.452108:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788203016.452120:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788203016.452138:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7100 x1875064728147712/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788203016.452202:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728147584:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788203016.452279:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788203016.452341:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203016/real 1788203016] req@ffff8bc1727d7b80 x1875064728147584/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203041 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788203016.452368:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7b80 x1875064728147584/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203041 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788203016.452380:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788203016.452386:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788203016.452392:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728147584:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788203016.452400:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728147712:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788203016.452423:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788203016.452436:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203016/real 1788203016] req@ffff8bc1727d7100 x1875064728147712/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203041 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788203016.452448:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7100 x1875064728147712/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203041 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788203016.452457:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788203016.452461:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788203016.452464:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728147712:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203017.283997:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203017.348086:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203018.308064:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203018.371930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203019.331991:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203019.395895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203020.355968:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203020.419871:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203021.379924:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203021.443888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203021.571937:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203021.571945:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203021.571948:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203021.571957:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2302 00000100:00080000:3.0:1788203021.571966:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203021.571972:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203021.572010:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728147840/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203021.572032:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203021.572035:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203021.572036:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203021.572039:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2302 00000100:00080000:3.0:1788203021.572041:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203021.572044:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203021.572052:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203021.572062:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728147968/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203021.572071:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728147840:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203021.572130:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203021.572168:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203021/real 1788203021] req@ffff8bc1726cea00 x1875064728147840/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203046 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203021.572185:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728147840/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203046 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203021.572192:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203021.572195:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203021.572197:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728147840:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203021.572216:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728147968:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203021.572230:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203021.572238:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203021/real 1788203021] req@ffff8bc1726ce300 x1875064728147968/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203046 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203021.572246:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728147968/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203046 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203021.572251:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203021.572253:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203021.572255:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728147968:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203022.403980:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203022.467911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203023.427974:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203023.491938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203024.452020:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203024.515866:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203025.476021:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203025.539914:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203026.499966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203026.563852:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203026.691938:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203026.691947:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203026.691951:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203026.691959:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2308 00000100:00080000:2.0:1788203026.691969:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203026.691974:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203026.692007:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e300 x1875064728148096/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203026.692030:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203026.692033:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203026.692034:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203026.692037:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2308 00000100:00080000:2.0:1788203026.692039:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203026.692042:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203026.692050:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203026.692060:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c380 x1875064728148224/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788203026.692064:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728148096:192.168.201.143@tcp:250:kworker.0 00000800:00000100:3.0:1788203026.692123:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788203026.692172:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203026/real 1788203026] req@ffff8bc17257e300 x1875064728148096/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203051 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788203026.692192:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e300 x1875064728148096/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203051 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788203026.692210:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788203026.692215:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788203026.692219:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728148096:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788203026.692242:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728148224:192.168.201.143@tcp:38:kworker.0 00000800:00000100:3.0:1788203026.692261:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:3.0:1788203026.692271:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203026/real 1788203026] req@ffff8bc17257c380 x1875064728148224/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203051 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788203026.692280:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c380 x1875064728148224/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203051 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788203026.692286:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788203026.692288:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:3.0:1788203026.692290:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728148224:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203027.523930:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203027.587916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203028.547976:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203028.611903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203029.571957:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203029.635870:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203030.595966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203030.659915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203031.619930:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203031.683890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203031.811930:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203031.811938:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203031.811941:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203031.811950:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2313 00000100:00080000:3.0:1788203031.811961:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203031.811969:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203031.812011:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728148352/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203031.812055:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203031.812058:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203031.812059:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203031.812062:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2313 00000100:00080000:3.0:1788203031.812065:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203031.812069:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203031.812078:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203031.812090:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728148480/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203031.812095:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728148352:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203031.812171:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203031.812219:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203031/real 1788203031] req@ffff8bc1726cc380 x1875064728148352/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203056 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203031.812233:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728148352/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203056 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203031.812241:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203031.812243:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203031.812246:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728148352:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203031.812268:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728148480:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203031.812287:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203031.812296:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203031/real 1788203031] req@ffff8bc1726ce680 x1875064728148480/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203056 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203031.812304:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728148480/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203056 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203031.812310:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203031.812312:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203031.812314:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728148480:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203032.644029:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203032.708011:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203033.667929:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203033.731870:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203034.692019:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203034.755922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203035.715938:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203035.779879:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203036.739982:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203036.803888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203036.931940:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203036.931950:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203036.931954:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203036.931966:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2318 00000100:00080000:3.0:1788203036.931978:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203036.931986:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203036.932033:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728148608/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203036.932074:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203036.932078:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203036.932080:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203036.932083:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2318 00000100:00080000:3.0:1788203036.932087:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203036.932091:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203036.932101:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203036.932118:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728148736/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203036.932129:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728148608:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203036.932195:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203036.932252:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203036/real 1788203036] req@ffff8bc1726cce00 x1875064728148608/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203061 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203036.932268:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728148608/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203061 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203036.932282:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203036.932285:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203036.932289:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728148608:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203036.932343:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728148736:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203036.932363:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203036.932372:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203036/real 1788203036] req@ffff8bc1726cdc00 x1875064728148736/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203061 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203036.932382:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728148736/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203061 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203036.932388:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203036.932391:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203036.932393:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728148736:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203037.764028:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203037.827946:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203038.787976:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203038.851954:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203039.812015:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203039.875896:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203040.835913:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203040.899931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203041.860014:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203041.923924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203042.051936:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203042.051945:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203042.051949:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203042.051959:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2323 00000100:00080000:3.0:1788203042.051970:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203042.051977:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203042.052020:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728148864/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203042.052043:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203042.052047:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203042.052049:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203042.052052:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2323 00000100:00080000:3.0:1788203042.052055:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203042.052059:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203042.052070:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203042.052084:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728148992/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203042.052098:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728148864:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203042.052230:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728148992:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203042.883959:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203042.948041:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203043.907951:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203043.971893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203044.931988:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203044.995875:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788203045.124020:0:10041:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788203045.124075:0:10041:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788203045.124090:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:0.0:1788203045.124249:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203042/real 1788203045] req@ffff8bc1726cdc00 x1875064728148864/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203067 ref 2 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203045.124282:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728148864/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203067 ref 2 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203045.124293:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203045.124298:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203045.124301:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728148864:192.168.201.143@tcp:250:kworker.0 00000800:00000100:1.0:1788203045.124357:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:0.0:1788203045.124425:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203042/real 1788203045] req@ffff8bc1726cce00 x1875064728148992/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203067 ref 2 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203045.124440:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728148992/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203067 ref 2 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203045.124447:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203045.124450:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203045.124453:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728148992:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203045.955986:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203046.019892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203046.979927:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203047.043895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203047.171876:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203047.171884:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203047.171887:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203047.171897:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2328 00000100:00080000:0.0:1788203047.171906:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203047.171913:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203047.171948:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142300 x1875064728149120/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203047.171979:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203047.171983:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203047.171985:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203047.171988:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2328 00000100:00080000:0.0:1788203047.171991:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203047.171995:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203047.172005:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203047.172018:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141f80 x1875064728149248/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203047.172022:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728149120:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203047.172086:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203047.172180:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203047/real 1788203047] req@ffff8bc144142300 x1875064728149120/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203072 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203047.172201:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142300 x1875064728149120/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203072 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203047.172212:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203047.172216:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203047.172219:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728149120:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203047.172244:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728149248:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203047.172268:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203047.172281:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203047/real 1788203047] req@ffff8bc144141f80 x1875064728149248/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203072 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203047.172301:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141f80 x1875064728149248/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203072 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203047.172309:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203047.172313:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203047.172316:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728149248:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203048.003981:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203048.067942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203049.027981:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203049.091923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203050.051979:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203050.115935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203051.075927:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203051.139875:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203052.099965:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203052.163882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203052.291873:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203052.291882:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203052.291885:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203052.291893:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2333 00000100:00080000:0.0:1788203052.291901:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203052.291907:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203052.291935:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143b80 x1875064728149376/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203052.291955:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203052.291958:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203052.291959:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203052.291961:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2333 00000100:00080000:0.0:1788203052.291963:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203052.291965:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203052.291972:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203052.291980:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141500 x1875064728149504/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203052.291996:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728149376:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203052.292074:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203052.292117:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203052/real 1788203052] req@ffff8bc144143b80 x1875064728149376/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203077 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203052.292129:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143b80 x1875064728149376/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203077 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203052.292136:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203052.292139:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203052.292141:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728149376:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203052.292158:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728149504:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203052.292172:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203052.292180:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203052/real 1788203052] req@ffff8bc144141500 x1875064728149504/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203077 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203052.292187:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141500 x1875064728149504/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203077 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203052.292191:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203052.292193:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203052.292195:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728149504:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203053.123887:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203053.187885:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203054.147928:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203054.211901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203055.171930:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203055.235925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203056.195906:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203056.259871:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203057.220000:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203057.283914:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203057.411897:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203057.411906:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203057.411910:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203057.411919:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2338 00000100:00080000:0.0:1788203057.411927:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203057.411933:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203057.411991:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143480 x1875064728149632/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203057.412021:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203057.412025:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203057.412027:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203057.412032:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2338 00000100:00080000:0.0:1788203057.412036:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203057.412041:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203057.412060:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203057.412065:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728149632:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203057.412080:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141880 x1875064728149760/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788203057.412123:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203057.412166:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203057/real 1788203057] req@ffff8bc144143480 x1875064728149632/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203082 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203057.412179:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143480 x1875064728149632/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203082 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203057.412187:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203057.412190:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203057.412194:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728149632:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203057.412216:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728149760:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203057.412233:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203057.412241:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203057/real 1788203057] req@ffff8bc144141880 x1875064728149760/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203082 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203057.412249:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141880 x1875064728149760/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203082 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203057.412255:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203057.412257:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203057.412259:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728149760:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203058.243924:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203058.307909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203059.268047:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203059.331849:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203060.291930:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203060.355857:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203061.316049:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203061.379862:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203062.339920:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203062.403885:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203062.531918:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203062.531928:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203062.531933:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203062.531943:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2343 00000100:00080000:0.0:1788203062.531956:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203062.531963:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203062.532006:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142a00 x1875064728149888/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203062.532035:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203062.532038:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203062.532039:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203062.532042:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2343 00000100:00080000:0.0:1788203062.532044:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203062.532047:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203062.532057:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203062.532065:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140e00 x1875064728150016/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203062.532134:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728149888:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203062.532212:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203062.532281:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203062/real 1788203062] req@ffff8bc144142a00 x1875064728149888/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203087 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203062.532299:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142a00 x1875064728149888/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203087 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203062.532311:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203062.532316:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203062.532321:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728149888:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203062.532330:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728150016:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203062.532357:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203062.532368:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203062/real 1788203062] req@ffff8bc144140e00 x1875064728150016/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203087 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203062.532377:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140e00 x1875064728150016/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203087 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203062.532383:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203062.532385:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203062.532387:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728150016:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203063.364052:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203063.427947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203064.388074:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203064.451850:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203065.411991:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203065.475907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203066.435953:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203066.499911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203067.459998:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203067.523877:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203067.651917:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203067.651927:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203067.651932:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203067.651942:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2349 00000100:00080000:2.0:1788203067.651954:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203067.651962:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203067.652018:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257fb80 x1875064728150144/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203067.652046:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203067.652049:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203067.652050:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203067.652053:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2349 00000100:00080000:2.0:1788203067.652055:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203067.652058:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203067.652069:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203067.652080:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ca80 x1875064728150272/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203067.652090:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728150144:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203067.652158:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203067.652210:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203067/real 1788203067] req@ffff8bc17257fb80 x1875064728150144/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203092 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203067.652226:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257fb80 x1875064728150144/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203092 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203067.652235:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203067.652239:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203067.652242:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728150144:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203067.652264:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728150272:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203067.652280:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203067.652289:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203067/real 1788203067] req@ffff8bc17257ca80 x1875064728150272/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203092 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203067.652297:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ca80 x1875064728150272/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203092 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203067.652303:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203067.652305:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203067.652307:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728150272:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203068.483955:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203068.547946:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203069.508030:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203069.571911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203070.531953:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203070.595882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203071.555996:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203071.619924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203072.579934:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203072.643890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203072.771977:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203072.771992:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203072.771997:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203072.772020:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2354 00000100:00080000:0.0:1788203072.772034:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203072.772044:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203072.772095:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140700 x1875064728150400/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203072.772131:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203072.772136:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203072.772139:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203072.772145:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2354 00000100:00080000:0.0:1788203072.772149:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203072.772155:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203072.772167:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728150400:192.168.201.143@tcp:250:kworker.0 00000008:00100000:0.0:1788203072.772169:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203072.772201:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141c00 x1875064728150528/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788203072.772239:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203072.772304:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203072/real 1788203072] req@ffff8bc144140700 x1875064728150400/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203097 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203072.772333:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140700 x1875064728150400/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203097 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203072.772343:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203072.772346:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203072.772349:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728150400:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203072.772374:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728150528:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203072.772393:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203072.772402:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203072/real 1788203072] req@ffff8bc144141c00 x1875064728150528/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203097 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203072.772411:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141c00 x1875064728150528/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203097 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203072.772417:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203072.772420:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203072.772422:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728150528:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203073.603998:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203073.667928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203074.628032:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203074.691894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203075.651975:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203075.715926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203076.676019:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203076.739891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203077.699993:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203077.763925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203077.891983:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203077.891998:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203077.892004:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203077.892018:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2359 00000100:00080000:0.0:1788203077.892033:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203077.892042:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203077.892098:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141c00 x1875064728150656/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203077.892134:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203077.892144:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203077.892146:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203077.892151:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2359 00000100:00080000:0.0:1788203077.892156:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203077.892162:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203077.892175:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203077.892180:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728150656:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203077.892194:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140700 x1875064728150784/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788203077.892254:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203077.892311:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203077/real 1788203077] req@ffff8bc144141c00 x1875064728150656/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203102 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203077.892328:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141c00 x1875064728150656/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203102 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203077.892337:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203077.892340:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203077.892344:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728150656:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203077.892373:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728150784:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203077.892398:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203077.892411:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203077/real 1788203077] req@ffff8bc144140700 x1875064728150784/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203102 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203077.892426:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140700 x1875064728150784/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203102 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203077.892433:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203077.892436:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203077.892440:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728150784:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203078.724028:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203078.787914:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203079.748001:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203079.811936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203080.772012:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203080.835925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203081.795960:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203081.859915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203082.819939:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203082.883877:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203083.011948:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203083.011959:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203083.011963:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203083.011975:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2364 00000100:00080000:0.0:1788203083.011987:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203083.011995:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203083.012041:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140e00 x1875064728150912/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203083.012071:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203083.012074:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203083.012078:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203083.012081:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2364 00000100:00080000:0.0:1788203083.012084:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203083.012087:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203083.012097:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203083.012109:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142a00 x1875064728151040/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203083.012125:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728150912:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203083.012194:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203083.012252:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203083/real 1788203083] req@ffff8bc144140e00 x1875064728150912/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203108 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203083.012269:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140e00 x1875064728150912/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203108 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203083.012279:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203083.012282:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203083.012286:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728150912:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203083.012311:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728151040:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203083.012327:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203083.012336:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203083/real 1788203083] req@ffff8bc144142a00 x1875064728151040/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203108 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203083.012345:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142a00 x1875064728151040/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203108 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203083.012350:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203083.012352:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203083.012354:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728151040:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203083.843980:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203083.907908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203084.867990:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203084.931877:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203085.891952:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203085.955904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203086.916026:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203086.979926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203087.939937:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203088.003880:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203088.131940:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203088.131954:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203088.131959:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203088.131973:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2369 00000100:00080000:0.0:1788203088.131986:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203088.131995:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203088.132044:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141880 x1875064728151168/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203088.132079:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203088.132083:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203088.132085:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203088.132089:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2369 00000100:00080000:0.0:1788203088.132092:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203088.132097:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203088.132109:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203088.132122:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143480 x1875064728151296/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203088.132146:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728151168:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203088.132230:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203088.132289:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203088/real 1788203088] req@ffff8bc144141880 x1875064728151168/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203113 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203088.132310:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141880 x1875064728151168/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203113 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203088.132323:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203088.132328:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203088.132332:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728151168:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203088.132366:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728151296:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203088.132387:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203088.132401:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203088/real 1788203088] req@ffff8bc144143480 x1875064728151296/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203113 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203088.132446:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143480 x1875064728151296/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203113 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203088.132456:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203088.132460:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203088.132464:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728151296:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203088.963946:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203089.028029:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203089.987922:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203090.051871:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203091.011950:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203091.075990:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203092.035929:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203092.099941:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203093.059979:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203093.123907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203093.251891:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203093.251901:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203093.251906:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203093.251917:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2374 00000100:00080000:3.0:1788203093.251931:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203093.251940:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203093.251990:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728151424/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203093.252014:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203093.252018:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203093.252020:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203093.252024:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2374 00000100:00080000:3.0:1788203093.252029:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203093.252032:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203093.252049:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203093.252059:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728151424:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788203093.252070:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728151552/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788203093.252138:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203093.252187:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203093/real 1788203093] req@ffff8bc1726ce680 x1875064728151424/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203118 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203093.252202:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728151424/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203118 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203093.252211:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203093.252223:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203093.252226:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728151424:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203093.252248:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728151552:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203093.252267:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203093.252276:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203093/real 1788203093] req@ffff8bc1726cc380 x1875064728151552/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203118 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203093.252285:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728151552/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203118 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203093.252291:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203093.252293:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203093.252295:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728151552:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203094.083972:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203094.147977:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203095.107972:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203095.171961:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203096.132069:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203096.195936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203097.155995:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203097.219934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203098.179970:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203098.243905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203098.371918:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203098.371930:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203098.371934:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203098.371945:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2379 00000100:00080000:3.0:1788203098.371956:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203098.371964:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203098.372004:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728151680/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203098.372038:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203098.372042:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203098.372044:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203098.372049:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2379 00000100:00080000:3.0:1788203098.372052:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203098.372057:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203098.372066:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203098.372080:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728151808/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203098.372123:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728151680:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203098.372179:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203098.372223:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203098/real 1788203098] req@ffff8bc1726ce300 x1875064728151680/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203123 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203098.372267:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728151680/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203123 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203098.372278:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203098.372283:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203098.372287:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728151680:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203098.372295:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728151808:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203098.372314:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203098.372323:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203098/real 1788203098] req@ffff8bc1726cea00 x1875064728151808/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203123 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203098.372331:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728151808/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203123 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203098.372337:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203098.372340:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203098.372342:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728151808:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203099.204003:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203099.267943:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203100.227976:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203100.291894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203101.251992:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203101.315909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203102.275952:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203102.339882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203103.299996:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203103.363890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203103.491882:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203103.491891:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203103.491894:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203103.491909:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2384 00000100:00080000:0.0:1788203103.491921:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203103.491927:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203103.491959:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141500 x1875064728151936/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203103.491981:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203103.491984:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203103.491986:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203103.491988:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2384 00000100:00080000:0.0:1788203103.491990:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203103.491993:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203103.492000:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203103.492009:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143b80 x1875064728152064/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203103.492023:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728151936:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203103.492090:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203103.492131:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203103/real 1788203103] req@ffff8bc144141500 x1875064728151936/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203128 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203103.492172:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141500 x1875064728151936/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203128 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203103.492180:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203103.492182:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203103.492185:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728151936:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203103.492207:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728152064:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203103.492226:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203103.492235:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203103/real 1788203103] req@ffff8bc144143b80 x1875064728152064/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203128 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203103.492244:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143b80 x1875064728152064/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203128 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203103.492249:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203103.492251:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203103.492254:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728152064:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203104.323959:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203104.387912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203105.347968:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203105.411914:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203106.371966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203106.435910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203107.395979:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203107.459879:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203108.419992:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203108.483903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788203108.611951:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788203108.611966:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788203108.611971:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203108.611984:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2389 00000100:00080000:1.0:1788203108.611998:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203108.612007:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788203108.612054:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7800 x1875064728152192/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788203108.612106:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788203108.612110:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788203108.612112:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203108.612118:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2389 00000100:00080000:1.0:1788203108.612122:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203108.612129:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788203108.612142:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203108.612155:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728152192:192.168.201.143@tcp:250:kworker.0 00000100:00100000:1.0:1788203108.612159:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4a80 x1875064728152320/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203108.612275:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728152320:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203109.443937:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203109.507886:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203110.467996:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203110.531874:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203111.491947:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203111.555857:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788203111.684096:0:10042:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788203111.684141:0:10042:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788203111.684155:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788203111.684188:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788203111.684245:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203108/real 1788203111] req@ffff8bc1727d4a80 x1875064728152320/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203133 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203111.684272:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4a80 x1875064728152320/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203133 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203111.684285:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203111.684289:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203111.684292:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728152320:192.168.201.143@tcp:38:kworker.0 00000100:00100000:2.0:1788203111.684298:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203108/real 1788203111] req@ffff8bc1727d7800 x1875064728152192/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203133 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203111.684309:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7800 x1875064728152192/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203133 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203111.684318:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203111.684322:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203111.684326:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728152192:192.168.201.143@tcp:250:kworker.0 00010000:00010000:3.0:1788203112.516041:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203112.579906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203113.539960:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203113.603880:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788203113.732002:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788203113.732014:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788203113.732017:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203113.732028:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2395 00000100:00080000:1.0:1788203113.732038:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203113.732045:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788203113.732080:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6a00 x1875064728152448/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788203113.732111:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788203113.732122:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788203113.732124:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203113.732128:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2395 00000100:00080000:1.0:1788203113.732132:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203113.732137:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788203113.732147:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788203113.732161:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4e00 x1875064728152576/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203113.732178:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728152448:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203113.732248:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203113.732298:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203113/real 1788203113] req@ffff8bc1727d6a00 x1875064728152448/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203138 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203113.732318:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6a00 x1875064728152448/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203138 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203113.732329:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203113.732333:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203113.732338:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728152448:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203113.732365:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728152576:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203113.732389:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203113.732405:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203113/real 1788203113] req@ffff8bc1727d4e00 x1875064728152576/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203138 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203113.732417:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4e00 x1875064728152576/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203138 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203113.732425:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203113.732428:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203113.732431:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728152576:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203114.563937:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203114.628112:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203115.588030:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203115.651915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203116.611950:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203116.675901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203117.636072:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203117.699864:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203118.659982:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203118.723960:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203118.851925:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203118.851935:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203118.851940:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203118.851950:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2400 00000100:00080000:2.0:1788203118.851962:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203118.851968:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203118.852008:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ea00 x1875064728152704/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203118.852043:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203118.852047:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203118.852049:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203118.852054:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2400 00000100:00080000:2.0:1788203118.852058:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203118.852063:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203118.852073:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203118.852085:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ce00 x1875064728152832/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203118.852098:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728152704:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203118.852157:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203118.852203:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203118/real 1788203118] req@ffff8bc17257ea00 x1875064728152704/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203143 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203118.852224:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ea00 x1875064728152704/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203143 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203118.852233:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203118.852236:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203118.852239:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728152704:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203118.852259:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728152832:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203118.852277:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203118.852286:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203118/real 1788203118] req@ffff8bc17257ce00 x1875064728152832/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203143 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203118.852294:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ce00 x1875064728152832/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203143 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203118.852300:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203118.852302:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203118.852304:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728152832:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203119.684013:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203119.747948:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203120.708031:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203120.771979:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203121.731964:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203121.795882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203122.756064:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203122.819949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203123.779972:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203123.843872:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203123.971926:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203123.971938:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203123.971942:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203123.971958:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2405 00000100:00080000:3.0:1788203123.971967:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203123.971973:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203123.972019:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728152960/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203123.972056:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203123.972059:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203123.972060:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203123.972063:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2405 00000100:00080000:3.0:1788203123.972066:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203123.972070:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203123.972079:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203123.972090:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728153088/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203123.972104:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728152960:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203123.972158:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203123.972203:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203123/real 1788203123] req@ffff8bc1726ced80 x1875064728152960/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203148 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203123.972218:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728152960/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203148 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203123.972233:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203123.972238:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203123.972242:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728152960:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203123.972271:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728153088:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203123.972301:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203123.972311:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203123/real 1788203123] req@ffff8bc1726cfb80 x1875064728153088/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203148 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203123.972320:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728153088/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203148 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203123.972326:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203123.972329:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203123.972331:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728153088:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203124.803968:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203124.867929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203125.828033:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203125.891859:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203126.851959:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203126.915884:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203127.875967:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203127.939866:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203128.899949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203128.963864:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203129.091923:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203129.091939:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203129.091943:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203129.091952:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2410 00000100:00080000:0.0:1788203129.091961:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203129.091967:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203129.092003:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141f80 x1875064728153216/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203129.092034:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203129.092041:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203129.092043:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203129.092047:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2410 00000100:00080000:0.0:1788203129.092052:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203129.092056:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203129.092065:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203129.092075:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728153216:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203129.092080:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142300 x1875064728153344/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788203129.092143:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203129.092199:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203129/real 1788203129] req@ffff8bc144141f80 x1875064728153216/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203154 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203129.092219:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141f80 x1875064728153216/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203154 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203129.092227:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203129.092230:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203129.092233:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728153216:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203129.092257:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728153344:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203129.092276:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203129.092285:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203129/real 1788203129] req@ffff8bc144142300 x1875064728153344/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203154 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203129.092298:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142300 x1875064728153344/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203154 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203129.092303:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203129.092306:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203129.092308:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728153344:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203129.923955:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203129.987936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203130.947949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203131.011876:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203131.971963:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203132.035925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203132.995993:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203133.059932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203134.019986:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203134.083928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203134.211967:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203134.211988:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203134.211994:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203134.212007:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2415 00000100:00080000:0.0:1788203134.212029:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203134.212039:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203134.212094:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140380 x1875064728153472/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203134.212126:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203134.212130:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203134.212133:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203134.212137:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2415 00000100:00080000:0.0:1788203134.212141:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203134.212146:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203134.212160:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203134.212175:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143800 x1875064728153600/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203134.212180:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728153472:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203134.212261:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203134.212319:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203134/real 1788203134] req@ffff8bc144140380 x1875064728153472/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203159 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203134.212337:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140380 x1875064728153472/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203159 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203134.212346:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203134.212350:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203134.212353:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728153472:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203134.212385:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728153600:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203134.212402:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203134.212411:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203134/real 1788203134] req@ffff8bc144143800 x1875064728153600/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203159 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203134.212425:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143800 x1875064728153600/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203159 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203134.212431:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203134.212433:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203134.212435:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728153600:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203135.044065:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203135.107976:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203136.067975:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203136.131911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203137.091982:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203137.155910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203138.115924:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203138.179909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203139.139950:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203139.203879:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788203139.331914:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788203139.331923:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788203139.331927:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203139.331937:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2420 00000100:00080000:1.0:1788203139.331948:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203139.331956:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788203139.331997:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5c00 x1875064728153728/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788203139.332021:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788203139.332026:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788203139.332028:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203139.332032:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2420 00000100:00080000:1.0:1788203139.332036:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203139.332041:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788203139.332050:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788203139.332065:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4700 x1875064728153856/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203139.332070:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728153728:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203139.332134:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203139.332181:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203139/real 1788203139] req@ffff8bc1727d5c00 x1875064728153728/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203164 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203139.332196:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5c00 x1875064728153728/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203164 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203139.332204:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203139.332206:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203139.332209:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728153728:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203139.332228:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728153856:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203139.332244:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203139.332252:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203139/real 1788203139] req@ffff8bc1727d4700 x1875064728153856/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203164 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203139.332260:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4700 x1875064728153856/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203164 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203139.332267:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203139.332269:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203139.332271:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728153856:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203140.163946:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203140.227906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203141.187969:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203141.251872:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203142.211972:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203142.275899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203143.235989:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203143.299924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203144.259919:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203144.323909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203144.451887:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203144.451896:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203144.451899:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203144.451908:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2425 00000100:00080000:2.0:1788203144.451917:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203144.451923:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203144.451955:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d880 x1875064728153984/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203144.451979:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203144.451983:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203144.451985:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203144.451989:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2425 00000100:00080000:2.0:1788203144.451993:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203144.451997:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203144.452006:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203144.452020:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ed80 x1875064728154112/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203144.452032:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728153984:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203144.452096:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203144.452135:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203144/real 1788203144] req@ffff8bc17257d880 x1875064728153984/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203169 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203144.452154:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d880 x1875064728153984/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203169 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203144.452164:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203144.452168:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203144.452173:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728153984:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203144.452196:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728154112:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203144.452214:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203144.452223:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203144/real 1788203144] req@ffff8bc17257ed80 x1875064728154112/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203169 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203144.452234:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ed80 x1875064728154112/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203169 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203144.452243:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203144.452247:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203144.452250:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728154112:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203145.283935:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203145.348010:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203146.307962:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203146.371871:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203147.331957:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203147.395890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203148.355915:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203148.419883:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203149.379934:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203149.443888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203149.571895:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203149.571907:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203149.571912:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203149.571922:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2430 00000100:00080000:0.0:1788203149.571932:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203149.571937:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203149.571969:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143100 x1875064728154240/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203149.571993:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203149.571996:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203149.571998:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203149.572001:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2430 00000100:00080000:0.0:1788203149.572003:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203149.572005:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203149.572013:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203149.572023:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140000 x1875064728154368/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203149.572032:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728154240:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203149.572090:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203149.572129:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203149/real 1788203149] req@ffff8bc144143100 x1875064728154240/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203174 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203149.572143:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143100 x1875064728154240/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203174 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203149.572151:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203149.572154:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203149.572157:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728154240:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203149.572175:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728154368:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203149.572190:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203149.572198:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203149/real 1788203149] req@ffff8bc144140000 x1875064728154368/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203174 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203149.572206:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140000 x1875064728154368/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203174 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203149.572212:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203149.572213:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203149.572216:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728154368:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203150.403921:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203150.467893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203151.427985:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203151.491925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203152.452027:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203152.515876:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203153.475936:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203153.539910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203154.499950:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203154.563863:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203154.691917:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203154.691926:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203154.691930:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203154.691938:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2436 00000100:00080000:3.0:1788203154.691947:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203154.691952:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203154.691986:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728154496/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203154.692009:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203154.692012:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203154.692014:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203154.692018:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2436 00000100:00080000:3.0:1788203154.692021:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203154.692025:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203154.692035:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203154.692050:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728154624/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203154.692070:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728154496:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203154.692128:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203154.692166:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203154/real 1788203154] req@ffff8bc1726cca80 x1875064728154496/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203179 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203154.692181:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728154496/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203179 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203154.692188:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203154.692191:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203154.692194:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728154496:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203154.692214:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728154624:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203154.692229:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203154.692237:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203154/real 1788203154] req@ffff8bc1726cd500 x1875064728154624/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203179 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203154.692245:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728154624/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203179 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203154.692251:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203154.692252:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203154.692255:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728154624:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203155.523929:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203155.587900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203156.547951:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203156.611891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203157.571920:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203157.635902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203158.595993:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203158.659890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203159.619964:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203159.683924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788203159.811897:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788203159.811905:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788203159.811909:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203159.811917:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2441 00000100:00080000:1.0:1788203159.811927:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203159.811936:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788203159.811975:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6300 x1875064728154752/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788203159.812000:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788203159.812003:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788203159.812004:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203159.812007:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2441 00000100:00080000:1.0:1788203159.812010:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203159.812013:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788203159.812021:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788203159.812030:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6d80 x1875064728154880/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203159.812079:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728154752:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203159.812137:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203159.812210:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203159/real 1788203159] req@ffff8bc1727d6300 x1875064728154752/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203184 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203159.812225:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6300 x1875064728154752/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203184 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203159.812234:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203159.812237:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203159.812241:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728154752:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203159.812246:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728154880:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203159.812262:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203159.812270:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203159/real 1788203159] req@ffff8bc1727d6d80 x1875064728154880/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203184 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203159.812278:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6d80 x1875064728154880/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203184 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203159.812283:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203159.812285:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203159.812287:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728154880:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203160.643990:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203160.707917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203161.667987:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203161.731918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203162.691966:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203162.755933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203163.715988:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203163.779916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203164.739975:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203164.803901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203164.931921:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203164.931930:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203164.931933:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203164.931941:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2446 00000100:00080000:0.0:1788203164.931950:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203164.931956:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203164.931989:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140a80 x1875064728155008/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203164.932011:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203164.932015:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203164.932016:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203164.932019:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2446 00000100:00080000:0.0:1788203164.932021:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203164.932023:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203164.932032:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203164.932041:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142680 x1875064728155136/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203164.932057:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728155008:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203164.932128:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203164.932182:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203164/real 1788203164] req@ffff8bc144140a80 x1875064728155008/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203189 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203164.932197:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140a80 x1875064728155008/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203189 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203164.932205:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203164.932209:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203164.932211:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728155008:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203164.932232:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728155136:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203164.932250:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203164.932260:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203164/real 1788203164] req@ffff8bc144142680 x1875064728155136/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203189 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203164.932269:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142680 x1875064728155136/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203189 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203164.932275:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203164.932277:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203164.932279:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728155136:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203165.763974:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203165.827921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203166.787975:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203166.851873:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203167.812005:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203167.875865:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203168.836036:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203168.899937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203169.859966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203169.923925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203170.051946:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203170.051959:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203170.051964:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203170.051974:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2451 00000100:00080000:3.0:1788203170.051986:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203170.052009:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203170.052058:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728155264/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203170.052093:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203170.052097:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203170.052100:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203170.052105:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2451 00000100:00080000:3.0:1788203170.052109:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203170.052114:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203170.052125:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203170.052140:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728155264:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788203170.052142:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728155392/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788203170.052225:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203170.052297:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203170/real 1788203170] req@ffff8bc1726cf480 x1875064728155264/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203195 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203170.052318:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728155264/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203195 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203170.052329:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203170.052333:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203170.052337:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728155264:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203170.052360:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728155392:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203170.052384:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203170.052406:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203170/real 1788203170] req@ffff8bc1726cf100 x1875064728155392/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203195 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203170.052420:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728155392/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203195 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203170.052429:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203170.052432:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203170.052436:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728155392:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203170.883968:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203170.947942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203171.908049:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203171.971972:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203172.931992:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203172.995982:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203173.956043:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203174.019967:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203174.979957:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203175.043998:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203175.171955:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203175.171966:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203175.171971:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203175.171983:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2456 00000100:00080000:3.0:1788203175.171996:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203175.172004:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203175.172051:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728155520/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203175.172078:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203175.172081:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203175.172083:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203175.172087:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2456 00000100:00080000:3.0:1788203175.172091:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203175.172096:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203175.172110:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203175.172126:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728155648/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203175.172146:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728155520:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203175.172315:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728155648:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203176.004024:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203176.067972:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203177.028012:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203177.091941:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203178.052023:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203178.115933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788203178.244170:0:10043:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788203178.244218:0:10043:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788203178.244243:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788203178.244293:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788203178.244407:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203175/real 1788203178] req@ffff8bc1726cc700 x1875064728155648/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203200 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203178.244439:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728155648/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203200 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203178.244453:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203178.244458:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203178.244464:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728155648:192.168.201.143@tcp:38:kworker.0 00000100:00100000:2.0:1788203178.244474:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203175/real 1788203178] req@ffff8bc1726cd180 x1875064728155520/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203200 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203178.244489:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728155520/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203200 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203178.244497:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203178.244502:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203178.244505:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728155520:192.168.201.143@tcp:250:kworker.0 00010000:00010000:2.0:1788203179.075974:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203179.139950:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203180.100018:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203180.163888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203180.292094:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203180.292107:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203180.292112:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203180.292129:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2461 00000100:00080000:3.0:1788203180.292147:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203180.292159:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203180.292225:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728155776/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203180.292276:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203180.292282:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203180.292284:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203180.292289:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2461 00000100:00080000:3.0:1788203180.292293:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203180.292299:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203180.292317:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203180.292337:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728155904/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203180.292466:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728155776:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203180.292619:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203180.292762:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203180/real 1788203180] req@ffff8bc1726cf800 x1875064728155776/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203205 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203180.292880:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728155776/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203205 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203180.292900:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203180.292906:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203180.292912:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728155776:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203180.292921:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728155904:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203180.292953:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203180.292979:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203180/real 1788203180] req@ffff8bc1726cdf80 x1875064728155904/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203205 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203180.292994:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728155904/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203205 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203180.293004:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203180.293010:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203180.293013:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728155904:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203181.124061:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203181.187910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203182.147994:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203182.211908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203183.172029:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203183.235897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203184.195990:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203184.259970:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203185.219990:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203185.283901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203185.411961:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203185.411971:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203185.411975:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203185.411985:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2466 00000100:00080000:0.0:1788203185.411996:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203185.412004:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203185.412044:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142d80 x1875064728156032/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203185.412067:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203185.412070:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203185.412072:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203185.412075:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2466 00000100:00080000:0.0:1788203185.412077:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203185.412080:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203185.412089:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203185.412099:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141180 x1875064728156160/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203185.412111:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728156032:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203185.412168:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203185.412216:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203185/real 1788203185] req@ffff8bc144142d80 x1875064728156032/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203210 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203185.412230:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142d80 x1875064728156032/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203210 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203185.412238:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203185.412242:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203185.412245:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728156032:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203185.412264:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728156160:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203185.412292:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203185.412306:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203185/real 1788203185] req@ffff8bc144141180 x1875064728156160/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203210 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203185.412318:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141180 x1875064728156160/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203210 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203185.412326:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203185.412329:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203185.412332:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728156160:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203186.244001:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203186.308075:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203187.267932:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203187.331909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203188.291994:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203188.355942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203189.315983:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203189.379919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203190.340046:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203190.403995:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203190.531852:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203190.531862:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203190.531867:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203190.531880:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2471 00000100:00080000:0.0:1788203190.531891:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203190.531900:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203190.531943:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141180 x1875064728156288/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203190.531975:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203190.531979:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203190.531981:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203190.531986:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2471 00000100:00080000:0.0:1788203190.531989:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203190.531994:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203190.532003:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203190.532014:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142d80 x1875064728156416/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203190.532081:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728156288:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203190.532148:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203190.532198:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203190/real 1788203190] req@ffff8bc144141180 x1875064728156288/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203215 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203190.532218:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141180 x1875064728156288/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203215 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203190.532229:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203190.532233:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203190.532237:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728156288:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203190.532244:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728156416:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203190.532263:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203190.532273:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203190/real 1788203190] req@ffff8bc144142d80 x1875064728156416/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203215 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203190.532284:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142d80 x1875064728156416/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203215 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203190.532293:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203190.532296:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203190.532299:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728156416:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203191.364024:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203191.428013:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203192.387979:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203192.451852:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203193.411933:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203193.475920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203194.435985:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203194.499892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203195.460016:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203195.523863:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203195.651899:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203195.651911:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203195.651915:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203195.651925:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2477 00000100:00080000:0.0:1788203195.651935:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203195.651942:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203195.651977:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142680 x1875064728156544/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203195.652013:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203195.652016:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203195.652018:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203195.652022:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2477 00000100:00080000:0.0:1788203195.652025:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203195.652029:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203195.652038:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203195.652050:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140a80 x1875064728156672/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203195.652057:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728156544:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203195.652120:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203195.652160:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203195/real 1788203195] req@ffff8bc144142680 x1875064728156544/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203220 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203195.652173:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142680 x1875064728156544/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203220 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203195.652180:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203195.652183:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203195.652186:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728156544:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203195.652205:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728156672:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203195.652220:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203195.652227:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203195/real 1788203195] req@ffff8bc144140a80 x1875064728156672/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203220 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203195.652235:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140a80 x1875064728156672/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203220 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203195.652242:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203195.652251:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203195.652254:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728156672:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203196.483947:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203196.548911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203197.507990:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203197.571878:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203198.532004:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203198.595916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203199.556024:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203199.619901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203200.579956:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203200.643899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203200.771885:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203200.771894:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203200.771897:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203200.771911:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2482 00000100:00080000:3.0:1788203200.771922:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203200.771928:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203200.771962:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728156800/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203200.771986:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203200.771993:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203200.771995:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203200.771999:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2482 00000100:00080000:3.0:1788203200.772004:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203200.772008:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203200.772017:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203200.772022:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728156800:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788203200.772034:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728156928/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788203200.772085:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203200.772138:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203200/real 1788203200] req@ffff8bc1726cdf80 x1875064728156800/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203225 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203200.772151:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728156800/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203225 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203200.772159:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203200.772162:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203200.772164:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728156800:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203200.772183:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728156928:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203200.772199:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203200.772207:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203200/real 1788203200] req@ffff8bc1726cf800 x1875064728156928/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203225 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203200.772213:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728156928/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203225 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203200.772218:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203200.772220:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203200.772222:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728156928:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203201.604666:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203201.667993:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203202.627987:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203202.691908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203203.651966:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203203.715918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203204.675932:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203204.739871:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203205.699970:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203205.763887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203205.891913:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203205.891921:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203205.891924:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203205.891933:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2487 00000100:00080000:0.0:1788203205.891942:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203205.891947:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203205.891977:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140000 x1875064728157056/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203205.891997:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203205.891999:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203205.892000:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203205.892003:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2487 00000100:00080000:0.0:1788203205.892004:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203205.892007:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203205.892013:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203205.892021:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143100 x1875064728157184/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203205.892033:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728157056:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203205.892084:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203205.892126:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203205/real 1788203205] req@ffff8bc144140000 x1875064728157056/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203230 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203205.892139:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140000 x1875064728157056/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203230 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203205.892146:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203205.892148:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203205.892151:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728157056:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203205.892171:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728157184:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203205.892192:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203205.892204:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203205/real 1788203205] req@ffff8bc144143100 x1875064728157184/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203230 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203205.892217:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143100 x1875064728157184/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203230 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203205.892226:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203205.892230:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203205.892233:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728157184:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203206.723918:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203206.787897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203207.747920:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203207.811913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203208.772006:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203208.835900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203209.796000:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203209.859866:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203210.819987:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203210.883908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203211.011946:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203211.011958:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203211.011964:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203211.011976:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2492 00000100:00080000:3.0:1788203211.011989:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203211.011997:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203211.012049:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728157312/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203211.012074:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203211.012077:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203211.012078:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203211.012081:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2492 00000100:00080000:3.0:1788203211.012083:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203211.012086:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203211.012095:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203211.012104:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728157440/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203211.012125:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728157312:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203211.012187:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203211.012241:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203211/real 1788203211] req@ffff8bc1726cd180 x1875064728157312/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203236 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203211.012257:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728157312/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203236 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203211.012266:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203211.012269:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203211.012271:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728157312:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203211.012276:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728157440:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203211.012312:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203211.012321:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203211/real 1788203211] req@ffff8bc1726cc700 x1875064728157440/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203236 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203211.012329:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728157440/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203236 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203211.012334:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203211.012336:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203211.012338:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728157440:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203211.843965:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203211.908009:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203212.867923:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203212.931919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203213.891901:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203213.955892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203214.915987:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203214.979895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203215.939973:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203216.003900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788203216.131906:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788203216.131914:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788203216.131918:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203216.131926:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2497 00000100:00080000:1.0:1788203216.131934:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203216.131941:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788203216.131972:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6680 x1875064728157568/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788203216.131998:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788203216.132001:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788203216.132003:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203216.132007:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2497 00000100:00080000:1.0:1788203216.132010:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203216.132014:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788203216.132023:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788203216.132048:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5500 x1875064728157696/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203216.132078:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728157568:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203216.132147:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203216.132224:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203216/real 1788203216] req@ffff8bc1727d6680 x1875064728157568/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203241 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203216.132242:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6680 x1875064728157568/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203241 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203216.132251:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203216.132255:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203216.132257:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728157568:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203216.132263:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728157696:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203216.132280:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203216.132288:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203216/real 1788203216] req@ffff8bc1727d5500 x1875064728157696/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203241 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203216.132296:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5500 x1875064728157696/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203241 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203216.132301:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203216.132303:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203216.132305:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728157696:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203216.964000:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203217.028006:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203217.987993:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203218.051919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203219.012006:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203219.075871:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203220.036002:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203220.099914:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203221.059992:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203221.123928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788203221.251909:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788203221.251921:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788203221.251926:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203221.251938:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2502 00000100:00080000:1.0:1788203221.251951:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203221.251959:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788203221.252022:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4380 x1875064728157824/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788203221.252053:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788203221.252057:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788203221.252059:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203221.252064:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2502 00000100:00080000:1.0:1788203221.252067:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203221.252072:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788203221.252085:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788203221.252098:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5f80 x1875064728157952/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203221.252116:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728157824:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203221.252184:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203221.252241:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203221/real 1788203221] req@ffff8bc1727d4380 x1875064728157824/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203246 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203221.252256:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4380 x1875064728157824/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203246 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203221.252265:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203221.252268:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203221.252271:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728157824:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203221.252293:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728157952:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203221.252306:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203221.252314:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203221/real 1788203221] req@ffff8bc1727d5f80 x1875064728157952/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203246 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203221.252321:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5f80 x1875064728157952/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203246 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203221.252327:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203221.252330:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203221.252333:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728157952:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203222.084013:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203222.147920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203223.107958:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203223.171908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203224.131978:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203224.195859:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203225.155985:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203225.219907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203226.179915:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203226.243914:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203226.371910:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203226.371921:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203226.371925:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203226.371936:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2507 00000100:00080000:3.0:1788203226.371946:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203226.371951:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203226.371985:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728158080/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203226.372024:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203226.372028:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203226.372030:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203226.372034:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2507 00000100:00080000:3.0:1788203226.372038:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203226.372044:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203226.372053:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203226.372057:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728158080:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788203226.372070:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728158208/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788203226.372112:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203226.372156:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203226/real 1788203226] req@ffff8bc1726cf100 x1875064728158080/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203251 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203226.372170:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728158080/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203251 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203226.372178:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203226.372181:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203226.372184:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728158080:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203226.372202:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728158208:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203226.372216:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203226.372223:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203226/real 1788203226] req@ffff8bc1726cf480 x1875064728158208/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203251 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203226.372235:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728158208/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203251 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203226.372239:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203226.372241:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203226.372243:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728158208:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203227.203947:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203227.267915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203228.227905:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203228.291907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203229.251946:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203229.315902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203230.275983:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203230.339902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203231.300048:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203231.364031:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203231.491887:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203231.491898:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203231.491903:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203231.491921:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2512 00000100:00080000:3.0:1788203231.491961:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203231.491969:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203231.492009:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728158336/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203231.492036:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203231.492039:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203231.492041:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203231.492044:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2512 00000100:00080000:3.0:1788203231.492046:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203231.492049:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203231.492059:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203231.492068:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728158464/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203231.492084:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728158336:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203231.492151:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203231.492209:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203231/real 1788203231] req@ffff8bc1726cd500 x1875064728158336/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203256 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203231.492229:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728158336/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203256 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203231.492240:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203231.492244:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203231.492248:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728158336:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203231.492271:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728158464:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203231.492288:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203231.492297:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203231/real 1788203231] req@ffff8bc1726cca80 x1875064728158464/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203256 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203231.492305:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728158464/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203256 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203231.492310:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203231.492312:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203231.492314:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728158464:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203232.324006:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203232.388000:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203233.347997:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203233.411951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203234.371972:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203234.435894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203235.395930:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203235.459931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203236.419981:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203236.483882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203236.611930:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203236.611940:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203236.611944:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203236.611954:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2517 00000100:00080000:0.0:1788203236.611963:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203236.611970:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203236.612004:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143800 x1875064728158592/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203236.612032:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203236.612035:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203236.612036:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203236.612039:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2517 00000100:00080000:0.0:1788203236.612041:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203236.612043:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203236.612051:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203236.612061:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140380 x1875064728158720/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203236.612081:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728158592:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203236.612143:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203236.612196:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203236/real 1788203236] req@ffff8bc144143800 x1875064728158592/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203261 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203236.612216:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143800 x1875064728158592/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203261 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203236.612227:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203236.612230:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203236.612234:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728158592:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203236.612241:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728158720:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203236.612263:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203236.612275:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203236/real 1788203236] req@ffff8bc144140380 x1875064728158720/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203261 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203236.612288:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140380 x1875064728158720/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203261 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203236.612296:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203236.612299:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203236.612302:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728158720:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203237.443953:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203237.507919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203238.467971:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203238.531865:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203239.491966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203239.555893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203240.516552:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203240.579893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203241.539975:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203241.603916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203241.731903:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203241.731911:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203241.731914:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203241.731922:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2523 00000100:00080000:3.0:1788203241.731930:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203241.731935:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203241.731967:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728158848/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203241.731987:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203241.731989:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203241.731991:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203241.731993:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2523 00000100:00080000:3.0:1788203241.731995:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203241.731997:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203241.732004:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203241.732011:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728158976/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203241.732034:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728158848:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203241.732117:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728158976:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203242.563947:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203242.627919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203243.587949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203243.651893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203244.611995:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203244.675949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:0.0:1788203244.804146:0:10040:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:0.0:1788203244.804203:0:10040:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:0.0:1788203244.804223:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:0.0:1788203244.804282:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788203244.804402:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203241/real 1788203244] req@ffff8bc1726cfb80 x1875064728158848/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203266 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203244.804438:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728158848/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203266 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203244.804461:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203244.804468:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203244.804473:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728158848:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203244.804482:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203241/real 1788203244] req@ffff8bc1726ced80 x1875064728158976/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203266 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203244.804499:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728158976/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203266 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203244.804509:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203244.804512:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203244.804515:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728158976:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203245.635924:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203245.699889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203246.659962:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203246.723944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788203246.851903:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788203246.851914:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788203246.851918:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203246.851928:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2528 00000100:00080000:1.0:1788203246.851938:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203246.851945:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788203246.851975:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4000 x1875064728159104/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788203246.852001:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788203246.852004:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788203246.852006:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203246.852009:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2528 00000100:00080000:1.0:1788203246.852012:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203246.852015:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788203246.852024:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788203246.852038:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5180 x1875064728159232/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203246.852079:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728159104:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203246.852170:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203246.852267:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203246/real 1788203246] req@ffff8bc1727d4000 x1875064728159104/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203271 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203246.852301:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4000 x1875064728159104/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203271 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203246.852317:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203246.852322:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203246.852328:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728159104:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203246.852350:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728159232:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203246.852378:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203246.852393:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203246/real 1788203246] req@ffff8bc1727d5180 x1875064728159232/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203271 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203246.852406:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5180 x1875064728159232/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203271 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203246.852416:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203246.852420:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203246.852424:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728159232:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203247.683985:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203247.747951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203248.707964:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203248.771962:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203249.731964:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203249.795891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203250.755976:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203250.819931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203251.779925:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203251.843894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203251.971915:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203251.971923:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203251.971926:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203251.971934:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2533 00000100:00080000:3.0:1788203251.971943:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203251.971950:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203251.971984:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728159360/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203251.972010:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203251.972013:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203251.972014:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203251.972019:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2533 00000100:00080000:3.0:1788203251.972021:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203251.972024:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203251.972032:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203251.972040:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728159488/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203251.972064:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728159360:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203251.972120:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203251.972165:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203251/real 1788203251] req@ffff8bc1726cea00 x1875064728159360/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203276 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203251.972177:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728159360/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203276 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203251.972184:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203251.972187:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203251.972189:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728159360:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203251.972194:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728159488:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203251.972207:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203251.972215:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203251/real 1788203251] req@ffff8bc1726ce300 x1875064728159488/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203276 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203251.972221:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728159488/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203276 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203251.972227:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203251.972228:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203251.972230:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728159488:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203252.803965:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203252.867910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203253.827944:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203253.891920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203254.851976:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203254.915895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203255.875917:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203255.939899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203256.899990:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203256.963901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203257.091869:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203257.091879:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203257.091883:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203257.091893:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2538 00000100:00080000:3.0:1788203257.091904:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203257.091911:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203257.091951:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728159616/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203257.091975:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203257.091977:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203257.091979:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203257.091981:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2538 00000100:00080000:3.0:1788203257.091984:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203257.091986:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203257.091996:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203257.092009:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728159744/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203257.092018:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728159616:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203257.092085:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203257.092141:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203257/real 1788203257] req@ffff8bc1726cc380 x1875064728159616/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203282 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203257.092156:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728159616/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203282 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203257.092164:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203257.092166:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203257.092169:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728159616:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203257.092192:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728159744:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203257.092208:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203257.092216:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203257/real 1788203257] req@ffff8bc1726ce680 x1875064728159744/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203282 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203257.092224:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728159744/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203282 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203257.092233:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203257.092235:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203257.092237:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728159744:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203257.923959:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203257.987913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203258.947958:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203259.011874:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203259.971987:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203260.035858:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203260.995960:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203261.059869:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203262.019973:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203262.083868:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203262.211897:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203262.211905:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203262.211908:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203262.211916:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2543 00000100:00080000:3.0:1788203262.211925:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203262.211930:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203262.211961:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728159872/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203262.211982:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203262.211985:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203262.211986:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203262.211989:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2543 00000100:00080000:3.0:1788203262.211990:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203262.211993:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203262.212000:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203262.212007:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728160000/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203262.212039:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728159872:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203262.212088:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203262.212133:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203262/real 1788203262] req@ffff8bc1726cce00 x1875064728159872/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203287 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203262.212146:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728159872/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203287 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203262.212155:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203262.212158:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203262.212161:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728159872:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203262.212167:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728160000:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203262.212184:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203262.212192:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203262/real 1788203262] req@ffff8bc1726cdc00 x1875064728160000/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203287 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203262.212199:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728160000/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203287 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203262.212204:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203262.212206:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203262.212208:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728160000:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203263.043940:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203263.107901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203264.067941:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203264.131847:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203265.091949:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203265.155921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203266.115919:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203266.179883:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203267.139905:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203267.203891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203267.331912:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203267.331921:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203267.331924:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203267.331935:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2548 00000100:00080000:0.0:1788203267.331946:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203267.331954:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203267.331991:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142300 x1875064728160128/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203267.332014:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203267.332017:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203267.332019:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203267.332022:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2548 00000100:00080000:0.0:1788203267.332025:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203267.332029:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203267.332037:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203267.332048:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141f80 x1875064728160256/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203267.332082:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728160128:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203267.332146:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203267.332202:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203267/real 1788203267] req@ffff8bc144142300 x1875064728160128/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203292 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203267.332222:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142300 x1875064728160128/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203292 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203267.332232:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203267.332236:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203267.332240:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728160128:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203267.332248:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728160256:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203267.332269:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203267.332282:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203267/real 1788203267] req@ffff8bc144141f80 x1875064728160256/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203292 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203267.332295:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141f80 x1875064728160256/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203292 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203267.332318:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203267.332322:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203267.332325:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728160256:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203268.163949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203268.227930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203269.187953:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203269.251919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203270.211941:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203270.275903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203271.235957:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203271.299856:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203272.259902:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203272.323864:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203272.451909:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203272.451922:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203272.451926:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203272.451937:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2553 00000100:00080000:2.0:1788203272.451948:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203272.451956:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203272.451996:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e680 x1875064728160384/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203272.452027:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203272.452032:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203272.452034:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203272.452040:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2553 00000100:00080000:2.0:1788203272.452046:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203272.452051:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203272.452058:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728160384:192.168.201.143@tcp:250:kworker.0 00000008:00100000:2.0:1788203272.452062:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203272.452080:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257df80 x1875064728160512/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788203272.452117:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203272.452156:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203272/real 1788203272] req@ffff8bc17257e680 x1875064728160384/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203297 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203272.452171:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e680 x1875064728160384/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203297 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203272.452178:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203272.452181:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203272.452184:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728160384:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203272.452202:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728160512:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203272.452237:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203272.452248:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203272/real 1788203272] req@ffff8bc17257df80 x1875064728160512/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203297 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203272.452257:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257df80 x1875064728160512/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203297 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203272.452267:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203272.452270:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203272.452272:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728160512:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203273.283972:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203273.347967:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203274.307912:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203274.371893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203275.331975:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203275.395899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203276.356010:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203276.419917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203277.379965:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203277.443890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203277.571875:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203277.571887:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203277.571891:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203277.571910:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2558 00000100:00080000:2.0:1788203277.571922:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203277.571928:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203277.571961:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c000 x1875064728160640/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203277.571984:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203277.571988:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203277.571990:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203277.571994:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2558 00000100:00080000:2.0:1788203277.571998:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203277.572003:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203277.572012:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203277.572026:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f480 x1875064728160768/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203277.572036:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728160640:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203277.572100:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203277.572177:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203277/real 1788203277] req@ffff8bc17257c000 x1875064728160640/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203302 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203277.572191:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c000 x1875064728160640/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203302 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203277.572199:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203277.572202:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203277.572204:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728160640:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203277.572224:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728160768:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203277.572242:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203277.572251:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203277/real 1788203277] req@ffff8bc17257f480 x1875064728160768/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203302 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203277.572259:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f480 x1875064728160768/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203302 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203277.572274:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203277.572276:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203277.572279:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728160768:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203278.403965:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203278.467916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203279.427945:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203279.491891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203280.451928:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203280.515917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203281.475989:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203281.539882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203282.499976:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203282.563917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203282.691904:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203282.691912:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203282.691916:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203282.691924:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2564 00000100:00080000:0.0:1788203282.691933:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203282.691938:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203282.691972:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143b80 x1875064728160896/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203282.691996:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203282.691998:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203282.692000:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203282.692002:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2564 00000100:00080000:0.0:1788203282.692005:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203282.692008:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203282.692018:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203282.692029:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728160896:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203282.692045:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141500 x1875064728161024/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788203282.692100:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203282.692140:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203282/real 1788203282] req@ffff8bc144143b80 x1875064728160896/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203307 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203282.692153:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143b80 x1875064728160896/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203307 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203282.692160:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203282.692163:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203282.692166:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728160896:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203282.692184:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728161024:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203282.692198:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203282.692206:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203282/real 1788203282] req@ffff8bc144141500 x1875064728161024/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203307 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203282.692213:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141500 x1875064728161024/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203307 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203282.692219:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203282.692221:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203282.692223:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728161024:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203283.523922:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203283.587931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203284.547986:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203284.611919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203285.571926:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203285.635897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203286.596012:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203286.659918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203287.619949:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203287.683919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203287.811910:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203287.811919:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203287.811931:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203287.811939:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2569 00000100:00080000:3.0:1788203287.811962:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203287.811968:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203287.812004:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728161152/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203287.812030:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203287.812033:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203287.812034:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203287.812037:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2569 00000100:00080000:3.0:1788203287.812039:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203287.812042:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203287.812049:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203287.812058:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728161280/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203287.812079:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728161152:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203287.812135:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203287.812175:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203287/real 1788203287] req@ffff8bc1726cdc00 x1875064728161152/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203312 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203287.812188:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728161152/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203312 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203287.812196:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203287.812199:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203287.812202:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728161152:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203287.812207:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728161280:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203287.812221:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203287.812229:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203287/real 1788203287] req@ffff8bc1726cce00 x1875064728161280/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203312 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203287.812237:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728161280/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203312 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203287.812242:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203287.812244:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203287.812247:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728161280:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203288.643974:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203288.707953:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203289.667976:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203289.731939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203290.691983:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203290.755889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203291.715924:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203291.779951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203292.739968:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203292.803894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203292.931941:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203292.931951:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203292.931956:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203292.931966:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2574 00000100:00080000:3.0:1788203292.931977:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203292.931984:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203292.932033:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728161408/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203292.932056:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203292.932059:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203292.932060:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203292.932063:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2574 00000100:00080000:3.0:1788203292.932066:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203292.932070:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203292.932078:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203292.932088:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728161536/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203292.932110:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728161408:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203292.932175:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203292.932221:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203292/real 1788203292] req@ffff8bc1726ce680 x1875064728161408/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203317 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203292.932235:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728161408/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203317 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203292.932244:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203292.932247:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203292.932250:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728161408:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203292.932256:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728161536:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203292.932272:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203292.932279:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203292/real 1788203292] req@ffff8bc1726cc380 x1875064728161536/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203317 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203292.932287:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728161536/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203317 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203292.932293:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203292.932295:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203292.932297:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728161536:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203293.763933:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203293.827924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203294.787993:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203294.851880:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203295.811995:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203295.875906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203296.836053:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203296.899906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203297.859969:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203297.923879:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203298.051889:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203298.051898:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203298.051902:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203298.051910:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2579 00000100:00080000:2.0:1788203298.051924:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203298.051932:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203298.051972:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f800 x1875064728161664/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203298.051999:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203298.052003:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203298.052005:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203298.052009:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2579 00000100:00080000:2.0:1788203298.052013:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203298.052017:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203298.052027:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203298.052044:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257dc00 x1875064728161792/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203298.052051:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728161664:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203298.052108:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203298.052145:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203298/real 1788203298] req@ffff8bc17257f800 x1875064728161664/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203298.052157:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f800 x1875064728161664/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203298.052165:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203298.052167:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203298.052170:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728161664:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203298.052189:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728161792:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203298.052203:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203298.052211:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203298/real 1788203298] req@ffff8bc17257dc00 x1875064728161792/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203298.052218:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257dc00 x1875064728161792/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203298.052223:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203298.052225:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203298.052227:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728161792:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203298.883944:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203298.947923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203299.907994:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203299.971907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203300.931946:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203300.995939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203301.955941:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203302.019904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203302.979969:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203303.043913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788203303.171896:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788203303.171906:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788203303.171911:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203303.171921:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2584 00000100:00080000:1.0:1788203303.171932:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203303.171940:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788203303.171978:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7480 x1875064728161920/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788203303.172003:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788203303.172007:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788203303.172009:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203303.172013:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2584 00000100:00080000:1.0:1788203303.172017:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203303.172022:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788203303.172031:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788203303.172045:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5880 x1875064728162048/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203303.172077:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728161920:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203303.172161:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203303.172213:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203303/real 1788203303] req@ffff8bc1727d7480 x1875064728161920/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203328 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203303.172233:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7480 x1875064728161920/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203328 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203303.172255:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203303.172260:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203303.172265:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728161920:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203303.172291:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728162048:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203303.172317:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203303.172332:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203303/real 1788203303] req@ffff8bc1727d5880 x1875064728162048/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203328 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203303.172347:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5880 x1875064728162048/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203328 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203303.172357:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203303.172361:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203303.172365:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728162048:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203304.003960:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203304.067945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203305.027916:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203305.091902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203306.051963:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203306.115935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203307.075970:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203307.139906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203308.099972:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203308.163902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203308.291946:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203308.291957:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203308.291961:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203308.291973:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2589 00000100:00080000:3.0:1788203308.291985:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203308.291993:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203308.292032:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728162176/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203308.292059:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203308.292063:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203308.292065:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203308.292069:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2589 00000100:00080000:3.0:1788203308.292073:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203308.292078:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203308.292088:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203308.292104:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728162176:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788203308.292104:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728162304/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203308.292227:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728162304:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203309.123959:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203309.187932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203310.148030:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203310.211937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203311.171923:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203311.235899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:3.0:1788203311.364051:0:10041:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:3.0:1788203311.364114:0:10041:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:3.0:1788203311.364138:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:3.0:1788203311.364198:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:0.0:1788203311.364261:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203308/real 1788203311] req@ffff8bc1726cea00 x1875064728162304/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203333 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203311.364301:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728162304/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203333 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203311.364315:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203311.364321:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203311.364325:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728162304:192.168.201.143@tcp:38:kworker.0 00000100:00100000:0.0:1788203311.364335:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203308/real 1788203311] req@ffff8bc1726ce300 x1875064728162176/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203333 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203311.364348:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728162176/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203333 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203311.364357:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203311.364361:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203311.364365:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728162176:192.168.201.143@tcp:250:kworker.0 00010000:00010000:2.0:1788203312.195969:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203312.259908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203313.219978:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203313.283875:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203313.411909:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203313.411918:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203313.411921:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203313.411931:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2594 00000100:00080000:3.0:1788203313.411940:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203313.411946:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203313.411977:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728162432/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203313.412003:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203313.412007:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203313.412014:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203313.412020:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2594 00000100:00080000:3.0:1788203313.412023:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203313.412029:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203313.412039:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203313.412054:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728162432:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788203313.412056:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728162560/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788203313.412127:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203313.412178:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203313/real 1788203313] req@ffff8bc1726ced80 x1875064728162432/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203338 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203313.412194:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728162432/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203338 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203313.412203:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203313.412206:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203313.412209:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728162432:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203313.412242:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728162560:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203313.412265:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203313.412280:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203313/real 1788203313] req@ffff8bc1726cfb80 x1875064728162560/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203338 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203313.412295:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728162560/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203338 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203313.412304:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203313.412308:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203313.412311:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728162560:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203314.243993:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203314.307914:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203315.268036:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203315.331936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203316.292055:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203316.355881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203317.315949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203317.379950:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203318.339946:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203318.403914:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203318.531896:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203318.531905:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203318.531909:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203318.531917:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2599 00000100:00080000:3.0:1788203318.531926:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203318.531932:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203318.531962:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728162688/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203318.531989:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203318.531993:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203318.531995:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203318.531999:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2599 00000100:00080000:3.0:1788203318.532003:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203318.532008:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203318.532018:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203318.532033:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728162688:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788203318.532035:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728162816/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788203318.532095:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203318.532142:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203318/real 1788203318] req@ffff8bc1726cca80 x1875064728162688/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203343 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203318.532159:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728162688/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203343 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203318.532167:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203318.532171:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203318.532174:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728162688:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203318.532194:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728162816:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203318.532210:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203318.532218:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203318/real 1788203318] req@ffff8bc1726cd500 x1875064728162816/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203343 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203318.532227:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728162816/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203343 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203318.532233:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203318.532235:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203318.532237:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728162816:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203319.363982:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203319.427902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203320.387995:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203320.451914:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203321.411981:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203321.475892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203322.436019:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203322.499960:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203323.459942:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203323.523915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203323.651940:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203323.651952:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203323.651956:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203323.651968:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2605 00000100:00080000:3.0:1788203323.651980:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203323.651987:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203323.652033:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728162944/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203323.652060:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203323.652064:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203323.652066:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203323.652069:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2605 00000100:00080000:3.0:1788203323.652071:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203323.652074:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203323.652089:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203323.652101:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728163072/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203323.652127:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728162944:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203323.652221:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203323.652294:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203323/real 1788203323] req@ffff8bc1726cf480 x1875064728162944/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203348 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203323.652313:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728162944/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203348 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203323.652323:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203323.652352:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203323.652357:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728162944:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203323.652366:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728163072:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203323.652394:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203323.652407:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203323/real 1788203323] req@ffff8bc1726cf100 x1875064728163072/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203348 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203323.652420:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728163072/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203348 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203323.652429:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203323.652433:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203323.652437:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728163072:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203324.484023:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203324.547955:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203325.508032:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203325.571881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203326.531947:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203326.595887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203327.556062:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203327.619869:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203328.579962:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203328.643906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203328.771963:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203328.771974:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203328.771978:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203328.771990:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2610 00000100:00080000:0.0:1788203328.772002:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203328.772009:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203328.772055:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143480 x1875064728163200/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203328.772095:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203328.772099:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203328.772100:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203328.772103:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2610 00000100:00080000:0.0:1788203328.772106:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203328.772108:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203328.772118:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203328.772128:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141880 x1875064728163328/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203328.772202:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728163200:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203328.772302:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203328.772347:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203328/real 1788203328] req@ffff8bc144143480 x1875064728163200/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203353 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203328.772366:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143480 x1875064728163200/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203353 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203328.772375:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203328.772378:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203328.772381:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728163200:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203328.772387:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728163328:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203328.772403:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203328.772412:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203328/real 1788203328] req@ffff8bc144141880 x1875064728163328/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203353 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203328.772422:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141880 x1875064728163328/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203353 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203328.772431:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203328.772435:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203328.772438:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728163328:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203329.604003:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203329.667918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203330.627963:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203330.691844:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203331.652048:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203331.715904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203332.676015:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203332.739923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203333.700047:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203333.763845:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203333.891915:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203333.891927:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203333.891932:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203333.891946:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2615 00000100:00080000:3.0:1788203333.891960:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203333.891969:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203333.892012:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728163456/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203333.892042:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203333.892045:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203333.892047:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203333.892050:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2615 00000100:00080000:3.0:1788203333.892052:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203333.892055:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203333.892064:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203333.892073:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728163584/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203333.892101:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728163456:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203333.892213:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203333.892274:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203333/real 1788203333] req@ffff8bc1726cc700 x1875064728163456/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203358 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203333.892295:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728163456/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203358 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203333.892307:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203333.892312:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203333.892317:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728163456:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203333.892326:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728163584:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203333.892353:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203333.892369:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203333/real 1788203333] req@ffff8bc1726cd180 x1875064728163584/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203358 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203333.892383:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728163584/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203358 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203333.892393:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203333.892395:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203333.892398:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728163584:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203334.723974:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203334.787978:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203335.748023:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203335.811931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203336.771981:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203336.835915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203337.796015:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203337.859932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203338.820004:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203338.883926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203339.011979:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203339.011989:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203339.011995:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203339.012010:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2620 00000100:00080000:0.0:1788203339.012026:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203339.012037:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203339.012106:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142a00 x1875064728163712/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203339.012133:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203339.012137:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203339.012139:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203339.012142:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2620 00000100:00080000:0.0:1788203339.012145:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203339.012148:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203339.012158:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203339.012168:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140e00 x1875064728163840/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203339.012199:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728163712:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203339.012272:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203339.012350:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203339/real 1788203339] req@ffff8bc144142a00 x1875064728163712/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203339.012368:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142a00 x1875064728163712/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203339.012378:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203339.012382:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203339.012386:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728163712:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203339.012391:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728163840:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203339.012408:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203339.012417:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203339/real 1788203339] req@ffff8bc144140e00 x1875064728163840/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203339.012425:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140e00 x1875064728163840/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203339.012431:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203339.012433:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203339.012435:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728163840:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203339.844001:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203339.907935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203340.867935:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203340.931869:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203341.892086:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203341.955903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203342.915952:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203342.979942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203343.940006:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203344.003930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203344.131997:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203344.132008:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203344.132012:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203344.132025:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2625 00000100:00080000:3.0:1788203344.132038:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203344.132047:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203344.132101:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728163968/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203344.132127:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203344.132132:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203344.132134:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203344.132138:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2625 00000100:00080000:3.0:1788203344.132142:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203344.132148:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203344.132159:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203344.132174:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728164096/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203344.132185:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728163968:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203344.132270:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203344.132339:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203344/real 1788203344] req@ffff8bc1726cf800 x1875064728163968/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203369 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203344.132362:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728163968/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203369 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203344.132371:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203344.132374:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203344.132379:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728163968:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203344.132407:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728164096:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203344.132427:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203344.132437:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203344/real 1788203344] req@ffff8bc1726cdf80 x1875064728164096/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203369 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203344.132445:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728164096/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203369 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203344.132451:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203344.132454:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203344.132456:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728164096:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203344.964049:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203345.028000:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203345.988019:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203346.051986:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203347.012053:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203347.075960:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203348.035955:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203348.099969:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203349.060056:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203349.123986:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203349.251990:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203349.252000:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203349.252005:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203349.252017:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2630 00000100:00080000:0.0:1788203349.252030:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203349.252037:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203349.252097:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140700 x1875064728164224/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203349.252134:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203349.252137:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203349.252139:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203349.252143:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2630 00000100:00080000:0.0:1788203349.252146:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203349.252149:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203349.252161:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203349.252174:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141c00 x1875064728164352/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203349.252191:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728164224:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203349.252264:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203349.252323:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203349/real 1788203349] req@ffff8bc144140700 x1875064728164224/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203374 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203349.252340:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140700 x1875064728164224/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203374 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203349.252349:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203349.252352:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203349.252356:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728164224:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203349.252379:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728164352:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203349.252395:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203349.252404:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203349/real 1788203349] req@ffff8bc144141c00 x1875064728164352/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203374 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203349.252412:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141c00 x1875064728164352/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203374 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203349.252419:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203349.252421:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203349.252423:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728164352:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203350.084029:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203350.148020:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203351.108082:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203351.171971:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203352.132023:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203352.195986:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203353.155980:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203353.219935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203354.180020:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203354.243930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203354.371935:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203354.371948:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203354.371954:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203354.371969:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2635 00000100:00080000:0.0:1788203354.371985:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203354.371994:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203354.372059:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141c00 x1875064728164480/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203354.372099:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203354.372104:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203354.372106:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203354.372111:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2635 00000100:00080000:0.0:1788203354.372115:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203354.372121:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203354.372135:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203354.372153:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140700 x1875064728164608/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203354.372166:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728164480:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203354.372241:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203354.372313:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203354/real 1788203354] req@ffff8bc144141c00 x1875064728164480/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203379 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203354.372334:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141c00 x1875064728164480/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203379 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203354.372344:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203354.372347:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203354.372350:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728164480:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203354.372385:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728164608:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203354.372403:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203354.372414:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203354/real 1788203354] req@ffff8bc144140700 x1875064728164608/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203379 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203354.372423:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140700 x1875064728164608/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203379 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203354.372429:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203354.372432:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203354.372434:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728164608:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203355.204012:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203355.267977:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203356.228028:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203356.291934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203357.252043:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203357.315951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203358.276010:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203358.339880:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203359.300027:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203359.363930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203359.491947:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203359.491962:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203359.491967:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203359.491981:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2640 00000100:00080000:3.0:1788203359.491997:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203359.492006:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203359.492061:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728164736/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203359.492094:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203359.492099:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203359.492102:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203359.492106:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2640 00000100:00080000:3.0:1788203359.492110:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203359.492118:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203359.492130:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203359.492140:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728164736:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788203359.492156:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728164864/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788203359.492221:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203359.492282:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203359/real 1788203359] req@ffff8bc1726cdf80 x1875064728164736/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203384 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203359.492300:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728164736/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203384 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203359.492310:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203359.492314:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203359.492318:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728164736:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203359.492350:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728164864:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203359.492372:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203359.492383:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203359/real 1788203359] req@ffff8bc1726cf800 x1875064728164864/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203384 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203359.492397:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728164864/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203384 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203359.492403:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203359.492405:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203359.492408:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728164864:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203360.323920:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203360.387937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203361.347997:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203361.411912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203362.371989:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203362.435956:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203363.396054:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203363.459939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203364.420050:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203364.483951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203364.611939:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203364.611949:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203364.611955:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203364.611965:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2645 00000100:00080000:0.0:1788203364.611977:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203364.611985:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203364.612030:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140e00 x1875064728164992/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203364.612056:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203364.612059:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203364.612061:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203364.612065:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2645 00000100:00080000:0.0:1788203364.612067:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203364.612070:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203364.612082:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203364.612093:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142a00 x1875064728165120/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203364.612113:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728164992:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203364.612193:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203364.612267:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203364/real 1788203364] req@ffff8bc144140e00 x1875064728164992/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203389 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203364.612290:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140e00 x1875064728164992/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203389 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203364.612303:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203364.612308:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203364.612313:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728164992:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203364.612348:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728165120:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203364.612377:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203364.612392:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203364/real 1788203364] req@ffff8bc144142a00 x1875064728165120/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203389 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203364.612401:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142a00 x1875064728165120/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203389 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203364.612407:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203364.612410:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203364.612412:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728165120:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203365.444013:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203365.508058:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203366.468011:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203366.531921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203367.492029:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203367.555979:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203368.515984:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203368.579904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203369.540017:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203369.603954:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203369.731941:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203369.731951:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203369.731956:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203369.731968:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2651 00000100:00080000:3.0:1788203369.731980:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203369.731987:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203369.732039:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728165248/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203369.732061:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203369.732064:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203369.732066:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203369.732069:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2651 00000100:00080000:3.0:1788203369.732071:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203369.732074:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203369.732083:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203369.732093:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728165376/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203369.732126:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728165248:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203369.732202:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203369.732253:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203369/real 1788203369] req@ffff8bc1726cd180 x1875064728165248/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203394 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203369.732269:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728165248/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203394 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203369.732278:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203369.732281:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203369.732285:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728165248:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203369.732291:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728165376:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203369.732306:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203369.732315:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203369/real 1788203369] req@ffff8bc1726cc700 x1875064728165376/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203394 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203369.732323:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728165376/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203394 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203369.732329:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203369.732331:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203369.732333:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728165376:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203370.563955:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203370.627914:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203371.587979:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203371.651935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203372.612009:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203372.675956:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203373.636002:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203373.699988:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203374.660035:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203374.723945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203374.851938:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203374.851950:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203374.851956:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203374.851969:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2656 00000100:00080000:3.0:1788203374.851983:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203374.851992:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203374.852045:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728165504/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203374.852082:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203374.852087:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203374.852089:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203374.852093:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2656 00000100:00080000:3.0:1788203374.852097:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203374.852101:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203374.852113:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203374.852126:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728165632/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203374.852178:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728165504:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203374.852314:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728165632:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203375.683982:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203375.747996:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203376.707967:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203376.771950:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203377.732001:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203377.795959:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788203377.924107:0:10042:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788203377.924156:0:10042:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788203377.924172:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788203377.924215:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788203377.924276:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203374/real 1788203377] req@ffff8bc1726cf100 x1875064728165504/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203399 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203377.924305:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728165504/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203399 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203377.924316:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203377.924322:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203377.924326:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728165504:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203377.924335:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203374/real 1788203377] req@ffff8bc1726cf480 x1875064728165632/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203399 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203377.924355:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728165632/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203399 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203377.924375:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203377.924378:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203377.924392:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728165632:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203378.756045:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203378.819962:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203379.780045:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203379.843952:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203379.971964:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203379.971983:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203379.971993:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203379.972008:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2661 00000100:00080000:0.0:1788203379.972022:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203379.972032:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203379.972089:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141880 x1875064728165760/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203379.972128:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203379.972136:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203379.972138:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203379.972143:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2661 00000100:00080000:0.0:1788203379.972148:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203379.972153:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203379.972167:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203379.972185:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143480 x1875064728165888/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203379.972200:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728165760:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203379.972329:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203379.972436:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203379/real 1788203379] req@ffff8bc144141880 x1875064728165760/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203404 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203379.972468:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141880 x1875064728165760/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203404 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203379.972486:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203379.972495:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203379.972501:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728165760:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203379.972554:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728165888:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203379.972590:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203379.972607:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203379/real 1788203379] req@ffff8bc144143480 x1875064728165888/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203404 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203379.972623:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143480 x1875064728165888/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203404 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203379.972641:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203379.972645:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203379.972649:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728165888:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203380.803964:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203380.867982:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203381.828053:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203381.891968:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203382.852035:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203382.915928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203383.876049:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203383.939953:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203384.899949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203384.963926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203385.091892:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203385.091902:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203385.091906:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203385.091915:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2666 00000100:00080000:3.0:1788203385.091924:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203385.091930:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203385.091966:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728166016/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203385.091992:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203385.091995:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203385.091996:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203385.092003:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2666 00000100:00080000:3.0:1788203385.092006:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203385.092008:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203385.092016:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203385.092025:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728166144/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203385.092053:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728166016:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203385.092116:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203385.092159:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203385/real 1788203385] req@ffff8bc1726cd500 x1875064728166016/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203385.092180:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728166016/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203385.092192:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203385.092196:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203385.092200:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728166016:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203385.092207:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728166144:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203385.092231:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203385.092245:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203385/real 1788203385] req@ffff8bc1726cca80 x1875064728166144/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203385.092275:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728166144/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203385.092281:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203385.092289:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203385.092291:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728166144:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203385.924012:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203385.987963:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203386.947977:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203387.011956:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203387.972012:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203388.035886:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203388.995979:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203389.059912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203390.020042:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203390.083906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203390.211937:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203390.211951:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203390.211955:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203390.211967:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2671 00000100:00080000:3.0:1788203390.211979:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203390.211987:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203390.212030:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728166272/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203390.212058:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203390.212061:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203390.212063:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203390.212066:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2671 00000100:00080000:3.0:1788203390.212068:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203390.212071:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203390.212079:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203390.212090:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728166400/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203390.212145:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728166272:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203390.212235:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203390.212286:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203390/real 1788203390] req@ffff8bc1726cfb80 x1875064728166272/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203415 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203390.212307:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728166272/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203415 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203390.212316:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203390.212319:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203390.212322:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728166272:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203390.212328:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728166400:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203390.212348:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203390.212361:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203390/real 1788203390] req@ffff8bc1726ced80 x1875064728166400/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203415 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203390.212374:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728166400/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203415 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203390.212384:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203390.212396:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203390.212401:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728166400:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203391.043999:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203391.107966:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203392.068057:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203392.131885:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203393.092006:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203393.155866:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203394.116013:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203394.179891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203395.139994:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203395.203860:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203395.331973:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203395.331988:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203395.331994:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203395.332006:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2676 00000100:00080000:0.0:1788203395.332019:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203395.332026:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203395.332071:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141500 x1875064728166528/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203395.332130:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203395.332134:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203395.332136:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203395.332139:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2676 00000100:00080000:0.0:1788203395.332142:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203395.332146:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203395.332157:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203395.332169:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143b80 x1875064728166656/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203395.332198:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728166528:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203395.332280:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203395.332344:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203395/real 1788203395] req@ffff8bc144141500 x1875064728166528/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203420 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203395.332369:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141500 x1875064728166528/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203420 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203395.332381:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203395.332386:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203395.332391:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728166528:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203395.332400:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728166656:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203395.332426:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203395.332441:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203395/real 1788203395] req@ffff8bc144143b80 x1875064728166656/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203420 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203395.332454:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143b80 x1875064728166656/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203420 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203395.332464:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203395.332469:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203395.332473:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728166656:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203396.164022:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203396.227947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203397.187964:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203397.251851:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203398.211999:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203398.275942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203399.235979:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203399.299934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203400.259984:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203400.323957:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203400.451901:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203400.451913:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203400.451917:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203400.451929:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2681 00000100:00080000:3.0:1788203400.451941:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203400.451950:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203400.452011:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728166784/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203400.452037:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203400.452041:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203400.452042:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203400.452046:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2681 00000100:00080000:3.0:1788203400.452049:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203400.452052:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203400.452063:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203400.452075:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728166912/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203400.452103:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728166784:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203400.452190:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203400.452252:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203400/real 1788203400] req@ffff8bc1726ce300 x1875064728166784/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203425 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203400.452270:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728166784/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203425 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203400.452284:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203400.452287:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203400.452291:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728166784:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203400.452296:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728166912:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203400.452315:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203400.452334:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203400/real 1788203400] req@ffff8bc1726cea00 x1875064728166912/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203425 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203400.452343:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728166912/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203425 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203400.452349:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203400.452351:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203400.452353:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728166912:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203401.284059:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203401.347938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203402.307931:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203402.371901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203403.332032:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203403.395910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203404.355950:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203404.419949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203405.379993:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203405.443878:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203405.571954:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203405.571969:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203405.571975:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203405.571996:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2686 00000100:00080000:2.0:1788203405.572014:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203405.572024:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203405.572080:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257dc00 x1875064728167040/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203405.572116:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203405.572120:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203405.572123:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203405.572127:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2686 00000100:00080000:2.0:1788203405.572130:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203405.572135:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203405.572147:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203405.572161:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f800 x1875064728167168/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203405.572178:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728167040:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203405.572259:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203405.572328:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203405/real 1788203405] req@ffff8bc17257dc00 x1875064728167040/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203430 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203405.572349:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257dc00 x1875064728167040/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203430 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203405.572362:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203405.572367:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203405.572372:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728167040:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203405.572399:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728167168:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203405.572426:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203405.572441:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203405/real 1788203405] req@ffff8bc17257f800 x1875064728167168/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203430 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203405.572456:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f800 x1875064728167168/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203430 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203405.572465:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203405.572470:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203405.572473:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728167168:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203406.403940:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203406.468060:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203407.428032:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203407.491909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203408.452029:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203408.516002:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203409.476044:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203409.539973:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203410.500025:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203410.563926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203410.691983:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203410.691994:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203410.691999:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203410.692012:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2692 00000100:00080000:2.0:1788203410.692028:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203410.692038:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203410.692094:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f480 x1875064728167296/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203410.692127:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203410.692131:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203410.692132:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203410.692135:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2692 00000100:00080000:2.0:1788203410.692138:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203410.692142:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203410.692151:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203410.692163:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c000 x1875064728167424/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203410.692188:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728167296:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203410.692258:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203410.692318:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203410/real 1788203410] req@ffff8bc17257f480 x1875064728167296/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203435 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203410.692341:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f480 x1875064728167296/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203435 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203410.692353:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203410.692359:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203410.692364:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728167296:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203410.692372:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728167424:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203410.692395:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203410.692405:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203410/real 1788203410] req@ffff8bc17257c000 x1875064728167424/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203435 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203410.692414:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c000 x1875064728167424/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203435 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203410.692421:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203410.692424:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203410.692427:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728167424:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203411.523986:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203411.587987:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203412.547973:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203412.611919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203413.571967:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203413.635908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203414.595930:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203414.659903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203415.620029:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203415.683928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203415.811961:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203415.811973:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203415.811978:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203415.811989:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2697 00000100:00080000:3.0:1788203415.812000:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203415.812007:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203415.812043:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728167552/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203415.812075:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203415.812078:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203415.812079:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203415.812082:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2697 00000100:00080000:3.0:1788203415.812085:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203415.812087:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203415.812095:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203415.812105:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728167680/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203415.812142:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728167552:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203415.812228:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203415.812295:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203415/real 1788203415] req@ffff8bc1726cc380 x1875064728167552/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203440 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203415.812319:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728167552/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203440 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203415.812328:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203415.812332:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203415.812335:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728167552:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203415.812342:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728167680:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203415.812370:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203415.812385:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203415/real 1788203415] req@ffff8bc1726ce680 x1875064728167680/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203440 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203415.812400:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728167680/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203440 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203415.812410:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203415.812413:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203415.812415:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728167680:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203416.643987:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203416.708002:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203417.668001:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203417.731976:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203418.692056:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203418.755978:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203419.715995:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203419.779938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203420.740039:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203420.803937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203420.931932:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203420.931947:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203420.931953:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203420.931968:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2702 00000100:00080000:2.0:1788203420.931983:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203420.931993:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203420.932049:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257df80 x1875064728167808/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203420.932091:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203420.932095:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203420.932097:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203420.932102:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2702 00000100:00080000:2.0:1788203420.932106:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203420.932112:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203420.932125:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203420.932141:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e680 x1875064728167936/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203420.932148:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728167808:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203420.932219:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203420.932285:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203420/real 1788203420] req@ffff8bc17257df80 x1875064728167808/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203445 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203420.932307:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257df80 x1875064728167808/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203445 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203420.932325:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203420.932329:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203420.932335:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728167808:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203420.932363:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728167936:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203420.932388:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203420.932401:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203420/real 1788203420] req@ffff8bc17257e680 x1875064728167936/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203445 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203420.932414:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e680 x1875064728167936/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203445 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203420.932423:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203420.932427:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203420.932430:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728167936:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203421.763968:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203421.827956:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203422.788003:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203422.851930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203423.812001:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203423.876038:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203424.836075:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203424.899882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203425.859992:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203425.923938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203426.051892:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203426.051906:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203426.051913:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203426.051927:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2707 00000100:00080000:2.0:1788203426.051942:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203426.051953:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203426.052008:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ed80 x1875064728168064/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203426.052042:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203426.052047:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203426.052050:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203426.052054:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2707 00000100:00080000:2.0:1788203426.052058:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203426.052064:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203426.052077:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203426.052093:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d880 x1875064728168192/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203426.052135:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728168064:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203426.052237:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203426.052325:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203426/real 1788203426] req@ffff8bc17257ed80 x1875064728168064/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203426.052354:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ed80 x1875064728168064/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203426.052370:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203426.052377:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203426.052384:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728168064:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203426.052423:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728168192:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203426.052460:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203426.052481:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203426/real 1788203426] req@ffff8bc17257d880 x1875064728168192/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203426.052499:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d880 x1875064728168192/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203426.052508:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203426.052512:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203426.052515:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728168192:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203426.884045:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203426.948007:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203427.907996:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203427.971959:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203428.931978:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203428.995897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203429.955963:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203430.019898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203430.980012:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203431.043916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203431.171910:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203431.171921:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203431.171926:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203431.171938:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2712 00000100:00080000:3.0:1788203431.171950:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203431.171958:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203431.172002:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728168320/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203431.172030:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203431.172035:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203431.172037:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203431.172041:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2712 00000100:00080000:3.0:1788203431.172053:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203431.172059:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203431.172072:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203431.172090:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728168320:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788203431.172091:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728168448/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788203431.172168:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203431.172224:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203431/real 1788203431] req@ffff8bc1726cce00 x1875064728168320/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203456 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203431.172241:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728168320/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203456 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203431.172251:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203431.172254:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203431.172257:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728168320:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203431.172281:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728168448:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203431.172298:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203431.172306:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203431/real 1788203431] req@ffff8bc1726cdc00 x1875064728168448/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203456 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203431.172316:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728168448/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203456 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203431.172322:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203431.172324:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203431.172327:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728168448:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203432.003966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203432.067921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203433.027985:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203433.091915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203434.051972:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203434.115849:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203435.076007:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203435.139936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203436.099968:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203436.163898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203436.291949:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203436.291960:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203436.291966:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203436.291978:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2717 00000100:00080000:2.0:1788203436.291990:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203436.291998:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203436.292046:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ce00 x1875064728168576/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203436.292073:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203436.292077:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203436.292078:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203436.292081:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2717 00000100:00080000:2.0:1788203436.292084:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203436.292086:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203436.292097:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203436.292107:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ea00 x1875064728168704/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203436.292123:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728168576:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203436.292211:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203436.292271:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203436/real 1788203436] req@ffff8bc17257ce00 x1875064728168576/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203461 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203436.292289:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ce00 x1875064728168576/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203461 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203436.292298:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203436.292302:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203436.292305:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728168576:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203436.292330:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728168704:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203436.292350:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203436.292359:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203436/real 1788203436] req@ffff8bc17257ea00 x1875064728168704/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203461 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203436.292383:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ea00 x1875064728168704/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203461 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203436.292396:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203436.292399:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203436.292401:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728168704:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203437.123989:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203437.187988:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203438.148013:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203438.211949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203439.171969:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203439.235964:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203440.196006:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203440.259909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203441.219952:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203441.283967:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203441.411907:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203441.411925:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203441.411930:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203441.411944:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2722 00000100:00080000:2.0:1788203441.411960:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203441.411969:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203441.412022:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ca80 x1875064728168832/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203441.412061:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203441.412066:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203441.412068:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203441.412073:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2722 00000100:00080000:2.0:1788203441.412077:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203441.412082:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203441.412094:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203441.412114:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257fb80 x1875064728168960/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203441.412159:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728168832:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203441.412268:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728168960:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203442.244019:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203442.307953:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203443.267991:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203443.331924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203444.292005:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203444.355850:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788203444.484149:0:10043:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788203444.484212:0:10043:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788203444.484272:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788203444.484331:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:0.0:1788203444.484405:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203441/real 1788203444] req@ffff8bc17257ca80 x1875064728168832/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203466 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203444.484452:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ca80 x1875064728168832/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203466 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203444.484471:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203444.484479:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203444.484485:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728168832:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203444.484499:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203441/real 1788203444] req@ffff8bc17257fb80 x1875064728168960/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203466 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203444.484514:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257fb80 x1875064728168960/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203466 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203444.484524:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203444.484530:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203444.484534:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728168960:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203445.315959:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203445.379891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203446.339953:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203446.403850:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203446.531869:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203446.531878:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203446.531881:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203446.531892:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2727 00000100:00080000:2.0:1788203446.531904:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203446.531912:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203446.531952:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c380 x1875064728169088/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203446.531981:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203446.531985:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203446.531986:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203446.531991:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2727 00000100:00080000:2.0:1788203446.531995:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203446.532000:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203446.532010:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203446.532020:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728169088:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203446.532026:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e300 x1875064728169216/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788203446.532090:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203446.532135:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203446/real 1788203446] req@ffff8bc17257c380 x1875064728169088/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203471 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203446.532155:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c380 x1875064728169088/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203471 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203446.532166:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203446.532177:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203446.532182:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728169088:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203446.532225:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728169216:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203446.532250:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203446.532263:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203446/real 1788203446] req@ffff8bc17257e300 x1875064728169216/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203471 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203446.532276:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e300 x1875064728169216/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203471 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203446.532298:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203446.532302:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203446.532306:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728169216:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203447.363973:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203447.427973:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203448.387931:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203448.451895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203449.412080:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203449.475919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203450.436021:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203450.499946:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203451.460017:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203451.523890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203451.651933:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203451.651949:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203451.651952:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203451.651961:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2733 00000100:00080000:0.0:1788203451.651973:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203451.651979:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203451.652022:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141f80 x1875064728169344/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203451.652054:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203451.652058:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203451.652060:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203451.652065:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2733 00000100:00080000:0.0:1788203451.652068:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203451.652073:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203451.652084:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203451.652096:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728169344:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203451.652097:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142300 x1875064728169472/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788203451.652184:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203451.652228:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203451/real 1788203451] req@ffff8bc144141f80 x1875064728169344/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203476 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203451.652242:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141f80 x1875064728169344/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203476 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203451.652254:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203451.652257:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203451.652260:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728169344:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203451.652283:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728169472:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203451.652300:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203451.652309:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203451/real 1788203451] req@ffff8bc144142300 x1875064728169472/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203476 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203451.652317:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142300 x1875064728169472/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203476 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203451.652323:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203451.652325:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203451.652328:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728169472:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203452.484031:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203452.547943:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203453.507970:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203453.571868:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203454.531944:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203454.595900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203455.556016:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203455.619939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203456.580011:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203456.643937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203456.771964:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203456.771979:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203456.771985:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203456.771999:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2738 00000100:00080000:2.0:1788203456.772044:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203456.772055:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203456.772110:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d500 x1875064728169600/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203456.772148:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203456.772153:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203456.772155:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203456.772168:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2738 00000100:00080000:2.0:1788203456.772173:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203456.772178:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203456.772188:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728169600:192.168.201.143@tcp:250:kworker.0 00000008:00100000:2.0:1788203456.772191:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203456.772209:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f100 x1875064728169728/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788203456.772270:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203456.772324:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203456/real 1788203456] req@ffff8bc17257d500 x1875064728169600/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203481 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203456.772340:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d500 x1875064728169600/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203481 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203456.772356:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203456.772360:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203456.772363:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728169600:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203456.772390:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728169728:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203456.772410:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203456.772419:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203456/real 1788203456] req@ffff8bc17257f100 x1875064728169728/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203481 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203456.772428:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f100 x1875064728169728/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203481 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203456.772434:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203456.772435:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203456.772437:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728169728:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203457.604044:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203457.667923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203458.627936:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203458.691863:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203459.652026:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203459.715880:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203460.675980:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203460.739868:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203461.700027:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203461.763914:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788203461.891993:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788203461.892004:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788203461.892009:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203461.892021:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2743 00000100:00080000:1.0:1788203461.892033:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203461.892040:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788203461.892094:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5880 x1875064728169856/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788203461.892128:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788203461.892132:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788203461.892134:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203461.892138:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2743 00000100:00080000:1.0:1788203461.892142:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203461.892147:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788203461.892159:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203461.892179:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728169856:192.168.201.143@tcp:250:kworker.0 00000100:00100000:1.0:1788203461.892179:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7480 x1875064728169984/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788203461.892250:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203461.892306:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203461/real 1788203461] req@ffff8bc1727d5880 x1875064728169856/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203486 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203461.892323:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5880 x1875064728169856/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203486 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203461.892334:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203461.892340:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203461.892345:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728169856:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203461.892378:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728169984:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203461.892400:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203461.892410:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203461/real 1788203461] req@ffff8bc1727d7480 x1875064728169984/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203486 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203461.892419:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7480 x1875064728169984/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203486 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203461.892425:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203461.892427:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203461.892430:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728169984:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203462.724047:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203462.787934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203463.748016:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203463.811854:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203464.772034:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203464.835982:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203465.796032:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203465.859933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203466.820004:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203466.883897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203467.011932:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203467.011944:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203467.011950:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203467.011964:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2748 00000100:00080000:2.0:1788203467.011978:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203467.011988:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203467.012041:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c700 x1875064728170112/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203467.012075:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203467.012079:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203467.012081:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203467.012084:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2748 00000100:00080000:2.0:1788203467.012088:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203467.012093:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203467.012106:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203467.012118:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d180 x1875064728170240/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203467.012152:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728170112:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203467.012232:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203467.012286:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203467/real 1788203467] req@ffff8bc17257c700 x1875064728170112/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203467.012304:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c700 x1875064728170112/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203467.012315:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203467.012319:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203467.012324:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728170112:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203467.012333:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728170240:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203467.012357:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203467.012369:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203467/real 1788203467] req@ffff8bc17257d180 x1875064728170240/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203467.012388:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d180 x1875064728170240/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203467.012396:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203467.012400:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203467.012404:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728170240:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203467.843974:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203467.907945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203468.867925:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203468.931905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203469.891986:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203469.955901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203470.915944:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203470.979876:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203471.940047:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203472.003958:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203472.131944:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203472.131953:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203472.131957:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203472.131968:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2753 00000100:00080000:2.0:1788203472.131979:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203472.131985:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203472.132023:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d180 x1875064728170368/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203472.132049:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203472.132052:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203472.132059:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203472.132062:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2753 00000100:00080000:2.0:1788203472.132064:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203472.132067:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203472.132078:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203472.132094:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c700 x1875064728170496/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203472.132111:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728170368:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203472.132193:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203472.132254:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203472/real 1788203472] req@ffff8bc17257d180 x1875064728170368/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203497 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203472.132272:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d180 x1875064728170368/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203497 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203472.132286:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203472.132292:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203472.132297:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728170368:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203472.132332:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728170496:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203472.132361:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203472.132376:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203472/real 1788203472] req@ffff8bc17257c700 x1875064728170496/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203497 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203472.132392:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c700 x1875064728170496/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203497 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203472.132410:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203472.132415:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203472.132419:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728170496:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203472.963926:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203473.027954:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203473.987998:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203474.051956:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203475.012008:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203475.075954:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203476.035964:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203476.099944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203477.060019:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203477.123951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203477.252186:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203477.252204:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203477.252216:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203477.252228:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2758 00000100:00080000:0.0:1788203477.252249:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203477.252255:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203477.252300:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140380 x1875064728170624/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203477.252334:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203477.252338:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203477.252340:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203477.252343:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2758 00000100:00080000:0.0:1788203477.252345:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203477.252348:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203477.252357:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203477.252367:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143800 x1875064728170752/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203477.252400:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728170624:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203477.252500:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203477.252585:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203477/real 1788203477] req@ffff8bc144140380 x1875064728170624/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203502 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203477.252606:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140380 x1875064728170624/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203502 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203477.252624:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203477.252628:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203477.252632:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728170624:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203477.252698:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728170752:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203477.252724:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203477.252752:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203477/real 1788203477] req@ffff8bc144143800 x1875064728170752/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203502 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203477.252767:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143800 x1875064728170752/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203502 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203477.252776:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203477.252780:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203477.252784:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728170752:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203478.083943:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203478.147945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203479.108072:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203479.171893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203480.132040:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203480.195882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203481.156053:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203481.219850:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203482.180033:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203482.243896:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203482.371919:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203482.371929:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203482.371933:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203482.371944:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2763 00000100:00080000:2.0:1788203482.371955:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203482.371962:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203482.371999:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f100 x1875064728170880/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203482.372031:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203482.372036:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203482.372038:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203482.372042:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2763 00000100:00080000:2.0:1788203482.372045:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203482.372050:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203482.372060:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203482.372074:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d500 x1875064728171008/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203482.372078:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728170880:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203482.372150:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203482.372204:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203482/real 1788203482] req@ffff8bc17257f100 x1875064728170880/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203507 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203482.372218:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f100 x1875064728170880/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203507 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203482.372225:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203482.372228:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203482.372231:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728170880:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203482.372250:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728171008:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203482.372267:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203482.372276:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203482/real 1788203482] req@ffff8bc17257d500 x1875064728171008/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203507 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203482.372284:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d500 x1875064728171008/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203507 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203482.372290:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203482.372292:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203482.372294:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728171008:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203483.204001:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203483.267954:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203484.228052:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203484.291946:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203485.252009:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203485.315922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203486.275980:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203486.339893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203487.300023:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203487.363899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203487.491879:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203487.491890:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203487.491893:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203487.491903:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2768 00000100:00080000:2.0:1788203487.491911:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203487.491953:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203487.491987:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e300 x1875064728171136/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203487.492010:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203487.492013:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203487.492014:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203487.492017:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2768 00000100:00080000:2.0:1788203487.492020:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203487.492022:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203487.492029:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203487.492038:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c380 x1875064728171264/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203487.492094:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728171136:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203487.492173:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203487.492252:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203487/real 1788203487] req@ffff8bc17257e300 x1875064728171136/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203512 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203487.492270:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e300 x1875064728171136/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203512 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203487.492284:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203487.492287:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203487.492291:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728171136:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203487.492298:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728171264:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203487.492319:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203487.492328:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203487/real 1788203487] req@ffff8bc17257c380 x1875064728171264/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203512 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203487.492336:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c380 x1875064728171264/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203512 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203487.492342:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203487.492344:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203487.492346:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728171264:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203488.323942:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203488.387890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203489.348031:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203489.413106:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203490.371909:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203490.435872:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203491.396019:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203491.459908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203492.419915:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203492.483874:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203492.611948:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203492.612010:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203492.612015:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203492.612027:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2773 00000100:00080000:3.0:1788203492.612038:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203492.612046:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203492.612095:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728171392/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203492.612126:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203492.612130:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203492.612131:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203492.612134:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2773 00000100:00080000:3.0:1788203492.612136:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203492.612139:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203492.612148:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203492.612158:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728171520/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203492.612184:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728171392:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203492.612250:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203492.612298:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203492/real 1788203492] req@ffff8bc1726cdc00 x1875064728171392/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203517 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203492.612314:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728171392/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203517 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203492.612324:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203492.612327:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203492.612330:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728171392:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203492.612336:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728171520:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203492.612351:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203492.612360:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203492/real 1788203492] req@ffff8bc1726cce00 x1875064728171520/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203517 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203492.612378:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728171520/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203517 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203492.612384:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203492.612387:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203492.612389:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728171520:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203493.444018:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203493.507928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203494.468045:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203494.531891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203495.491993:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203495.556006:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203496.516005:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203496.579915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203497.539945:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203497.603975:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203497.731960:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203497.731971:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203497.731975:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203497.731987:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2779 00000100:00080000:0.0:1788203497.732000:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203497.732008:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203497.732054:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143100 x1875064728171648/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203497.732082:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203497.732085:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203497.732087:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203497.732090:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2779 00000100:00080000:0.0:1788203497.732092:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203497.732095:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203497.732105:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203497.732115:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140000 x1875064728171776/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203497.732129:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728171648:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203497.732201:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203497.732259:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203497/real 1788203497] req@ffff8bc144143100 x1875064728171648/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203522 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203497.732280:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143100 x1875064728171648/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203522 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203497.732290:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203497.732294:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203497.732298:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728171648:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203497.732337:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728171776:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203497.732356:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203497.732366:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203497/real 1788203497] req@ffff8bc144140000 x1875064728171776/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203522 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203497.732375:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140000 x1875064728171776/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203522 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203497.732381:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203497.732383:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203497.732386:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728171776:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203498.563993:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203498.627937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203499.587949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203499.651972:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203500.612023:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203500.675917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203501.635992:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203501.699939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203502.660011:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203502.723939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203502.851917:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203502.851929:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203502.851933:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203502.851945:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2784 00000100:00080000:0.0:1788203502.851957:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203502.851965:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203502.852009:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140a80 x1875064728171904/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203502.852038:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203502.852042:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203502.852044:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203502.852046:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2784 00000100:00080000:0.0:1788203502.852049:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203502.852052:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203502.852061:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203502.852071:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142680 x1875064728172032/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203502.852094:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728171904:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203502.852160:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203502.852210:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203502/real 1788203502] req@ffff8bc144140a80 x1875064728171904/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203527 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203502.852247:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140a80 x1875064728171904/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203527 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203502.852259:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203502.852263:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203502.852267:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728171904:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203502.852275:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728172032:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203502.852299:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203502.852313:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203502/real 1788203502] req@ffff8bc144142680 x1875064728172032/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203527 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203502.852324:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142680 x1875064728172032/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203527 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203502.852333:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203502.852336:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203502.852339:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728172032:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203503.683963:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203503.747946:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203504.707999:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203504.771936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203505.731970:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203505.795923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203506.755988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203506.819923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203507.779972:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203507.843865:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203507.971956:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203507.971964:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203507.971967:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203507.971976:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2789 00000100:00080000:3.0:1788203507.971985:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203507.971991:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203507.972024:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728172160/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203507.972045:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203507.972049:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203507.972050:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203507.972053:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2789 00000100:00080000:3.0:1788203507.972055:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203507.972058:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203507.972065:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203507.972072:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728172288/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203507.972158:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728172160:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203507.972297:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728172288:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203508.804011:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203508.867925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203509.827965:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203509.891885:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203510.852009:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203510.915948:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:0.0:1788203511.044113:0:10040:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:0.0:1788203511.044165:0:10040:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:0.0:1788203511.044182:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:0.0:1788203511.044225:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788203511.044294:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203507/real 1788203511] req@ffff8bc1726ce680 x1875064728172160/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203532 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203511.044328:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728172160/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203532 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203511.044342:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203511.044349:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203511.044353:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728172160:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203511.044363:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203507/real 1788203511] req@ffff8bc1726cc380 x1875064728172288/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203532 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203511.044375:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728172288/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203532 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203511.044384:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203511.044388:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203511.044392:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728172288:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203511.875957:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203511.939916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203512.900067:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203512.963930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203513.091935:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203513.091947:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203513.091952:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203513.091966:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2794 00000100:00080000:3.0:1788203513.091979:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203513.091988:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203513.092054:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728172416/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203513.092092:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203513.092096:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203513.092098:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203513.092102:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2794 00000100:00080000:3.0:1788203513.092106:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203513.092111:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203513.092124:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203513.092142:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728172544/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203513.092198:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728172416:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203513.092304:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203513.092368:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203513/real 1788203513] req@ffff8bc1726cea00 x1875064728172416/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203513.092392:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728172416/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203513.092406:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203513.092413:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203513.092417:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728172416:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203513.092427:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728172544:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203513.092457:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203513.092473:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203513/real 1788203513] req@ffff8bc1726ce300 x1875064728172544/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203513.092487:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728172544/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203513.092496:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203513.092501:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203513.092504:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728172544:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203513.923972:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203513.987939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203514.948002:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203515.011904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203515.971953:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203516.035912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203516.995937:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203517.059922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203518.019994:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203518.083911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203518.211887:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203518.211895:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203518.211899:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203518.211908:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2799 00000100:00080000:3.0:1788203518.211918:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203518.211923:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203518.211977:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728172672/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203518.212008:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203518.212012:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203518.212014:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203518.212019:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2799 00000100:00080000:3.0:1788203518.212023:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203518.212028:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203518.212036:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203518.212049:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728172800/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203518.212056:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728172672:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203518.212115:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203518.212163:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203518/real 1788203518] req@ffff8bc1726ced80 x1875064728172672/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203543 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203518.212186:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728172672/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203543 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203518.212198:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203518.212202:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203518.212206:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728172672:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203518.212239:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728172800:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203518.212259:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203518.212269:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203518/real 1788203518] req@ffff8bc1726cfb80 x1875064728172800/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203543 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203518.212277:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728172800/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203543 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203518.212284:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203518.212286:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203518.212288:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728172800:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203519.043963:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203519.107894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203520.067956:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203520.131932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203521.091939:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203521.155968:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203522.115981:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203522.179904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203523.139957:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203523.203884:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203523.331904:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203523.331914:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203523.331917:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203523.331927:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2804 00000100:00080000:0.0:1788203523.331937:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203523.331944:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203523.331975:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142d80 x1875064728172928/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203523.332001:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203523.332005:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203523.332007:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203523.332011:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2804 00000100:00080000:0.0:1788203523.332013:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203523.332017:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203523.332026:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203523.332039:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141180 x1875064728173056/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203523.332043:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728172928:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203523.332099:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203523.332136:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203523/real 1788203523] req@ffff8bc144142d80 x1875064728172928/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203548 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203523.332148:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142d80 x1875064728172928/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203548 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203523.332155:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203523.332157:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203523.332160:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728172928:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203523.332178:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728173056:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203523.332192:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203523.332199:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203523/real 1788203523] req@ffff8bc144141180 x1875064728173056/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203548 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203523.332207:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141180 x1875064728173056/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203548 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203523.332212:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203523.332214:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203523.332216:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728173056:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203524.163957:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203524.228083:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203525.188033:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203525.251899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203526.211950:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203526.275906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203527.235991:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203527.299918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203528.260085:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203528.323907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203528.451870:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203528.451878:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203528.451882:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203528.451889:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2809 00000100:00080000:0.0:1788203528.451897:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203528.451902:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203528.451936:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141180 x1875064728173184/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203528.451966:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203528.451968:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203528.451969:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203528.451972:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2809 00000100:00080000:0.0:1788203528.451973:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203528.451976:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203528.451982:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203528.451990:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142d80 x1875064728173312/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203528.452064:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728173184:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203528.452151:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203528.452226:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203528/real 1788203528] req@ffff8bc144141180 x1875064728173184/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203553 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203528.452250:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141180 x1875064728173184/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203553 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203528.452264:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203528.452270:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203528.452275:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728173184:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203528.452285:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728173312:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203528.452312:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203528.452327:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203528/real 1788203528] req@ffff8bc144142d80 x1875064728173312/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203553 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203528.452352:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142d80 x1875064728173312/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203553 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203528.452362:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203528.452366:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203528.452370:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728173312:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203529.283961:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203529.347904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203530.308048:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203530.371853:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203531.332000:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203531.395897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203532.355932:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203532.419913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203533.379997:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203533.443904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203533.571910:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203533.571934:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203533.571939:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203533.571951:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2814 00000100:00080000:3.0:1788203533.571963:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203533.571971:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203533.572015:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728173440/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203533.572042:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203533.572046:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203533.572047:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203533.572050:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2814 00000100:00080000:3.0:1788203533.572053:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203533.572055:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203533.572065:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203533.572074:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728173568/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203533.572103:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728173440:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203533.572183:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203533.572245:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203533/real 1788203533] req@ffff8bc1726cca80 x1875064728173440/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203558 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203533.572276:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728173440/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203558 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203533.572288:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203533.572293:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203533.572298:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728173440:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203533.572306:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728173568:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203533.572329:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203533.572342:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203533/real 1788203533] req@ffff8bc1726cd500 x1875064728173568/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203558 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203533.572354:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728173568/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203558 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203533.572362:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203533.572365:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203533.572369:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728173568:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203534.403939:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203534.467920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203535.428022:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203535.491925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203536.451942:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203536.515945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203537.476024:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203537.539913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203538.499963:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203538.563918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203538.691941:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203538.691961:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203538.691965:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203538.691977:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2820 00000100:00080000:0.0:1788203538.691988:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203538.691995:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203538.692048:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142680 x1875064728173696/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203538.692074:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203538.692077:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203538.692079:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203538.692081:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2820 00000100:00080000:0.0:1788203538.692084:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203538.692087:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203538.692101:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203538.692111:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140a80 x1875064728173824/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203538.692148:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728173696:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203538.692230:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203538.692297:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203538/real 1788203538] req@ffff8bc144142680 x1875064728173696/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203563 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203538.692319:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142680 x1875064728173696/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203563 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203538.692333:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203538.692338:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203538.692342:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728173696:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203538.692351:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728173824:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203538.692378:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203538.692394:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203538/real 1788203538] req@ffff8bc144140a80 x1875064728173824/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203563 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203538.692409:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140a80 x1875064728173824/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203563 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203538.692420:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203538.692424:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203538.692428:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728173824:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203539.523953:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203539.587900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203540.548029:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203540.611951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203541.571979:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203541.635949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203542.595994:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203542.659919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203543.620017:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203543.683894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203543.811924:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203543.811933:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203543.811937:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203543.811946:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2825 00000100:00080000:3.0:1788203543.811955:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203543.811961:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203543.811994:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728173952/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203543.812017:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203543.812020:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203543.812021:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203543.812024:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2825 00000100:00080000:3.0:1788203543.812027:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203543.812030:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203543.812037:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203543.812046:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728174080/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203543.812115:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728173952:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203543.812208:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203543.812276:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203543/real 1788203543] req@ffff8bc1726cf480 x1875064728173952/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203568 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203543.812302:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728173952/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203568 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203543.812317:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203543.812323:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203543.812327:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728173952:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203543.812336:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728174080:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203543.812364:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203543.812379:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203543/real 1788203543] req@ffff8bc1726cf100 x1875064728174080/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203568 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203543.812393:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728174080/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203568 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203543.812403:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203543.812407:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203543.812410:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728174080:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203544.643992:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203544.707924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203545.667993:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203545.731937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203546.691928:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203546.755863:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203547.715977:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203547.779898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203548.739917:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203548.803871:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203548.931917:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203548.931926:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203548.931930:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203548.931938:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2830 00000100:00080000:0.0:1788203548.931948:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203548.931953:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203548.931989:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140000 x1875064728174208/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203548.932018:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203548.932023:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203548.932024:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203548.932028:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2830 00000100:00080000:0.0:1788203548.932031:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203548.932035:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203548.932045:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203548.932058:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728174208:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203548.932064:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143100 x1875064728174336/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788203548.932116:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203548.932167:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203548/real 1788203548] req@ffff8bc144140000 x1875064728174208/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203573 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203548.932181:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140000 x1875064728174208/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203573 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203548.932189:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203548.932192:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203548.932194:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728174208:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203548.932213:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728174336:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203548.932228:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203548.932236:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203548/real 1788203548] req@ffff8bc144143100 x1875064728174336/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203573 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203548.932244:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143100 x1875064728174336/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203573 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203548.932249:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203548.932251:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203548.932253:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728174336:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203549.763950:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203549.827888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203550.788034:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203550.851932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203551.812037:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203551.875932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203552.836036:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203552.899961:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203553.859931:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203553.923942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203554.052019:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203554.052033:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203554.052039:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203554.052053:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2835 00000100:00080000:3.0:1788203554.052068:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203554.052077:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203554.052141:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728174464/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203554.052175:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203554.052179:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203554.052182:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203554.052187:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2835 00000100:00080000:3.0:1788203554.052191:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203554.052196:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203554.052209:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203554.052223:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728174592/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203554.052236:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728174464:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203554.052361:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203554.052472:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203554/real 1788203554] req@ffff8bc1726cc700 x1875064728174464/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203554.052501:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728174464/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203554.052517:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203554.052524:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203554.052529:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728174464:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203554.052564:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728174592:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203554.052599:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203554.052619:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203554/real 1788203554] req@ffff8bc1726cd180 x1875064728174592/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203554.052638:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728174592/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203554.052649:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203554.052654:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203554.052659:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728174592:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203554.884030:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203554.947942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203555.907966:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203555.971936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203556.932038:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203556.995854:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203557.956030:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203558.019935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203558.979933:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203559.043880:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788203559.171956:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788203559.171967:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788203559.171971:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203559.171983:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2840 00000100:00080000:1.0:1788203559.171995:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203559.172002:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788203559.172048:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5180 x1875064728174720/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788203559.172079:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788203559.172084:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788203559.172086:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203559.172090:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2840 00000100:00080000:1.0:1788203559.172093:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203559.172098:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788203559.172111:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788203559.172125:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4000 x1875064728174848/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203559.172134:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728174720:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203559.172218:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203559.172299:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203559/real 1788203559] req@ffff8bc1727d5180 x1875064728174720/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203584 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203559.172317:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5180 x1875064728174720/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203584 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203559.172331:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203559.172335:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203559.172340:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728174720:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203559.172371:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728174848:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203559.172395:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203559.172409:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203559/real 1788203559] req@ffff8bc1727d4000 x1875064728174848/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203584 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203559.172422:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4000 x1875064728174848/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203584 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203559.172432:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203559.172436:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203559.172440:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728174848:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203560.003996:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203560.067984:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203561.027972:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203561.091912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203562.051943:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203562.115858:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203563.075960:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203563.139896:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203564.099969:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203564.163855:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203564.291944:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203564.291953:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203564.291957:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203564.291965:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2845 00000100:00080000:3.0:1788203564.291976:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203564.291982:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203564.292018:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728174976/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203564.292041:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203564.292044:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203564.292046:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203564.292048:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2845 00000100:00080000:3.0:1788203564.292050:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203564.292054:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203564.292063:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203564.292077:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728175104/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203564.292123:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728174976:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203564.292227:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203564.292293:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203564/real 1788203564] req@ffff8bc1726cf800 x1875064728174976/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203589 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203564.292313:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728174976/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203589 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203564.292323:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203564.292328:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203564.292331:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728174976:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203564.292338:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728175104:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203564.292356:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203564.292365:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203564/real 1788203564] req@ffff8bc1726cdf80 x1875064728175104/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203589 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203564.292374:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728175104/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203589 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203564.292384:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203564.292387:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203564.292390:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728175104:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203565.123979:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203565.187940:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203566.147958:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203566.211859:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203567.171948:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203567.235909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203568.195968:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203568.259953:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203569.220011:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203569.283933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203569.411938:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203569.411949:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203569.411954:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203569.411965:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2850 00000100:00080000:0.0:1788203569.411975:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203569.411982:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203569.412019:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143800 x1875064728175232/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203569.412048:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203569.412052:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203569.412054:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203569.412071:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2850 00000100:00080000:0.0:1788203569.412075:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203569.412080:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203569.412090:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203569.412104:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140380 x1875064728175360/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203569.412112:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728175232:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203569.412174:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203569.412221:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203569/real 1788203569] req@ffff8bc144143800 x1875064728175232/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203594 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203569.412238:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143800 x1875064728175232/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203594 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203569.412247:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203569.412250:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203569.412252:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728175232:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203569.412270:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728175360:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203569.412291:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203569.412306:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203569/real 1788203569] req@ffff8bc144140380 x1875064728175360/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203594 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203569.412325:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140380 x1875064728175360/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203594 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203569.412334:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203569.412337:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203569.412341:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728175360:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203570.243977:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203570.307921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203571.267981:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203571.331921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203572.292032:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203572.355925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203573.315932:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203573.379907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203574.340008:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203574.403880:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203574.531890:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203574.531902:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203574.531906:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203574.531917:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2855 00000100:00080000:0.0:1788203574.531929:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203574.531935:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203574.531983:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142300 x1875064728175488/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203574.532010:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203574.532013:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203574.532015:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203574.532018:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2855 00000100:00080000:0.0:1788203574.532020:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203574.532023:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203574.532031:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203574.532042:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141f80 x1875064728175616/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203574.532056:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728175488:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203574.532154:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728175616:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203575.363984:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203575.428015:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203576.388031:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203576.451901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203577.412054:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203577.475948:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:3.0:1788203577.604208:0:10041:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:3.0:1788203577.604280:0:10041:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:3.0:1788203577.604301:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:3.0:1788203577.604352:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788203577.604415:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203574/real 1788203577] req@ffff8bc144141f80 x1875064728175616/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203599 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203577.604451:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141f80 x1875064728175616/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203599 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203577.604473:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203577.604480:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203577.604486:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728175616:192.168.201.143@tcp:38:kworker.0 00000100:00100000:2.0:1788203577.604495:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203574/real 1788203577] req@ffff8bc144142300 x1875064728175488/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203599 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203577.604510:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142300 x1875064728175488/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203599 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203577.604520:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203577.604524:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203577.604528:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728175488:192.168.201.143@tcp:250:kworker.0 00010000:00010000:2.0:1788203578.436020:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203578.499862:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203579.460066:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203579.523915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203579.651864:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203579.651872:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203579.651876:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203579.651900:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2861 00000100:00080000:0.0:1788203579.651909:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203579.651915:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203579.651944:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143b80 x1875064728175744/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203579.651966:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203579.651970:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203579.651971:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203579.651974:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2861 00000100:00080000:0.0:1788203579.651976:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203579.651978:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203579.651985:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203579.651993:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141500 x1875064728175872/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203579.652064:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728175744:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203579.652158:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203579.652242:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203579/real 1788203579] req@ffff8bc144143b80 x1875064728175744/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203604 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203579.652267:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143b80 x1875064728175744/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203604 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203579.652279:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203579.652284:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203579.652289:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728175744:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203579.652302:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728175872:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203579.652333:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203579.652349:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203579/real 1788203579] req@ffff8bc144141500 x1875064728175872/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203604 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203579.652364:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141500 x1875064728175872/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203604 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203579.652388:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203579.652393:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203579.652397:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728175872:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203580.484016:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203580.547984:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203581.508048:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203581.571969:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203582.531996:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203582.595954:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203583.555992:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203583.619942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203584.580031:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203584.643969:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203584.771954:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203584.771968:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203584.771974:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203584.771988:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2866 00000100:00080000:2.0:1788203584.772003:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203584.772012:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203584.772063:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257fb80 x1875064728176000/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203584.772099:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203584.772106:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203584.772109:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203584.772113:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2866 00000100:00080000:2.0:1788203584.772118:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203584.772124:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203584.772136:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203584.772149:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728176000:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203584.772153:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ca80 x1875064728176128/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788203584.772241:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203584.772305:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203584/real 1788203584] req@ffff8bc17257fb80 x1875064728176000/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203609 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203584.772328:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257fb80 x1875064728176000/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203609 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203584.772342:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203584.772347:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203584.772351:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728176000:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203584.772380:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728176128:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203584.772404:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203584.772417:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203584/real 1788203584] req@ffff8bc17257ca80 x1875064728176128/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203609 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203584.772431:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ca80 x1875064728176128/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203609 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203584.772440:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203584.772443:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203584.772446:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728176128:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203585.604002:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203585.667940:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203586.628008:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203586.691944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203587.652014:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203587.715942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203588.675961:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203588.739954:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203589.700023:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203589.763940:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203589.891998:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203589.892009:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203589.892014:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203589.892026:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2871 00000100:00080000:0.0:1788203589.892038:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203589.892050:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203589.892091:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143480 x1875064728176256/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203589.892121:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203589.892127:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203589.892129:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203589.892134:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2871 00000100:00080000:0.0:1788203589.892138:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203589.892143:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203589.892152:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203589.892168:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141880 x1875064728176384/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203589.892176:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728176256:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203589.892278:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203589.892351:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203589/real 1788203589] req@ffff8bc144143480 x1875064728176256/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203614 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203589.892376:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143480 x1875064728176256/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203614 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203589.892390:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203589.892396:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203589.892401:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728176256:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203589.892433:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728176384:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203589.892477:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203589.892494:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203589/real 1788203589] req@ffff8bc144141880 x1875064728176384/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203614 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203589.892509:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141880 x1875064728176384/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203614 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203589.892519:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203589.892523:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203589.892527:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728176384:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203590.723931:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203590.787925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203591.747955:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203591.811850:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203592.771913:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203592.835862:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203593.795960:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203593.859862:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203594.819926:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203594.884833:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203595.011899:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203595.011907:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203595.011910:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203595.011918:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2876 00000100:00080000:3.0:1788203595.011927:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203595.011932:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203595.011962:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728176512/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203595.011981:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203595.011983:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203595.011984:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203595.011987:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2876 00000100:00080000:3.0:1788203595.011989:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203595.011992:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203595.012001:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203595.012014:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728176640/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203595.012026:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728176512:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203595.012078:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203595.012122:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203595/real 1788203595] req@ffff8bc1726cdf80 x1875064728176512/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203595.012141:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728176512/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203595.012149:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203595.012151:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203595.012154:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728176512:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203595.012173:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728176640:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203595.012186:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203595.012194:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203595/real 1788203595] req@ffff8bc1726cf800 x1875064728176640/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203595.012201:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728176640/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203595.012206:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203595.012208:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203595.012210:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728176640:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203595.843975:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203595.907959:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203596.867963:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203596.931861:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203597.891943:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203597.955854:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203598.915979:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203598.979909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203599.939961:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203600.003882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203600.131902:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203600.131912:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203600.131916:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203600.131933:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2881 00000100:00080000:3.0:1788203600.131944:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203600.131952:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203600.131995:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728176768/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203600.132028:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203600.132032:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203600.132034:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203600.132038:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2881 00000100:00080000:3.0:1788203600.132041:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203600.132045:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203600.132054:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203600.132067:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728176896/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203600.132076:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728176768:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203600.132137:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203600.132195:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203600/real 1788203600] req@ffff8bc1726cd180 x1875064728176768/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203625 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203600.132212:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728176768/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203625 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203600.132222:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203600.132225:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203600.132229:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728176768:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203600.132250:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728176896:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203600.132269:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203600.132278:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203600/real 1788203600] req@ffff8bc1726cc700 x1875064728176896/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203625 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203600.132285:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728176896/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203625 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203600.132291:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203600.132293:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203600.132294:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728176896:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203600.963939:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203601.027986:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203601.987959:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203602.051890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203603.011938:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203603.075866:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203604.035973:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203604.099904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203605.059936:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203605.123863:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203605.251943:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203605.251967:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203605.251973:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203605.251988:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2886 00000100:00080000:0.0:1788203605.252007:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203605.252016:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203605.252065:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142a00 x1875064728177024/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203605.252099:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203605.252104:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203605.252106:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203605.252110:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2886 00000100:00080000:0.0:1788203605.252115:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203605.252119:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203605.252131:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203605.252146:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140e00 x1875064728177152/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203605.252190:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728177024:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203605.252269:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203605.252333:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203605/real 1788203605] req@ffff8bc144142a00 x1875064728177024/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203630 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203605.252353:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142a00 x1875064728177024/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203630 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203605.252365:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203605.252370:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203605.252374:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728177024:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203605.252383:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728177152:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203605.252410:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203605.252427:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203605/real 1788203605] req@ffff8bc144140e00 x1875064728177152/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203630 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203605.252470:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140e00 x1875064728177152/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203630 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203605.252476:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203605.252479:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203605.252481:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728177152:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203606.083980:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203606.148066:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203607.107955:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203607.171917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203608.131996:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203608.195894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203609.155952:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203609.219913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203610.179974:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203610.243908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203610.371923:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203610.371943:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203610.371948:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203610.371959:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2891 00000100:00080000:0.0:1788203610.371970:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203610.371979:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203610.372017:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140700 x1875064728177280/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203610.372049:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203610.372053:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203610.372055:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203610.372060:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2891 00000100:00080000:0.0:1788203610.372064:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203610.372069:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203610.372078:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203610.372091:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728177280:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203610.372096:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141c00 x1875064728177408/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788203610.372149:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203610.372187:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203610/real 1788203610] req@ffff8bc144140700 x1875064728177280/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203635 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203610.372201:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140700 x1875064728177280/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203635 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203610.372209:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203610.372212:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203610.372215:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728177280:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203610.372234:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728177408:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203610.372249:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203610.372258:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203610/real 1788203610] req@ffff8bc144141c00 x1875064728177408/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203635 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203610.372266:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141c00 x1875064728177408/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203635 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203610.372272:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203610.372274:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203610.372276:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728177408:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203611.203953:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203611.267906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203612.227940:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203612.291917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203613.252012:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203613.315899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203614.276021:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203614.339920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203615.300014:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203615.363937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203615.491986:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203615.491998:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203615.492003:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203615.492015:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2896 00000100:00080000:3.0:1788203615.492027:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203615.492034:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203615.492080:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728177536/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203615.492108:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203615.492111:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203615.492113:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203615.492116:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2896 00000100:00080000:3.0:1788203615.492118:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203615.492121:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203615.492131:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203615.492141:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728177664/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203615.492166:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728177536:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203615.492242:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203615.492313:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203615/real 1788203615] req@ffff8bc1726cf100 x1875064728177536/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203640 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203615.492330:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728177536/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203640 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203615.492339:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203615.492342:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203615.492346:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728177536:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203615.492351:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728177664:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203615.492368:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203615.492377:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203615/real 1788203615] req@ffff8bc1726cf480 x1875064728177664/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203640 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203615.492386:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728177664/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203640 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203615.492391:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203615.492393:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203615.492395:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728177664:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203616.324014:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203616.387933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203617.348024:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203617.411902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203618.372025:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203618.435944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203619.396012:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203619.459974:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203620.419928:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203620.483931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203620.611972:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203620.611982:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203620.611987:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203620.611998:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2901 00000100:00080000:2.0:1788203620.612011:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203620.612019:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203620.612064:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ea00 x1875064728177792/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203620.612093:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203620.612096:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203620.612098:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203620.612101:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2901 00000100:00080000:2.0:1788203620.612104:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203620.612107:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203620.612118:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203620.612127:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ce00 x1875064728177920/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203620.612152:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728177792:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203620.612259:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203620.612312:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203620/real 1788203620] req@ffff8bc17257ea00 x1875064728177792/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203645 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203620.612329:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ea00 x1875064728177792/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203645 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203620.612338:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203620.612341:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203620.612344:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728177792:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203620.612350:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728177920:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203620.612367:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203620.612375:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203620/real 1788203620] req@ffff8bc17257ce00 x1875064728177920/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203645 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203620.612389:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ce00 x1875064728177920/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203645 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203620.612395:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203620.612397:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203620.612399:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728177920:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203621.443937:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203621.508020:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203622.467942:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203622.531897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203623.491977:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203623.556258:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203624.515923:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203624.579953:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203625.539980:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203625.603898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203625.731906:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203625.731927:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203625.731932:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203625.731944:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2907 00000100:00080000:0.0:1788203625.731954:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203625.731962:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203625.732010:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141c00 x1875064728178048/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203625.732042:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203625.732047:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203625.732049:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203625.732053:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2907 00000100:00080000:0.0:1788203625.732057:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203625.732063:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203625.732074:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203625.732128:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140700 x1875064728178176/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203625.732154:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728178048:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203625.732211:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203625.732251:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203625/real 1788203625] req@ffff8bc144141c00 x1875064728178048/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203650 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203625.732274:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141c00 x1875064728178048/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203650 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203625.732281:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203625.732284:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203625.732287:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728178048:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203625.732308:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728178176:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203625.732324:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203625.732332:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203625/real 1788203625] req@ffff8bc144140700 x1875064728178176/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203650 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203625.732345:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140700 x1875064728178176/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203650 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203625.732350:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203625.732352:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203625.732354:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728178176:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203626.563930:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203626.627886:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203627.588032:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203627.651942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203628.612047:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203628.675949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203629.636070:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203629.699938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203630.660024:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203630.723932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788203630.851983:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788203630.852033:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788203630.852039:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203630.852053:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2912 00000100:00080000:1.0:1788203630.852067:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203630.852077:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788203630.852130:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5f80 x1875064728178304/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788203630.852165:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788203630.852170:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788203630.852172:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203630.852178:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2912 00000100:00080000:1.0:1788203630.852182:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203630.852188:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788203630.852200:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203630.852210:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728178304:192.168.201.143@tcp:250:kworker.0 00000100:00100000:1.0:1788203630.852221:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4380 x1875064728178432/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788203630.852291:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203630.852341:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203630/real 1788203630] req@ffff8bc1727d5f80 x1875064728178304/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203655 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203630.852363:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5f80 x1875064728178304/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203655 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203630.852375:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203630.852380:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203630.852384:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728178304:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203630.852406:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728178432:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203630.852425:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203630.852435:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203630/real 1788203630] req@ffff8bc1727d4380 x1875064728178432/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203655 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203630.852444:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4380 x1875064728178432/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203655 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203630.852450:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203630.852452:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203630.852455:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728178432:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203631.684055:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203631.747973:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203632.708133:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203632.771881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203633.731960:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203633.795985:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203634.756090:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203634.819887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203635.780042:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203635.843978:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203635.972069:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203635.972088:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203635.972094:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203635.972108:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2917 00000100:00080000:3.0:1788203635.972121:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203635.972130:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203635.972183:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728178560/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203635.972221:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203635.972225:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203635.972227:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203635.972232:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2917 00000100:00080000:3.0:1788203635.972236:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203635.972243:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203635.972255:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203635.972265:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728178560:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788203635.972272:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728178688/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788203635.972347:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203635.972427:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203635/real 1788203635] req@ffff8bc1726cd500 x1875064728178560/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203660 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203635.972446:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728178560/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203660 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203635.972455:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203635.972459:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203635.972461:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728178560:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203635.972491:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728178688:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203635.972518:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203635.972534:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203635/real 1788203635] req@ffff8bc1726cca80 x1875064728178688/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203660 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203635.972546:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728178688/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203660 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203635.972552:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203635.972555:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203635.972557:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728178688:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203636.804002:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203636.867948:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203637.827988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203637.891905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203638.851987:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203638.915946:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203639.876021:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203639.939907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203640.900036:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203640.963952:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203641.091928:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203641.091937:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203641.091941:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203641.091951:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2922 00000100:00080000:3.0:1788203641.091963:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203641.091969:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203641.092019:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728178816/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203641.092044:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203641.092047:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203641.092048:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203641.092050:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2922 00000100:00080000:3.0:1788203641.092052:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203641.092055:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203641.092067:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203641.092078:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728178944/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203641.092093:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728178816:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203641.092209:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728178944:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203641.923997:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203641.987936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203642.948018:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203643.011857:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203643.971970:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203644.035905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788203644.164159:0:10042:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788203644.164215:0:10042:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788203644.164234:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788203644.164284:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788203644.164341:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203641/real 1788203644] req@ffff8bc1726ced80 x1875064728178944/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203644.164375:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728178944/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203644.164389:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203644.164394:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203644.164399:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728178944:192.168.201.143@tcp:38:kworker.0 00000100:00100000:2.0:1788203644.164409:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203641/real 1788203644] req@ffff8bc1726cfb80 x1875064728178816/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203644.164422:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728178816/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203644.164430:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203644.164433:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203644.164437:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728178816:192.168.201.143@tcp:250:kworker.0 00010000:00010000:3.0:1788203644.996007:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203645.059913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203646.019982:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203646.083897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203646.211948:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203646.211963:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203646.211969:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203646.211981:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2927 00000100:00080000:3.0:1788203646.211994:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203646.212003:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203646.212053:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728179072/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203646.212085:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203646.212089:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203646.212091:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203646.212095:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2927 00000100:00080000:3.0:1788203646.212099:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203646.212103:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203646.212114:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203646.212137:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728179200/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203646.212139:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728179072:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203646.212223:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203646.212279:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203646/real 1788203646] req@ffff8bc1726ce300 x1875064728179072/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203671 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203646.212299:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728179072/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203671 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203646.212310:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203646.212314:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203646.212319:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728179072:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203646.212347:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728179200:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203646.212368:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203646.212380:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203646/real 1788203646] req@ffff8bc1726cea00 x1875064728179200/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203671 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203646.212392:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728179200/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203671 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203646.212412:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203646.212415:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203646.212418:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728179200:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203647.043967:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203647.107959:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203648.067991:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203648.131940:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203649.091958:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203649.155909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203650.116006:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203650.179907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203651.139932:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203651.203956:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203651.331950:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203651.331961:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203651.331965:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203651.331976:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2932 00000100:00080000:3.0:1788203651.331989:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203651.331998:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203651.332044:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728179328/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203651.332078:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203651.332083:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203651.332085:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203651.332089:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2932 00000100:00080000:3.0:1788203651.332093:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203651.332098:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203651.332108:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203651.332119:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728179456/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203651.332126:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728179328:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203651.332193:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203651.332251:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203651/real 1788203651] req@ffff8bc1726cc380 x1875064728179328/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203676 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203651.332275:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728179328/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203676 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203651.332283:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203651.332286:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203651.332289:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728179328:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203651.332318:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728179456:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203651.332335:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203651.332345:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203651/real 1788203651] req@ffff8bc1726ce680 x1875064728179456/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203676 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203651.332352:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728179456/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203676 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203651.332358:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203651.332362:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203651.332365:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728179456:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203652.164002:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203652.227919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203653.188006:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203653.251951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203654.212010:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203654.275875:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203655.235967:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203655.299949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203656.259967:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203656.323922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203656.451956:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203656.451964:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203656.451967:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203656.451976:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2937 00000100:00080000:2.0:1788203656.451985:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203656.451993:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203656.452031:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d880 x1875064728179584/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203656.452067:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203656.452072:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203656.452073:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203656.452078:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2937 00000100:00080000:2.0:1788203656.452083:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203656.452088:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203656.452098:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203656.452110:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ed80 x1875064728179712/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203656.452135:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728179584:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203656.452205:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203656.452268:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203656/real 1788203656] req@ffff8bc17257d880 x1875064728179584/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203681 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203656.452289:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d880 x1875064728179584/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203681 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203656.452307:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203656.452312:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203656.452317:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728179584:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203656.452325:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728179712:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203656.452351:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203656.452366:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203656/real 1788203656] req@ffff8bc17257ed80 x1875064728179712/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203681 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203656.452380:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ed80 x1875064728179712/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203681 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203656.452390:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203656.452394:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203656.452398:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728179712:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203657.284018:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203657.347952:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203658.307987:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203658.371854:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203659.331974:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203659.395861:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203660.356042:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203660.419872:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203661.380002:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203661.444851:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203661.571942:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203661.571956:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203661.571961:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203661.571972:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2942 00000100:00080000:0.0:1788203661.571984:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203661.571993:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203661.572039:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140e00 x1875064728179840/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203661.572068:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203661.572074:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203661.572075:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203661.572079:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2942 00000100:00080000:0.0:1788203661.572081:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203661.572084:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203661.572094:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203661.572109:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142a00 x1875064728179968/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203661.572120:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728179840:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203661.572205:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203661.572270:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203661/real 1788203661] req@ffff8bc144140e00 x1875064728179840/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203686 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203661.572299:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140e00 x1875064728179840/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203686 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203661.572311:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203661.572316:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203661.572321:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728179840:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203661.572363:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728179968:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203661.572390:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203661.572405:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203661/real 1788203661] req@ffff8bc144142a00 x1875064728179968/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203686 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203661.572419:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142a00 x1875064728179968/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203686 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203661.572429:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203661.572433:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203661.572438:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728179968:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203662.403976:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203662.467915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203663.427942:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203663.491861:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203664.451975:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203664.515970:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203665.476036:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203665.539954:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203666.499990:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203666.563933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203666.691903:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203666.691917:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203666.691923:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203666.691937:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2948 00000100:00080000:0.0:1788203666.691951:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203666.691961:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203666.692013:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141880 x1875064728180096/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203666.692056:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203666.692061:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203666.692063:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203666.692067:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2948 00000100:00080000:0.0:1788203666.692071:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203666.692076:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203666.692089:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203666.692104:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143480 x1875064728180224/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203666.692111:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728180096:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203666.692197:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203666.692256:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203666/real 1788203666] req@ffff8bc144141880 x1875064728180096/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203691 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203666.692281:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141880 x1875064728180096/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203691 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203666.692294:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203666.692300:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203666.692304:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728180096:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203666.692338:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728180224:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203666.692395:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203666.692408:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203666/real 1788203666] req@ffff8bc144143480 x1875064728180224/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203691 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203666.692417:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143480 x1875064728180224/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203691 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203666.692424:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203666.692426:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203666.692428:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728180224:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203667.523932:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203667.588036:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203668.547949:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203668.611905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203669.571925:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203669.635936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203670.595939:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203670.659944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203671.619993:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203671.683888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203671.811938:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203671.811950:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203671.811955:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203671.811968:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2953 00000100:00080000:0.0:1788203671.811981:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203671.811990:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203671.812035:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141500 x1875064728180352/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203671.812066:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203671.812071:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203671.812073:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203671.812077:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2953 00000100:00080000:0.0:1788203671.812080:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203671.812085:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203671.812097:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203671.812109:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143b80 x1875064728180480/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203671.812124:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728180352:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203671.812184:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203671.812227:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203671/real 1788203671] req@ffff8bc144141500 x1875064728180352/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203696 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203671.812241:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141500 x1875064728180352/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203696 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203671.812249:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203671.812252:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203671.812260:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728180352:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203671.812295:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728180480:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203671.812312:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203671.812320:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203671/real 1788203671] req@ffff8bc144143b80 x1875064728180480/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203696 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203671.812328:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143b80 x1875064728180480/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203696 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203671.812334:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203671.812336:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203671.812338:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728180480:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203672.643919:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203672.708131:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203673.668013:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203673.731868:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203674.691949:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203674.755937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203675.716037:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203675.779956:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203676.740005:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203676.803881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203676.931975:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203676.931984:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203676.931987:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203676.932000:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2958 00000100:00080000:2.0:1788203676.932010:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203676.932018:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203676.932059:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e680 x1875064728180608/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203676.932088:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203676.932091:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203676.932093:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203676.932096:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2958 00000100:00080000:2.0:1788203676.932099:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203676.932104:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203676.932113:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203676.932122:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257df80 x1875064728180736/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203676.932149:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728180608:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203676.932251:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203676.932311:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203676/real 1788203676] req@ffff8bc17257e680 x1875064728180608/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203701 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203676.932327:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e680 x1875064728180608/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203701 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203676.932336:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203676.932340:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203676.932343:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728180608:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203676.932368:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728180736:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203676.932386:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203676.932394:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203676/real 1788203676] req@ffff8bc17257df80 x1875064728180736/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203701 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203676.932401:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257df80 x1875064728180736/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203701 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203676.932406:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203676.932408:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203676.932409:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728180736:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203677.763991:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203677.827933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203678.787926:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203678.851883:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203679.811950:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203679.875898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203680.835913:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203680.899863:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203681.859953:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203681.923892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203682.051893:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203682.051901:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203682.051905:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203682.051912:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2963 00000100:00080000:0.0:1788203682.051920:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203682.051925:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203682.051958:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142300 x1875064728180864/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203682.051985:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203682.051988:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203682.051996:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203682.052002:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2963 00000100:00080000:0.0:1788203682.052005:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203682.052008:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203682.052016:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203682.052020:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728180864:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203682.052032:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141f80 x1875064728180992/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788203682.052082:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203682.052137:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203682/real 1788203682] req@ffff8bc144142300 x1875064728180864/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203682.052152:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142300 x1875064728180864/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203682.052158:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203682.052161:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203682.052163:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728180864:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203682.052182:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728180992:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203682.052205:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203682.052215:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203682/real 1788203682] req@ffff8bc144141f80 x1875064728180992/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203682.052226:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141f80 x1875064728180992/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203682.052234:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203682.052237:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203682.052241:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728180992:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203682.883916:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203682.947904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203683.907969:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203683.971902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203684.931956:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203684.995895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203685.955980:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203686.019915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203686.979990:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203687.043948:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203687.171921:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203687.171932:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203687.171936:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203687.171947:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2968 00000100:00080000:0.0:1788203687.171958:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203687.171965:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203687.172004:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140380 x1875064728181120/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203687.172053:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203687.172056:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203687.172057:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203687.172060:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2968 00000100:00080000:0.0:1788203687.172062:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203687.172065:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203687.172075:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203687.172086:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143800 x1875064728181248/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203687.172105:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728181120:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203687.172190:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203687.172257:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203687/real 1788203687] req@ffff8bc144140380 x1875064728181120/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203712 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203687.172278:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140380 x1875064728181120/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203712 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203687.172289:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203687.172293:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203687.172297:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728181120:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203687.172328:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728181248:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203687.172352:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203687.172362:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203687/real 1788203687] req@ffff8bc144143800 x1875064728181248/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203712 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203687.172371:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143800 x1875064728181248/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203712 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203687.172376:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203687.172378:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203687.172381:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728181248:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203688.004030:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203688.067979:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203689.027922:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203689.091933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203690.051997:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203690.115945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203691.075973:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203691.139922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203692.099969:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203692.163919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203692.291924:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203692.291944:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203692.291949:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203692.291959:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2973 00000100:00080000:0.0:1788203692.291969:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203692.291977:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203692.292011:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143100 x1875064728181376/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203692.292031:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203692.292035:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203692.292037:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203692.292042:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2973 00000100:00080000:0.0:1788203692.292045:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203692.292049:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203692.292058:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203692.292071:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140000 x1875064728181504/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203692.292074:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728181376:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203692.292169:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203692.292229:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203692/real 1788203692] req@ffff8bc144143100 x1875064728181376/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203717 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203692.292249:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143100 x1875064728181376/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203717 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203692.292260:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203692.292266:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203692.292270:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728181376:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203692.292302:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728181504:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203692.292326:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203692.292340:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203692/real 1788203692] req@ffff8bc144140000 x1875064728181504/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203717 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203692.292361:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140000 x1875064728181504/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203717 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203692.292374:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203692.292377:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203692.292381:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728181504:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203693.123964:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203693.187901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203694.147979:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203694.211992:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203695.172006:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203695.235857:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203696.195963:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203696.259939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203697.219971:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203697.283982:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788203697.411999:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788203697.412009:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788203697.412013:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203697.412025:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2978 00000100:00080000:1.0:1788203697.412035:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203697.412043:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788203697.412081:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5500 x1875064728181632/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788203697.412116:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788203697.412120:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788203697.412122:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203697.412126:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2978 00000100:00080000:1.0:1788203697.412129:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203697.412133:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788203697.412142:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788203697.412155:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6680 x1875064728181760/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203697.412252:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728181632:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203697.412303:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203697.412341:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203697/real 1788203697] req@ffff8bc1727d5500 x1875064728181632/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203722 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203697.412353:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5500 x1875064728181632/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203722 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203697.412360:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203697.412363:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203697.412365:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728181632:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203697.412370:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728181760:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203697.412382:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203697.412389:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203697/real 1788203697] req@ffff8bc1727d6680 x1875064728181760/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203722 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203697.412398:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6680 x1875064728181760/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203722 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203697.412521:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203697.412525:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203697.412529:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728181760:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203698.243978:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203698.307938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203699.267969:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203699.331969:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203700.291953:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203700.355902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203701.315949:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203701.379987:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203702.339923:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203702.403936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788203702.531935:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788203702.531949:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788203702.531955:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203702.531967:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2983 00000100:00080000:1.0:1788203702.531979:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203702.531986:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788203702.532026:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6d80 x1875064728181888/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788203702.532053:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788203702.532056:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788203702.532057:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203702.532060:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2983 00000100:00080000:1.0:1788203702.532062:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203702.532065:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788203702.532074:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788203702.532087:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6300 x1875064728182016/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203702.532117:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728181888:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203702.532191:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203702.532245:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203702/real 1788203702] req@ffff8bc1727d6d80 x1875064728181888/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203727 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203702.532264:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6d80 x1875064728181888/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203727 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203702.532274:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203702.532278:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203702.532282:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728181888:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203702.532289:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728182016:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203702.532312:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203702.532325:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203702/real 1788203702] req@ffff8bc1727d6300 x1875064728182016/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203727 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203702.532336:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6300 x1875064728182016/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203727 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203702.532344:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203702.532347:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203702.532350:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728182016:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203703.363968:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203703.427938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203704.388026:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203704.451967:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203705.411992:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203705.475930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203706.436018:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203706.499938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203707.459951:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203707.523910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203707.651951:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203707.651961:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203707.651966:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203707.651976:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2989 00000100:00080000:2.0:1788203707.651988:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203707.651994:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203707.652041:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c000 x1875064728182144/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203707.652079:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203707.652083:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203707.652085:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203707.652090:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2989 00000100:00080000:2.0:1788203707.652093:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203707.652099:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203707.652111:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203707.652125:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728182144:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203707.652125:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f480 x1875064728182272/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203707.652229:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728182272:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203708.483958:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203708.547930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203709.507921:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203709.571932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203710.531920:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203710.595903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788203710.724031:0:10043:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788203710.724065:0:10043:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788203710.724077:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788203710.724108:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:0.0:1788203710.724150:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203707/real 1788203710] req@ffff8bc17257f480 x1875064728182272/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203732 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203710.724168:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f480 x1875064728182272/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203732 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203710.724192:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203710.724197:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203710.724201:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728182272:192.168.201.143@tcp:38:kworker.0 00000100:00100000:0.0:1788203710.724208:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203707/real 1788203710] req@ffff8bc17257c000 x1875064728182144/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203732 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203710.724221:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c000 x1875064728182144/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203732 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203710.724227:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203710.724230:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203710.724234:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728182144:192.168.201.143@tcp:250:kworker.0 00010000:00010000:2.0:1788203711.555924:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203711.619901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203712.579998:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203712.643906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203712.771930:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203712.771940:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203712.771944:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203712.771955:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2994 00000100:00080000:0.0:1788203712.771965:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203712.771972:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203712.772006:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140a80 x1875064728182400/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203712.772037:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203712.772041:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203712.772043:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203712.772047:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2994 00000100:00080000:0.0:1788203712.772051:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203712.772056:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203712.772068:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203712.772083:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142680 x1875064728182528/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203712.772088:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728182400:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203712.772169:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203712.772233:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203712/real 1788203712] req@ffff8bc144140a80 x1875064728182400/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203737 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203712.772254:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140a80 x1875064728182400/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203737 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203712.772265:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203712.772269:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203712.772273:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728182400:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203712.772303:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728182528:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203712.772326:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203712.772339:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203712/real 1788203712] req@ffff8bc144142680 x1875064728182528/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203737 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203712.772350:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142680 x1875064728182528/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203737 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203712.772358:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203712.772367:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203712.772370:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728182528:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203713.603995:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203713.668070:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203714.627984:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203714.691926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203715.651925:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203715.715893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203716.675962:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203716.739891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203717.699934:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203717.763862:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203717.891896:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203717.891906:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203717.891909:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203717.891919:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 2999 00000100:00080000:3.0:1788203717.891929:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203717.891937:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203717.891971:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728182656/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203717.891995:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203717.891999:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203717.892001:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203717.892005:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 2999 00000100:00080000:3.0:1788203717.892008:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203717.892013:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203717.892021:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203717.892024:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728182656:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788203717.892036:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728182784/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788203717.892079:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203717.892120:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203717/real 1788203717] req@ffff8bc1726cce00 x1875064728182656/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203742 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203717.892133:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728182656/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203742 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203717.892140:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203717.892143:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203717.892145:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728182656:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203717.892163:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728182784:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203717.892177:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203717.892184:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203717/real 1788203717] req@ffff8bc1726cdc00 x1875064728182784/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203742 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203717.892191:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728182784/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203742 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203717.892197:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203717.892198:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203717.892200:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728182784:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203718.723961:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203718.787908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203719.747918:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203719.811865:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203720.771933:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203720.835880:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203721.795905:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203721.859864:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203722.819956:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203722.883883:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203723.011861:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203723.011868:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203723.011871:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203723.011879:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3004 00000100:00080000:3.0:1788203723.011887:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203723.011893:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203723.011923:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728182912/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203723.011943:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203723.011945:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203723.011947:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203723.011949:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3004 00000100:00080000:3.0:1788203723.011951:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203723.011953:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203723.011961:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203723.011972:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728183040/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203723.011991:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728182912:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203723.012050:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203723.012096:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203723/real 1788203723] req@ffff8bc1726cdc00 x1875064728182912/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203723.012108:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728182912/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203723.012115:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203723.012118:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203723.012120:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728182912:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203723.012137:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728183040:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203723.012152:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203723.012160:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203723/real 1788203723] req@ffff8bc1726cce00 x1875064728183040/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203723.012178:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728183040/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203723.012184:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203723.012186:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203723.012187:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728183040:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203723.843958:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203723.907894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203724.867950:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203724.931882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203725.891946:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203725.955855:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203726.915954:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203726.979853:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203727.939952:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203728.003844:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788203728.131916:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788203728.131924:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788203728.131927:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203728.131935:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3009 00000100:00080000:1.0:1788203728.131944:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203728.131949:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788203728.131979:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4700 x1875064728183168/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788203728.132001:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788203728.132003:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788203728.132004:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203728.132007:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3009 00000100:00080000:1.0:1788203728.132009:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203728.132011:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788203728.132017:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788203728.132025:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5c00 x1875064728183296/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203728.132040:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728183168:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203728.132091:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203728.132128:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203728/real 1788203728] req@ffff8bc1727d4700 x1875064728183168/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203753 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203728.132140:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4700 x1875064728183168/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203753 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203728.132147:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203728.132150:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203728.132152:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728183168:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203728.132167:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728183296:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203728.132181:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203728.132187:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203728/real 1788203728] req@ffff8bc1727d5c00 x1875064728183296/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203753 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203728.132194:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5c00 x1875064728183296/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203753 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203728.132199:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203728.132200:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203728.132202:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728183296:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203728.963926:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203729.027925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203729.987944:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203730.051843:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203731.011914:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203731.075880:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203732.035944:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203732.099878:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203733.059983:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203733.123928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203733.251937:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203733.251950:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203733.251956:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203733.251969:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3014 00000100:00080000:0.0:1788203733.251984:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203733.251993:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203733.252044:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142d80 x1875064728183424/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203733.252082:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203733.252087:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203733.252089:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203733.252094:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3014 00000100:00080000:0.0:1788203733.252098:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203733.252103:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203733.252115:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203733.252128:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141180 x1875064728183552/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203733.252139:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728183424:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203733.252206:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203733.252281:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203733/real 1788203733] req@ffff8bc144142d80 x1875064728183424/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203758 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203733.252305:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142d80 x1875064728183424/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203758 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203733.252317:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203733.252322:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203733.252327:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728183424:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203733.252360:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728183552:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203733.252380:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203733.252390:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203733/real 1788203733] req@ffff8bc144141180 x1875064728183552/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203758 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203733.252400:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141180 x1875064728183552/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203758 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203733.252406:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203733.252408:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203733.252410:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728183552:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203734.083976:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203734.147930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203735.108017:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203735.171894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203736.131945:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203736.195891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203737.155988:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203737.219877:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203738.179971:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203738.243892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203738.371937:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203738.371952:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203738.371957:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203738.371971:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3019 00000100:00080000:0.0:1788203738.371986:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203738.371994:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203738.372047:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141180 x1875064728183680/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203738.372080:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203738.372083:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203738.372085:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203738.372088:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3019 00000100:00080000:0.0:1788203738.372092:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203738.372095:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203738.372107:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203738.372121:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142d80 x1875064728183808/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203738.372175:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728183680:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203738.372244:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203738.372298:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203738/real 1788203738] req@ffff8bc144141180 x1875064728183680/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203763 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203738.372313:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141180 x1875064728183680/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203763 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203738.372322:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203738.372325:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203738.372329:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728183680:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203738.372335:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728183808:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203738.372359:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203738.372371:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203738/real 1788203738] req@ffff8bc144142d80 x1875064728183808/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203763 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203738.372380:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142d80 x1875064728183808/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203763 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203738.372386:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203738.372388:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203738.372391:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728183808:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203739.203965:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203739.267926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203740.227976:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203740.291963:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203741.251945:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203741.315939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203742.275965:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203742.339930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203743.299985:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203743.363896:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203743.491916:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203743.491924:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203743.491928:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203743.491937:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3024 00000100:00080000:2.0:1788203743.491946:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203743.491951:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203743.491983:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f800 x1875064728183936/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203743.492011:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203743.492014:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203743.492016:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203743.492019:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3024 00000100:00080000:2.0:1788203743.492021:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203743.492023:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203743.492031:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203743.492054:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257dc00 x1875064728184064/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203743.492094:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728183936:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203743.492152:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203743.492205:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203743/real 1788203743] req@ffff8bc17257f800 x1875064728183936/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203768 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203743.492223:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f800 x1875064728183936/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203768 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203743.492231:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203743.492233:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203743.492236:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728183936:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203743.492242:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728184064:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203743.492257:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203743.492265:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203743/real 1788203743] req@ffff8bc17257dc00 x1875064728184064/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203768 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203743.492273:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257dc00 x1875064728184064/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203768 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203743.492283:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203743.492293:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203743.492296:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728184064:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203744.324006:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203744.387972:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203745.348032:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203745.411894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203746.371944:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203746.435898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203747.396026:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203747.459872:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203748.419971:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203748.483911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203748.611874:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203748.611883:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203748.611887:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203748.611895:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3029 00000100:00080000:2.0:1788203748.611904:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203748.611910:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203748.611944:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257dc00 x1875064728184192/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203748.611993:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203748.611996:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203748.611998:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203748.612004:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3029 00000100:00080000:2.0:1788203748.612007:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203748.612010:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203748.612018:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203748.612029:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f800 x1875064728184320/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203748.612047:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728184192:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203748.612116:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203748.612176:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203748/real 1788203748] req@ffff8bc17257dc00 x1875064728184192/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203773 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203748.612196:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257dc00 x1875064728184192/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203773 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203748.612208:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203748.612212:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203748.612217:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728184192:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203748.612243:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728184320:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203748.612268:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203748.612281:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203748/real 1788203748] req@ffff8bc17257f800 x1875064728184320/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203773 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203748.612296:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f800 x1875064728184320/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203773 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203748.612305:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203748.612309:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203748.612313:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728184320:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203749.444024:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203749.507929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203750.467961:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203750.531846:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203751.492011:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203751.555890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203752.515973:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203752.579929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203753.540013:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203753.603944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203753.731925:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203753.731936:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203753.731940:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203753.731958:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3035 00000100:00080000:0.0:1788203753.731968:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203753.731974:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203753.732005:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142680 x1875064728184448/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203753.732029:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203753.732032:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203753.732034:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203753.732036:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3035 00000100:00080000:0.0:1788203753.732039:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203753.732041:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203753.732049:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203753.732058:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140a80 x1875064728184576/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203753.732084:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728184448:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203753.732149:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203753.732211:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203753/real 1788203753] req@ffff8bc144142680 x1875064728184448/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203778 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203753.732231:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142680 x1875064728184448/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203778 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203753.732242:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203753.732246:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203753.732250:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728184448:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203753.732258:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728184576:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203753.732281:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203753.732304:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203753/real 1788203753] req@ffff8bc144140a80 x1875064728184576/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203778 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203753.732318:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140a80 x1875064728184576/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203778 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203753.732327:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203753.732330:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203753.732333:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728184576:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203754.564008:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203754.627956:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203755.587983:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203755.651968:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203756.611997:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203756.675937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203757.636054:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203757.699905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203758.659950:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203758.723891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203758.851922:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203758.851937:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203758.851943:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203758.851957:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3040 00000100:00080000:0.0:1788203758.851971:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203758.851981:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203758.852028:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140000 x1875064728184704/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203758.852057:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203758.852060:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203758.852061:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203758.852065:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3040 00000100:00080000:0.0:1788203758.852067:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203758.852070:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203758.852081:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203758.852096:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143100 x1875064728184832/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203758.852121:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728184704:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203758.852204:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203758.852280:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203758/real 1788203758] req@ffff8bc144140000 x1875064728184704/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203783 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203758.852303:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140000 x1875064728184704/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203783 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203758.852316:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203758.852321:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203758.852326:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728184704:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203758.852362:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728184832:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203758.852389:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203758.852404:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203758/real 1788203758] req@ffff8bc144143100 x1875064728184832/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203783 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203758.852427:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143100 x1875064728184832/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203783 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203758.852437:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203758.852441:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203758.852445:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728184832:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203759.683970:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203759.747974:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203760.707943:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203760.771883:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203761.732001:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203761.795938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203762.756030:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203762.819933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203763.779997:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203763.843934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203763.971941:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203763.971949:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203763.971952:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203763.971961:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3045 00000100:00080000:2.0:1788203763.971969:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203763.971975:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203763.972013:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c000 x1875064728184960/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203763.972046:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203763.972049:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203763.972051:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203763.972054:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3045 00000100:00080000:2.0:1788203763.972058:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203763.972062:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203763.972071:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203763.972083:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f480 x1875064728185088/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203763.972102:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728184960:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203763.972179:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203763.972252:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203763/real 1788203763] req@ffff8bc17257c000 x1875064728184960/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203788 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203763.972275:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c000 x1875064728184960/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203788 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203763.972289:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203763.972295:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203763.972300:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728184960:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203763.972329:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728185088:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203763.972350:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203763.972360:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203763/real 1788203763] req@ffff8bc17257f480 x1875064728185088/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203788 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203763.972370:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f480 x1875064728185088/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203788 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203763.972377:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203763.972379:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203763.972382:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728185088:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203764.804030:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203764.867955:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203765.827966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203765.891942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203766.851950:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203766.915861:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203767.875935:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203767.939908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203768.899993:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203768.963910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788203769.091927:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788203769.091935:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788203769.091939:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203769.091948:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3050 00000100:00080000:1.0:1788203769.091961:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203769.091967:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788203769.092000:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4e00 x1875064728185216/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788203769.092026:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788203769.092029:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788203769.092030:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203769.092033:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3050 00000100:00080000:1.0:1788203769.092035:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203769.092038:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788203769.092047:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788203769.092058:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6a00 x1875064728185344/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203769.092094:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728185216:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203769.092175:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203769.092253:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203769/real 1788203769] req@ffff8bc1727d4e00 x1875064728185216/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203769.092278:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4e00 x1875064728185216/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203769.092293:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203769.092299:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203769.092303:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728185216:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203769.092311:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728185344:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203769.092333:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203769.092343:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203769/real 1788203769] req@ffff8bc1727d6a00 x1875064728185344/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203769.092352:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6a00 x1875064728185344/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203769.092372:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203769.092375:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203769.092381:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728185344:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203769.923959:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203769.987908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203770.947971:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203771.011867:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203771.971979:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203772.035893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203772.995938:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203773.059856:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203774.019991:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203774.083908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203774.211910:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203774.211926:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203774.211932:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203774.211946:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3055 00000100:00080000:0.0:1788203774.211959:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203774.211967:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203774.212023:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143800 x1875064728185472/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203774.212050:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203774.212054:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203774.212055:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203774.212058:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3055 00000100:00080000:0.0:1788203774.212061:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203774.212063:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203774.212072:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203774.212081:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140380 x1875064728185600/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203774.212114:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728185472:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203774.212238:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728185600:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203775.043972:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203775.107963:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203776.067995:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203776.131905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203777.092003:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203777.155957:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:3.0:1788203777.284217:0:10040:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:3.0:1788203777.284268:0:10040:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:3.0:1788203777.284283:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:3.0:1788203777.284331:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788203777.284432:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203774/real 1788203777] req@ffff8bc144143800 x1875064728185472/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203799 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203777.284493:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143800 x1875064728185472/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203799 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203777.284507:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203777.284513:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203777.284517:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728185472:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203777.284527:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203774/real 1788203777] req@ffff8bc144140380 x1875064728185600/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203799 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203777.284541:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140380 x1875064728185600/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203799 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203777.284550:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203777.284554:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203777.284557:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728185600:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203778.115979:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203778.179887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203779.139969:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203779.203901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203779.332017:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203779.332029:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203779.332034:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203779.332045:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3060 00000100:00080000:0.0:1788203779.332058:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203779.332066:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203779.332106:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141f80 x1875064728185728/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203779.332141:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203779.332144:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203779.332146:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203779.332149:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3060 00000100:00080000:0.0:1788203779.332151:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203779.332154:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203779.332165:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203779.332181:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142300 x1875064728185856/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203779.332200:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728185728:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203779.332296:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203779.332376:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203779/real 1788203779] req@ffff8bc144141f80 x1875064728185728/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203804 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203779.332398:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141f80 x1875064728185728/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203804 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203779.332410:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203779.332448:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203779.332454:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728185728:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203779.332491:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728185856:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203779.332518:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203779.332533:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203779/real 1788203779] req@ffff8bc144142300 x1875064728185856/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203804 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203779.332545:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142300 x1875064728185856/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203804 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203779.332553:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203779.332557:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203779.332560:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728185856:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203780.163991:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203780.227928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203781.188030:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203781.251925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203782.211967:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203782.275989:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203783.235991:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203783.299966:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203784.260029:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203784.323938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203784.451949:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203784.451962:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203784.451967:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203784.451978:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3065 00000100:00080000:0.0:1788203784.451991:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203784.451998:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203784.452044:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143b80 x1875064728185984/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203784.452075:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203784.452078:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203784.452080:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203784.452083:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3065 00000100:00080000:0.0:1788203784.452085:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203784.452088:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203784.452098:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203784.452110:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141500 x1875064728186112/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203784.452144:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728185984:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203784.452225:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203784.452289:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203784/real 1788203784] req@ffff8bc144143b80 x1875064728185984/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203809 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203784.452310:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143b80 x1875064728185984/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203809 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203784.452322:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203784.452341:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203784.452346:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728185984:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203784.452356:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728186112:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203784.452384:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203784.452400:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203784/real 1788203784] req@ffff8bc144141500 x1875064728186112/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203809 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203784.452422:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141500 x1875064728186112/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203809 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203784.452432:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203784.452436:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203784.452439:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728186112:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203785.283970:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203785.347934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203786.308007:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203786.371949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203787.332016:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203787.395912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203788.356058:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203788.419881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203789.380029:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203789.443924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788203789.571924:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788203789.571935:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788203789.571940:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203789.571951:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3070 00000100:00080000:1.0:1788203789.571965:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203789.571975:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788203789.572027:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7800 x1875064728186240/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788203789.572056:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788203789.572059:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788203789.572060:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203789.572063:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3070 00000100:00080000:1.0:1788203789.572066:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203789.572069:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788203789.572078:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788203789.572090:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4a80 x1875064728186368/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203789.572153:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728186240:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203789.572235:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203789.572312:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203789/real 1788203789] req@ffff8bc1727d7800 x1875064728186240/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203814 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203789.572335:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7800 x1875064728186240/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203814 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203789.572347:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203789.572352:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203789.572357:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728186240:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203789.572366:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728186368:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203789.572394:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203789.572409:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203789/real 1788203789] req@ffff8bc1727d4a80 x1875064728186368/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203814 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203789.572425:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4a80 x1875064728186368/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203814 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203789.572435:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203789.572439:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203789.572443:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728186368:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203790.404032:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203790.467888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203791.427990:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203791.491844:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203792.452051:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203792.515839:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203793.475963:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203793.539842:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203794.500009:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203794.563862:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203794.691945:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203794.691954:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203794.691958:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203794.691967:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3076 00000100:00080000:2.0:1788203794.691975:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203794.691981:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203794.692015:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257df80 x1875064728186496/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203794.692044:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203794.692046:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203794.692048:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203794.692050:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3076 00000100:00080000:2.0:1788203794.692052:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203794.692055:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203794.692062:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203794.692070:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e680 x1875064728186624/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203794.692099:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728186496:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203794.692174:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203794.692216:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203794/real 1788203794] req@ffff8bc17257df80 x1875064728186496/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203819 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203794.692232:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257df80 x1875064728186496/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203819 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203794.692243:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203794.692247:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203794.692252:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728186496:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203794.692260:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728186624:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203794.692294:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203794.692312:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203794/real 1788203794] req@ffff8bc17257e680 x1875064728186624/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203819 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203794.692327:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e680 x1875064728186624/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203819 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203794.692336:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203794.692340:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203794.692344:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728186624:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203795.523964:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203795.587916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203796.548050:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203796.611844:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203797.571970:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203797.635901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203798.595982:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203798.659920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203799.619948:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203799.683892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203799.811966:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203799.811976:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203799.811980:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203799.811990:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3081 00000100:00080000:3.0:1788203799.812001:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203799.812008:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203799.812048:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728186752/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203799.812099:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203799.812102:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203799.812104:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203799.812107:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3081 00000100:00080000:3.0:1788203799.812110:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203799.812113:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203799.812123:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203799.812134:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728186880/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203799.812157:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728186752:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203799.812220:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203799.812265:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203799/real 1788203799] req@ffff8bc1726ce680 x1875064728186752/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203824 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203799.812280:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728186752/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203824 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203799.812288:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203799.812292:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203799.812297:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728186752:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203799.812306:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728186880:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203799.812346:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203799.812361:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203799/real 1788203799] req@ffff8bc1726cc380 x1875064728186880/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203824 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203799.812373:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728186880/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203824 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203799.812382:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203799.812385:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203799.812389:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728186880:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203800.644039:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203800.707967:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203801.667989:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203801.731931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203802.692032:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203802.755940:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203803.716027:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203803.779915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203804.739951:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203804.803886:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203804.931905:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203804.931919:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203804.931924:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203804.931936:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3086 00000100:00080000:3.0:1788203804.931950:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203804.931959:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203804.932031:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728187008/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203804.932063:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203804.932067:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203804.932069:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203804.932074:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3086 00000100:00080000:3.0:1788203804.932078:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203804.932083:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203804.932094:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203804.932105:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728187008:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788203804.932109:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728187136/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788203804.932173:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203804.932231:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203804/real 1788203804] req@ffff8bc1726cea00 x1875064728187008/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203829 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203804.932251:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728187008/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203829 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203804.932262:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203804.932275:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203804.932281:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728187008:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203804.932306:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728187136:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203804.932324:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203804.932334:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203804/real 1788203804] req@ffff8bc1726ce300 x1875064728187136/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203829 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203804.932346:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728187136/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203829 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203804.932360:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203804.932363:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203804.932366:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728187136:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203805.763990:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203805.827937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203806.787919:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203806.851931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203807.812094:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203807.875870:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203808.836003:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203808.899929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203809.860038:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203809.923958:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788203810.051952:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788203810.051961:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788203810.051965:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203810.051975:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3091 00000100:00080000:1.0:1788203810.051986:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203810.051993:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788203810.052032:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7100 x1875064728187264/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788203810.052056:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788203810.052058:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788203810.052060:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203810.052062:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3091 00000100:00080000:1.0:1788203810.052064:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203810.052067:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788203810.052075:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788203810.052085:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7b80 x1875064728187392/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203810.052107:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728187264:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203810.052168:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203810.052224:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203810/real 1788203810] req@ffff8bc1727d7100 x1875064728187264/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203810.052243:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7100 x1875064728187264/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203810.052253:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203810.052256:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203810.052259:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728187264:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203810.052282:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728187392:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203810.052299:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203810.052307:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203810/real 1788203810] req@ffff8bc1727d7b80 x1875064728187392/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203810.052315:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7b80 x1875064728187392/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203810.052320:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203810.052322:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203810.052324:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728187392:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203810.884002:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203810.948066:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203811.907998:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203811.971968:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203812.931981:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203812.995898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203813.956014:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203814.019961:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203814.979956:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203815.043906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203815.171936:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203815.171945:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203815.171949:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203815.171959:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3096 00000100:00080000:0.0:1788203815.171971:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203815.171977:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203815.172021:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143480 x1875064728187520/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203815.172047:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203815.172050:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203815.172052:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203815.172054:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3096 00000100:00080000:0.0:1788203815.172056:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203815.172058:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203815.172067:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203815.172075:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141880 x1875064728187648/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203815.172098:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728187520:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203815.172169:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203815.172239:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203815/real 1788203815] req@ffff8bc144143480 x1875064728187520/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203840 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203815.172260:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143480 x1875064728187520/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203840 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203815.172272:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203815.172276:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203815.172280:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728187520:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203815.172287:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728187648:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203815.172308:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203815.172321:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203815/real 1788203815] req@ffff8bc144141880 x1875064728187648/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203840 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203815.172333:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141880 x1875064728187648/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203840 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203815.172341:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203815.172344:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203815.172348:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728187648:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203816.003988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203816.068059:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203817.027961:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203817.091856:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203818.052020:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203818.115947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203819.075964:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203819.139926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203820.099999:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203820.164840:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203820.291956:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203820.291966:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203820.291970:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203820.291980:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3101 00000100:00080000:3.0:1788203820.291991:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203820.291998:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203820.292041:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728187776/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203820.292069:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203820.292073:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203820.292075:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203820.292079:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3101 00000100:00080000:3.0:1788203820.292082:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203820.292087:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203820.292098:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203820.292112:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728187904/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203820.292125:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728187776:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203820.292198:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203820.292274:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203820/real 1788203820] req@ffff8bc1726cfb80 x1875064728187776/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203845 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203820.292299:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728187776/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203845 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203820.292310:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203820.292313:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203820.292318:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728187776:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203820.292345:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728187904:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203820.292367:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203820.292380:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203820/real 1788203820] req@ffff8bc1726ced80 x1875064728187904/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203845 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203820.292393:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728187904/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203845 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203820.292400:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203820.292403:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203820.292407:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728187904:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203821.123943:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203821.187923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203822.147921:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203822.211931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203823.171964:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203823.235910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203824.195947:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203824.259903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203825.220007:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203825.283896:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203825.411913:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203825.411923:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203825.411927:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203825.411937:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3106 00000100:00080000:3.0:1788203825.411948:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203825.411955:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203825.411990:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728188032/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203825.412021:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203825.412025:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203825.412027:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203825.412031:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3106 00000100:00080000:3.0:1788203825.412034:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203825.412038:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203825.412047:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203825.412059:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728188160/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203825.412098:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728188032:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203825.412146:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203825.412187:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203825/real 1788203825] req@ffff8bc1726cca80 x1875064728188032/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203850 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203825.412200:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728188032/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203850 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203825.412208:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203825.412211:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203825.412213:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728188032:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203825.412219:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728188160:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203825.412234:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203825.412241:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203825/real 1788203825] req@ffff8bc1726cd500 x1875064728188160/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203850 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203825.412248:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728188160/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203850 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203825.412253:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203825.412255:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203825.412256:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728188160:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203826.244045:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203826.308019:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203827.268003:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203827.331868:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203828.291982:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203828.355876:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203829.315982:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203829.379893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203830.339995:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203830.403936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203830.531886:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203830.531895:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203830.531899:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203830.531909:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3111 00000100:00080000:3.0:1788203830.531917:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203830.531923:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203830.531958:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728188288/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203830.531984:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203830.531987:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203830.531997:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203830.532001:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3111 00000100:00080000:3.0:1788203830.532006:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203830.532011:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203830.532020:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203830.532033:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728188416/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203830.532043:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728188288:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203830.532104:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203830.532146:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203830/real 1788203830] req@ffff8bc1726cf480 x1875064728188288/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203855 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203830.532163:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728188288/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203855 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203830.532173:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203830.532177:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203830.532180:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728188288:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203830.532201:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728188416:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203830.532223:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203830.532236:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203830/real 1788203830] req@ffff8bc1726cf100 x1875064728188416/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203855 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203830.532247:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728188416/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203855 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203830.532256:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203830.532259:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203830.532263:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728188416:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203831.364018:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203831.428021:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203832.387963:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203832.451867:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203833.411996:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203833.475917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203834.435980:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203834.499885:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203835.459991:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203835.523918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203835.651882:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203835.651889:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203835.651893:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203835.651901:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3117 00000100:00080000:3.0:1788203835.651910:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203835.651918:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203835.651952:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728188544/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203835.651977:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203835.651979:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203835.651981:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203835.651984:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3117 00000100:00080000:3.0:1788203835.651986:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203835.651990:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203835.651998:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203835.652013:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728188672/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203835.652016:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728188544:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203835.652079:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203835.652119:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203835/real 1788203835] req@ffff8bc1726cc700 x1875064728188544/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203860 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203835.652137:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728188544/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203860 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203835.652148:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203835.652151:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203835.652155:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728188544:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203835.652189:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728188672:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203835.652207:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203835.652216:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203835/real 1788203835] req@ffff8bc1726cd180 x1875064728188672/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203860 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203835.652228:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728188672/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203860 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203835.652234:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203835.652236:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203835.652238:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728188672:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203836.483895:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203836.547911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203837.507995:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203837.571915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203838.531966:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203838.595885:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203839.555997:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203839.619922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203840.580033:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203840.643931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203840.771919:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203840.771933:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203840.771939:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203840.771951:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3122 00000100:00080000:3.0:1788203840.771964:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203840.771973:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203840.772013:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728188800/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203840.772038:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203840.772041:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203840.772043:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203840.772045:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3122 00000100:00080000:3.0:1788203840.772048:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203840.772051:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203840.772059:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203840.772068:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728188928/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203840.772085:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728188800:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203840.772190:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728188928:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203841.603981:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203841.667948:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203842.627976:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203842.691885:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203843.651973:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203843.715885:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:3.0:1788203843.844055:0:10041:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:3.0:1788203843.844100:0:10041:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:3.0:1788203843.844115:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:3.0:1788203843.844154:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788203843.844210:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203840/real 1788203843] req@ffff8bc1726cdf80 x1875064728188928/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203865 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203843.844236:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728188928/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203865 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203843.844248:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203843.844254:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203843.844259:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728188928:192.168.201.143@tcp:38:kworker.0 00000100:00100000:2.0:1788203843.844268:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203840/real 1788203843] req@ffff8bc1726cf800 x1875064728188800/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203865 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203843.844281:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728188800/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203865 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203843.844291:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203843.844307:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203843.844311:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728188800:192.168.201.143@tcp:250:kworker.0 00010000:00010000:2.0:1788203844.676012:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203844.739888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203845.699955:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203845.763881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203845.891880:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203845.891888:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203845.891891:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203845.891899:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3127 00000100:00080000:0.0:1788203845.891907:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203845.891912:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203845.891936:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142a00 x1875064728189056/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203845.891956:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203845.891958:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203845.891959:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203845.891962:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3127 00000100:00080000:0.0:1788203845.891964:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203845.891966:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203845.891972:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203845.891980:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140e00 x1875064728189184/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203845.891998:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728189056:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203845.892066:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203845.892103:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203845/real 1788203845] req@ffff8bc144142a00 x1875064728189056/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203870 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203845.892118:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142a00 x1875064728189056/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203870 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203845.892128:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203845.892131:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203845.892135:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728189056:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203845.892142:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728189184:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203845.892165:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203845.892179:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203845/real 1788203845] req@ffff8bc144140e00 x1875064728189184/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203870 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203845.892197:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140e00 x1875064728189184/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203870 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203845.892205:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203845.892207:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203845.892211:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728189184:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203846.724008:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203846.787935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203847.748031:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203847.811907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203848.771985:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203848.835956:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203849.796018:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203849.859925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203850.819993:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203850.883950:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203851.011909:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203851.011919:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203851.011923:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203851.011934:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3132 00000100:00080000:0.0:1788203851.011945:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203851.011952:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203851.011992:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140700 x1875064728189312/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203851.012019:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203851.012022:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203851.012023:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203851.012026:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3132 00000100:00080000:0.0:1788203851.012028:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203851.012030:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203851.012039:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203851.012048:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141c00 x1875064728189440/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203851.012069:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728189312:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203851.012134:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203851.012216:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203851/real 1788203851] req@ffff8bc144140700 x1875064728189312/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203851.012231:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140700 x1875064728189312/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203851.012239:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203851.012242:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203851.012245:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728189312:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203851.012250:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728189440:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203851.012268:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203851.012276:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203851/real 1788203851] req@ffff8bc144141c00 x1875064728189440/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203851.012283:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141c00 x1875064728189440/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203851.012288:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203851.012290:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203851.012292:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728189440:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203851.843973:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203851.907924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203852.868003:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203852.931940:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203853.891970:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203853.955888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203854.915955:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203854.979916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203855.939932:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203856.003876:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203856.131921:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203856.131932:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203856.131935:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203856.131945:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3137 00000100:00080000:2.0:1788203856.131956:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203856.131963:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203856.131999:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ed80 x1875064728189568/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203856.132025:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203856.132029:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203856.132030:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203856.132034:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3137 00000100:00080000:2.0:1788203856.132040:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203856.132044:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203856.132052:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203856.132055:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728189568:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203856.132067:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d880 x1875064728189696/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788203856.132120:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203856.132156:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203856/real 1788203856] req@ffff8bc17257ed80 x1875064728189568/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203881 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203856.132168:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ed80 x1875064728189568/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203881 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203856.132174:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203856.132177:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203856.132179:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728189568:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203856.132199:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728189696:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203856.132212:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203856.132219:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203856/real 1788203856] req@ffff8bc17257d880 x1875064728189696/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203881 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203856.132227:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d880 x1875064728189696/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203881 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203856.132232:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203856.132233:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203856.132235:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728189696:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203856.963956:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203857.027921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203857.987965:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203858.051847:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203859.011958:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203859.075865:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203860.035962:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203860.099877:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203861.059931:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203861.123950:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203861.251895:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203861.251903:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203861.251906:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203861.251914:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3142 00000100:00080000:3.0:1788203861.251928:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203861.251933:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203861.251963:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728189824/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203861.251984:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203861.251986:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203861.251987:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203861.251990:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3142 00000100:00080000:3.0:1788203861.252002:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203861.252006:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203861.252013:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203861.252024:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728189952/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203861.252036:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728189824:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203861.252087:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203861.252122:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203861/real 1788203861] req@ffff8bc1726cf800 x1875064728189824/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203886 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203861.252137:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728189824/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203886 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203861.252146:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203861.252150:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203861.252154:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728189824:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203861.252177:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728189952:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203861.252199:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203861.252212:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203861/real 1788203861] req@ffff8bc1726cdf80 x1875064728189952/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203886 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203861.252230:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728189952/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203886 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203861.252238:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203861.252242:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203861.252245:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728189952:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203862.083942:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203862.147891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203863.107973:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203863.171862:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203864.131984:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203864.195927:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203865.155902:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203865.219894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203866.179981:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203866.243860:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203866.371931:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203866.371939:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203866.371942:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203866.371950:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3147 00000100:00080000:0.0:1788203866.371958:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203866.371964:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203866.371994:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141c00 x1875064728190080/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203866.372016:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203866.372019:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203866.372020:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203866.372022:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3147 00000100:00080000:0.0:1788203866.372024:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203866.372026:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203866.372033:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203866.372041:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140700 x1875064728190208/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203866.372058:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728190080:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203866.372107:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203866.372150:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203866/real 1788203866] req@ffff8bc144141c00 x1875064728190080/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203891 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203866.372163:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141c00 x1875064728190080/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203891 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203866.372169:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203866.372172:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203866.372174:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728190080:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203866.372193:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728190208:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203866.372205:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203866.372213:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203866/real 1788203866] req@ffff8bc144140700 x1875064728190208/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203891 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203866.372219:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140700 x1875064728190208/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203891 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203866.372224:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203866.372226:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203866.372227:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728190208:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203867.203961:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203867.267868:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203868.228056:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203868.291897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203869.251996:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203869.315922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203870.276010:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203870.339905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203871.300007:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203871.363912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203871.491884:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203871.491891:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203871.491894:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203871.491903:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3152 00000100:00080000:3.0:1788203871.491912:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203871.491917:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203871.491944:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728190336/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203871.491968:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203871.491970:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203871.491972:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203871.491975:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3152 00000100:00080000:3.0:1788203871.491976:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203871.491978:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203871.491985:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203871.492001:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728190464/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203871.492005:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728190336:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203871.492067:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203871.492110:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203871/real 1788203871] req@ffff8bc1726cd180 x1875064728190336/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203896 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203871.492129:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728190336/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203896 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203871.492139:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203871.492144:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203871.492147:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728190336:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203871.492172:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728190464:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203871.492195:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203871.492206:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203871/real 1788203871] req@ffff8bc1726cc700 x1875064728190464/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203896 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203871.492214:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728190464/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203896 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203871.492230:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203871.492234:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203871.492237:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728190464:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203872.324040:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203872.387936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203873.347989:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203873.411889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203874.372031:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203874.435903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203875.395921:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203875.459942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203876.419988:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203876.483929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203876.611896:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203876.611906:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203876.611910:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203876.611920:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3157 00000100:00080000:0.0:1788203876.611932:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203876.611938:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203876.611983:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140e00 x1875064728190592/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203876.612007:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203876.612009:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203876.612011:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203876.612013:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3157 00000100:00080000:0.0:1788203876.612015:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203876.612018:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203876.612026:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203876.612037:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142a00 x1875064728190720/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203876.612059:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728190592:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203876.612133:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203876.612192:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203876/real 1788203876] req@ffff8bc144140e00 x1875064728190592/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203901 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203876.612213:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140e00 x1875064728190592/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203901 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203876.612221:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203876.612224:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203876.612227:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728190592:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203876.612233:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728190720:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203876.612250:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203876.612258:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203876/real 1788203876] req@ffff8bc144142a00 x1875064728190720/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203901 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203876.612265:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142a00 x1875064728190720/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203901 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203876.612271:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203876.612272:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203876.612274:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728190720:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203877.443957:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203877.507953:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203878.467988:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203878.531924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203879.492021:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203879.555931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203880.516035:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203880.579965:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203881.540015:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203881.603938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203881.731897:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203881.731912:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203881.731918:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203881.731931:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3163 00000100:00080000:2.0:1788203881.731943:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203881.731952:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203881.731992:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ce00 x1875064728190848/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203881.732026:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203881.732031:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203881.732034:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203881.732040:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3163 00000100:00080000:2.0:1788203881.732044:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203881.732047:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203881.732058:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203881.732065:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728190848:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203881.732082:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ea00 x1875064728190976/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788203881.732133:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203881.732190:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203881/real 1788203881] req@ffff8bc17257ce00 x1875064728190848/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203906 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203881.732206:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ce00 x1875064728190848/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203906 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203881.732216:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203881.732221:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203881.732225:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728190848:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203881.732254:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728190976:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203881.732279:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203881.732293:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203881/real 1788203881] req@ffff8bc17257ea00 x1875064728190976/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203906 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203881.732304:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ea00 x1875064728190976/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203906 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203881.732311:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203881.732314:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203881.732316:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728190976:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203882.563928:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203882.627990:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203883.588015:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203883.651942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203884.611923:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203884.675940:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203885.635990:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203885.699885:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203886.659969:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203886.723912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203886.851926:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203886.851936:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203886.851940:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203886.851951:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3168 00000100:00080000:0.0:1788203886.851962:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203886.851968:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203886.852008:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141880 x1875064728191104/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203886.852033:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203886.852036:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203886.852037:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203886.852041:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3168 00000100:00080000:0.0:1788203886.852043:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203886.852054:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203886.852065:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203886.852070:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728191104:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203886.852078:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143480 x1875064728191232/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788203886.852136:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203886.852193:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203886/real 1788203886] req@ffff8bc144141880 x1875064728191104/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203911 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203886.852210:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141880 x1875064728191104/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203911 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203886.852220:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203886.852228:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203886.852231:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728191104:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203886.852261:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728191232:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203886.852284:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203886.852299:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203886/real 1788203886] req@ffff8bc144143480 x1875064728191232/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203911 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203886.852313:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143480 x1875064728191232/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203911 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203886.852323:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203886.852327:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203886.852331:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728191232:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203887.683971:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203887.747950:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203888.708003:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203888.771938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203889.731992:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203889.795954:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203890.755988:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203890.819902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203891.779994:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203891.843910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203891.972003:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203891.972015:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203891.972020:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203891.972033:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3173 00000100:00080000:0.0:1788203891.972045:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203891.972055:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203891.972100:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141500 x1875064728191360/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203891.972126:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203891.972129:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203891.972130:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203891.972133:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3173 00000100:00080000:0.0:1788203891.972136:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203891.972139:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203891.972148:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203891.972158:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143b80 x1875064728191488/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203891.972184:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728191360:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203891.972255:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203891.972314:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203891/real 1788203891] req@ffff8bc144141500 x1875064728191360/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203916 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203891.972349:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141500 x1875064728191360/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203916 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203891.972359:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203891.972362:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203891.972365:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728191360:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203891.972395:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728191488:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203891.972415:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203891.972425:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203891/real 1788203891] req@ffff8bc144143b80 x1875064728191488/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203916 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203891.972435:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143b80 x1875064728191488/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203916 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203891.972444:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203891.972448:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203891.972452:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728191488:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203892.804001:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203892.867948:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203893.828008:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203893.891931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203894.851969:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203894.915899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203895.875994:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203895.939942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203896.899973:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203896.963869:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203897.091863:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203897.091871:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203897.091875:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203897.091883:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3178 00000100:00080000:0.0:1788203897.091892:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203897.091898:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203897.091930:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142300 x1875064728191616/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203897.091953:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203897.091956:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203897.091957:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203897.091960:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3178 00000100:00080000:0.0:1788203897.091963:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203897.091966:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203897.091973:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203897.091983:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141f80 x1875064728191744/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203897.092005:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728191616:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203897.092060:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203897.092109:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203897/real 1788203897] req@ffff8bc144142300 x1875064728191616/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203897.092124:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142300 x1875064728191616/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203897.092132:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203897.092135:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203897.092138:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728191616:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203897.092143:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728191744:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203897.092163:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203897.092172:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203897/real 1788203897] req@ffff8bc144141f80 x1875064728191744/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203897.092181:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141f80 x1875064728191744/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203897.092187:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203897.092189:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203897.092191:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728191744:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203897.923971:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203897.987941:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203898.948043:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203899.011917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203899.971948:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203900.035922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203900.995999:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203901.059897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203902.019936:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203902.083877:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203902.211893:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203902.211905:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203902.211909:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203902.211920:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3183 00000100:00080000:0.0:1788203902.211931:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203902.211938:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203902.211975:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140380 x1875064728191872/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203902.212002:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203902.212005:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203902.212007:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203902.212010:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3183 00000100:00080000:0.0:1788203902.212013:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203902.212016:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203902.212023:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203902.212032:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143800 x1875064728192000/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203902.212065:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728191872:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203902.212121:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203902.212161:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203902/real 1788203902] req@ffff8bc144140380 x1875064728191872/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203927 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203902.212175:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140380 x1875064728191872/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203927 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203902.212183:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203902.212185:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203902.212188:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728191872:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203902.212194:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728192000:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203902.212208:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203902.212215:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203902/real 1788203902] req@ffff8bc144143800 x1875064728192000/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203927 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203902.212229:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143800 x1875064728192000/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203927 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203902.212235:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203902.212237:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203902.212239:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728192000:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203903.044011:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203903.107934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203904.067990:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203904.131921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203905.091933:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203905.155898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203906.115991:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203906.179881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203907.140002:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203907.203885:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203907.331960:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203907.331971:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203907.331977:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203907.331991:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3188 00000100:00080000:0.0:1788203907.332003:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203907.332011:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203907.332057:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143100 x1875064728192128/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203907.332084:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203907.332087:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203907.332089:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203907.332092:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3188 00000100:00080000:0.0:1788203907.332095:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203907.332098:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203907.332108:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203907.332117:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728192128:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203907.332120:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140000 x1875064728192256/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203907.332273:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728192256:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203908.163975:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203908.227932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203909.187966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203909.251912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203910.212002:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203910.275900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788203910.404155:0:10042:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788203910.404211:0:10042:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788203910.404237:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788203910.404291:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788203910.404359:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203907/real 1788203910] req@ffff8bc144140000 x1875064728192256/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203932 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203910.404411:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140000 x1875064728192256/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203932 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203910.404429:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203910.404438:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203910.404443:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728192256:192.168.201.143@tcp:38:kworker.0 00000100:00100000:2.0:1788203910.404452:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203907/real 1788203910] req@ffff8bc144143100 x1875064728192128/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203932 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203910.404466:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143100 x1875064728192128/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203932 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203910.404476:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203910.404479:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203910.404483:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728192128:192.168.201.143@tcp:250:kworker.0 00010000:00010000:3.0:1788203911.236013:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203911.299925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203912.259947:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203912.323887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788203912.451978:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788203912.451994:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788203912.451998:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203912.452010:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3193 00000100:00080000:1.0:1788203912.452022:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203912.452029:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788203912.452071:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7b80 x1875064728192384/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788203912.452128:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788203912.452134:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788203912.452137:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203912.452143:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3193 00000100:00080000:1.0:1788203912.452148:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203912.452154:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788203912.452167:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203912.452170:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728192384:192.168.201.143@tcp:250:kworker.0 00000100:00100000:1.0:1788203912.452186:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7100 x1875064728192512/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788203912.452259:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203912.452355:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203912/real 1788203912] req@ffff8bc1727d7b80 x1875064728192384/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203937 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203912.452383:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7b80 x1875064728192384/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203937 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203912.452395:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203912.452401:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203912.452407:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728192384:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203912.452444:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728192512:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203912.452474:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203912.452506:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203912/real 1788203912] req@ffff8bc1727d7100 x1875064728192512/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203937 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203912.452520:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7100 x1875064728192512/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203937 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203912.452528:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203912.452532:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203912.452536:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728192512:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203913.284004:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203913.347939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203914.307944:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203914.371942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203915.331962:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203915.395937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203916.356030:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203916.419935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203917.379954:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788203917.443922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788203917.571887:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788203917.571895:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788203917.571899:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203917.571923:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3198 00000100:00080000:1.0:1788203917.571931:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203917.571938:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788203917.571973:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4a80 x1875064728192640/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788203917.571996:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788203917.572000:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788203917.572002:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788203917.572005:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3198 00000100:00080000:1.0:1788203917.572008:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788203917.572012:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788203917.572034:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203917.572046:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728192640:192.168.201.143@tcp:250:kworker.0 00000100:00100000:1.0:1788203917.572049:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7800 x1875064728192768/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788203917.572115:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203917.572155:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203917/real 1788203917] req@ffff8bc1727d4a80 x1875064728192640/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203942 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203917.572175:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4a80 x1875064728192640/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203942 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203917.572184:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203917.572187:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203917.572190:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728192640:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203917.572208:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728192768:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203917.572224:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203917.572232:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203917/real 1788203917] req@ffff8bc1727d7800 x1875064728192768/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203942 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203917.572240:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7800 x1875064728192768/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203942 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203917.572246:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203917.572248:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203917.572249:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728192768:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203918.403971:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203918.467947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203919.427977:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203919.491894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203920.452063:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203920.515839:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203921.476018:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203921.539974:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203922.500104:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203922.563891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203922.691984:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203922.691995:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203922.692000:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203922.692011:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3204 00000100:00080000:0.0:1788203922.692023:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203922.692031:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203922.692078:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140a80 x1875064728192896/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203922.692108:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203922.692111:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203922.692113:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203922.692116:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3204 00000100:00080000:0.0:1788203922.692119:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203922.692122:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203922.692132:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203922.692145:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142680 x1875064728193024/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203922.692158:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728192896:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203922.692247:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203922.692309:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203922/real 1788203922] req@ffff8bc144140a80 x1875064728192896/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203947 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203922.692326:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140a80 x1875064728192896/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203947 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203922.692335:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203922.692339:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203922.692342:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728192896:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203922.692380:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728193024:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203922.692398:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203922.692408:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203922/real 1788203922] req@ffff8bc144142680 x1875064728193024/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203947 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203922.692417:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142680 x1875064728193024/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203947 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203922.692424:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203922.692426:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203922.692429:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728193024:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203923.524017:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203923.587938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203924.548044:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203924.611910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203925.571918:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203925.635863:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203926.596042:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203926.659893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203927.619989:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203927.683926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203927.812038:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203927.812052:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203927.812059:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203927.812074:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3209 00000100:00080000:0.0:1788203927.812089:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203927.812099:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203927.812149:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142d80 x1875064728193152/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203927.812181:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203927.812186:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203927.812188:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203927.812193:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3209 00000100:00080000:0.0:1788203927.812198:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203927.812203:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203927.812216:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203927.812234:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728193152:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203927.812235:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141180 x1875064728193280/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788203927.812320:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203927.812398:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203927/real 1788203927] req@ffff8bc144142d80 x1875064728193152/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203952 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203927.812431:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142d80 x1875064728193152/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203952 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203927.812444:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203927.812449:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203927.812454:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728193152:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203927.812481:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728193280:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203927.812507:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203927.812521:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203927/real 1788203927] req@ffff8bc144141180 x1875064728193280/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203952 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203927.812535:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141180 x1875064728193280/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203952 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203927.812544:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203927.812549:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203927.812553:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728193280:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203928.644038:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203928.707930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203929.667967:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203929.731864:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203930.691973:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203930.755954:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203931.715981:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203931.779891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203932.739993:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203932.803895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203932.931895:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203932.931910:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203932.931916:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203932.931930:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3214 00000100:00080000:0.0:1788203932.931945:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203932.931955:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203932.932026:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141180 x1875064728193408/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203932.932063:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203932.932068:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203932.932070:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203932.932075:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3214 00000100:00080000:0.0:1788203932.932079:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203932.932085:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203932.932096:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203932.932114:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142d80 x1875064728193536/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203932.932151:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728193408:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203932.932220:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203932.932289:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203932/real 1788203932] req@ffff8bc144141180 x1875064728193408/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203957 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203932.932312:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141180 x1875064728193408/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203957 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203932.932326:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203932.932331:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203932.932336:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728193408:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203932.932345:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728193536:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203932.932374:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203932.932390:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203932/real 1788203932] req@ffff8bc144142d80 x1875064728193536/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203957 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203932.932404:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142d80 x1875064728193536/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203957 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203932.932415:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203932.932419:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203932.932423:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728193536:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203933.764019:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203933.827960:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203934.788009:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203934.851880:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203935.812002:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203935.875965:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203936.835972:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203936.899947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203937.860048:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203937.923987:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203938.051953:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203938.051965:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203938.051969:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203938.051980:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3219 00000100:00080000:0.0:1788203938.051993:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203938.052000:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203938.052045:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142680 x1875064728193664/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203938.052076:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203938.052081:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203938.052083:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203938.052087:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3219 00000100:00080000:0.0:1788203938.052091:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203938.052096:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203938.052107:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203938.052124:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140a80 x1875064728193792/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203938.052134:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728193664:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203938.052202:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203938.052251:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203938/real 1788203938] req@ffff8bc144142680 x1875064728193664/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203938.052267:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142680 x1875064728193664/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203938.052276:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203938.052279:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203938.052282:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728193664:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203938.052306:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728193792:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203938.052333:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203938.052341:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203938/real 1788203938] req@ffff8bc144140a80 x1875064728193792/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203938.052350:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140a80 x1875064728193792/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203938.052356:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203938.052359:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203938.052361:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728193792:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203938.883971:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203938.947957:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203939.908032:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203939.971915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203940.931992:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203940.995945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203941.956000:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203942.019874:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203942.979989:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203943.043942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203943.171935:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203943.171950:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203943.171955:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203943.171967:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3224 00000100:00080000:3.0:1788203943.171979:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203943.171987:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203943.172030:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728193920/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203943.172057:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203943.172060:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203943.172065:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203943.172069:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3224 00000100:00080000:3.0:1788203943.172072:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203943.172075:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203943.172085:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203943.172096:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728194048/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203943.172118:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728193920:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203943.172204:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203943.172261:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203943/real 1788203943] req@ffff8bc1726cf100 x1875064728193920/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203968 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203943.172283:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728193920/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203968 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203943.172296:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203943.172301:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203943.172306:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728193920:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203943.172336:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728194048:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203943.172360:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203943.172373:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203943/real 1788203943] req@ffff8bc1726cf480 x1875064728194048/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203968 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203943.172387:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728194048/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203968 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203943.172396:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203943.172399:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203943.172403:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728194048:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203944.004012:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203944.067938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203945.027976:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203945.091971:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203946.052013:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203946.115917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203947.075989:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203947.140012:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203948.100000:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203948.163944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203948.291917:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203948.291929:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203948.291934:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203948.291945:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3229 00000100:00080000:2.0:1788203948.291957:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203948.291965:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203948.292020:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ca80 x1875064728194176/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203948.292060:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203948.292064:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203948.292066:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203948.292070:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3229 00000100:00080000:2.0:1788203948.292073:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203948.292076:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203948.292086:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203948.292098:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257fb80 x1875064728194304/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203948.292151:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728194176:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203948.292255:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203948.292338:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203948/real 1788203948] req@ffff8bc17257ca80 x1875064728194176/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203973 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203948.292361:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ca80 x1875064728194176/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203973 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203948.292385:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203948.292391:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203948.292396:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728194176:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203948.292405:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728194304:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203948.292432:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203948.292446:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203948/real 1788203948] req@ffff8bc17257fb80 x1875064728194304/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203973 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203948.292460:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257fb80 x1875064728194304/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203973 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203948.292470:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203948.292473:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203948.292477:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728194304:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203949.123992:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203949.187952:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203950.148137:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203950.211993:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203951.171951:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203951.236005:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203952.195982:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203952.259968:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203953.219951:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203953.283916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203953.411939:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203953.411950:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203953.411955:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203953.411966:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3234 00000100:00080000:3.0:1788203953.411977:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203953.411985:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203953.412023:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728194432/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203953.412053:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203953.412057:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203953.412059:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203953.412063:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3234 00000100:00080000:3.0:1788203953.412067:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203953.412071:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203953.412080:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203953.412093:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728194560/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203953.412109:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728194432:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203953.412174:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203953.412220:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203953/real 1788203953] req@ffff8bc1726cd500 x1875064728194432/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203978 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203953.412244:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728194432/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203978 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203953.412255:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203953.412259:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203953.412263:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728194432:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203953.412286:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728194560:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203953.412307:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203953.412320:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203953/real 1788203953] req@ffff8bc1726cca80 x1875064728194560/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203978 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203953.412333:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728194560/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203978 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203953.412341:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203953.412344:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203953.412348:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728194560:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203954.243934:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203954.307899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203955.268014:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203955.331944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203956.291968:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203956.355939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203957.315984:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203957.379907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203958.339927:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203958.403893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203958.531849:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203958.531862:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203958.531865:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203958.531875:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3239 00000100:00080000:3.0:1788203958.531883:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203958.531895:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203958.531926:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728194688/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203958.531949:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203958.531952:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203958.531953:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203958.531956:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3239 00000100:00080000:3.0:1788203958.531959:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203958.531961:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203958.531969:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203958.531977:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728194816/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203958.532008:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728194688:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203958.532070:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203958.532115:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203958/real 1788203958] req@ffff8bc1726ced80 x1875064728194688/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203983 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203958.532132:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728194688/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203983 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203958.532143:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203958.532147:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203958.532151:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728194688:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203958.532158:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728194816:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203958.532177:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203958.532188:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203958/real 1788203958] req@ffff8bc1726cfb80 x1875064728194816/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203983 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203958.532201:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728194816/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203983 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203958.532209:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203958.532212:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203958.532215:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728194816:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203959.364009:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203959.427905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203960.388008:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203960.451971:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203961.412019:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203961.475908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203962.435955:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203962.499964:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203963.459950:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203963.523888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203963.651914:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203963.651924:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203963.651927:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203963.651936:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3245 00000100:00080000:2.0:1788203963.651945:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203963.651952:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203963.651983:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c380 x1875064728194944/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203963.652005:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203963.652008:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203963.652009:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203963.652012:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3245 00000100:00080000:2.0:1788203963.652014:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203963.652017:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203963.652024:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203963.652034:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e300 x1875064728195072/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203963.652052:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728194944:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203963.652108:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203963.652154:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203963/real 1788203963] req@ffff8bc17257c380 x1875064728194944/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203988 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203963.652175:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c380 x1875064728194944/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203988 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203963.652186:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203963.652190:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203963.652194:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728194944:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203963.652238:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728195072:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203963.652258:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203963.652267:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203963/real 1788203963] req@ffff8bc17257e300 x1875064728195072/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203988 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203963.652276:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e300 x1875064728195072/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203988 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203963.652282:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203963.652284:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203963.652287:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728195072:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203964.483958:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203964.547922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203965.507971:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203965.571866:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203966.531932:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203966.595861:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203967.555978:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203967.619911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203968.579969:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203968.643866:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203968.771899:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203968.771908:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203968.771911:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203968.771920:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3250 00000100:00080000:2.0:1788203968.771929:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203968.771935:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203968.771964:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d500 x1875064728195200/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203968.771998:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203968.772002:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203968.772004:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203968.772008:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3250 00000100:00080000:2.0:1788203968.772012:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203968.772017:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203968.772026:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203968.772042:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f100 x1875064728195328/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203968.772060:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728195200:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203968.772120:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203968.772182:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203968/real 1788203968] req@ffff8bc17257d500 x1875064728195200/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203993 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203968.772198:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d500 x1875064728195200/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203993 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203968.772211:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203968.772214:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203968.772217:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728195200:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203968.772238:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728195328:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203968.772256:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203968.772265:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203968/real 1788203968] req@ffff8bc17257f100 x1875064728195328/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203993 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203968.772273:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f100 x1875064728195328/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203993 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203968.772279:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203968.772281:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203968.772283:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728195328:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203969.603986:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203969.667986:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203970.627934:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203970.691863:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203971.651993:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203971.715924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203972.675943:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203972.739871:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203973.700002:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788203973.763945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203973.891905:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203973.891916:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203973.891929:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203973.891940:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3255 00000100:00080000:2.0:1788203973.891952:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203973.891960:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203973.892003:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c700 x1875064728195456/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203973.892030:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203973.892033:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203973.892034:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203973.892060:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3255 00000100:00080000:2.0:1788203973.892065:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203973.892068:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203973.892079:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203973.892093:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d180 x1875064728195584/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203973.892114:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728195456:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203973.892284:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728195584:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203974.724002:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203974.788006:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203975.747940:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203975.811928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203976.772007:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203976.835899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788203976.964216:0:10043:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788203976.964279:0:10043:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788203976.964302:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788203976.964368:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:0.0:1788203976.964499:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203973/real 1788203976] req@ffff8bc17257d180 x1875064728195584/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203998 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203976.964535:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d180 x1875064728195584/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788203998 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203976.964551:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203976.964560:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203976.964568:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728195584:192.168.201.143@tcp:38:kworker.0 00000100:00100000:0.0:1788203976.964578:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203973/real 1788203976] req@ffff8bc17257c700 x1875064728195456/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203998 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203976.964595:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c700 x1875064728195456/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788203998 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203976.964603:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203976.964608:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203976.964612:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728195456:192.168.201.143@tcp:250:kworker.0 00010000:00010000:2.0:1788203977.795926:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203977.859937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203978.820052:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203978.883905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203979.011974:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203979.011986:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203979.011991:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203979.012004:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3260 00000100:00080000:3.0:1788203979.012016:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203979.012024:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203979.012064:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728195712/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203979.012094:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203979.012099:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203979.012101:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203979.012105:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3260 00000100:00080000:3.0:1788203979.012109:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203979.012114:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203979.012125:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203979.012142:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728195712:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788203979.012143:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728195840/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788203979.012226:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203979.012279:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203979/real 1788203979] req@ffff8bc1726ce300 x1875064728195712/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203979.012300:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728195712/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203979.012316:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203979.012321:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203979.012325:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728195712:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203979.012356:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728195840:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203979.012381:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203979.012394:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203979/real 1788203979] req@ffff8bc1726cea00 x1875064728195840/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203979.012413:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728195840/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203979.012421:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203979.012424:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203979.012428:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728195840:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203979.843963:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203979.907923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203980.867971:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203980.931877:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203981.891965:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203981.955957:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203982.916028:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203982.979955:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203983.939959:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203984.003885:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788203984.131949:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788203984.131963:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788203984.131968:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203984.131982:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3265 00000100:00080000:3.0:1788203984.131996:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203984.132006:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788203984.132054:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728195968/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788203984.132085:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788203984.132090:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788203984.132092:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788203984.132097:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3265 00000100:00080000:3.0:1788203984.132100:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788203984.132105:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788203984.132116:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788203984.132130:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728196096/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203984.132149:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728195968:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203984.132233:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203984.132290:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203984/real 1788203984] req@ffff8bc1726cc380 x1875064728195968/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204009 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203984.132311:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728195968/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204009 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203984.132324:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203984.132329:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203984.132334:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728195968:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203984.132366:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728196096:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203984.132387:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203984.132396:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203984/real 1788203984] req@ffff8bc1726ce680 x1875064728196096/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204009 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203984.132405:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728196096/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204009 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203984.132416:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203984.132418:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203984.132421:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728196096:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203984.963971:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203985.027957:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203985.987923:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203986.051914:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203987.012015:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203987.075961:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203988.035941:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203988.099908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203989.060000:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203989.123892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788203989.251893:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788203989.251904:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788203989.251909:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203989.251920:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3270 00000100:00080000:2.0:1788203989.251934:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203989.251943:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788203989.252003:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c700 x1875064728196224/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788203989.252031:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788203989.252036:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788203989.252038:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788203989.252043:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3270 00000100:00080000:2.0:1788203989.252047:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788203989.252052:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788203989.252064:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203989.252081:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d180 x1875064728196352/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788203989.252093:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728196224:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788203989.252162:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203989.252219:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203989/real 1788203989] req@ffff8bc17257c700 x1875064728196224/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204014 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203989.252241:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c700 x1875064728196224/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204014 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203989.252253:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203989.252257:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203989.252261:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728196224:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203989.252289:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728196352:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788203989.252316:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788203989.252330:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203989/real 1788203989] req@ffff8bc17257d180 x1875064728196352/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204014 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788203989.252344:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d180 x1875064728196352/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204014 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788203989.252353:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788203989.252356:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788203989.252359:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728196352:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788203990.084022:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203990.148003:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203991.107949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203991.171857:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203992.131981:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203992.195860:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788203993.156014:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203993.219867:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203994.180028:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788203994.243914:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203994.371954:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203994.371965:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203994.371970:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203994.371984:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3275 00000100:00080000:0.0:1788203994.371998:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203994.372008:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203994.372061:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143100 x1875064728196480/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203994.372094:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203994.372098:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203994.372100:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203994.372106:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3275 00000100:00080000:0.0:1788203994.372111:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203994.372117:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203994.372131:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788203994.372144:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728196480:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788203994.372152:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140000 x1875064728196608/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788203994.372229:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203994.372293:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203994/real 1788203994] req@ffff8bc144143100 x1875064728196480/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204019 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203994.372315:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143100 x1875064728196480/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204019 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203994.372324:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203994.372327:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203994.372331:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728196480:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203994.372357:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728196608:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203994.372376:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203994.372386:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203994/real 1788203994] req@ffff8bc144140000 x1875064728196608/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204019 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203994.372396:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140000 x1875064728196608/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204019 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203994.372405:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203994.372408:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203994.372413:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728196608:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788203995.203928:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203995.267937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203996.228008:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203996.291882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203997.252024:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203997.315925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203998.275979:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203998.339900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788203999.300014:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788203999.363902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788203999.491882:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788203999.491891:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788203999.491895:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203999.491904:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3280 00000100:00080000:0.0:1788203999.491914:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203999.491921:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788203999.491960:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143800 x1875064728196736/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788203999.491989:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788203999.491992:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788203999.491993:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788203999.491996:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3280 00000100:00080000:0.0:1788203999.491999:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788203999.492002:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788203999.492010:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788203999.492020:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140380 x1875064728196864/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788203999.492047:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728196736:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788203999.492113:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203999.492171:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203999/real 1788203999] req@ffff8bc144143800 x1875064728196736/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204024 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203999.492196:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143800 x1875064728196736/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204024 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203999.492207:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203999.492211:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203999.492216:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728196736:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788203999.492223:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728196864:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788203999.492244:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788203999.492256:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788203999/real 1788203999] req@ffff8bc144140380 x1875064728196864/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204024 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788203999.492265:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140380 x1875064728196864/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204024 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788203999.492270:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788203999.492273:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788203999.492275:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728196864:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204000.323960:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204000.387998:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204001.347991:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204001.411963:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204002.371984:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204002.435933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204003.396081:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204003.459921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204004.419992:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204004.483957:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204004.611933:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204004.611942:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204004.611947:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204004.611957:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3285 00000100:00080000:3.0:1788204004.611968:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204004.611975:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204004.612014:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728196992/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204004.612038:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204004.612041:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204004.612042:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204004.612045:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3285 00000100:00080000:3.0:1788204004.612047:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204004.612049:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204004.612059:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204004.612067:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728197120/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204004.612081:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728196992:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204004.612141:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204004.612191:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204004/real 1788204004] req@ffff8bc1726cce00 x1875064728196992/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204029 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204004.612206:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728196992/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204029 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204004.612214:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204004.612216:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204004.612219:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728196992:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204004.612243:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728197120:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204004.612263:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204004.612276:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204004/real 1788204004] req@ffff8bc1726cdc00 x1875064728197120/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204029 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204004.612288:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728197120/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204029 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204004.612296:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204004.612298:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204004.612300:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728197120:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204005.444009:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204005.507924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204006.468031:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204006.531919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204007.491902:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204007.555860:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204008.515941:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204008.579899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204009.539918:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204009.603871:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204009.731926:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204009.731936:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204009.731940:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204009.731951:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3291 00000100:00080000:0.0:1788204009.731963:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204009.731969:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204009.732013:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141f80 x1875064728197248/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204009.732046:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204009.732050:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204009.732052:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204009.732056:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3291 00000100:00080000:0.0:1788204009.732060:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204009.732065:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204009.732077:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204009.732091:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142300 x1875064728197376/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204009.732122:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728197248:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204009.732191:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204009.732244:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204009/real 1788204009] req@ffff8bc144141f80 x1875064728197248/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204034 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204009.732264:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141f80 x1875064728197248/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204034 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204009.732275:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204009.732279:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204009.732283:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728197248:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204009.732310:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728197376:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204009.732330:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204009.732342:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204009/real 1788204009] req@ffff8bc144142300 x1875064728197376/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204034 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204009.732355:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142300 x1875064728197376/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204034 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204009.732369:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204009.732373:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204009.732376:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728197376:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204010.564000:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204010.627942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204011.588023:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204011.651907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204012.611989:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204012.675857:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204013.635993:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204013.699904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204014.659986:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204014.723955:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204014.851911:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204014.851919:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204014.851922:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204014.851930:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3296 00000100:00080000:3.0:1788204014.851940:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204014.851946:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204014.851982:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728197504/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204014.852002:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204014.852005:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204014.852007:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204014.852009:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3296 00000100:00080000:3.0:1788204014.852011:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204014.852014:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204014.852021:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204014.852029:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728197632/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204014.852056:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728197504:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204014.852117:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204014.852173:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204014/real 1788204014] req@ffff8bc1726cdc00 x1875064728197504/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204039 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204014.852189:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728197504/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204039 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204014.852199:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204014.852203:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204014.852206:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728197504:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204014.852213:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728197632:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204014.852243:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204014.852256:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204014/real 1788204014] req@ffff8bc1726cce00 x1875064728197632/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204039 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204014.852268:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728197632/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204039 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204014.852277:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204014.852280:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204014.852283:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728197632:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204015.683984:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204015.747898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204016.707969:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204016.771950:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204017.732005:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204017.795866:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204018.756020:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204018.819927:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204019.779995:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204019.843936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204019.971931:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204019.971950:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204019.971955:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204019.971968:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3301 00000100:00080000:3.0:1788204019.971981:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204019.971990:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204019.972035:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728197760/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204019.972063:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204019.972067:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204019.972069:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204019.972073:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3301 00000100:00080000:3.0:1788204019.972077:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204019.972082:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204019.972094:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204019.972108:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728197888/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204019.972129:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728197760:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204019.972196:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204019.972276:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204019/real 1788204019] req@ffff8bc1726ce680 x1875064728197760/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204044 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204019.972300:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728197760/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204044 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204019.972311:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204019.972316:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204019.972320:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728197760:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204019.972347:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728197888:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204019.972368:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204019.972379:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204019/real 1788204019] req@ffff8bc1726cc380 x1875064728197888/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204044 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204019.972391:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728197888/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204044 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204019.972400:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204019.972403:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204019.972407:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728197888:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204020.803998:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204020.867963:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204021.827973:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204021.891927:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204022.851988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204022.915931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204023.876017:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204023.939950:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204024.899955:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204024.963899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204025.091892:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204025.091899:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204025.091902:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204025.091911:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3306 00000100:00080000:3.0:1788204025.091925:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204025.091930:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204025.091964:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728198016/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204025.091985:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204025.091987:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204025.091988:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204025.091991:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3306 00000100:00080000:3.0:1788204025.091993:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204025.091995:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204025.092001:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204025.092008:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728198144/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204025.092092:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728198016:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204025.092187:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204025.092248:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204025/real 1788204025] req@ffff8bc1726cea00 x1875064728198016/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204025.092270:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728198016/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204025.092280:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204025.092283:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204025.092286:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728198016:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204025.092291:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728198144:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204025.092305:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204025.092313:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204025/real 1788204025] req@ffff8bc1726ce300 x1875064728198144/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204025.092320:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728198144/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204025.092326:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204025.092327:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204025.092329:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728198144:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204025.924020:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204025.988001:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204026.947942:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204027.011849:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204027.971967:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204028.035894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204028.995943:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204029.059881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204030.019916:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204030.083883:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204030.211888:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204030.211898:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204030.211902:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204030.211911:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3311 00000100:00080000:3.0:1788204030.211921:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204030.211928:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204030.211964:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728198272/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204030.211999:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204030.212005:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204030.212006:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204030.212009:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3311 00000100:00080000:3.0:1788204030.212011:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204030.212015:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204030.212022:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204030.212033:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728198400/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204030.212042:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728198272:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204030.212104:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204030.212150:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204030/real 1788204030] req@ffff8bc1726cfb80 x1875064728198272/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204055 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204030.212165:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728198272/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204055 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204030.212173:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204030.212176:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204030.212179:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728198272:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204030.212197:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728198400:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204030.212212:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204030.212219:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204030/real 1788204030] req@ffff8bc1726ced80 x1875064728198400/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204055 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204030.212227:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728198400/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204055 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204030.212232:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204030.212234:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204030.212235:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728198400:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204031.043986:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204031.107998:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204032.067986:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204032.131951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204033.091944:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204033.155905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204034.115924:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204034.179881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204035.139967:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204035.203929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204035.331957:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204035.331970:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204035.331987:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204035.332000:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3316 00000100:00080000:0.0:1788204035.332014:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204035.332022:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204035.332062:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143b80 x1875064728198528/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204035.332089:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204035.332095:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204035.332097:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204035.332100:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3316 00000100:00080000:0.0:1788204035.332102:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204035.332105:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204035.332116:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204035.332129:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141500 x1875064728198656/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204035.332141:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728198528:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204035.332202:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204035.332245:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204035/real 1788204035] req@ffff8bc144143b80 x1875064728198528/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204060 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204035.332261:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143b80 x1875064728198528/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204060 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204035.332269:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204035.332272:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204035.332275:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728198528:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204035.332298:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728198656:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204035.332312:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204035.332319:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204035/real 1788204035] req@ffff8bc144141500 x1875064728198656/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204060 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204035.332328:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141500 x1875064728198656/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204060 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204035.332336:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204035.332339:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204035.332342:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728198656:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204036.163980:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204036.228012:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204037.188005:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204037.251890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204038.212033:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204038.275944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204039.236042:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204039.299857:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204040.259960:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204040.323877:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204040.451869:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204040.451877:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204040.451880:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204040.451908:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3321 00000100:00080000:1.0:1788204040.451917:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204040.451922:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204040.451954:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6a00 x1875064728198784/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204040.451975:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204040.451978:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204040.451979:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204040.451981:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3321 00000100:00080000:1.0:1788204040.451984:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204040.451986:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204040.451994:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204040.452006:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4e00 x1875064728198912/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204040.452036:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728198784:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204040.452132:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728198912:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204041.284072:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204041.348001:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204042.308045:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204042.371875:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204043.332023:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204043.395932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:3.0:1788204043.524142:0:10040:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:3.0:1788204043.524202:0:10040:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:3.0:1788204043.524223:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:3.0:1788204043.524277:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788204043.524330:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204040/real 1788204043] req@ffff8bc1727d6a00 x1875064728198784/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204065 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204043.524365:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6a00 x1875064728198784/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204065 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204043.524378:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204043.524384:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204043.524390:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728198784:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204043.524399:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204040/real 1788204043] req@ffff8bc1727d4e00 x1875064728198912/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204065 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204043.524413:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4e00 x1875064728198912/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204065 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204043.524421:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204043.524426:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204043.524436:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728198912:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204044.355992:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204044.419957:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204045.380045:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204045.443963:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204045.571915:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204045.571925:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204045.571930:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204045.571941:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3326 00000100:00080000:0.0:1788204045.571952:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204045.571960:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204045.571996:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143480 x1875064728199040/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204045.572030:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204045.572033:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204045.572034:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204045.572037:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3326 00000100:00080000:0.0:1788204045.572040:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204045.572043:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204045.572054:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204045.572069:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141880 x1875064728199168/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204045.572096:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728199040:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204045.572174:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204045.572241:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204045/real 1788204045] req@ffff8bc144143480 x1875064728199040/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204070 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204045.572270:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143480 x1875064728199040/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204070 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204045.572283:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204045.572289:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204045.572294:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728199040:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204045.572325:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728199168:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204045.572353:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204045.572385:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204045/real 1788204045] req@ffff8bc144141880 x1875064728199168/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204070 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204045.572398:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141880 x1875064728199168/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204070 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204045.572407:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204045.572411:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204045.572414:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728199168:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204046.403963:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204046.468007:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204047.427944:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204047.491887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204048.451998:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204048.515944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204049.476018:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204049.539952:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204050.499992:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204050.563873:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204050.691961:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204050.691974:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204050.691978:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204050.691991:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3332 00000100:00080000:2.0:1788204050.692005:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204050.692013:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204050.692062:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f100 x1875064728199296/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204050.692095:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204050.692099:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204050.692101:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204050.692105:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3332 00000100:00080000:2.0:1788204050.692109:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204050.692114:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204050.692125:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204050.692139:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728199296:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204050.692141:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d500 x1875064728199424/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788204050.692214:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204050.692270:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204050/real 1788204050] req@ffff8bc17257f100 x1875064728199296/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204075 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204050.692288:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f100 x1875064728199296/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204075 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204050.692298:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204050.692303:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204050.692307:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728199296:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204050.692336:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728199424:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204050.692358:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204050.692371:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204050/real 1788204050] req@ffff8bc17257d500 x1875064728199424/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204075 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204050.692382:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d500 x1875064728199424/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204075 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204050.692390:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204050.692393:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204050.692396:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728199424:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204051.523950:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204051.588033:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204052.547975:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204052.611871:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204053.571923:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204053.635936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204054.595965:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204054.659866:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204055.619941:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204055.683932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204055.811898:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204055.811907:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204055.811911:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204055.811921:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3337 00000100:00080000:3.0:1788204055.811932:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204055.811946:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204055.811987:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728199552/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204055.812008:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204055.812011:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204055.812012:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204055.812014:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3337 00000100:00080000:3.0:1788204055.812017:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204055.812019:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204055.812028:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204055.812036:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728199680/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204055.812056:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728199552:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204055.812124:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204055.812184:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204055/real 1788204055] req@ffff8bc1726cca80 x1875064728199552/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204080 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204055.812198:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728199552/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204080 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204055.812210:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204055.812213:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204055.812216:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728199552:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204055.812240:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728199680:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204055.812255:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204055.812263:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204055/real 1788204055] req@ffff8bc1726cd500 x1875064728199680/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204080 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204055.812271:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728199680/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204080 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204055.812276:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204055.812278:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204055.812280:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728199680:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204056.644004:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204056.707898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204057.668031:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204057.731883:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204058.691984:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204058.755889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204059.716007:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204059.779928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204060.740008:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204060.803880:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204060.931935:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204060.931949:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204060.931954:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204060.931967:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3342 00000100:00080000:3.0:1788204060.931980:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204060.931988:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204060.932036:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728199808/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204060.932067:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204060.932072:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204060.932073:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204060.932077:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3342 00000100:00080000:3.0:1788204060.932081:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204060.932086:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204060.932097:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204060.932111:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728199936/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204060.932120:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728199808:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204060.932187:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204060.932237:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204060/real 1788204060] req@ffff8bc1726cf480 x1875064728199808/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204085 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204060.932251:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728199808/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204085 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204060.932260:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204060.932262:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204060.932265:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728199808:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204060.932295:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728199936:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204060.932310:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204060.932318:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204060/real 1788204060] req@ffff8bc1726cf100 x1875064728199936/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204085 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204060.932326:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728199936/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204085 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204060.932334:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204060.932337:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204060.932341:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728199936:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204061.764079:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204061.827908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204062.788000:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204062.851907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204063.811951:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204063.875877:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204064.835970:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204064.899919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204065.860008:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204065.923930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204066.051954:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204066.051963:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204066.051970:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204066.051981:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3347 00000100:00080000:0.0:1788204066.051993:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204066.051999:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204066.052039:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142a00 x1875064728200064/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204066.052066:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204066.052070:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204066.052072:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204066.052075:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3347 00000100:00080000:0.0:1788204066.052079:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204066.052085:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204066.052095:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204066.052108:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140e00 x1875064728200192/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204066.052119:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728200064:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204066.052187:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204066.052244:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204066/real 1788204066] req@ffff8bc144142a00 x1875064728200064/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204066.052264:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142a00 x1875064728200064/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204066.052274:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204066.052277:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204066.052280:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728200064:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204066.052300:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728200192:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204066.052317:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204066.052326:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204066/real 1788204066] req@ffff8bc144140e00 x1875064728200192/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204066.052334:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140e00 x1875064728200192/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204066.052339:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204066.052341:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204066.052343:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728200192:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204066.883993:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204066.947912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204067.907978:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204067.971891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204068.931967:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204068.995932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204069.956001:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204070.019891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204070.979974:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204071.043947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204071.171932:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204071.171944:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204071.171950:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204071.171962:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3352 00000100:00080000:0.0:1788204071.171976:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204071.171984:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204071.172032:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140700 x1875064728200320/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204071.172068:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204071.172073:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204071.172074:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204071.172078:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3352 00000100:00080000:0.0:1788204071.172082:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204071.172086:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204071.172098:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204071.172114:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141c00 x1875064728200448/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204071.172132:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728200320:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204071.172204:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204071.172271:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204071/real 1788204071] req@ffff8bc144140700 x1875064728200320/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204096 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204071.172291:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140700 x1875064728200320/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204096 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204071.172302:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204071.172306:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204071.172310:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728200320:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204071.172340:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728200448:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204071.172378:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204071.172391:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204071/real 1788204071] req@ffff8bc144141c00 x1875064728200448/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204096 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204071.172403:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141c00 x1875064728200448/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204096 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204071.172412:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204071.172415:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204071.172418:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728200448:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204072.004026:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204072.068051:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204073.027979:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204073.091940:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204074.051995:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204074.115865:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204075.075969:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204075.139935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204076.100001:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204076.163881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204076.291944:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204076.291958:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204076.291964:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204076.291976:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3357 00000100:00080000:2.0:1788204076.291996:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204076.292007:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204076.292057:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e300 x1875064728200576/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204076.292091:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204076.292095:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204076.292097:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204076.292101:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3357 00000100:00080000:2.0:1788204076.292105:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204076.292110:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204076.292120:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204076.292122:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728200576:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204076.292136:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c380 x1875064728200704/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788204076.292197:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204076.292248:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204076/real 1788204076] req@ffff8bc17257e300 x1875064728200576/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204101 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204076.292281:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e300 x1875064728200576/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204101 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204076.292293:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204076.292297:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204076.292300:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728200576:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204076.292324:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728200704:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204076.292348:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204076.292358:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204076/real 1788204076] req@ffff8bc17257c380 x1875064728200704/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204101 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204076.292370:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c380 x1875064728200704/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204101 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204076.292379:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204076.292382:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204076.292385:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728200704:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204077.123983:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204077.187950:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204078.148013:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204078.211923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204079.171995:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204079.235906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204080.196035:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204080.259880:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204081.220001:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204081.283886:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204081.411907:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204081.411917:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204081.411921:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204081.411931:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3362 00000100:00080000:2.0:1788204081.411941:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204081.411949:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204081.411987:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257fb80 x1875064728200832/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204081.412011:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204081.412014:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204081.412016:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204081.412018:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3362 00000100:00080000:2.0:1788204081.412020:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204081.412023:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204081.412032:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204081.412040:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ca80 x1875064728200960/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204081.412070:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728200832:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204081.412143:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204081.412227:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204081/real 1788204081] req@ffff8bc17257fb80 x1875064728200832/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204106 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204081.412248:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257fb80 x1875064728200832/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204106 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204081.412267:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204081.412271:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204081.412275:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728200832:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204081.412283:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728200960:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204081.412301:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204081.412309:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204081/real 1788204081] req@ffff8bc17257ca80 x1875064728200960/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204106 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204081.412317:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ca80 x1875064728200960/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204106 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204081.412322:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204081.412325:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204081.412327:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728200960:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204082.243998:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204082.307969:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204083.267957:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204083.331883:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204084.292005:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204084.355918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204085.315909:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204085.379892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204086.339950:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204086.403882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204086.531894:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204086.531901:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204086.531905:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204086.531913:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3367 00000100:00080000:0.0:1788204086.531921:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204086.531927:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204086.531957:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141c00 x1875064728201088/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204086.531978:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204086.531982:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204086.531984:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204086.531987:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3367 00000100:00080000:0.0:1788204086.531990:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204086.531993:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204086.531999:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204086.532007:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140700 x1875064728201216/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204086.532023:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728201088:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204086.532077:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204086.532139:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204086/real 1788204086] req@ffff8bc144141c00 x1875064728201088/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204111 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204086.532153:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141c00 x1875064728201088/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204111 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204086.532160:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204086.532163:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204086.532165:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728201088:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204086.532185:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728201216:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204086.532201:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204086.532209:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204086/real 1788204086] req@ffff8bc144140700 x1875064728201216/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204111 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204086.532216:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140700 x1875064728201216/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204111 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204086.532222:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204086.532223:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204086.532225:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728201216:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204087.364001:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204087.427928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204088.387938:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204088.451885:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204089.411940:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204089.475890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204090.435972:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204090.499882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204091.459958:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204091.523868:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204091.651914:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204091.651925:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204091.651929:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204091.651938:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3373 00000100:00080000:3.0:1788204091.651948:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204091.651956:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204091.651989:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728201344/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204091.652023:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204091.652025:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204091.652026:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204091.652029:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3373 00000100:00080000:3.0:1788204091.652032:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204091.652034:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204091.652042:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204091.652051:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728201472/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204091.652069:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728201344:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204091.652124:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204091.652182:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204091/real 1788204091] req@ffff8bc1726cc700 x1875064728201344/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204116 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204091.652201:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728201344/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204116 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204091.652212:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204091.652215:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204091.652226:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728201344:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204091.652247:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728201472:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204091.652267:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204091.652278:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204091/real 1788204091] req@ffff8bc1726cd180 x1875064728201472/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204116 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204091.652303:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728201472/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204116 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204091.652312:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204091.652315:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204091.652318:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728201472:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204092.483941:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204092.547952:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204093.507959:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204093.571907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204094.531937:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204094.595921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204095.556024:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204095.619958:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204096.580038:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204096.643931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204096.771873:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204096.771883:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204096.771887:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204096.771917:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3378 00000100:00080000:3.0:1788204096.771931:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204096.771938:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204096.771989:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728201600/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204096.772021:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204096.772025:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204096.772027:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204096.772031:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3378 00000100:00080000:3.0:1788204096.772035:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204096.772040:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204096.772052:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204096.772064:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728201728/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204096.772084:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728201600:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204096.772157:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204096.772231:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204096/real 1788204096] req@ffff8bc1726cdf80 x1875064728201600/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204121 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204096.772254:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728201600/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204121 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204096.772265:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204096.772269:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204096.772273:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728201600:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204096.772302:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728201728:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204096.772323:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204096.772335:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204096/real 1788204096] req@ffff8bc1726cf800 x1875064728201728/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204121 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204096.772346:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728201728/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204121 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204096.772354:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204096.772357:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204096.772360:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728201728:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204097.603958:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204097.668030:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204098.627966:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204098.691917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204099.651994:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204099.715942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204100.675974:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204100.739926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204101.699997:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204101.763929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204101.891942:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204101.891952:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204101.891957:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204101.891967:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3383 00000100:00080000:0.0:1788204101.891978:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204101.891985:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204101.892032:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140e00 x1875064728201856/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204101.892071:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204101.892076:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204101.892078:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204101.892082:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3383 00000100:00080000:0.0:1788204101.892086:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204101.892091:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204101.892101:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204101.892114:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142a00 x1875064728201984/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204101.892120:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728201856:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204101.892205:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204101.892255:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204101/real 1788204101] req@ffff8bc144140e00 x1875064728201856/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204126 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204101.892269:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140e00 x1875064728201856/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204126 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204101.892278:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204101.892281:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204101.892284:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728201856:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204101.892318:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728201984:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204101.892342:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204101.892355:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204101/real 1788204101] req@ffff8bc144142a00 x1875064728201984/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204126 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204101.892368:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142a00 x1875064728201984/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204126 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204101.892376:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204101.892379:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204101.892383:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728201984:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204102.723997:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204102.787955:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204103.747980:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204103.811954:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204104.771968:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204104.835911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204105.795967:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204105.859918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204106.819993:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204106.883907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204107.011907:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204107.011919:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204107.011924:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204107.011936:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3388 00000100:00080000:0.0:1788204107.011947:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204107.011955:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204107.011994:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141880 x1875064728202112/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204107.012026:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204107.012030:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204107.012032:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204107.012036:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3388 00000100:00080000:0.0:1788204107.012039:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204107.012043:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204107.012053:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204107.012066:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143480 x1875064728202240/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204107.012092:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728202112:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204107.012198:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728202240:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204107.843977:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204107.907896:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204108.868026:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204108.931920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204109.891916:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204109.955919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:3.0:1788204110.084076:0:10041:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:3.0:1788204110.084113:0:10041:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:3.0:1788204110.084126:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:3.0:1788204110.084168:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788204110.084222:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204107/real 1788204110] req@ffff8bc144141880 x1875064728202112/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204110.084263:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141880 x1875064728202112/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204110.084276:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204110.084281:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204110.084286:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728202112:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204110.084295:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204107/real 1788204110] req@ffff8bc144143480 x1875064728202240/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204110.084308:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143480 x1875064728202240/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204110.084317:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204110.084320:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204110.084323:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728202240:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204110.915944:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204110.979920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204111.940033:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204112.003882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204112.131960:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204112.131971:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204112.131974:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204112.131985:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3393 00000100:00080000:3.0:1788204112.131994:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204112.132001:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204112.132034:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728202368/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204112.132065:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204112.132069:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204112.132071:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204112.132075:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3393 00000100:00080000:3.0:1788204112.132079:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204112.132082:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204112.132091:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204112.132105:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728202496/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204112.132129:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728202368:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204112.132194:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204112.132263:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204112/real 1788204112] req@ffff8bc1726cf800 x1875064728202368/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204137 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204112.132282:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728202368/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204137 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204112.132293:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204112.132297:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204112.132301:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728202368:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204112.132325:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728202496:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204112.132349:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204112.132364:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204112/real 1788204112] req@ffff8bc1726cdf80 x1875064728202496/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204137 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204112.132380:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728202496/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204137 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204112.132389:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204112.132392:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204112.132396:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728202496:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204112.964022:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204113.027931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204113.988008:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204114.051915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204115.011982:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204115.075944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204116.035931:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204116.099925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204117.060026:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204117.123940:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204117.251952:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204117.251967:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204117.251973:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204117.251987:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3398 00000100:00080000:3.0:1788204117.252001:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204117.252010:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204117.252076:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728202624/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204117.252112:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204117.252117:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204117.252119:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204117.252124:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3398 00000100:00080000:3.0:1788204117.252128:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204117.252133:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204117.252146:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204117.252163:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728202624:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788204117.252164:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728202752/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788204117.252244:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204117.252293:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204117/real 1788204117] req@ffff8bc1726cd180 x1875064728202624/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204142 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204117.252309:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728202624/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204142 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204117.252317:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204117.252321:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204117.252324:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728202624:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204117.252347:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728202752:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204117.252363:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204117.252372:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204117/real 1788204117] req@ffff8bc1726cc700 x1875064728202752/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204142 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204117.252380:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728202752/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204142 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204117.252386:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204117.252388:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204117.252390:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728202752:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204118.083961:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204118.148031:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204119.108000:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204119.171900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204120.132000:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204120.195865:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204121.156021:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204121.219932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204122.179957:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204122.243956:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204122.371954:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204122.371968:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204122.371974:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204122.371988:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3403 00000100:00080000:3.0:1788204122.372001:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204122.372009:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204122.372073:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728202880/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204122.372112:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204122.372117:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204122.372119:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204122.372124:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3403 00000100:00080000:3.0:1788204122.372127:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204122.372133:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204122.372146:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204122.372161:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728203008/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204122.372166:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728202880:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204122.372252:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204122.372308:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204122/real 1788204122] req@ffff8bc1726cf100 x1875064728202880/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204147 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204122.372324:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728202880/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204147 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204122.372333:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204122.372336:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204122.372339:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728202880:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204122.372364:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728203008:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204122.372383:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204122.372392:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204122/real 1788204122] req@ffff8bc1726cf480 x1875064728203008/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204147 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204122.372400:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728203008/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204147 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204122.372406:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204122.372408:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204122.372411:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728203008:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204123.203997:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204123.268002:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204124.228028:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204124.291880:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204125.251924:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204125.315856:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204126.275955:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204126.339879:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204127.299937:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204127.363907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204127.491922:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204127.491933:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204127.491938:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204127.491948:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3408 00000100:00080000:0.0:1788204127.491959:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204127.491966:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204127.492002:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141500 x1875064728203136/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204127.492033:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204127.492037:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204127.492039:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204127.492044:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3408 00000100:00080000:0.0:1788204127.492048:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204127.492052:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204127.492063:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204127.492077:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143b80 x1875064728203264/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204127.492088:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728203136:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204127.492158:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204127.492213:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204127/real 1788204127] req@ffff8bc144141500 x1875064728203136/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204152 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204127.492235:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141500 x1875064728203136/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204152 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204127.492246:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204127.492251:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204127.492255:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728203136:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204127.492282:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728203264:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204127.492307:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204127.492322:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204127/real 1788204127] req@ffff8bc144143b80 x1875064728203264/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204152 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204127.492335:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143b80 x1875064728203264/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204152 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204127.492345:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204127.492348:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204127.492352:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728203264:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204128.323983:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204128.387901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204129.347945:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204129.411951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204130.372013:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204130.435922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204131.396026:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204131.459944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204132.420013:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204132.483869:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204132.611968:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204132.611980:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204132.611985:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204132.611999:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3413 00000100:00080000:1.0:1788204132.612015:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204132.612024:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204132.612081:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5c00 x1875064728203392/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204132.612115:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204132.612119:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204132.612122:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204132.612126:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3413 00000100:00080000:1.0:1788204132.612129:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204132.612134:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204132.612145:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204132.612161:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4700 x1875064728203520/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204132.612174:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728203392:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204132.612251:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204132.612347:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204132/real 1788204132] req@ffff8bc1727d5c00 x1875064728203392/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204157 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204132.612367:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5c00 x1875064728203392/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204157 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204132.612376:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204132.612380:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204132.612383:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728203392:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204132.612406:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728203520:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204132.612426:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204132.612436:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204132/real 1788204132] req@ffff8bc1727d4700 x1875064728203520/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204157 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204132.612444:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4700 x1875064728203520/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204157 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204132.612450:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204132.612453:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204132.612455:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728203520:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204133.444026:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204133.508176:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204134.468122:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204134.531966:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204135.492001:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204135.555935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204136.516033:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204136.579966:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204137.539965:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204137.603905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204137.731955:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204137.731969:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204137.731975:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204137.731990:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3419 00000100:00080000:0.0:1788204137.732005:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204137.732014:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204137.732067:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142300 x1875064728203648/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204137.732094:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204137.732097:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204137.732099:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204137.732102:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3419 00000100:00080000:0.0:1788204137.732105:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204137.732108:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204137.732118:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204137.732128:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141f80 x1875064728203776/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204137.732224:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728203648:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204137.732297:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204137.732344:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204137/real 1788204137] req@ffff8bc144142300 x1875064728203648/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204162 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204137.732364:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142300 x1875064728203648/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204162 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204137.732376:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204137.732380:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204137.732384:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728203648:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204137.732394:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728203776:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204137.732420:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204137.732434:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204137/real 1788204137] req@ffff8bc144141f80 x1875064728203776/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204162 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204137.732447:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141f80 x1875064728203776/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204162 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204137.732457:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204137.732461:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204137.732465:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728203776:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204138.564010:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204138.628050:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204139.587965:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204139.651906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204140.611990:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204140.675954:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204141.636009:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204141.699944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204142.659944:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204142.723888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204142.851948:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204142.851959:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204142.851964:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204142.851974:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3424 00000100:00080000:2.0:1788204142.851985:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204142.852002:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204142.852034:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ea00 x1875064728203904/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204142.852059:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204142.852062:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204142.852063:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204142.852066:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3424 00000100:00080000:2.0:1788204142.852069:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204142.852072:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204142.852079:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204142.852088:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ce00 x1875064728204032/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204142.852129:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728203904:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204142.852214:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204142.852278:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204142/real 1788204142] req@ffff8bc17257ea00 x1875064728203904/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204167 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204142.852310:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ea00 x1875064728203904/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204167 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204142.852319:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204142.852323:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204142.852331:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728203904:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204142.852338:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728204032:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204142.852359:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204142.852369:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204142/real 1788204142] req@ffff8bc17257ce00 x1875064728204032/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204167 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204142.852378:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ce00 x1875064728204032/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204167 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204142.852384:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204142.852386:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204142.852389:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728204032:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204143.683956:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204143.747956:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204144.707943:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204144.771912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204145.731950:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204145.795935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204146.755952:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204146.819932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204147.780019:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204147.843900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204147.971907:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204147.971918:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204147.971923:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204147.971934:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3429 00000100:00080000:2.0:1788204147.971947:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204147.971956:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204147.972008:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d880 x1875064728204160/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204147.972075:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204147.972079:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204147.972081:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204147.972084:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3429 00000100:00080000:2.0:1788204147.972088:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204147.972091:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204147.972102:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204147.972116:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ed80 x1875064728204288/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204147.972127:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728204160:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204147.972200:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204147.972262:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204147/real 1788204147] req@ffff8bc17257d880 x1875064728204160/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204172 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204147.972279:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d880 x1875064728204160/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204172 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204147.972288:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204147.972291:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204147.972295:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728204160:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204147.972320:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728204288:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204147.972337:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204147.972350:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204147/real 1788204147] req@ffff8bc17257ed80 x1875064728204288/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204172 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204147.972364:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ed80 x1875064728204288/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204172 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204147.972381:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204147.972385:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204147.972389:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728204288:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204148.803939:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204148.868148:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204149.828048:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204149.891882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204150.851965:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204150.915907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204151.875993:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204151.939943:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204152.900008:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204152.963887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204153.091950:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204153.091963:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204153.091968:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204153.091981:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3434 00000100:00080000:3.0:1788204153.091994:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204153.092003:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204153.092049:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728204416/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204153.092081:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204153.092086:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204153.092088:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204153.092100:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3434 00000100:00080000:3.0:1788204153.092105:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204153.092109:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204153.092114:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728204416:192.168.201.143@tcp:250:kworker.0 00000008:00100000:3.0:1788204153.092120:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204153.092133:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728204544/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788204153.092183:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204153.092240:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204153/real 1788204153] req@ffff8bc1726cd500 x1875064728204416/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204153.092261:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728204416/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204153.092285:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204153.092289:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204153.092294:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728204416:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204153.092323:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728204544:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204153.092340:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204153.092350:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204153/real 1788204153] req@ffff8bc1726cca80 x1875064728204544/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204153.092358:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728204544/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204153.092363:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204153.092365:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204153.092368:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728204544:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204153.924008:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204153.987965:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204154.947989:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204155.011855:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204155.971972:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204156.035903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204156.995995:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204157.059917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204158.019994:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204158.083951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204158.211909:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204158.211918:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204158.211923:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204158.211933:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3439 00000100:00080000:3.0:1788204158.211944:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204158.211950:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204158.212004:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728204672/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204158.212036:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204158.212039:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204158.212040:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204158.212043:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3439 00000100:00080000:3.0:1788204158.212046:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204158.212050:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204158.212060:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204158.212070:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728204800/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204158.212104:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728204672:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204158.212180:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204158.212248:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204158/real 1788204158] req@ffff8bc1726ced80 x1875064728204672/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204183 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204158.212269:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728204672/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204183 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204158.212280:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204158.212284:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204158.212289:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728204672:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204158.212296:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728204800:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204158.212320:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204158.212333:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204158/real 1788204158] req@ffff8bc1726cfb80 x1875064728204800/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204183 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204158.212344:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728204800/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204183 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204158.212352:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204158.212356:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204158.212359:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728204800:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204159.044030:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204159.107954:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204160.068040:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204160.131942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204161.091994:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204161.155969:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204162.115984:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204162.179866:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204163.139996:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204163.203969:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204163.331936:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204163.331950:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204163.331955:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204163.331968:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3444 00000100:00080000:3.0:1788204163.331981:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204163.331989:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204163.332046:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728204928/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204163.332077:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204163.332081:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204163.332083:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204163.332087:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3444 00000100:00080000:3.0:1788204163.332090:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204163.332094:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204163.332105:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204163.332117:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728205056/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204163.332141:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728204928:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204163.332213:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204163.332274:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204163/real 1788204163] req@ffff8bc1726ce300 x1875064728204928/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204188 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204163.332292:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728204928/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204188 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204163.332304:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204163.332308:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204163.332313:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728204928:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204163.332341:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728205056:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204163.332365:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204163.332379:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204163/real 1788204163] req@ffff8bc1726cea00 x1875064728205056/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204188 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204163.332391:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728205056/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204188 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204163.332397:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204163.332399:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204163.332401:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728205056:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204164.163988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204164.227952:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204165.187931:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204165.251916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204166.211932:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204166.275899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204167.235994:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204167.299894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204168.260027:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204168.323895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204168.451947:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204168.451960:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204168.451965:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204168.451978:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3449 00000100:00080000:0.0:1788204168.451991:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204168.451999:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204168.452045:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140380 x1875064728205184/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204168.452072:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204168.452076:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204168.452077:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204168.452080:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3449 00000100:00080000:0.0:1788204168.452083:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204168.452087:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204168.452099:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204168.452112:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143800 x1875064728205312/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204168.452153:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728205184:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204168.452225:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204168.452289:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204168/real 1788204168] req@ffff8bc144140380 x1875064728205184/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204193 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204168.452309:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140380 x1875064728205184/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204193 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204168.452317:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204168.452320:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204168.452322:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728205184:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204168.452328:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728205312:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204168.452345:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204168.452355:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204168/real 1788204168] req@ffff8bc144143800 x1875064728205312/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204193 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204168.452362:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143800 x1875064728205312/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204193 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204168.452367:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204168.452369:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204168.452371:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728205312:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204169.284003:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204169.347908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204170.307988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204170.371915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204171.331958:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204171.395846:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204172.355974:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204172.419891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204173.379959:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204173.443929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204173.571926:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204173.571934:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204173.571937:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204173.571946:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3454 00000100:00080000:2.0:1788204173.571954:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204173.571960:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204173.571990:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e680 x1875064728205440/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204173.572013:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204173.572015:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204173.572017:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204173.572019:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3454 00000100:00080000:2.0:1788204173.572021:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204173.572024:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204173.572031:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204173.572040:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257df80 x1875064728205568/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204173.572060:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728205440:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204173.572139:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728205568:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204174.404029:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204174.467901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204175.427964:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204175.491889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204176.451970:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204176.515883:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788204176.644120:0:10042:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788204176.644171:0:10042:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788204176.644187:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788204176.644224:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:0.0:1788204176.644257:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204173/real 1788204176] req@ffff8bc17257e680 x1875064728205440/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204198 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204176.644277:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e680 x1875064728205440/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204198 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204176.644285:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204176.644289:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204176.644293:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728205440:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204176.644301:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204173/real 1788204176] req@ffff8bc17257df80 x1875064728205568/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204198 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204176.644314:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257df80 x1875064728205568/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204198 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204176.644322:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204176.644325:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204176.644328:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728205568:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204177.475972:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204177.539913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204178.499971:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204178.563891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204178.691934:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204178.691944:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204178.691948:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204178.691958:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3460 00000100:00080000:0.0:1788204178.691970:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204178.691977:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204178.692015:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140000 x1875064728205696/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204178.692045:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204178.692049:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204178.692051:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204178.692055:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3460 00000100:00080000:0.0:1788204178.692059:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204178.692065:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204178.692076:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204178.692077:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728205696:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204178.692092:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143100 x1875064728205824/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788204178.692156:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204178.692254:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204178/real 1788204178] req@ffff8bc144140000 x1875064728205696/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204203 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204178.692277:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140000 x1875064728205696/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204203 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204178.692288:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204178.692292:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204178.692296:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728205696:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204178.692325:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728205824:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204178.692347:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204178.692359:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204178/real 1788204178] req@ffff8bc144143100 x1875064728205824/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204203 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204178.692370:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143100 x1875064728205824/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204203 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204178.692378:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204178.692381:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204178.692384:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728205824:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204179.523959:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204179.587930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204180.547966:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204180.611913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204181.571932:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204181.635858:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204182.596078:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204182.659903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204183.619978:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204183.683968:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204183.811931:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204183.811939:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204183.811943:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204183.811951:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3465 00000100:00080000:3.0:1788204183.811960:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204183.811966:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204183.811999:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728205952/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204183.812021:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204183.812023:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204183.812025:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204183.812027:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3465 00000100:00080000:3.0:1788204183.812030:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204183.812032:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204183.812039:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204183.812048:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728206080/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204183.812098:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728205952:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204183.812172:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204183.812232:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204183/real 1788204183] req@ffff8bc1726cc380 x1875064728205952/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204208 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204183.812252:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728205952/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204208 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204183.812261:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204183.812265:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204183.812268:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728205952:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204183.812274:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728206080:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204183.812290:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204183.812299:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204183/real 1788204183] req@ffff8bc1726ce680 x1875064728206080/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204208 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204183.812307:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728206080/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204208 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204183.812314:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204183.812316:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204183.812319:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728206080:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204184.644029:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204184.707961:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204185.667999:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204185.731889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204186.692031:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204186.755908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204187.716023:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204187.779896:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204188.740006:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204188.803850:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204188.931928:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204188.931939:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204188.931943:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204188.931952:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3470 00000100:00080000:2.0:1788204188.931960:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204188.931966:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204188.932004:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f480 x1875064728206208/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204188.932030:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204188.932033:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204188.932035:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204188.932040:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3470 00000100:00080000:2.0:1788204188.932042:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204188.932045:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204188.932053:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204188.932065:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c000 x1875064728206336/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204188.932085:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728206208:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204188.932148:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204188.932209:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204188/real 1788204188] req@ffff8bc17257f480 x1875064728206208/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204213 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204188.932228:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f480 x1875064728206208/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204213 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204188.932242:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204188.932246:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204188.932250:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728206208:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204188.932272:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728206336:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204188.932292:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204188.932303:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204188/real 1788204188] req@ffff8bc17257c000 x1875064728206336/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204213 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204188.932349:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c000 x1875064728206336/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204213 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204188.932356:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204188.932359:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204188.932362:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728206336:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204189.764369:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204189.827953:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204190.788026:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204190.851934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204191.812008:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204191.875935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204192.836002:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204192.899938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204193.859935:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204193.923877:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204194.051942:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204194.051953:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204194.051958:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204194.051971:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3475 00000100:00080000:3.0:1788204194.051984:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204194.051992:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204194.052044:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728206464/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204194.052078:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204194.052081:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204194.052083:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204194.052087:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3475 00000100:00080000:3.0:1788204194.052091:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204194.052095:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204194.052106:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204194.052119:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728206592/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204194.052127:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728206464:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204194.052202:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204194.052272:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204194/real 1788204194] req@ffff8bc1726cce00 x1875064728206464/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204194.052288:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728206464/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204194.052296:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204194.052299:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204194.052302:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728206464:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204194.052328:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728206592:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204194.052366:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204194.052378:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204194/real 1788204194] req@ffff8bc1726cdc00 x1875064728206592/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204194.052387:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728206592/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204194.052392:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204194.052395:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204194.052397:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728206592:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204194.884004:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204194.947958:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204195.907945:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204195.971875:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204196.932022:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204196.995858:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204197.956002:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204198.019931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204198.980096:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204199.043963:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204199.171923:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204199.171932:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204199.171936:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204199.171946:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3480 00000100:00080000:3.0:1788204199.171958:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204199.171964:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204199.172010:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728206720/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204199.172045:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204199.172050:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204199.172052:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204199.172056:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3480 00000100:00080000:3.0:1788204199.172060:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204199.172064:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204199.172076:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204199.172088:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728206848/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204199.172105:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728206720:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204199.172194:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204199.172248:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204199/real 1788204199] req@ffff8bc1726cdc00 x1875064728206720/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204224 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204199.172262:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728206720/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204224 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204199.172270:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204199.172274:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204199.172277:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728206720:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204199.172303:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728206848:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204199.172320:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204199.172331:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204199/real 1788204199] req@ffff8bc1726cce00 x1875064728206848/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204224 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204199.172343:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728206848/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204224 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204199.172351:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204199.172355:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204199.172368:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728206848:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204200.004032:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204200.067949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204201.027999:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204201.091922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204202.052019:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204202.115939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204203.076043:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204203.139952:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204204.100096:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204204.163902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204204.291953:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204204.291967:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204204.291972:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204204.291984:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3485 00000100:00080000:3.0:1788204204.291999:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204204.292007:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204204.292070:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728206976/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204204.292107:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204204.292112:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204204.292114:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204204.292118:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3485 00000100:00080000:3.0:1788204204.292122:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204204.292126:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204204.292137:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204204.292148:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728207104/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204204.292233:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728206976:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204204.292318:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204204.292389:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204204/real 1788204204] req@ffff8bc1726ce680 x1875064728206976/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204229 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204204.292410:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728206976/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204229 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204204.292421:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204204.292425:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204204.292430:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728206976:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204204.292438:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728207104:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204204.292463:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204204.292476:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204204/real 1788204204] req@ffff8bc1726cc380 x1875064728207104/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204229 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204204.292487:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728207104/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204229 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204204.292501:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204204.292505:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204204.292508:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728207104:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204205.124048:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204205.187975:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204206.148004:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204206.211936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204207.171977:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204207.235933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204208.195946:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204208.259895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204209.219988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204209.283907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204209.411911:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204209.411923:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204209.411929:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204209.411940:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3490 00000100:00080000:2.0:1788204209.411967:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204209.411976:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204209.412021:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f800 x1875064728207232/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204209.412056:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204209.412060:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204209.412062:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204209.412065:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3490 00000100:00080000:2.0:1788204209.412069:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204209.412072:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204209.412082:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204209.412095:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257dc00 x1875064728207360/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204209.412119:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728207232:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204209.412191:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204209.412254:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204209/real 1788204209] req@ffff8bc17257f800 x1875064728207232/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204234 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204209.412275:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f800 x1875064728207232/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204234 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204209.412286:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204209.412291:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204209.412295:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728207232:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204209.412302:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728207360:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204209.412324:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204209.412335:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204209/real 1788204209] req@ffff8bc17257dc00 x1875064728207360/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204234 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204209.412347:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257dc00 x1875064728207360/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204234 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204209.412356:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204209.412359:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204209.412362:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728207360:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204210.244024:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204210.307958:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204211.267998:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204211.331871:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204212.292024:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204212.355967:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204213.316022:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204213.379915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204214.340020:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204214.403954:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204214.531919:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204214.531933:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204214.531938:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204214.531951:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3495 00000100:00080000:3.0:1788204214.531964:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204214.531971:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204214.532016:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728207488/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204214.532047:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204214.532051:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204214.532053:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204214.532058:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3495 00000100:00080000:3.0:1788204214.532061:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204214.532066:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204214.532077:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204214.532090:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728207616/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204214.532101:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728207488:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204214.532191:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204214.532246:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204214/real 1788204214] req@ffff8bc1726cea00 x1875064728207488/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204239 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204214.532266:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728207488/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204239 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204214.532277:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204214.532281:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204214.532285:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728207488:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204214.532316:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728207616:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204214.532338:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204214.532351:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204214/real 1788204214] req@ffff8bc1726ce300 x1875064728207616/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204239 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204214.532363:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728207616/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204239 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204214.532371:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204214.532374:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204214.532378:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728207616:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204215.363998:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204215.427926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204216.388042:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204216.451949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204217.411950:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204217.475995:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204218.435955:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204218.499978:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204219.459983:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204219.523897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204219.652182:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204219.652197:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204219.652204:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204219.652233:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3501 00000100:00080000:0.0:1788204219.652253:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204219.652263:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204219.652317:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140a80 x1875064728207744/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204219.652362:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204219.652366:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204219.652368:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204219.652372:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3501 00000100:00080000:0.0:1788204219.652376:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204219.652380:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204219.652393:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204219.652983:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728207744:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204219.653081:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204219.653152:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204219/real 1788204219] req@ffff8bc144140a80 x1875064728207744/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204244 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204219.653176:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140a80 x1875064728207744/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204244 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204219.653194:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204219.653199:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204219.653205:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728207744:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204219.653836:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142680 x1875064728207872/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204219.653998:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728207872:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204219.654033:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204219.654059:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204219/real 1788204219] req@ffff8bc144142680 x1875064728207872/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204244 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204219.654072:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142680 x1875064728207872/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204244 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204219.654078:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204219.654081:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204219.654083:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728207872:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204220.484196:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204220.547938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204221.507989:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204221.571904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204222.531946:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204222.595935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204223.556005:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204223.619920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204224.580015:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204224.643934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204224.771879:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204224.771892:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204224.771897:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204224.771910:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3506 00000100:00080000:0.0:1788204224.771923:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204224.771931:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204224.771976:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142d80 x1875064728208000/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204224.772005:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204224.772008:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204224.772011:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204224.772015:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3506 00000100:00080000:0.0:1788204224.772019:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204224.772023:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204224.772035:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204224.772047:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141180 x1875064728208128/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204224.772051:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728208000:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204224.772115:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204224.772161:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204224/real 1788204224] req@ffff8bc144142d80 x1875064728208000/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204249 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204224.772181:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142d80 x1875064728208000/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204249 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204224.772189:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204224.772191:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204224.772195:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728208000:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204224.772216:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728208128:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204224.772231:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204224.772238:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204224/real 1788204224] req@ffff8bc144141180 x1875064728208128/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204249 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204224.772252:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141180 x1875064728208128/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204249 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204224.772260:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204224.772263:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204224.772266:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728208128:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204225.604009:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204225.667982:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204226.627997:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204226.691989:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204227.651948:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204227.715891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204228.676012:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204228.739979:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204229.700004:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204229.763925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204229.891955:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204229.891969:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204229.891975:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204229.891988:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3511 00000100:00080000:3.0:1788204229.892003:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204229.892013:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204229.892062:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728208256/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204229.892087:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204229.892091:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204229.892092:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204229.892098:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3511 00000100:00080000:3.0:1788204229.892101:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204229.892105:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204229.892113:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204229.892123:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728208384/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204229.892140:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728208256:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204229.892218:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204229.892269:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204229/real 1788204229] req@ffff8bc1726cfb80 x1875064728208256/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204254 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204229.892284:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728208256/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204254 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204229.892291:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204229.892294:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204229.892297:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728208256:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204229.892323:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728208384:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204229.892338:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204229.892347:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204229/real 1788204229] req@ffff8bc1726ced80 x1875064728208384/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204254 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204229.892354:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728208384/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204254 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204229.892359:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204229.892361:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204229.892363:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728208384:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204230.723998:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204230.787945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204231.747983:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204231.811906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204232.771934:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204232.835918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204233.796035:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204233.859887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204234.820003:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204234.883866:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204235.011956:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204235.011966:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204235.011971:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204235.011982:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3516 00000100:00080000:2.0:1788204235.011991:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204235.011999:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204235.012036:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257dc00 x1875064728208512/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204235.012066:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204235.012070:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204235.012072:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204235.012075:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3516 00000100:00080000:2.0:1788204235.012078:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204235.012082:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204235.012090:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204235.012103:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f800 x1875064728208640/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204235.012146:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728208512:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204235.012230:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204235.012291:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204235/real 1788204235] req@ffff8bc17257dc00 x1875064728208512/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204235.012311:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257dc00 x1875064728208512/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204235.012323:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204235.012328:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204235.012333:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728208512:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204235.012341:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728208640:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204235.012366:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204235.012379:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204235/real 1788204235] req@ffff8bc17257f800 x1875064728208640/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204235.012391:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f800 x1875064728208640/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204235.012410:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204235.012418:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204235.012422:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728208640:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204235.843922:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204235.907881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204236.868046:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204236.931905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204237.891949:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204237.955891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204238.915946:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204238.979926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204239.939988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204240.003922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204240.131954:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204240.131965:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204240.131969:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204240.131978:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3521 00000100:00080000:3.0:1788204240.131996:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204240.132004:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204240.132047:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728208768/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204240.132078:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204240.132081:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204240.132082:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204240.132085:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3521 00000100:00080000:3.0:1788204240.132088:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204240.132091:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204240.132101:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204240.132111:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728208896/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204240.132136:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728208768:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204240.132271:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728208896:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204240.963965:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204241.027909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204241.987978:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204242.051937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204243.011994:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204243.075895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788204243.204229:0:10043:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788204243.204298:0:10043:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788204243.204318:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788204243.204395:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:0.0:1788204243.204556:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204240/real 1788204243] req@ffff8bc1726cca80 x1875064728208768/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204265 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204243.204586:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728208768/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204265 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204243.204600:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204243.204606:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204243.204612:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728208768:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204243.204621:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204240/real 1788204243] req@ffff8bc1726cd500 x1875064728208896/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204265 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204243.204635:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728208896/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204265 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204243.204644:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204243.204648:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204243.204651:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728208896:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204244.036008:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204244.099949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204245.059970:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204245.123890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204245.251926:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204245.251939:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204245.251943:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204245.251953:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3526 00000100:00080000:2.0:1788204245.251961:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204245.251966:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204245.251998:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c000 x1875064728209024/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204245.252032:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204245.252037:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204245.252039:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204245.252044:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3526 00000100:00080000:2.0:1788204245.252048:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204245.252054:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204245.252063:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728209024:192.168.201.143@tcp:250:kworker.0 00000008:00100000:2.0:1788204245.252063:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204245.252084:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f480 x1875064728209152/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788204245.252130:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204245.252173:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204245/real 1788204245] req@ffff8bc17257c000 x1875064728209024/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204270 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204245.252192:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c000 x1875064728209024/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204270 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204245.252202:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204245.252206:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204245.252210:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728209024:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204245.252239:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728209152:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204245.252268:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204245.252281:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204245/real 1788204245] req@ffff8bc17257f480 x1875064728209152/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204270 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204245.252300:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f480 x1875064728209152/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204270 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204245.252308:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204245.252311:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204245.252314:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728209152:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204246.083978:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204246.147993:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204247.108036:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204247.171947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204248.131973:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204248.195956:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204249.155984:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204249.219928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204250.179963:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204250.243868:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204250.371851:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204250.371859:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204250.371862:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204250.371870:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3531 00000100:00080000:2.0:1788204250.371879:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204250.371885:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204250.371915:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257df80 x1875064728209280/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204250.371935:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204250.371938:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204250.371940:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204250.371943:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3531 00000100:00080000:2.0:1788204250.371946:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204250.371950:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204250.371958:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204250.371970:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e680 x1875064728209408/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204250.371982:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728209280:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204250.372039:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204250.372086:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204250/real 1788204250] req@ffff8bc17257df80 x1875064728209280/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204275 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204250.372098:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257df80 x1875064728209280/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204275 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204250.372106:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204250.372109:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204250.372112:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728209280:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204250.372132:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728209408:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204250.372153:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204250.372165:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204250/real 1788204250] req@ffff8bc17257e680 x1875064728209408/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204275 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204250.372177:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e680 x1875064728209408/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204275 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204250.372186:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204250.372188:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204250.372190:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728209408:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204251.203993:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204251.267915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204252.227943:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204252.291885:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204253.252049:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204253.315946:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204254.275964:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204254.339953:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204255.300016:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204255.363942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204255.491956:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204255.491965:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204255.491970:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204255.491980:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3536 00000100:00080000:0.0:1788204255.491991:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204255.491998:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204255.492040:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141180 x1875064728209536/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204255.492065:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204255.492068:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204255.492069:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204255.492072:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3536 00000100:00080000:0.0:1788204255.492075:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204255.492078:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204255.492086:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204255.492094:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728209536:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204255.492098:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142d80 x1875064728209664/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788204255.492172:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204255.492239:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204255/real 1788204255] req@ffff8bc144141180 x1875064728209536/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204280 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204255.492255:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141180 x1875064728209536/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204280 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204255.492267:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204255.492270:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204255.492273:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728209536:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204255.492300:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728209664:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204255.492318:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204255.492326:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204255/real 1788204255] req@ffff8bc144142d80 x1875064728209664/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204280 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204255.492334:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142d80 x1875064728209664/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204280 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204255.492339:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204255.492342:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204255.492345:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728209664:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204256.324014:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204256.388244:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204257.347981:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204257.411941:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204258.372006:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204258.436364:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204259.396005:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204259.459953:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204260.419992:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204260.483942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204260.611911:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204260.611920:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204260.611924:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204260.611935:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3541 00000100:00080000:0.0:1788204260.611947:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204260.611954:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204260.611993:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142680 x1875064728209792/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204260.612023:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204260.612027:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204260.612029:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204260.612033:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3541 00000100:00080000:0.0:1788204260.612036:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204260.612041:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204260.612052:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204260.612076:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140a80 x1875064728209920/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204260.612099:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728209792:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204260.612170:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204260.612228:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204260/real 1788204260] req@ffff8bc144142680 x1875064728209792/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204285 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204260.612250:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142680 x1875064728209792/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204285 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204260.612262:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204260.612266:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204260.612271:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728209792:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204260.612297:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728209920:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204260.612320:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204260.612334:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204260/real 1788204260] req@ffff8bc144140a80 x1875064728209920/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204285 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204260.612347:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140a80 x1875064728209920/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204285 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204260.612356:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204260.612360:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204260.612363:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728209920:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204261.444029:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204261.507990:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204262.467995:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204262.531918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204263.492047:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204263.555922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204264.515988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204264.579874:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204265.540023:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204265.603944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204265.731900:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204265.731910:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204265.731916:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204265.731929:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3547 00000100:00080000:2.0:1788204265.731942:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204265.731959:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204265.732017:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ed80 x1875064728210048/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204265.732053:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204265.732063:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204265.732065:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204265.732070:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3547 00000100:00080000:2.0:1788204265.732075:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204265.732080:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204265.732091:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204265.732099:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728210048:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204265.732105:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d880 x1875064728210176/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788204265.732184:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204265.732237:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204265/real 1788204265] req@ffff8bc17257ed80 x1875064728210048/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204290 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204265.732252:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ed80 x1875064728210048/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204290 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204265.732261:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204265.732264:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204265.732267:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728210048:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204265.732289:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728210176:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204265.732305:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204265.732313:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204265/real 1788204265] req@ffff8bc17257d880 x1875064728210176/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204290 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204265.732320:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d880 x1875064728210176/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204290 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204265.732333:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204265.732335:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204265.732337:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728210176:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204266.563968:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204266.627944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204267.588027:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204267.651893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204268.612001:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204268.675875:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204269.635962:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204269.699928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204270.659972:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204270.723908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204270.851952:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204270.851962:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204270.851967:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204270.851976:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3552 00000100:00080000:3.0:1788204270.851988:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204270.851994:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204270.852033:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728210304/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204270.852057:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204270.852059:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204270.852061:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204270.852064:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3552 00000100:00080000:3.0:1788204270.852066:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204270.852069:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204270.852079:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204270.852091:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728210432/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204270.852141:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728210304:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204270.852218:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204270.852270:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204270/real 1788204270] req@ffff8bc1726cf480 x1875064728210304/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204295 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204270.852293:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728210304/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204295 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204270.852306:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204270.852310:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204270.852314:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728210304:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204270.852321:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728210432:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204270.852340:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204270.852350:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204270/real 1788204270] req@ffff8bc1726cf100 x1875064728210432/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204295 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204270.852361:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728210432/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204295 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204270.852369:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204270.852372:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204270.852375:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728210432:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204271.683941:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204271.747990:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204272.708001:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204272.771976:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204273.731945:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204273.795928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204274.756001:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204274.819954:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204275.780041:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204275.843941:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204275.971958:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204275.971970:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204275.971974:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204275.971985:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3557 00000100:00080000:3.0:1788204275.971995:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204275.972002:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204275.972057:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728210560/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204275.972097:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204275.972102:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204275.972104:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204275.972108:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3557 00000100:00080000:3.0:1788204275.972112:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204275.972116:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204275.972131:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204275.972143:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728210688/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204275.972156:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728210560:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204275.972232:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204275.972292:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204275/real 1788204275] req@ffff8bc1726cc700 x1875064728210560/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204300 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204275.972309:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728210560/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204300 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204275.972317:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204275.972320:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204275.972323:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728210560:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204275.972350:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728210688:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204275.972373:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204275.972393:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204275/real 1788204275] req@ffff8bc1726cd180 x1875064728210688/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204300 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204275.972404:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728210688/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204300 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204275.972409:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204275.972411:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204275.972414:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728210688:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204276.803987:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204276.867968:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204277.828058:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204277.891948:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204278.851986:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204278.915918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204279.876022:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204279.939924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204280.899949:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204280.963963:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204281.091941:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204281.091954:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204281.091960:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204281.091973:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3562 00000100:00080000:3.0:1788204281.091986:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204281.091994:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204281.092044:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728210816/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204281.092083:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204281.092087:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204281.092089:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204281.092093:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3562 00000100:00080000:3.0:1788204281.092097:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204281.092102:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204281.092113:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204281.092127:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728210944/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204281.092144:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728210816:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204281.092218:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204281.092276:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204281/real 1788204281] req@ffff8bc1726cdf80 x1875064728210816/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204281.092296:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728210816/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204281.092306:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204281.092310:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204281.092315:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728210816:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204281.092346:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728210944:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204281.092370:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204281.092379:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204281/real 1788204281] req@ffff8bc1726cf800 x1875064728210944/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204281.092387:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728210944/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204281.092392:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204281.092394:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204281.092396:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728210944:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204281.924033:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204281.988009:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204282.947993:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204283.011918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204283.971968:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204284.035924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204284.995985:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204285.059933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204286.019985:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204286.083944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204286.211933:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204286.211945:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204286.211950:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204286.211961:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3567 00000100:00080000:3.0:1788204286.211975:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204286.211982:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204286.212030:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728211072/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204286.212062:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204286.212067:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204286.212069:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204286.212073:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3567 00000100:00080000:3.0:1788204286.212076:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204286.212081:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204286.212091:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204286.212112:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728211200/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204286.212118:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728211072:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204286.212193:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204286.212262:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204286/real 1788204286] req@ffff8bc1726cf800 x1875064728211072/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204311 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204286.212283:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728211072/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204311 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204286.212295:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204286.212299:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204286.212303:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728211072:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204286.212340:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728211200:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204286.212367:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204286.212379:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204286/real 1788204286] req@ffff8bc1726cdf80 x1875064728211200/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204311 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204286.212392:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728211200/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204311 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204286.212417:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204286.212420:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204286.212424:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728211200:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204287.043972:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204287.108006:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204288.067973:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204288.131937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204289.091961:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204289.155920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204290.115992:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204290.179931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204291.139934:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204291.203876:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204291.331965:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204291.331980:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204291.331985:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204291.331997:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3572 00000100:00080000:3.0:1788204291.332010:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204291.332018:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204291.332065:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728211328/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204291.332096:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204291.332100:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204291.332102:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204291.332106:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3572 00000100:00080000:3.0:1788204291.332110:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204291.332114:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204291.332125:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204291.332138:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728211456/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204291.332158:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728211328:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204291.332234:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204291.332289:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204291/real 1788204291] req@ffff8bc1726cd180 x1875064728211328/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204316 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204291.332309:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728211328/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204316 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204291.332319:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204291.332322:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204291.332327:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728211328:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204291.332354:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728211456:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204291.332375:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204291.332386:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204291/real 1788204291] req@ffff8bc1726cc700 x1875064728211456/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204316 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204291.332398:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728211456/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204316 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204291.332406:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204291.332408:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204291.332410:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728211456:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204292.164014:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204292.227949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204293.188018:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204293.251931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204294.212002:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204294.275937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204295.235971:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204295.299948:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204296.259965:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204296.323905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204296.451939:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204296.451947:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204296.451950:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204296.451958:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3577 00000100:00080000:3.0:1788204296.451966:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204296.451971:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204296.452001:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728211584/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204296.452027:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204296.452031:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204296.452033:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204296.452036:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3577 00000100:00080000:3.0:1788204296.452040:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204296.452044:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204296.452052:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204296.452064:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728211712/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204296.452075:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728211584:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204296.452139:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204296.452209:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204296/real 1788204296] req@ffff8bc1726cf100 x1875064728211584/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204321 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204296.452233:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728211584/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204321 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204296.452243:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204296.452247:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204296.452250:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728211584:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204296.452278:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728211712:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204296.452299:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204296.452310:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204296/real 1788204296] req@ffff8bc1726cf480 x1875064728211712/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204321 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204296.452322:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728211712/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204321 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204296.452330:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204296.452334:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204296.452337:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728211712:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204297.283983:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204297.347938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204298.307941:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204298.371953:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204299.331999:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204299.395939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204300.356041:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204300.419941:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204301.379984:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204301.443912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204301.571922:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204301.571933:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204301.571937:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204301.571949:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3582 00000100:00080000:2.0:1788204301.571963:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204301.571972:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204301.572029:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ce00 x1875064728211840/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204301.572053:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204301.572056:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204301.572058:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204301.572060:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3582 00000100:00080000:2.0:1788204301.572065:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204301.572069:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204301.572078:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204301.572087:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ea00 x1875064728211968/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204301.572097:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728211840:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204301.572156:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204301.572205:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204301/real 1788204301] req@ffff8bc17257ce00 x1875064728211840/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204326 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204301.572224:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ce00 x1875064728211840/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204326 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204301.572235:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204301.572240:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204301.572244:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728211840:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204301.572270:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728211968:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204301.572292:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204301.572303:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204301/real 1788204301] req@ffff8bc17257ea00 x1875064728211968/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204326 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204301.572314:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ea00 x1875064728211968/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204326 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204301.572322:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204301.572325:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204301.572328:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728211968:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204302.403947:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204302.467912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204303.427940:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204303.491864:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204304.451984:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204304.515889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204305.475999:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204305.539929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204306.500022:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204306.563880:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204306.691941:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204306.691951:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204306.691956:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204306.691965:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3588 00000100:00080000:3.0:1788204306.691977:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204306.691983:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204306.692030:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728212096/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204306.692065:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204306.692069:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204306.692071:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204306.692075:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3588 00000100:00080000:3.0:1788204306.692079:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204306.692083:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204306.692094:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204306.692105:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728212224/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204306.692115:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728212096:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204306.692217:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728212224:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204307.523959:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204307.587939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204308.547917:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204308.611868:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204309.571963:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204309.635905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:0.0:1788204309.764109:0:10040:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:0.0:1788204309.764163:0:10040:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:0.0:1788204309.764179:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:0.0:1788204309.764232:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788204309.764323:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204306/real 1788204309] req@ffff8bc1726cca80 x1875064728212224/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204331 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204309.764349:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728212224/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204331 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204309.764362:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204309.764368:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204309.764372:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728212224:192.168.201.143@tcp:38:kworker.0 00000100:00100000:2.0:1788204309.764381:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204306/real 1788204309] req@ffff8bc1726cd500 x1875064728212096/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204331 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204309.764394:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728212096/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204331 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204309.764402:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204309.764406:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204309.764409:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728212096:192.168.201.143@tcp:250:kworker.0 00010000:00010000:2.0:1788204310.595917:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204310.659858:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204311.619949:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204311.683915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204311.811944:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204311.811959:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204311.811964:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204311.811977:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3593 00000100:00080000:0.0:1788204311.811991:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204311.812000:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204311.812043:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143100 x1875064728212352/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204311.812075:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204311.812080:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204311.812082:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204311.812085:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3593 00000100:00080000:0.0:1788204311.812089:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204311.812094:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204311.812111:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204311.812124:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140000 x1875064728212480/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204311.812131:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728212352:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204311.812221:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204311.812296:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204311/real 1788204311] req@ffff8bc144143100 x1875064728212352/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204336 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204311.812317:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143100 x1875064728212352/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204336 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204311.812340:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204311.812346:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204311.812351:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728212352:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204311.812381:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728212480:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204311.812406:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204311.812420:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204311/real 1788204311] req@ffff8bc144140000 x1875064728212480/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204336 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204311.812433:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140000 x1875064728212480/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204336 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204311.812442:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204311.812445:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204311.812449:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728212480:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204312.643915:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204312.707927:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204313.668181:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204313.731915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204314.691979:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204314.755936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204315.716008:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204315.779911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204316.740007:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204316.803906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204316.931927:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204316.931934:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204316.931937:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204316.931945:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3598 00000100:00080000:2.0:1788204316.931954:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204316.931959:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204316.931991:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ca80 x1875064728212608/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204316.932014:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204316.932017:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204316.932018:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204316.932020:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3598 00000100:00080000:2.0:1788204316.932022:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204316.932025:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204316.932032:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204316.932041:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257fb80 x1875064728212736/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204316.932064:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728212608:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204316.932179:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204316.932232:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204316/real 1788204316] req@ffff8bc17257ca80 x1875064728212608/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204341 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204316.932247:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ca80 x1875064728212608/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204341 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204316.932256:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204316.932260:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204316.932263:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728212608:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204316.932284:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728212736:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204316.932305:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204316.932314:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204316/real 1788204316] req@ffff8bc17257fb80 x1875064728212736/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204341 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204316.932321:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257fb80 x1875064728212736/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204341 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204316.932327:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204316.932329:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204316.932331:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728212736:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204317.763974:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204317.827976:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204318.787934:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204318.851859:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204319.811925:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204319.875891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204320.835956:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204320.899869:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204321.859995:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204321.923911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204322.051913:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204322.051925:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204322.051930:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204322.051942:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3603 00000100:00080000:1.0:1788204322.051954:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204322.051963:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204322.052025:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6300 x1875064728212864/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204322.052050:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204322.052053:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204322.052055:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204322.052058:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3603 00000100:00080000:1.0:1788204322.052061:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204322.052064:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204322.052072:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204322.052081:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6d80 x1875064728212992/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204322.052131:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728212864:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204322.052197:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204322.052249:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204322/real 1788204322] req@ffff8bc1727d6300 x1875064728212864/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204322.052263:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6300 x1875064728212864/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204322.052271:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204322.052274:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204322.052277:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728212864:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204322.052282:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728212992:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204322.052298:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204322.052306:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204322/real 1788204322] req@ffff8bc1727d6d80 x1875064728212992/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204322.052313:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6d80 x1875064728212992/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204322.052318:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204322.052327:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204322.052329:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728212992:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204322.883999:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204322.948075:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204323.907990:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204323.971913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204324.932057:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204324.995895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204325.955956:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204326.019894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204326.979991:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204327.043908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204327.171955:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204327.171967:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204327.171972:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204327.171982:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3608 00000100:00080000:2.0:1788204327.171994:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204327.172001:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204327.172043:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c380 x1875064728213120/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204327.172064:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204327.172066:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204327.172068:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204327.172075:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3608 00000100:00080000:2.0:1788204327.172078:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204327.172082:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204327.172091:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204327.172106:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e300 x1875064728213248/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204327.172136:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728213120:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204327.172206:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204327.172255:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204327/real 1788204327] req@ffff8bc17257c380 x1875064728213120/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204352 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204327.172270:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c380 x1875064728213120/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204352 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204327.172278:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204327.172281:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204327.172285:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728213120:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204327.172310:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728213248:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204327.172350:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204327.172365:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204327/real 1788204327] req@ffff8bc17257e300 x1875064728213248/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204352 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204327.172379:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e300 x1875064728213248/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204352 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204327.172389:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204327.172393:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204327.172396:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728213248:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204328.003945:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204328.067998:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204329.028025:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204329.091951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204330.051950:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204330.115879:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204331.076046:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204331.140000:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204332.100007:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204332.163937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204332.291903:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204332.291919:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204332.291923:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204332.291931:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3613 00000100:00080000:2.0:1788204332.291939:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204332.291944:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204332.291972:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d500 x1875064728213376/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204332.291991:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204332.291994:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204332.291995:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204332.291997:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3613 00000100:00080000:2.0:1788204332.291999:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204332.292001:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204332.292008:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204332.292016:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f100 x1875064728213504/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204332.292096:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728213376:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204332.292182:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204332.292249:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204332/real 1788204332] req@ffff8bc17257d500 x1875064728213376/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204357 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204332.292273:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d500 x1875064728213376/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204357 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204332.292293:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204332.292298:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204332.292302:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728213376:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204332.292313:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728213504:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204332.292341:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204332.292362:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204332/real 1788204332] req@ffff8bc17257f100 x1875064728213504/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204357 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204332.292377:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f100 x1875064728213504/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204357 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204332.292387:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204332.292390:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204332.292394:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728213504:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204333.124011:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204333.188015:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204334.148030:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204334.211891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204335.172029:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204335.235940:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204336.196018:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204336.259941:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204337.219982:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204337.283931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204337.411942:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204337.411951:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204337.411954:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204337.411962:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3618 00000100:00080000:0.0:1788204337.411970:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204337.411975:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204337.412015:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143800 x1875064728213632/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204337.412042:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204337.412046:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204337.412047:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204337.412051:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3618 00000100:00080000:0.0:1788204337.412056:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204337.412062:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204337.412071:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204337.412086:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140380 x1875064728213760/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204337.412106:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728213632:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204337.412191:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204337.412255:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204337/real 1788204337] req@ffff8bc144143800 x1875064728213632/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204362 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204337.412275:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143800 x1875064728213632/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204362 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204337.412285:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204337.412288:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204337.412292:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728213632:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204337.412322:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728213760:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204337.412340:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204337.412350:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204337/real 1788204337] req@ffff8bc144140380 x1875064728213760/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204362 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204337.412358:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140380 x1875064728213760/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204362 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204337.412364:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204337.412367:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204337.412369:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728213760:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204338.243968:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204338.307969:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204339.267990:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204339.331888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204340.291952:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204340.355876:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204341.315954:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204341.379899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204342.340051:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204342.403888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204342.531952:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204342.531960:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204342.531963:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204342.531971:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3623 00000100:00080000:2.0:1788204342.531979:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204342.531985:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204342.532016:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d180 x1875064728213888/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204342.532043:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204342.532046:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204342.532047:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204342.532049:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3623 00000100:00080000:2.0:1788204342.532051:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204342.532054:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204342.532060:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204342.532068:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c700 x1875064728214016/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204342.532098:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728213888:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204342.532159:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204342.532199:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204342/real 1788204342] req@ffff8bc17257d180 x1875064728213888/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204367 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204342.532211:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d180 x1875064728213888/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204367 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204342.532218:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204342.532220:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204342.532223:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728213888:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204342.532227:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728214016:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204342.532241:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204342.532248:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204342/real 1788204342] req@ffff8bc17257c700 x1875064728214016/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204367 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204342.532255:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c700 x1875064728214016/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204367 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204342.532260:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204342.532262:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204342.532264:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728214016:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204343.364036:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204343.427975:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204344.388017:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204344.451962:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204345.412035:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204345.475898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204346.436024:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204346.499886:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204347.459903:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204347.523903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204347.651959:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204347.651967:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204347.651970:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204347.651978:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3629 00000100:00080000:0.0:1788204347.651987:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204347.651993:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204347.652023:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141f80 x1875064728214144/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204347.652042:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204347.652045:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204347.652047:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204347.652049:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3629 00000100:00080000:0.0:1788204347.652051:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204347.652054:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204347.652061:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204347.652070:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728214144:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204347.652071:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142300 x1875064728214272/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788204347.652124:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204347.652164:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204347/real 1788204347] req@ffff8bc144141f80 x1875064728214144/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204372 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204347.652181:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141f80 x1875064728214144/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204372 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204347.652192:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204347.652195:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204347.652200:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728214144:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204347.652220:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728214272:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204347.652235:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204347.652244:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204347/real 1788204347] req@ffff8bc144142300 x1875064728214272/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204372 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204347.652251:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142300 x1875064728214272/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204372 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204347.652256:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204347.652258:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204347.652260:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728214272:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204348.483957:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204348.547963:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204349.507943:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204349.571923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204350.532020:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204350.595937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204351.556045:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204351.619954:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204352.579980:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204352.643920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204352.771904:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204352.771911:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204352.771915:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204352.771924:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3634 00000100:00080000:3.0:1788204352.771934:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204352.771941:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204352.771977:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728214400/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204352.772004:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204352.772008:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204352.772010:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204352.772013:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3634 00000100:00080000:3.0:1788204352.772017:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204352.772021:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204352.772029:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204352.772040:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728214528/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204352.772046:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728214400:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204352.772104:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204352.772148:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204352/real 1788204352] req@ffff8bc1726ced80 x1875064728214400/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204377 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204352.772165:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728214400/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204377 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204352.772174:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204352.772177:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204352.772181:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728214400:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204352.772211:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728214528:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204352.772233:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204352.772245:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204352/real 1788204352] req@ffff8bc1726cfb80 x1875064728214528/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204377 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204352.772258:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728214528/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204377 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204352.772267:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204352.772270:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204352.772272:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728214528:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204353.604055:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204353.667922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204354.627960:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204354.691923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204355.651990:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204355.715978:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204356.675988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204356.739923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204357.700011:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204357.763953:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204357.891910:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204357.891918:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204357.891922:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204357.891932:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3639 00000100:00080000:3.0:1788204357.891942:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204357.891956:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204357.891993:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728214656/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204357.892020:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204357.892024:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204357.892026:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204357.892030:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3639 00000100:00080000:3.0:1788204357.892033:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204357.892037:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204357.892046:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204357.892060:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728214784/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204357.892103:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728214656:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204357.892181:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204357.892236:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204357/real 1788204357] req@ffff8bc1726ce300 x1875064728214656/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204382 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204357.892251:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728214656/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204382 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204357.892259:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204357.892261:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204357.892265:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728214656:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204357.892270:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728214784:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204357.892285:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204357.892293:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204357/real 1788204357] req@ffff8bc1726cea00 x1875064728214784/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204382 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204357.892300:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728214784/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204382 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204357.892305:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204357.892306:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204357.892308:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728214784:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204358.723907:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204358.787915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204359.747933:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204359.811863:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204360.771969:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204360.835888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204361.796030:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204361.859964:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204362.819975:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204362.883898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204363.011939:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204363.011948:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204363.011952:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204363.011962:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3644 00000100:00080000:0.0:1788204363.011972:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204363.011980:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204363.012016:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143b80 x1875064728214912/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204363.012049:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204363.012053:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204363.012055:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204363.012059:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3644 00000100:00080000:0.0:1788204363.012062:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204363.012067:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204363.012076:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204363.012088:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141500 x1875064728215040/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204363.012105:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728214912:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204363.012179:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204363.012238:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204363/real 1788204363] req@ffff8bc144143b80 x1875064728214912/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204363.012256:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143b80 x1875064728214912/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204363.012267:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204363.012272:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204363.012276:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728214912:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204363.012308:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728215040:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204363.012334:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204363.012347:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204363/real 1788204363] req@ffff8bc144141500 x1875064728215040/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204363.012360:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141500 x1875064728215040/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204363.012368:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204363.012371:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204363.012374:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728215040:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204363.843978:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204363.907966:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204364.867933:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204364.931870:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204365.892007:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204365.955894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204366.915965:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204366.979887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204367.939984:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204368.003942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204368.131907:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204368.131920:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204368.131930:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204368.131943:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3649 00000100:00080000:0.0:1788204368.131963:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204368.131972:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204368.132021:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143480 x1875064728215168/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204368.132056:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204368.132059:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204368.132062:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204368.132066:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3649 00000100:00080000:0.0:1788204368.132070:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204368.132073:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204368.132085:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204368.132098:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141880 x1875064728215296/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204368.132104:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728215168:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204368.132167:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204368.132226:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204368/real 1788204368] req@ffff8bc144143480 x1875064728215168/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204368.132241:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143480 x1875064728215168/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204368.132249:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204368.132252:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204368.132256:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728215168:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204368.132278:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728215296:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204368.132299:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204368.132313:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204368/real 1788204368] req@ffff8bc144141880 x1875064728215296/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204368.132326:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141880 x1875064728215296/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204368.132335:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204368.132337:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204368.132339:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728215296:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204368.964017:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204369.027941:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204369.987994:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204370.051895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204371.011985:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204371.075947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204372.035989:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204372.099912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204373.059974:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204373.123896:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204373.251868:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204373.251877:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204373.251881:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204373.251891:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3654 00000100:00080000:0.0:1788204373.251900:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204373.251906:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204373.251938:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142a00 x1875064728215424/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204373.251963:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204373.251966:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204373.251968:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204373.251972:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3654 00000100:00080000:0.0:1788204373.251975:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204373.251979:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204373.251988:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204373.251999:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140e00 x1875064728215552/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204373.252007:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728215424:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204373.252106:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728215552:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204374.083932:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204374.147918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204375.107949:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204375.171887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204376.131922:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204376.195955:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788204376.324094:0:10041:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788204376.324140:0:10041:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788204376.324157:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788204376.324212:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788204376.324303:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204373/real 1788204376] req@ffff8bc144140e00 x1875064728215552/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204376.324342:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140e00 x1875064728215552/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204376.324353:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204376.324358:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204376.324361:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728215552:192.168.201.143@tcp:38:kworker.0 00000100:00100000:2.0:1788204376.324369:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204373/real 1788204376] req@ffff8bc144142a00 x1875064728215424/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204376.324381:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142a00 x1875064728215424/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204376.324388:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204376.324392:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204376.324395:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728215424:192.168.201.143@tcp:250:kworker.0 00010000:00010000:2.0:1788204377.155965:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204377.219927:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204378.179994:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204378.243964:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204378.371934:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204378.371948:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204378.371953:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204378.371967:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3659 00000100:00080000:0.0:1788204378.371980:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204378.371989:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204378.372048:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140700 x1875064728215680/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204378.372080:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204378.372085:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204378.372086:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204378.372090:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3659 00000100:00080000:0.0:1788204378.372094:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204378.372098:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204378.372109:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204378.372121:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141c00 x1875064728215808/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204378.372150:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728215680:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204378.372237:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204378.372293:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204378/real 1788204378] req@ffff8bc144140700 x1875064728215680/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204403 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204378.372327:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140700 x1875064728215680/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204403 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204378.372340:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204378.372344:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204378.372348:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728215680:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204378.372387:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728215808:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204378.372411:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204378.372424:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204378/real 1788204378] req@ffff8bc144141c00 x1875064728215808/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204403 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204378.372435:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141c00 x1875064728215808/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204403 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204378.372442:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204378.372445:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204378.372448:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728215808:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204379.203969:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204379.267917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204380.228027:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204380.291940:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204381.251922:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204381.315895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204382.275943:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204382.339932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204383.299977:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204383.363928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204383.491924:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204383.491958:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204383.491962:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204383.491972:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3664 00000100:00080000:1.0:1788204383.491984:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204383.491990:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204383.492024:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6680 x1875064728215936/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204383.492048:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204383.492051:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204383.492053:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204383.492056:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3664 00000100:00080000:1.0:1788204383.492060:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204383.492064:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204383.492073:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204383.492086:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5500 x1875064728216064/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204383.492098:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728215936:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204383.492161:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204383.492211:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204383/real 1788204383] req@ffff8bc1727d6680 x1875064728215936/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204408 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204383.492230:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6680 x1875064728215936/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204408 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204383.492238:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204383.492241:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204383.492243:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728215936:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204383.492260:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728216064:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204383.492277:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204383.492285:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204383/real 1788204383] req@ffff8bc1727d5500 x1875064728216064/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204408 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204383.492293:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5500 x1875064728216064/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204408 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204383.492298:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204383.492300:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204383.492302:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728216064:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204384.323957:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204384.387924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204385.347964:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204385.411886:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204386.371941:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204386.435863:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204387.395999:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204387.459984:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204388.419934:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204388.483902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204388.611911:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204388.611921:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204388.611925:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204388.611935:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3669 00000100:00080000:1.0:1788204388.611945:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204388.611953:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204388.611989:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4380 x1875064728216192/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204388.612015:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204388.612019:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204388.612021:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204388.612025:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3669 00000100:00080000:1.0:1788204388.612028:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204388.612032:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204388.612041:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204388.612056:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5f80 x1875064728216320/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204388.612058:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728216192:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204388.612115:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204388.612158:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204388/real 1788204388] req@ffff8bc1727d4380 x1875064728216192/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204413 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204388.612171:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4380 x1875064728216192/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204413 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204388.612178:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204388.612181:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204388.612183:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728216192:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204388.612200:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728216320:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204388.612215:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204388.612222:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204388/real 1788204388] req@ffff8bc1727d5f80 x1875064728216320/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204413 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204388.612228:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5f80 x1875064728216320/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204413 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204388.612233:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204388.612235:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204388.612237:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728216320:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204389.443947:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204389.508002:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204390.467919:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204390.531891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204391.491960:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204391.555934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204392.515970:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204392.579945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204393.539956:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204393.603964:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204393.731913:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204393.731923:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204393.731927:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204393.731937:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3675 00000100:00080000:1.0:1788204393.731947:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204393.731954:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204393.731990:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4000 x1875064728216448/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204393.732018:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204393.732022:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204393.732024:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204393.732028:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3675 00000100:00080000:1.0:1788204393.732031:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204393.732036:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204393.732045:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204393.732059:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5180 x1875064728216576/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204393.732073:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728216448:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204393.732136:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204393.732175:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204393/real 1788204393] req@ffff8bc1727d4000 x1875064728216448/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204418 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204393.732187:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4000 x1875064728216448/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204418 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204393.732194:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204393.732196:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204393.732199:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728216448:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204393.732217:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728216576:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204393.732232:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204393.732239:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204393/real 1788204393] req@ffff8bc1727d5180 x1875064728216576/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204418 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204393.732249:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5180 x1875064728216576/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204418 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204393.732257:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204393.732260:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204393.732263:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728216576:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204394.563955:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204394.628006:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204395.587960:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204395.651872:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204396.611972:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204396.675883:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204397.635963:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204397.699911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204398.659964:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204398.723913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204398.851944:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204398.851953:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204398.851957:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204398.851966:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3680 00000100:00080000:0.0:1788204398.851977:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204398.851984:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204398.852027:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141c00 x1875064728216704/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204398.852057:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204398.852062:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204398.852064:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204398.852067:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3680 00000100:00080000:0.0:1788204398.852071:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204398.852075:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204398.852084:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204398.852098:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140700 x1875064728216832/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204398.852104:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728216704:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204398.852170:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204398.852216:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204398/real 1788204398] req@ffff8bc144141c00 x1875064728216704/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204423 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204398.852230:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141c00 x1875064728216704/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204423 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204398.852237:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204398.852239:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204398.852242:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728216704:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204398.852262:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728216832:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204398.852282:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204398.852293:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204398/real 1788204398] req@ffff8bc144140700 x1875064728216832/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204423 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204398.852305:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140700 x1875064728216832/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204423 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204398.852313:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204398.852316:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204398.852318:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728216832:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204399.683981:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204399.747998:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204400.707966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204400.771921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204401.732000:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204401.795916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204402.755970:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204402.819944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204403.779940:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204403.843907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204403.971914:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204403.971925:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204403.971928:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204403.971936:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3685 00000100:00080000:1.0:1788204403.971944:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204403.971949:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204403.971978:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7480 x1875064728216960/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204403.971998:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204403.972000:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204403.972001:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204403.972004:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3685 00000100:00080000:1.0:1788204403.972007:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204403.972011:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204403.972019:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204403.972032:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5880 x1875064728217088/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204403.972047:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728216960:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204403.972107:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204403.972150:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204403/real 1788204403] req@ffff8bc1727d7480 x1875064728216960/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204428 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204403.972168:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7480 x1875064728216960/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204428 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204403.972178:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204403.972182:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204403.972187:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728216960:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204403.972209:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728217088:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204403.972229:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204403.972241:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204403/real 1788204403] req@ffff8bc1727d5880 x1875064728217088/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204428 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204403.972253:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5880 x1875064728217088/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204428 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204403.972271:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204403.972277:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204403.972281:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728217088:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204404.803971:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204404.867892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204405.827923:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204405.891867:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204406.851963:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204406.915887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204407.875896:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204407.939853:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204408.899994:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204408.963932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204409.091881:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204409.091888:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204409.091891:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204409.091899:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3690 00000100:00080000:0.0:1788204409.091907:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204409.091913:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204409.091942:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142a00 x1875064728217216/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204409.091962:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204409.091965:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204409.091966:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204409.091968:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3690 00000100:00080000:0.0:1788204409.091970:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204409.091972:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204409.091979:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204409.091991:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140e00 x1875064728217344/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204409.092013:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728217216:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204409.092063:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204409.092114:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204409/real 1788204409] req@ffff8bc144142a00 x1875064728217216/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204409.092128:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142a00 x1875064728217216/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204409.092135:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204409.092137:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204409.092140:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728217216:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204409.092144:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728217344:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204409.092158:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204409.092165:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204409/real 1788204409] req@ffff8bc144140e00 x1875064728217344/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204409.092173:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140e00 x1875064728217344/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204409.092178:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204409.092180:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204409.092182:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728217344:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204409.923947:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204409.987951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204410.947980:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204411.011931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204411.971981:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204412.035925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204412.995966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204413.059948:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204414.019962:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204414.083879:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204414.211936:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204414.211947:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204414.211952:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204414.211963:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3695 00000100:00080000:2.0:1788204414.211975:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204414.211982:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204414.212025:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c700 x1875064728217472/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204414.212054:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204414.212057:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204414.212058:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204414.212061:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3695 00000100:00080000:2.0:1788204414.212063:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204414.212067:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204414.212075:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204414.212084:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d180 x1875064728217600/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204414.212106:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728217472:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204414.212186:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204414.212234:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204414/real 1788204414] req@ffff8bc17257c700 x1875064728217472/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204439 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204414.212248:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c700 x1875064728217472/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204439 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204414.212256:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204414.212258:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204414.212261:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728217472:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204414.212281:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728217600:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204414.212301:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204414.212314:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204414/real 1788204414] req@ffff8bc17257d180 x1875064728217600/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204439 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204414.212325:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d180 x1875064728217600/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204439 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204414.212334:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204414.212337:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204414.212340:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728217600:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204415.043949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204415.107925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204416.067967:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204416.131847:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204417.091938:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204417.155884:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204418.115947:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204418.179887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204419.139953:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204419.203884:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204419.331889:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204419.331898:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204419.331902:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204419.331912:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3700 00000100:00080000:1.0:1788204419.331922:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204419.331929:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204419.331964:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5880 x1875064728217728/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204419.331989:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204419.331993:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204419.331994:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204419.331998:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3700 00000100:00080000:1.0:1788204419.332001:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204419.332005:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204419.332013:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204419.332028:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7480 x1875064728217856/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204419.332039:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728217728:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204419.332097:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204419.332138:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204419/real 1788204419] req@ffff8bc1727d5880 x1875064728217728/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204444 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204419.332155:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5880 x1875064728217728/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204444 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204419.332165:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204419.332168:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204419.332172:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728217728:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204419.332191:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728217856:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204419.332210:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204419.332221:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204419/real 1788204419] req@ffff8bc1727d7480 x1875064728217856/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204444 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204419.332231:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7480 x1875064728217856/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204444 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204419.332239:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204419.332242:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204419.332245:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728217856:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204420.163944:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204420.227905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204421.187982:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204421.251910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204422.211960:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204422.275874:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204423.235983:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204423.299866:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204424.260002:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204424.323892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204424.451923:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204424.451936:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204424.451941:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204424.451954:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3705 00000100:00080000:3.0:1788204424.451968:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204424.451977:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204424.452023:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728217984/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204424.452055:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204424.452059:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204424.452061:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204424.452064:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3705 00000100:00080000:3.0:1788204424.452069:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204424.452073:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204424.452084:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204424.452100:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728218112/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204424.452102:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728217984:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204424.452182:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204424.452251:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204424/real 1788204424] req@ffff8bc1726cc380 x1875064728217984/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204449 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204424.452272:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728217984/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204449 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204424.452285:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204424.452289:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204424.452292:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728217984:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204424.452318:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728218112:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204424.452347:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204424.452356:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204424/real 1788204424] req@ffff8bc1726ce680 x1875064728218112/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204449 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204424.452364:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728218112/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204449 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204424.452373:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204424.452375:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204424.452377:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728218112:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204425.283953:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204425.347936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204426.307986:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204426.371920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204427.331963:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204427.395920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204428.355947:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204428.419878:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204429.379929:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204429.443908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204429.571921:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204429.571935:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204429.571940:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204429.571953:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3710 00000100:00080000:3.0:1788204429.571966:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204429.571975:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204429.572022:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728218240/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204429.572058:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204429.572067:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204429.572069:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204429.572074:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3710 00000100:00080000:3.0:1788204429.572078:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204429.572083:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204429.572095:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204429.572108:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728218240:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788204429.572112:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728218368/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788204429.572210:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204429.572272:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204429/real 1788204429] req@ffff8bc1726cce00 x1875064728218240/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204454 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204429.572294:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728218240/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204454 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204429.572305:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204429.572310:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204429.572314:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728218240:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204429.572345:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728218368:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204429.572369:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204429.572379:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204429/real 1788204429] req@ffff8bc1726cdc00 x1875064728218368/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204454 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204429.572387:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728218368/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204454 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204429.572393:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204429.572395:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204429.572398:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728218368:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204430.403988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204430.468007:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204431.428002:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204431.491953:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204432.452002:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204432.515908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204433.476039:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204433.539926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204434.499959:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204434.563908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204434.691913:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204434.691928:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204434.691933:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204434.691945:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3716 00000100:00080000:2.0:1788204434.691958:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204434.691968:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204434.692020:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f100 x1875064728218496/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204434.692063:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204434.692067:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204434.692069:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204434.692074:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3716 00000100:00080000:2.0:1788204434.692077:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204434.692082:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204434.692095:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204434.692110:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728218496:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204434.692113:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d500 x1875064728218624/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788204434.692191:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204434.692246:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204434/real 1788204434] req@ffff8bc17257f100 x1875064728218496/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204459 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204434.692261:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f100 x1875064728218496/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204459 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204434.692270:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204434.692273:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204434.692276:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728218496:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204434.692301:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728218624:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204434.692317:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204434.692324:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204434/real 1788204434] req@ffff8bc17257d500 x1875064728218624/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204459 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204434.692332:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d500 x1875064728218624/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204459 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204434.692337:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204434.692338:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204434.692340:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728218624:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204435.523965:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204435.587883:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204436.548031:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204436.611954:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204437.571948:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204437.635929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204438.595953:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204438.659936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204439.620010:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204439.683889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204439.811974:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204439.811984:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204439.811989:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204439.811999:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3721 00000100:00080000:2.0:1788204439.812011:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204439.812018:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204439.812062:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e300 x1875064728218752/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204439.812088:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204439.812091:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204439.812093:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204439.812095:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3721 00000100:00080000:2.0:1788204439.812098:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204439.812100:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204439.812110:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204439.812119:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c380 x1875064728218880/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204439.812144:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728218752:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204439.812256:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728218880:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204440.643959:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204440.708019:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204441.667961:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204441.731892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204442.691955:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204442.755913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788204442.884099:0:10042:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788204442.884144:0:10042:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788204442.884160:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788204442.884197:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:0.0:1788204442.884251:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204439/real 1788204442] req@ffff8bc17257e300 x1875064728218752/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204464 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204442.884275:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e300 x1875064728218752/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204464 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204442.884287:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204442.884291:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204442.884296:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728218752:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204442.884303:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204439/real 1788204442] req@ffff8bc17257c380 x1875064728218880/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204464 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204442.884315:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c380 x1875064728218880/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204464 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204442.884323:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204442.884326:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204442.884329:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728218880:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204443.715941:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204443.779906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204444.739956:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204444.803882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204444.931934:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204444.931943:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204444.931947:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204444.931957:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3726 00000100:00080000:0.0:1788204444.931966:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204444.931972:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204444.932002:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141880 x1875064728219008/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204444.932046:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204444.932050:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204444.932052:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204444.932056:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3726 00000100:00080000:0.0:1788204444.932059:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204444.932063:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204444.932071:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204444.932084:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143480 x1875064728219136/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204444.932089:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728219008:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204444.932157:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204444.932208:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204444/real 1788204444] req@ffff8bc144141880 x1875064728219008/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204469 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204444.932226:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141880 x1875064728219008/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204469 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204444.932237:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204444.932241:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204444.932255:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728219008:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204444.932278:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728219136:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204444.932309:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204444.932321:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204444/real 1788204444] req@ffff8bc144143480 x1875064728219136/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204469 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204444.932333:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143480 x1875064728219136/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204469 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204444.932347:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204444.932351:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204444.932354:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728219136:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204445.764003:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204445.827999:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204446.788043:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204446.851895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204447.812049:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204447.875984:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204448.836027:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204448.899945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204449.860000:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204449.923926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204450.051881:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204450.051890:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204450.051895:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204450.051905:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3731 00000100:00080000:0.0:1788204450.051916:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204450.051922:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204450.051962:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141500 x1875064728219264/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204450.051994:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204450.051998:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204450.052000:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204450.052004:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3731 00000100:00080000:0.0:1788204450.052007:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204450.052012:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204450.052024:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204450.052037:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143b80 x1875064728219392/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204450.052050:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728219264:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204450.052118:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204450.052183:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204450/real 1788204450] req@ffff8bc144141500 x1875064728219264/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204450.052203:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141500 x1875064728219264/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204450.052214:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204450.052218:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204450.052223:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728219264:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204450.052252:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728219392:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204450.052275:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204450.052289:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204450/real 1788204450] req@ffff8bc144143b80 x1875064728219392/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204450.052301:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143b80 x1875064728219392/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204450.052310:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204450.052312:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204450.052316:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728219392:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204450.883999:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204450.948820:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204451.908018:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204451.971916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204452.931997:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204452.995949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204453.955962:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204454.020078:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204454.979996:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204455.043934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204455.171976:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204455.171991:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204455.171997:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204455.172011:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3736 00000100:00080000:0.0:1788204455.172026:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204455.172035:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204455.172094:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142300 x1875064728219520/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204455.172123:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204455.172127:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204455.172129:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204455.172133:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3736 00000100:00080000:0.0:1788204455.172137:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204455.172141:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204455.172154:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204455.172162:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728219520:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204455.172176:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141f80 x1875064728219648/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788204455.172239:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204455.172310:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204455/real 1788204455] req@ffff8bc144142300 x1875064728219520/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204455.172331:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142300 x1875064728219520/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204455.172342:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204455.172347:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204455.172351:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728219520:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204455.172381:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728219648:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204455.172405:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204455.172419:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204455/real 1788204455] req@ffff8bc144141f80 x1875064728219648/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204455.172432:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141f80 x1875064728219648/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204455.172441:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204455.172444:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204455.172447:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728219648:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204456.003991:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204456.067932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204457.027954:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204457.091879:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204458.051977:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204458.115946:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204459.076004:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204459.139928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204460.100034:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204460.163925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204460.291887:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204460.291896:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204460.291900:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204460.291910:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3741 00000100:00080000:1.0:1788204460.291921:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204460.291931:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204460.291976:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5180 x1875064728219776/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204460.291999:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204460.292002:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204460.292003:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204460.292005:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3741 00000100:00080000:1.0:1788204460.292008:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204460.292011:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204460.292021:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204460.292031:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4000 x1875064728219904/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204460.292044:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728219776:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204460.292112:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204460.292176:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204460/real 1788204460] req@ffff8bc1727d5180 x1875064728219776/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204460.292197:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5180 x1875064728219776/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204460.292205:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204460.292207:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204460.292210:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728219776:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204460.292232:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728219904:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204460.292249:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204460.292258:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204460/real 1788204460] req@ffff8bc1727d4000 x1875064728219904/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204460.292266:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4000 x1875064728219904/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204460.292271:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204460.292273:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204460.292275:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728219904:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204461.124018:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204461.187937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204462.148018:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204462.211937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204463.172028:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204463.235950:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204464.195941:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204464.259915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204465.219980:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204465.283866:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204465.411946:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204465.411955:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204465.411959:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204465.411969:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3746 00000100:00080000:0.0:1788204465.411981:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204465.411989:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204465.412030:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140380 x1875064728220032/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204465.412055:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204465.412058:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204465.412060:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204465.412063:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3746 00000100:00080000:0.0:1788204465.412065:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204465.412067:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204465.412076:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204465.412085:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143800 x1875064728220160/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204465.412114:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728220032:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204465.412183:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204465.412242:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204465/real 1788204465] req@ffff8bc144140380 x1875064728220032/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204490 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204465.412257:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140380 x1875064728220032/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204490 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204465.412265:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204465.412268:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204465.412271:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728220032:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204465.412276:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728220160:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204465.412292:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204465.412300:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204465/real 1788204465] req@ffff8bc144143800 x1875064728220160/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204490 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204465.412307:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143800 x1875064728220160/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204490 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204465.412312:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204465.412313:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204465.412315:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728220160:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204466.244021:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204466.307934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204467.268026:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204467.331953:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204468.291985:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204468.355937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204469.315980:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204469.379949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204470.339995:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204470.403949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204470.531934:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204470.531946:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204470.531951:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204470.531964:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3751 00000100:00080000:2.0:1788204470.531978:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204470.531987:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204470.532036:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257fb80 x1875064728220288/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204470.532074:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204470.532079:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204470.532081:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204470.532085:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3751 00000100:00080000:2.0:1788204470.532090:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204470.532097:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204470.532109:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204470.532119:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728220288:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204470.532124:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ca80 x1875064728220416/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788204470.532192:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204470.532245:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204470/real 1788204470] req@ffff8bc17257fb80 x1875064728220288/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204495 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204470.532262:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257fb80 x1875064728220288/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204495 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204470.532273:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204470.532277:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204470.532280:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728220288:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204470.532306:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728220416:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204470.532324:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204470.532332:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204470/real 1788204470] req@ffff8bc17257ca80 x1875064728220416/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204495 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204470.532340:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ca80 x1875064728220416/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204495 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204470.532345:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204470.532347:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204470.532349:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728220416:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204471.364044:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204471.427933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204472.387997:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204472.451938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204473.411947:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204473.475944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204474.435998:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204474.499912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204475.460011:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204475.523923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204475.651955:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204475.651966:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204475.651970:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204475.651980:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3757 00000100:00080000:0.0:1788204475.651992:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204475.651999:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204475.652045:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140000 x1875064728220544/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204475.652071:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204475.652074:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204475.652075:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204475.652078:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3757 00000100:00080000:0.0:1788204475.652081:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204475.652085:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204475.652094:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204475.652105:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143100 x1875064728220672/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204475.652111:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728220544:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204475.652180:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204475.652233:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204475/real 1788204475] req@ffff8bc144140000 x1875064728220544/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204500 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204475.652252:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140000 x1875064728220544/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204500 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204475.652262:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204475.652266:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204475.652270:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728220544:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204475.652297:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728220672:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204475.652344:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204475.652359:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204475/real 1788204475] req@ffff8bc144143100 x1875064728220672/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204500 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204475.652371:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143100 x1875064728220672/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204500 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204475.652379:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204475.652382:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204475.652386:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728220672:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204476.484012:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204476.547933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204477.507981:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204477.571918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204478.531905:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204478.595894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204479.555960:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204479.619872:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204480.579917:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204480.643907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204480.771891:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204480.771899:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204480.771902:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204480.771917:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3762 00000100:00080000:3.0:1788204480.771925:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204480.771931:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204480.771961:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728220800/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204480.771982:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204480.771984:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204480.771985:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204480.771988:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3762 00000100:00080000:3.0:1788204480.771990:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204480.771992:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204480.771998:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204480.772007:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728220928/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204480.772021:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728220800:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204480.772070:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204480.772110:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204480/real 1788204480] req@ffff8bc1726cdc00 x1875064728220800/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204505 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204480.772123:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728220800/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204505 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204480.772130:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204480.772132:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204480.772135:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728220800:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204480.772150:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728220928:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204480.772163:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204480.772175:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204480/real 1788204480] req@ffff8bc1726cce00 x1875064728220928/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204505 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204480.772183:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728220928/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204505 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204480.772188:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204480.772190:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204480.772192:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728220928:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204481.603915:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204481.667916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204482.627972:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204482.691912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204483.651911:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204483.715870:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204484.675921:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204484.739887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204485.699881:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204485.763860:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204485.891900:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204485.891908:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204485.891911:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204485.891919:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3767 00000100:00080000:3.0:1788204485.891928:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204485.891933:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204485.891963:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728221056/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204485.891982:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204485.891984:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204485.891985:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204485.891988:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3767 00000100:00080000:3.0:1788204485.891990:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204485.891992:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204485.891998:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204485.892005:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728221184/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204485.892033:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728221056:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204485.892091:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204485.892135:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204485/real 1788204485] req@ffff8bc1726ce680 x1875064728221056/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204510 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204485.892164:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728221056/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204510 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204485.892174:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204485.892178:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204485.892182:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728221056:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204485.892188:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728221184:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204485.892208:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204485.892220:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204485/real 1788204485] req@ffff8bc1726cc380 x1875064728221184/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204510 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204485.892231:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728221184/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204510 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204485.892239:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204485.892241:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204485.892245:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728221184:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204486.723947:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204486.787914:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204487.747962:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204487.811871:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204488.771941:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204488.835889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204489.795961:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204489.859900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204490.819987:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204490.883928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204491.011945:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204491.011955:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204491.011959:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204491.011968:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3772 00000100:00080000:1.0:1788204491.011978:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204491.011984:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204491.012027:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5f80 x1875064728221312/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204491.012057:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204491.012061:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204491.012063:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204491.012080:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3772 00000100:00080000:1.0:1788204491.012083:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204491.012088:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204491.012097:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204491.012107:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728221312:192.168.201.143@tcp:250:kworker.0 00000100:00100000:1.0:1788204491.012114:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4380 x1875064728221440/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788204491.012166:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204491.012220:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204491/real 1788204491] req@ffff8bc1727d5f80 x1875064728221312/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204491.012236:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5f80 x1875064728221312/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204491.012244:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204491.012248:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204491.012251:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728221312:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204491.012268:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728221440:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204491.012284:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204491.012292:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204491/real 1788204491] req@ffff8bc1727d4380 x1875064728221440/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204491.012299:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4380 x1875064728221440/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204491.012304:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204491.012306:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204491.012308:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728221440:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204491.843980:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204491.908001:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204492.867949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204492.931958:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204493.891984:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204493.955860:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204494.915895:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204494.979889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204495.940028:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204496.003848:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204496.131941:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204496.131955:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204496.131961:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204496.131974:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3777 00000100:00080000:0.0:1788204496.132001:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204496.132010:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204496.132061:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140a80 x1875064728221568/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204496.132095:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204496.132099:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204496.132102:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204496.132106:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3777 00000100:00080000:0.0:1788204496.132110:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204496.132114:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204496.132127:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204496.132144:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142680 x1875064728221696/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204496.132155:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728221568:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204496.132237:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204496.132324:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204496/real 1788204496] req@ffff8bc144140a80 x1875064728221568/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204521 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204496.132359:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140a80 x1875064728221568/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204521 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204496.132371:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204496.132376:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204496.132381:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728221568:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204496.132413:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728221696:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204496.132440:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204496.132455:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204496/real 1788204496] req@ffff8bc144142680 x1875064728221696/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204521 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204496.132466:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142680 x1875064728221696/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204521 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204496.132474:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204496.132476:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204496.132479:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728221696:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204496.963999:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204497.027976:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204497.987963:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204498.051901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204499.011975:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204499.075896:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204500.035980:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204500.099891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204501.060002:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204501.123910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204501.251939:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204501.251948:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204501.251952:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204501.251962:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3782 00000100:00080000:2.0:1788204501.251973:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204501.251980:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204501.252015:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ea00 x1875064728221824/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204501.252045:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204501.252049:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204501.252051:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204501.252055:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3782 00000100:00080000:2.0:1788204501.252058:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204501.252062:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204501.252072:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204501.252078:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728221824:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204501.252086:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ce00 x1875064728221952/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788204501.252136:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204501.252188:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204501/real 1788204501] req@ffff8bc17257ea00 x1875064728221824/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204526 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204501.252212:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ea00 x1875064728221824/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204526 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204501.252222:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204501.252225:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204501.252229:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728221824:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204501.252253:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728221952:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204501.252270:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204501.252278:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204501/real 1788204501] req@ffff8bc17257ce00 x1875064728221952/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204526 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204501.252286:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ce00 x1875064728221952/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204526 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204501.252291:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204501.252293:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204501.252295:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728221952:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204502.083990:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204502.148004:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204503.107975:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204503.171907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204504.131949:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204504.195909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204505.155954:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204505.219939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204506.180022:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204506.243978:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204506.371908:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204506.371930:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204506.371935:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204506.371947:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3787 00000100:00080000:2.0:1788204506.371959:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204506.371968:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204506.372014:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d880 x1875064728222080/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204506.372048:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204506.372053:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204506.372055:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204506.372060:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3787 00000100:00080000:2.0:1788204506.372064:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204506.372069:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204506.372080:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204506.372081:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728222080:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204506.372095:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ed80 x1875064728222208/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204506.372217:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728222208:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204507.204016:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204507.268004:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204508.227966:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204508.291895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204509.251964:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204509.315952:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788204509.444052:0:10043:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788204509.444090:0:10043:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788204509.444106:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788204509.444142:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:0.0:1788204509.444193:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204506/real 1788204509] req@ffff8bc17257ed80 x1875064728222208/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204531 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204509.444216:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ed80 x1875064728222208/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204531 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204509.444234:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204509.444239:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204509.444243:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728222208:192.168.201.143@tcp:38:kworker.0 00000100:00100000:0.0:1788204509.444250:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204506/real 1788204509] req@ffff8bc17257d880 x1875064728222080/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204531 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204509.444262:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d880 x1875064728222080/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204531 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204509.444269:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204509.444272:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204509.444275:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728222080:192.168.201.143@tcp:250:kworker.0 00010000:00010000:2.0:1788204510.275983:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204510.339945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204511.299977:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204511.363935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204511.491966:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204511.491980:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204511.491985:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204511.491998:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3792 00000100:00080000:0.0:1788204511.492010:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204511.492028:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204511.492072:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142d80 x1875064728222336/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204511.492110:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204511.492114:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204511.492116:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204511.492120:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3792 00000100:00080000:0.0:1788204511.492124:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204511.492128:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204511.492141:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204511.492155:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141180 x1875064728222464/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204511.492167:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728222336:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204511.492244:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204511.492315:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204511/real 1788204511] req@ffff8bc144142d80 x1875064728222336/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204536 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204511.492337:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142d80 x1875064728222336/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204536 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204511.492350:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204511.492354:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204511.492359:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728222336:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204511.492390:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728222464:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204511.492413:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204511.492427:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204511/real 1788204511] req@ffff8bc144141180 x1875064728222464/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204536 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204511.492439:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141180 x1875064728222464/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204536 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204511.492446:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204511.492449:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204511.492452:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728222464:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204512.323933:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204512.387981:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204513.347993:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204513.411904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204514.371993:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204514.435898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204515.395982:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204515.459890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204516.419979:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204516.483902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204516.612758:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204516.612768:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204516.612773:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204516.612782:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3797 00000100:00080000:0.0:1788204516.612823:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204516.612832:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204516.612873:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141180 x1875064728222592/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204516.612893:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204516.612896:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204516.612899:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204516.612904:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3797 00000100:00080000:0.0:1788204516.612909:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204516.612915:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204516.612926:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204516.612935:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728222592:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204516.612946:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142d80 x1875064728222720/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788204516.613040:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204516.613106:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204516/real 1788204516] req@ffff8bc144141180 x1875064728222592/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204541 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204516.613125:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141180 x1875064728222592/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204541 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204516.613135:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204516.613138:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204516.613146:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728222592:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204516.613175:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728222720:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204516.613192:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204516.613204:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204516/real 1788204516] req@ffff8bc144142d80 x1875064728222720/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204541 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204516.613212:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142d80 x1875064728222720/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204541 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204516.613217:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204516.613220:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204516.613223:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728222720:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204517.443960:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204517.507977:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204518.467934:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204518.531906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204519.491904:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204519.555935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204520.515994:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204520.579866:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204521.540013:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204521.603928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204521.731944:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204521.731953:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204521.731957:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204521.731967:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3803 00000100:00080000:2.0:1788204521.731978:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204521.731985:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204521.732025:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e680 x1875064728222848/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204521.732053:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204521.732059:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204521.732061:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204521.732065:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3803 00000100:00080000:2.0:1788204521.732069:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204521.732074:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204521.732086:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204521.732093:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728222848:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204521.732103:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257df80 x1875064728222976/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788204521.732176:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204521.732230:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204521/real 1788204521] req@ffff8bc17257e680 x1875064728222848/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204546 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204521.732245:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e680 x1875064728222848/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204546 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204521.732253:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204521.732256:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204521.732259:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728222848:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204521.732283:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728222976:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204521.732300:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204521.732307:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204521/real 1788204521] req@ffff8bc17257df80 x1875064728222976/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204546 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204521.732315:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257df80 x1875064728222976/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204546 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204521.732320:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204521.732322:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204521.732324:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728222976:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204522.563977:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204522.628033:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204523.588027:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204523.651962:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204524.611990:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204524.675934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204525.635961:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204525.699964:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204526.659947:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204526.723861:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204526.851906:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204526.851914:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204526.851919:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204526.851928:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3808 00000100:00080000:2.0:1788204526.851939:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204526.851946:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204526.851981:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f480 x1875064728223104/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204526.852013:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204526.852017:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204526.852019:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204526.852023:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3808 00000100:00080000:2.0:1788204526.852027:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204526.852031:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204526.852041:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204526.852054:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c000 x1875064728223232/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204526.852061:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728223104:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204526.852126:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204526.852170:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204526/real 1788204526] req@ffff8bc17257f480 x1875064728223104/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204551 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204526.852188:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f480 x1875064728223104/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204551 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204526.852198:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204526.852202:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204526.852206:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728223104:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204526.852230:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728223232:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204526.852253:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204526.852266:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204526/real 1788204526] req@ffff8bc17257c000 x1875064728223232/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204551 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204526.852278:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c000 x1875064728223232/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204551 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204526.852286:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204526.852289:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204526.852292:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728223232:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204527.683916:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204527.747883:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204528.708008:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204528.771920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204529.732025:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204529.795947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204530.756001:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204530.819871:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204531.779958:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204531.843906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204531.971881:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204531.971888:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204531.971891:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204531.971899:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3813 00000100:00080000:2.0:1788204531.971907:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204531.971914:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204531.971950:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f800 x1875064728223360/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204531.971977:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204531.971981:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204531.971983:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204531.971986:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3813 00000100:00080000:2.0:1788204531.971990:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204531.971994:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204531.972002:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204531.972016:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257dc00 x1875064728223488/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204531.972026:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728223360:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204531.972076:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204531.972118:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204531/real 1788204531] req@ffff8bc17257f800 x1875064728223360/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204556 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204531.972130:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f800 x1875064728223360/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204556 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204531.972137:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204531.972139:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204531.972142:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728223360:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204531.972158:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728223488:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204531.972171:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204531.972179:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204531/real 1788204531] req@ffff8bc17257dc00 x1875064728223488/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204556 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204531.972190:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257dc00 x1875064728223488/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204556 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204531.972198:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204531.972201:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204531.972204:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728223488:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204532.804009:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204532.867928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204533.828004:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204533.891943:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204534.851979:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204534.915850:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204535.876002:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204535.939949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204536.899998:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204536.963938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204537.091953:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204537.091964:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204537.091968:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204537.091977:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3818 00000100:00080000:3.0:1788204537.091989:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204537.091996:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204537.092041:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728223616/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204537.092073:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204537.092076:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204537.092078:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204537.092081:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3818 00000100:00080000:3.0:1788204537.092084:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204537.092087:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204537.092097:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204537.092108:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728223744/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204537.092115:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728223616:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204537.092182:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204537.092235:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204537/real 1788204537] req@ffff8bc1726cea00 x1875064728223616/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204537.092254:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728223616/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204537.092262:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204537.092296:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204537.092301:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728223616:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204537.092330:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728223744:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204537.092348:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204537.092358:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204537/real 1788204537] req@ffff8bc1726ce300 x1875064728223744/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204537.092365:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728223744/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204537.092371:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204537.092373:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204537.092375:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728223744:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204537.923999:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204537.987960:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204538.948046:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204539.011944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204539.972001:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204540.035937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204540.995986:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204541.059927:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204542.019912:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204542.083879:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204542.211917:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204542.211927:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204542.211931:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204542.211941:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3823 00000100:00080000:3.0:1788204542.211952:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204542.211959:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204542.211995:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728223872/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204542.212020:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204542.212023:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204542.212024:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204542.212027:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3823 00000100:00080000:3.0:1788204542.212029:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204542.212032:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204542.212040:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204542.212047:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728224000/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204542.212131:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728223872:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204542.212202:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204542.212245:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204542/real 1788204542] req@ffff8bc1726cfb80 x1875064728223872/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204567 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204542.212259:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728223872/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204567 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204542.212271:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204542.212274:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204542.212277:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728223872:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204542.212281:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728224000:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204542.212297:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204542.212306:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204542/real 1788204542] req@ffff8bc1726ced80 x1875064728224000/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204567 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204542.212318:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728224000/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204567 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204542.212325:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204542.212329:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204542.212332:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728224000:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204543.044015:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204543.107938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204544.068014:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204544.131955:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204545.091989:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204545.155939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204546.115986:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204546.179927:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204547.139995:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204547.203948:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204547.331969:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204547.331982:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204547.331988:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204547.332001:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3828 00000100:00080000:0.0:1788204547.332016:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204547.332024:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204547.332073:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142680 x1875064728224128/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204547.332139:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204547.332145:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204547.332147:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204547.332151:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3828 00000100:00080000:0.0:1788204547.332154:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204547.332158:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204547.332169:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204547.332182:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140a80 x1875064728224256/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204547.332198:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728224128:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204547.332271:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204547.332340:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204547/real 1788204547] req@ffff8bc144142680 x1875064728224128/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204547.332359:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142680 x1875064728224128/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204547.332371:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204547.332374:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204547.332378:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728224128:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204547.332406:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728224256:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204547.332428:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204547.332447:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204547/real 1788204547] req@ffff8bc144140a80 x1875064728224256/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204547.332459:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140a80 x1875064728224256/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204547.332467:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204547.332470:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204547.332473:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728224256:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204548.163991:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204548.227920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204549.187953:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204549.251920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204550.212005:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204550.275920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204551.235997:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204551.299948:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204552.259957:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204552.323874:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204552.451928:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204552.451938:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204552.451943:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204552.451953:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3833 00000100:00080000:0.0:1788204552.451963:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204552.451970:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204552.452026:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143100 x1875064728224384/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204552.452063:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204552.452068:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204552.452070:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204552.452074:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3833 00000100:00080000:0.0:1788204552.452078:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204552.452083:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204552.452094:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204552.452108:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140000 x1875064728224512/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204552.452124:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728224384:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204552.452199:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204552.452258:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204552/real 1788204552] req@ffff8bc144143100 x1875064728224384/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204552.452273:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143100 x1875064728224384/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204552.452281:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204552.452284:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204552.452287:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728224384:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204552.452312:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728224512:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204552.452329:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204552.452337:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204552/real 1788204552] req@ffff8bc144140000 x1875064728224512/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204552.452344:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140000 x1875064728224512/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204552.452349:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204552.452350:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204552.452352:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728224512:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204553.283932:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204553.347932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204554.307963:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204554.371868:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204555.331990:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204555.395919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204556.355976:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204556.419959:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204557.379987:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204557.443905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204557.571884:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204557.571898:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204557.571904:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204557.571931:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3838 00000100:00080000:0.0:1788204557.571945:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204557.571955:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204557.572018:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143800 x1875064728224640/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204557.572050:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204557.572055:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204557.572057:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204557.572061:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3838 00000100:00080000:0.0:1788204557.572065:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204557.572071:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204557.572084:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204557.572086:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728224640:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204557.572100:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140380 x1875064728224768/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788204557.572154:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204557.572201:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204557/real 1788204557] req@ffff8bc144143800 x1875064728224640/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204582 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204557.572215:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143800 x1875064728224640/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204582 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204557.572224:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204557.572229:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204557.572233:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728224640:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204557.572260:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728224768:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204557.572282:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204557.572294:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204557/real 1788204557] req@ffff8bc144140380 x1875064728224768/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204582 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204557.572307:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140380 x1875064728224768/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204582 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204557.572319:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204557.572321:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204557.572323:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728224768:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204558.404013:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204558.467995:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204559.428008:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204559.491901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204560.452008:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204560.515987:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204561.475984:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204561.539942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204562.500026:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204562.563912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204562.691978:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204562.691988:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204562.691992:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204562.692003:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3844 00000100:00080000:1.0:1788204562.692016:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204562.692025:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204562.692072:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5500 x1875064728224896/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204562.692096:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204562.692099:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204562.692101:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204562.692104:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3844 00000100:00080000:1.0:1788204562.692107:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204562.692109:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204562.692119:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204562.692133:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6680 x1875064728225024/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204562.692148:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728224896:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204562.692216:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204562.692272:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204562/real 1788204562] req@ffff8bc1727d5500 x1875064728224896/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204587 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204562.692288:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5500 x1875064728224896/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204587 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204562.692296:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204562.692299:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204562.692301:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728224896:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204562.692323:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728225024:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204562.692338:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204562.692349:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204562/real 1788204562] req@ffff8bc1727d6680 x1875064728225024/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204587 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204562.692362:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6680 x1875064728225024/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204587 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204562.692370:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204562.692373:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204562.692376:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728225024:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204563.523925:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204563.587945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204564.547958:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204564.611958:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204565.571904:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204565.635909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204566.595965:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204566.659902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204567.620032:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204567.683894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204567.811948:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204567.811960:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204567.811965:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204567.811976:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3849 00000100:00080000:0.0:1788204567.811987:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204567.811993:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204567.812032:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141f80 x1875064728225152/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204567.812058:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204567.812062:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204567.812064:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204567.812068:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3849 00000100:00080000:0.0:1788204567.812072:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204567.812076:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204567.812088:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204567.812104:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142300 x1875064728225280/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204567.812129:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728225152:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204567.812195:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204567.812244:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204567/real 1788204567] req@ffff8bc144141f80 x1875064728225152/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204592 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204567.812262:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141f80 x1875064728225152/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204592 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204567.812273:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204567.812277:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204567.812282:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728225152:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204567.812309:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728225280:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204567.812332:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204567.812344:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204567/real 1788204567] req@ffff8bc144142300 x1875064728225280/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204592 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204567.812357:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142300 x1875064728225280/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204592 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204567.812365:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204567.812369:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204567.812372:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728225280:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204568.644020:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204568.707966:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204569.667997:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204569.731855:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204570.691990:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204570.755919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204571.715982:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204571.779841:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204572.739971:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204572.803928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204572.931896:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204572.931910:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204572.931915:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204572.931927:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3854 00000100:00080000:0.0:1788204572.931941:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204572.931950:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204572.931989:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143b80 x1875064728225408/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204572.932016:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204572.932020:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204572.932022:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204572.932026:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3854 00000100:00080000:0.0:1788204572.932029:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204572.932035:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204572.932047:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204572.932061:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728225408:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204572.932063:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141500 x1875064728225536/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204572.932183:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728225536:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204573.763949:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204573.827933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204574.787982:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204574.854729:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204575.811934:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204575.875997:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:0.0:1788204576.004081:0:10040:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:0.0:1788204576.004120:0:10040:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:0.0:1788204576.004136:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:0.0:1788204576.004350:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788204576.004919:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204572/real 1788204576] req@ffff8bc144141500 x1875064728225536/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204597 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204576.004949:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141500 x1875064728225536/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204597 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204576.004964:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204576.004971:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204576.004976:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728225536:192.168.201.143@tcp:38:kworker.0 00000100:00100000:2.0:1788204576.004986:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204572/real 1788204576] req@ffff8bc144143b80 x1875064728225408/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204597 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204576.004999:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143b80 x1875064728225408/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204597 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204576.005007:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204576.005011:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204576.005014:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728225408:192.168.201.143@tcp:250:kworker.0 00010000:00010000:2.0:1788204576.835916:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204576.899901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204577.859928:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204577.923897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204578.051897:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204578.051905:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204578.051908:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204578.051916:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3859 00000100:00080000:2.0:1788204578.051923:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204578.051929:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204578.051957:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257dc00 x1875064728225664/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204578.051978:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204578.051980:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204578.051982:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204578.051984:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3859 00000100:00080000:2.0:1788204578.051986:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204578.051988:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204578.051995:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204578.052002:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f800 x1875064728225792/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204578.052020:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728225664:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204578.052087:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204578.052129:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204578/real 1788204578] req@ffff8bc17257dc00 x1875064728225664/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204578.052148:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257dc00 x1875064728225664/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204578.052158:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204578.052162:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204578.052165:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728225664:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204578.052189:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728225792:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204578.052212:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204578.052224:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204578/real 1788204578] req@ffff8bc17257f800 x1875064728225792/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204578.052237:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f800 x1875064728225792/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204578.052244:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204578.052247:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204578.052250:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728225792:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204578.883940:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204578.947952:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204579.907992:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204579.971893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204580.931915:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204580.995858:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204581.955995:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204582.019922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204582.979974:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204583.043935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204583.171972:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204583.171983:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204583.171988:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204583.171999:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3864 00000100:00080000:0.0:1788204583.172011:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204583.172020:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204583.172061:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143480 x1875064728225920/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204583.172093:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204583.172097:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204583.172099:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204583.172102:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3864 00000100:00080000:0.0:1788204583.172106:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204583.172110:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204583.172122:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204583.172134:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728225920:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204583.172135:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141880 x1875064728226048/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788204583.172219:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204583.172279:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204583/real 1788204583] req@ffff8bc144143480 x1875064728225920/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204583.172297:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143480 x1875064728225920/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204583.172314:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204583.172318:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204583.172322:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728225920:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204583.172347:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728226048:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204583.172366:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204583.172375:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204583/real 1788204583] req@ffff8bc144141880 x1875064728226048/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204583.172383:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141880 x1875064728226048/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204583.172388:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204583.172391:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204583.172392:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728226048:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204584.003983:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204584.068045:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204585.027974:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204585.091895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204586.051922:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204586.115892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204587.075935:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204587.139861:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204588.099982:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204588.163924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204588.291890:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204588.291898:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204588.291901:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204588.291909:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3869 00000100:00080000:0.0:1788204588.291916:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204588.291922:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204588.291953:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140e00 x1875064728226176/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204588.291982:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204588.291985:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204588.291987:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204588.291989:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3869 00000100:00080000:0.0:1788204588.291992:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204588.291995:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204588.292003:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204588.292017:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142a00 x1875064728226304/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204588.292059:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728226176:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204588.292131:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204588.292196:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204588/real 1788204588] req@ffff8bc144140e00 x1875064728226176/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204588.292211:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140e00 x1875064728226176/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204588.292220:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204588.292223:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204588.292226:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728226176:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204588.292232:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728226304:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204588.292250:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204588.292259:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204588/real 1788204588] req@ffff8bc144142a00 x1875064728226304/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204588.292266:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142a00 x1875064728226304/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204588.292271:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204588.292273:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204588.292275:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728226304:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204589.123966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204589.187961:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204590.147973:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204590.211902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204591.172010:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204591.235862:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204592.196046:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204592.259957:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204593.219978:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204593.283919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204593.411924:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204593.411938:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204593.411944:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204593.411958:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3874 00000100:00080000:2.0:1788204593.411968:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204593.411975:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204593.412017:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c000 x1875064728226432/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204593.412044:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204593.412047:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204593.412048:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204593.412051:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3874 00000100:00080000:2.0:1788204593.412053:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204593.412056:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204593.412066:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204593.412074:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728226432:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204593.412076:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f480 x1875064728226560/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788204593.412136:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204593.412197:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204593/real 1788204593] req@ffff8bc17257c000 x1875064728226432/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204618 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204593.412217:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c000 x1875064728226432/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204618 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204593.412228:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204593.412233:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204593.412238:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728226432:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204593.412267:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728226560:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204593.412303:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204593.412321:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204593/real 1788204593] req@ffff8bc17257f480 x1875064728226560/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204618 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204593.412334:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f480 x1875064728226560/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204618 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204593.412343:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204593.412346:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204593.412349:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728226560:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204594.243962:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204594.307919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204595.267981:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204595.331884:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204596.291911:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204596.355913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204597.315975:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204597.379935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204598.339982:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204598.403866:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204598.531899:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204598.531909:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204598.531913:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204598.531924:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3879 00000100:00080000:2.0:1788204598.531934:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204598.531942:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204598.531982:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257df80 x1875064728226688/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204598.532005:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204598.532009:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204598.532010:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204598.532013:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3879 00000100:00080000:2.0:1788204598.532015:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204598.532018:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204598.532026:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204598.532035:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e680 x1875064728226816/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204598.532054:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728226688:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204598.532116:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204598.532158:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204598/real 1788204598] req@ffff8bc17257df80 x1875064728226688/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204623 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204598.532173:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257df80 x1875064728226688/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204623 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204598.532184:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204598.532189:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204598.532193:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728226688:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204598.532233:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728226816:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204598.532256:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204598.532265:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204598/real 1788204598] req@ffff8bc17257e680 x1875064728226816/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204623 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204598.532273:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e680 x1875064728226816/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204623 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204598.532279:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204598.532281:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204598.532283:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728226816:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204599.363975:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204599.427987:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204600.387927:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204600.451881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204601.412002:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204601.475892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204602.435931:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204602.499900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204603.460003:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204603.523908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204603.651907:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204603.651915:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204603.651918:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204603.651926:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3885 00000100:00080000:0.0:1788204603.651935:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204603.651940:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204603.651975:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140700 x1875064728226944/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204603.651994:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204603.651996:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204603.651997:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204603.652000:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3885 00000100:00080000:0.0:1788204603.652002:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204603.652005:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204603.652013:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204603.652021:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141c00 x1875064728227072/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204603.652030:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728226944:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204603.652083:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204603.652132:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204603/real 1788204603] req@ffff8bc144140700 x1875064728226944/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204628 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204603.652144:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140700 x1875064728226944/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204628 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204603.652151:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204603.652153:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204603.652156:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728226944:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204603.652177:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728227072:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204603.652202:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204603.652214:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204603/real 1788204603] req@ffff8bc144141c00 x1875064728227072/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204628 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204603.652226:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141c00 x1875064728227072/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204628 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204603.652234:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204603.652237:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204603.652240:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728227072:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204604.484000:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204604.547953:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204605.507987:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204605.571891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204606.531909:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204606.595875:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204607.555922:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204607.619893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204608.579972:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204608.643877:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204608.771860:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204608.771867:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204608.771871:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204608.771879:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3890 00000100:00080000:0.0:1788204608.771886:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204608.771892:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204608.771920:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141c00 x1875064728227200/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204608.771940:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204608.771943:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204608.771947:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204608.771949:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3890 00000100:00080000:0.0:1788204608.771952:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204608.771954:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204608.771960:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204608.771969:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140700 x1875064728227328/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204608.771989:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728227200:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204608.772067:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204608.772118:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204608/real 1788204608] req@ffff8bc144141c00 x1875064728227200/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204633 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204608.772137:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141c00 x1875064728227200/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204633 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204608.772147:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204608.772152:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204608.772156:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728227200:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204608.772163:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728227328:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204608.772192:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204608.772206:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204608/real 1788204608] req@ffff8bc144140700 x1875064728227328/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204633 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204608.772219:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140700 x1875064728227328/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204633 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204608.772227:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204608.772231:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204608.772234:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728227328:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204609.603929:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204609.668001:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204610.628018:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204610.691871:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204611.651996:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204611.715952:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204612.675990:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204612.739842:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204613.699984:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204613.763930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204613.891909:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204613.891921:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204613.891926:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204613.891949:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3895 00000100:00080000:2.0:1788204613.891962:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204613.891972:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204613.892017:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d880 x1875064728227456/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204613.892050:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204613.892054:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204613.892056:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204613.892061:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3895 00000100:00080000:2.0:1788204613.892064:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204613.892069:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204613.892081:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204613.892084:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728227456:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204613.892095:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ed80 x1875064728227584/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788204613.892147:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204613.892210:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204613/real 1788204613] req@ffff8bc17257d880 x1875064728227456/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204638 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204613.892232:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d880 x1875064728227456/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204638 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204613.892245:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204613.892249:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204613.892253:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728227456:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204613.892280:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728227584:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204613.892302:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204613.892315:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204613/real 1788204613] req@ffff8bc17257ed80 x1875064728227584/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204638 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204613.892328:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ed80 x1875064728227584/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204638 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204613.892337:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204613.892340:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204613.892343:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728227584:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204614.724021:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204614.787962:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204615.747928:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204615.811913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204616.771980:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204616.835913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204617.795990:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204617.859911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204618.820044:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204618.883908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204619.011958:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204619.011969:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204619.011973:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204619.011983:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3900 00000100:00080000:3.0:1788204619.011992:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204619.011999:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204619.012035:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728227712/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204619.012058:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204619.012060:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204619.012062:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204619.012064:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3900 00000100:00080000:3.0:1788204619.012066:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204619.012069:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204619.012075:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204619.012083:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728227840/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204619.012134:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728227712:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204619.012212:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204619.012272:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204619/real 1788204619] req@ffff8bc1726cd500 x1875064728227712/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204619.012288:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728227712/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204619.012296:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204619.012300:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204619.012303:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728227712:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204619.012309:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728227840:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204619.012325:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204619.012333:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204619/real 1788204619] req@ffff8bc1726cca80 x1875064728227840/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204619.012340:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728227840/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204619.012345:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204619.012347:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204619.012348:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728227840:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204619.843923:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204619.907887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204620.868016:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204620.931955:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204621.892017:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204621.955967:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204622.915999:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204622.979973:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204623.939985:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204624.003944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204624.131936:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204624.131949:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204624.131955:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204624.131968:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3905 00000100:00080000:2.0:1788204624.131981:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204624.131990:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204624.132042:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ce00 x1875064728227968/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204624.132076:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204624.132080:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204624.132082:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204624.132086:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3905 00000100:00080000:2.0:1788204624.132089:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204624.132094:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204624.132105:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204624.132118:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ea00 x1875064728228096/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204624.132121:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728227968:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204624.132193:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204624.132243:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204624/real 1788204624] req@ffff8bc17257ce00 x1875064728227968/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204624.132264:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ce00 x1875064728227968/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204624.132274:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204624.132277:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204624.132280:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728227968:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204624.132303:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728228096:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204624.132320:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204624.132328:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204624/real 1788204624] req@ffff8bc17257ea00 x1875064728228096/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204624.132336:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ea00 x1875064728228096/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204624.132341:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204624.132343:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204624.132345:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728228096:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204624.963976:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204625.028170:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204625.988000:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204626.051929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204627.011934:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204627.075951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204628.035989:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204628.099906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204629.060018:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204629.123952:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204629.251902:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204629.251912:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204629.251922:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204629.251932:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3910 00000100:00080000:3.0:1788204629.251942:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204629.251950:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204629.251993:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728228224/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204629.252014:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204629.252020:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204629.252022:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204629.252024:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3910 00000100:00080000:3.0:1788204629.252027:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204629.252029:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204629.252039:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204629.252052:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728228352/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204629.252060:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728228224:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204629.252124:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204629.252178:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204629/real 1788204629] req@ffff8bc1726cf480 x1875064728228224/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204629.252198:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728228224/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204629.252210:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204629.252213:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204629.252216:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728228224:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204629.252240:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728228352:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204629.252261:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204629.252273:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204629/real 1788204629] req@ffff8bc1726cf100 x1875064728228352/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204629.252286:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728228352/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204629.252294:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204629.252297:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204629.252301:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728228352:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204630.083992:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204630.147908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204631.108011:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204631.171912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204632.131939:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204632.195905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204633.155992:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204633.219963:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204634.180019:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204634.243986:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204634.371928:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204634.371938:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204634.371942:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204634.371952:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3915 00000100:00080000:0.0:1788204634.371961:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204634.371967:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204634.372000:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142a00 x1875064728228480/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204634.372025:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204634.372028:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204634.372030:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204634.372033:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3915 00000100:00080000:0.0:1788204634.372036:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204634.372039:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204634.372047:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204634.372058:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140e00 x1875064728228608/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204634.372112:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728228480:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204634.372191:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204634.372266:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204634/real 1788204634] req@ffff8bc144142a00 x1875064728228480/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204634.372287:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142a00 x1875064728228480/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204634.372296:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204634.372299:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204634.372302:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728228480:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204634.372308:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728228608:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204634.372324:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204634.372333:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204634/real 1788204634] req@ffff8bc144140e00 x1875064728228608/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204634.372340:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140e00 x1875064728228608/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204634.372345:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204634.372347:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204634.372348:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728228608:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204635.203987:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204635.267981:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204636.227953:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204636.291897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204637.251980:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204637.315867:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204638.276006:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204638.339878:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204639.299981:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204639.363966:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204639.491926:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204639.491937:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204639.491942:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204639.491954:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3920 00000100:00080000:3.0:1788204639.491965:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204639.491972:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204639.492013:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728228736/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204639.492040:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204639.492043:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204639.492045:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204639.492047:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3920 00000100:00080000:3.0:1788204639.492049:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204639.492052:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204639.492060:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204639.492075:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728228864/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204639.492087:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728228736:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204639.492201:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728228864:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204640.323962:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204640.388849:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204641.347973:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204641.412144:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204642.371972:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204642.435934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788204642.564093:0:10041:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788204642.564149:0:10041:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788204642.564168:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788204642.564226:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788204642.564329:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204639/real 1788204642] req@ffff8bc1726cd180 x1875064728228864/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204642.564377:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728228864/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204642.564391:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204642.564397:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204642.564402:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728228864:192.168.201.143@tcp:38:kworker.0 00000100:00100000:2.0:1788204642.564411:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204639/real 1788204642] req@ffff8bc1726cc700 x1875064728228736/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204642.564424:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728228736/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204642.564431:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204642.564447:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204642.564451:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728228736:192.168.201.143@tcp:250:kworker.0 00010000:00010000:2.0:1788204643.396007:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204643.459922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204644.419919:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204644.484175:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204644.611937:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204644.611950:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204644.611955:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204644.611968:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3925 00000100:00080000:2.0:1788204644.611981:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204644.611990:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204644.612039:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ca80 x1875064728228992/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204644.612073:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204644.612078:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204644.612079:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204644.612083:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3925 00000100:00080000:2.0:1788204644.612087:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204644.612091:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204644.612101:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204644.612115:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257fb80 x1875064728229120/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204644.612141:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728228992:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204644.612226:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204644.612301:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204644/real 1788204644] req@ffff8bc17257ca80 x1875064728228992/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204669 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204644.612323:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ca80 x1875064728228992/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204669 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204644.612334:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204644.612338:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204644.612342:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728228992:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204644.612351:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728229120:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204644.612378:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204644.612390:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204644/real 1788204644] req@ffff8bc17257fb80 x1875064728229120/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204669 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204644.612415:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257fb80 x1875064728229120/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204669 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204644.612424:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204644.612427:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204644.612430:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728229120:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204645.443998:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204645.508127:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204646.467920:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204646.531857:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204647.491969:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204647.555911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204648.515969:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204648.579933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204649.539978:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204649.603855:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204649.731952:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204649.731965:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204649.731971:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204649.731983:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3931 00000100:00080000:0.0:1788204649.731998:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204649.732007:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204649.732056:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141880 x1875064728229248/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204649.732092:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204649.732096:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204649.732098:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204649.732102:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3931 00000100:00080000:0.0:1788204649.732106:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204649.732112:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204649.732123:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204649.732130:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728229248:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204649.732140:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143480 x1875064728229376/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788204649.732220:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204649.732291:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204649/real 1788204649] req@ffff8bc144141880 x1875064728229248/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204674 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204649.732324:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141880 x1875064728229248/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204674 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204649.732337:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204649.732342:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204649.732346:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728229248:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204649.732378:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728229376:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204649.732399:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204649.732411:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204649/real 1788204649] req@ffff8bc144143480 x1875064728229376/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204674 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204649.732422:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143480 x1875064728229376/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204674 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204649.732429:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204649.732431:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204649.732433:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728229376:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204650.563973:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204650.627929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204651.588008:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204651.651911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204652.611960:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204652.676474:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204653.635982:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204653.699936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204654.660008:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204654.723892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204654.851935:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204654.851946:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204654.851952:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204654.851963:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3936 00000100:00080000:0.0:1788204654.851975:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204654.851983:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204654.852028:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143b80 x1875064728229504/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204654.852059:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204654.852064:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204654.852066:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204654.852070:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3936 00000100:00080000:0.0:1788204654.852074:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204654.852080:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204654.852093:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204654.852111:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141500 x1875064728229632/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204654.852112:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728229504:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204654.852196:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204654.852281:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204654/real 1788204654] req@ffff8bc144143b80 x1875064728229504/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204679 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204654.852299:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143b80 x1875064728229504/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204679 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204654.852309:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204654.852313:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204654.852317:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728229504:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204654.852344:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728229632:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204654.852363:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204654.852373:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204654/real 1788204654] req@ffff8bc144141500 x1875064728229632/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204679 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204654.852381:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141500 x1875064728229632/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204679 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204654.852387:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204654.852389:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204654.852392:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728229632:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204655.683989:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204655.747936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204656.707953:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204656.771880:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204657.731958:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204657.795961:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204658.755890:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204658.819866:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204659.779977:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204659.843892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204659.971857:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204659.971865:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204659.971869:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204659.971878:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3941 00000100:00080000:0.0:1788204659.971887:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204659.971897:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204659.971928:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142300 x1875064728229760/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204659.971950:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204659.971953:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204659.971954:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204659.971957:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3941 00000100:00080000:0.0:1788204659.971959:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204659.971962:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204659.971969:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204659.971978:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141f80 x1875064728229888/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204659.971987:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728229760:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204659.972045:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204659.972084:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204659/real 1788204659] req@ffff8bc144142300 x1875064728229760/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204684 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204659.972099:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142300 x1875064728229760/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204684 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204659.972107:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204659.972110:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204659.972113:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728229760:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204659.972131:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728229888:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204659.972286:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204659.972296:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204659/real 1788204659] req@ffff8bc144141f80 x1875064728229888/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204684 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204659.972305:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141f80 x1875064728229888/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204684 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204659.972319:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204659.972322:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204659.972324:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728229888:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204660.803992:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204660.867948:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204661.827911:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204661.891999:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204662.851968:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204662.915970:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204663.875970:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204663.939943:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204664.899964:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204664.963902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204665.091884:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204665.091892:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204665.091895:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204665.091902:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3946 00000100:00080000:0.0:1788204665.091910:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204665.091915:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204665.091943:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140380 x1875064728230016/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204665.091963:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204665.091966:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204665.091967:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204665.091970:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3946 00000100:00080000:0.0:1788204665.091972:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204665.091974:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204665.091980:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204665.091988:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143800 x1875064728230144/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204665.092009:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728230016:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204665.092084:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204665.092124:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204665/real 1788204665] req@ffff8bc144140380 x1875064728230016/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204665.092137:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140380 x1875064728230016/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204665.092144:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204665.092146:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204665.092149:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728230016:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204665.092153:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728230144:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204665.092168:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204665.092175:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204665/real 1788204665] req@ffff8bc144143800 x1875064728230144/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204665.092183:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143800 x1875064728230144/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204665.092188:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204665.092189:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204665.092191:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728230144:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204665.923935:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204665.987909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204666.947942:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204667.011878:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204667.971980:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204668.035903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204668.995941:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204669.059863:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204670.019949:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204670.083935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204670.211860:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204670.211867:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204670.211870:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204670.211878:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3951 00000100:00080000:0.0:1788204670.211885:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204670.211890:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204670.211917:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140000 x1875064728230272/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204670.211940:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204670.211944:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204670.211946:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204670.211949:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3951 00000100:00080000:0.0:1788204670.211952:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204670.211978:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204670.211993:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204670.212005:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728230272:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204670.212013:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143100 x1875064728230400/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788204670.212065:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204670.212119:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204670/real 1788204670] req@ffff8bc144140000 x1875064728230272/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204670.212136:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140000 x1875064728230272/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204670.212147:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204670.212152:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204670.212156:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728230272:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204670.212177:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728230400:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204670.212198:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204670.212209:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204670/real 1788204670] req@ffff8bc144143100 x1875064728230400/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204670.212231:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143100 x1875064728230400/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204670.212238:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204670.212241:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204670.212244:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728230400:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204671.043963:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204671.107935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204672.067972:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204672.131855:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204673.091936:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204673.157227:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204674.115925:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204674.180305:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204675.139996:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204675.203903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204675.331923:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204675.331932:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204675.331936:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204675.331944:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3956 00000100:00080000:0.0:1788204675.331953:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204675.331958:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204675.331988:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140a80 x1875064728230528/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204675.332009:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204675.332012:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204675.332013:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204675.332015:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3956 00000100:00080000:0.0:1788204675.332017:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204675.332019:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204675.332026:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204675.332035:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142680 x1875064728230656/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204675.332056:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728230528:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204675.332114:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204675.332160:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204675/real 1788204675] req@ffff8bc144140a80 x1875064728230528/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204675.332193:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140a80 x1875064728230528/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204675.332204:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204675.332208:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204675.332211:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728230528:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204675.332217:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728230656:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204675.332235:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204675.332247:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204675/real 1788204675] req@ffff8bc144142680 x1875064728230656/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204675.332258:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142680 x1875064728230656/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204675.332266:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204675.332269:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204675.332273:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728230656:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204676.163945:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204676.227897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204677.187962:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204677.251904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204678.211970:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204678.275907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204679.235974:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204679.299916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204680.259961:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204680.323902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204680.451918:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204680.451929:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204680.451933:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204680.451942:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3961 00000100:00080000:3.0:1788204680.451952:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204680.451959:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204680.451993:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728230784/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204680.452017:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204680.452021:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204680.452023:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204680.452027:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3961 00000100:00080000:3.0:1788204680.452030:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204680.452034:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204680.452044:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204680.452057:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728230784:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788204680.452061:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728230912/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788204680.452111:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204680.452169:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204680/real 1788204680] req@ffff8bc1726cdf80 x1875064728230784/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204680.452188:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728230784/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204680.452197:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204680.452200:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204680.452202:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728230784:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204680.452220:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728230912:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204680.452236:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204680.452244:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204680/real 1788204680] req@ffff8bc1726cf800 x1875064728230912/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204680.452255:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728230912/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204680.452261:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204680.452263:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204680.452265:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728230912:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204681.283928:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204681.347933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204682.307955:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204682.371930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204683.331894:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204683.395967:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204684.355953:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204684.419936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204685.379961:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204685.445139:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204685.571920:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204685.571971:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204685.571976:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204685.571984:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3966 00000100:00080000:0.0:1788204685.571996:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204685.572001:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204685.572040:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142d80 x1875064728231040/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204685.572067:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204685.572071:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204685.572073:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204685.572077:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3966 00000100:00080000:0.0:1788204685.572080:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204685.572085:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204685.572094:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204685.572108:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141180 x1875064728231168/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204685.572108:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728231040:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204685.572187:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204685.572223:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204685/real 1788204685] req@ffff8bc144142d80 x1875064728231040/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204710 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204685.572235:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142d80 x1875064728231040/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204710 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204685.572242:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204685.572244:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204685.572247:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728231040:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204685.572274:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728231168:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204685.572300:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204685.572313:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204685/real 1788204685] req@ffff8bc144141180 x1875064728231168/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204710 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204685.572326:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141180 x1875064728231168/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204710 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204685.572333:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204685.572336:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204685.572340:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728231168:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204686.403966:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204686.468823:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204687.428014:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204687.491958:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204688.451975:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204688.515962:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204689.475929:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204689.539921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204690.499974:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204690.563867:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204690.691903:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204690.691911:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204690.691915:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204690.691924:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3972 00000100:00080000:3.0:1788204690.691934:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204690.691941:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204690.691980:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728231296/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204690.692008:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204690.692012:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204690.692014:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204690.692018:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3972 00000100:00080000:3.0:1788204690.692022:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204690.692025:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204690.692034:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204690.692049:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728231424/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204690.692059:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728231296:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204690.692125:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204690.692171:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204690/real 1788204690] req@ffff8bc1726cf800 x1875064728231296/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204715 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204690.692189:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728231296/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204715 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204690.692200:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204690.692203:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204690.692207:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728231296:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204690.692230:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728231424:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204690.692250:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204690.692261:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204690/real 1788204690] req@ffff8bc1726cdf80 x1875064728231424/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204715 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204690.692272:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728231424/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204715 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204690.692281:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204690.692284:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204690.692287:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728231424:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204691.523922:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204691.587903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204692.548043:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204692.611900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204693.571963:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204693.635881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204694.595939:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204694.659932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204695.619947:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204695.683875:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204695.811902:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204695.811911:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204695.811914:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204695.811923:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3977 00000100:00080000:3.0:1788204695.811932:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204695.811988:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204695.812019:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728231552/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204695.812039:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204695.812042:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204695.812043:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204695.812046:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3977 00000100:00080000:3.0:1788204695.812048:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204695.812050:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204695.812057:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204695.812065:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728231680/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204695.812082:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728231552:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204695.812134:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204695.812171:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204695/real 1788204695] req@ffff8bc1726cc700 x1875064728231552/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204720 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204695.812191:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728231552/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204720 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204695.812199:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204695.812201:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204695.812204:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728231552:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204695.812209:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728231680:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204695.812223:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204695.812230:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204695/real 1788204695] req@ffff8bc1726cd180 x1875064728231680/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204720 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204695.812238:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728231680/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204720 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204695.812243:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204695.812245:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204695.812247:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728231680:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204696.644024:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204696.708123:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204697.668007:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204697.731922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204698.691960:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204698.755926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204699.716053:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204699.779923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204700.739941:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204700.803893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204700.932593:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204700.932601:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204700.932604:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204700.932613:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3982 00000100:00080000:1.0:1788204700.932622:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204700.932627:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204700.932661:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6d80 x1875064728231808/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204700.932687:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204700.932691:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204700.932694:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204700.932698:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3982 00000100:00080000:1.0:1788204700.932702:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204700.932707:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204700.932716:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204700.932720:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728231808:192.168.201.143@tcp:250:kworker.0 00000100:00100000:1.0:1788204700.932731:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6300 x1875064728231936/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788204700.932780:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204700.932868:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204700/real 1788204700] req@ffff8bc1727d6d80 x1875064728231808/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204725 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204700.932883:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6d80 x1875064728231808/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204725 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204700.932891:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204700.932894:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204700.932896:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728231808:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204700.932914:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728231936:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204700.932935:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204700.932947:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204700/real 1788204700] req@ffff8bc1727d6300 x1875064728231936/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204725 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204700.932958:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6300 x1875064728231936/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204725 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204700.932965:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204700.932968:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204700.932972:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728231936:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204701.763979:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204701.828082:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204702.788010:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204702.851938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204703.812013:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204703.875931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204704.835953:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204704.899921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204705.860013:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204705.923886:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204706.051959:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204706.051971:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204706.051976:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204706.051987:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3987 00000100:00080000:3.0:1788204706.051999:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204706.052006:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204706.052047:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728232064/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204706.052071:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204706.052074:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204706.052075:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204706.052078:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3987 00000100:00080000:3.0:1788204706.052080:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204706.052083:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204706.052092:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204706.052100:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728232192/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204706.052128:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728232064:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204706.052243:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728232192:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204706.883974:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204706.947911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204707.908005:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204707.971876:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204708.932018:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204708.995929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788204709.124082:0:10042:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788204709.124143:0:10042:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788204709.124164:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788204709.124216:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788204709.124333:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204706/real 1788204709] req@ffff8bc1726cf100 x1875064728232064/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204709.124368:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728232064/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204709.124380:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204709.124387:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204709.124391:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728232064:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204709.124401:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204706/real 1788204709] req@ffff8bc1726cf480 x1875064728232192/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204709.124411:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728232192/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204709.124419:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204709.124423:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204709.124426:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728232192:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204709.955983:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204710.019919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204710.979978:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204711.043907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204711.171889:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204711.171908:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204711.171912:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204711.171921:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3992 00000100:00080000:3.0:1788204711.171930:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204711.171935:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204711.171962:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728232320/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204711.171982:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204711.171984:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204711.171985:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204711.171995:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3992 00000100:00080000:3.0:1788204711.171999:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204711.172003:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204711.172013:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204711.172029:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728232448/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204711.172065:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728232320:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204711.172154:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204711.172242:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204711/real 1788204711] req@ffff8bc1726cca80 x1875064728232320/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204736 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204711.172302:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728232320/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204736 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204711.172316:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204711.172321:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204711.172325:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728232320:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204711.172335:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728232448:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204711.172364:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204711.172388:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204711/real 1788204711] req@ffff8bc1726cd500 x1875064728232448/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204736 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204711.172400:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728232448/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204736 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204711.172411:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204711.172415:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204711.172417:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728232448:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204712.003984:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204712.067969:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204713.027977:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204713.091919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204714.051984:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204714.115973:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204715.075919:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204715.139837:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204716.099950:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204716.163901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204716.291871:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204716.291881:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204716.291886:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204716.291896:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 3997 00000100:00080000:3.0:1788204716.291906:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204716.291913:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204716.291948:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728232576/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204716.291976:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204716.291980:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204716.291981:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204716.291985:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 3997 00000100:00080000:3.0:1788204716.291989:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204716.291994:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204716.292004:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204716.292012:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728232576:192.168.201.143@tcp:250:kworker.0 00000100:00100000:3.0:1788204716.292020:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728232704/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788204716.292071:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204716.292118:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204716/real 1788204716] req@ffff8bc1726ced80 x1875064728232576/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204741 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204716.292133:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728232576/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204741 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204716.292142:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204716.292145:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204716.292148:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728232576:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204716.292196:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728232704:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204716.292214:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204716.292224:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204716/real 1788204716] req@ffff8bc1726cfb80 x1875064728232704/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204741 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204716.292233:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728232704/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204741 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204716.292239:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204716.292241:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204716.292243:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728232704:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204717.123978:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204717.187925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204718.147935:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204718.212024:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204719.171947:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204719.236058:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204720.195939:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204720.259937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204721.219955:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204721.283913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204721.411928:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204721.411938:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204721.411942:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204721.411950:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4002 00000100:00080000:0.0:1788204721.411958:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204721.411963:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204721.411999:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141180 x1875064728232832/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204721.412023:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204721.412026:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204721.412027:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204721.412030:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4002 00000100:00080000:0.0:1788204721.412033:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204721.412035:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204721.412042:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204721.412051:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142d80 x1875064728232960/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204721.412095:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728232832:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204721.412150:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204721.412202:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204721/real 1788204721] req@ffff8bc144141180 x1875064728232832/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204746 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204721.412221:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141180 x1875064728232832/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204746 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204721.412231:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204721.412234:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204721.412238:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728232832:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204721.412245:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728232960:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204721.412267:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204721.412281:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204721/real 1788204721] req@ffff8bc144142d80 x1875064728232960/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204746 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204721.412293:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142d80 x1875064728232960/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204746 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204721.412302:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204721.412306:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204721.412309:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728232960:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204722.243920:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204722.307985:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204723.267967:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204723.331924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204724.291896:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204724.355880:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204725.315951:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204725.379872:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204726.340045:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204726.403903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204726.531933:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204726.531944:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204726.531947:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204726.531958:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4007 00000100:00080000:1.0:1788204726.531970:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204726.531977:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204726.532037:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4700 x1875064728233088/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204726.532064:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204726.532067:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204726.532068:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204726.532071:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4007 00000100:00080000:1.0:1788204726.532073:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204726.532075:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204726.532084:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204726.532094:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5c00 x1875064728233216/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204726.532146:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728233088:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204726.532219:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204726.532286:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204726/real 1788204726] req@ffff8bc1727d4700 x1875064728233088/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204751 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204726.532311:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4700 x1875064728233088/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204751 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204726.532322:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204726.532327:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204726.532331:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728233088:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204726.532338:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728233216:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204726.532361:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204726.532373:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204726/real 1788204726] req@ffff8bc1727d5c00 x1875064728233216/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204751 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204726.532384:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5c00 x1875064728233216/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204751 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204726.532392:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204726.532396:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204726.532399:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728233216:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204727.363936:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204727.427931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204728.388034:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204728.451916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204729.411989:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204729.475896:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204730.435949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204730.500657:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204731.459972:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204731.523926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204731.651910:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204731.651918:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204731.651921:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204731.651929:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4013 00000100:00080000:0.0:1788204731.651937:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204731.651942:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204731.651971:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142680 x1875064728233344/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204731.651995:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204731.652004:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204731.652005:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204731.652009:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4013 00000100:00080000:0.0:1788204731.652013:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204731.652017:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204731.652027:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204731.652040:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140a80 x1875064728233472/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204731.652043:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728233344:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204731.652092:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204731.652128:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204731/real 1788204731] req@ffff8bc144142680 x1875064728233344/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204756 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204731.652140:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142680 x1875064728233344/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204756 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204731.652147:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204731.652149:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204731.652152:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728233344:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204731.652173:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728233472:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204731.652193:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204731.652205:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204731/real 1788204731] req@ffff8bc144140a80 x1875064728233472/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204756 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204731.652218:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140a80 x1875064728233472/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204756 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204731.652224:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204731.652226:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204731.652228:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728233472:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204732.484087:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204732.547997:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204733.508026:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204733.571904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204734.531969:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204734.595896:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204735.555966:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204735.619929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204736.579969:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204736.643898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204736.771983:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204736.771997:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204736.772004:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204736.772018:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4018 00000100:00080000:0.0:1788204736.772034:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204736.772042:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204736.772089:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143100 x1875064728233600/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204736.772119:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204736.772122:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204736.772123:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204736.772126:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4018 00000100:00080000:0.0:1788204736.772130:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204736.772132:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204736.772143:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204736.772156:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140000 x1875064728233728/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204736.772174:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728233600:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204736.772247:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204736.772298:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204736/real 1788204736] req@ffff8bc144143100 x1875064728233600/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204761 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204736.772315:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143100 x1875064728233600/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204761 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204736.772324:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204736.772327:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204736.772330:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728233600:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204736.772352:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728233728:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204736.772367:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204736.772375:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204736/real 1788204736] req@ffff8bc144140000 x1875064728233728/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204761 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204736.772384:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140000 x1875064728233728/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204761 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204736.772390:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204736.772392:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204736.772394:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728233728:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204737.603974:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204737.667983:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204738.628001:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204738.691949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204739.651912:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204739.715905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204740.676047:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204740.739895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204741.699938:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204741.763908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204741.891894:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204741.891902:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204741.891906:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204741.891914:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4023 00000100:00080000:0.0:1788204741.891923:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204741.891929:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204741.891960:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143800 x1875064728233856/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204741.891987:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204741.891991:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204741.891993:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204741.891997:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4023 00000100:00080000:0.0:1788204741.892004:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204741.892018:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204741.892027:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728233856:192.168.201.143@tcp:250:kworker.0 00000008:00100000:0.0:1788204741.892028:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204741.892048:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140380 x1875064728233984/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788204741.892106:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204741.892157:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204741/real 1788204741] req@ffff8bc144143800 x1875064728233856/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204766 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204741.892193:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143800 x1875064728233856/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204766 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204741.892206:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204741.892210:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204741.892214:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728233856:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204741.892234:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728233984:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204741.892254:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204741.892264:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204741/real 1788204741] req@ffff8bc144140380 x1875064728233984/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204766 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204741.892273:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140380 x1875064728233984/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204766 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204741.892282:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204741.892286:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204741.892290:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728233984:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204742.723964:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204742.787971:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204743.747963:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204743.811924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204744.771958:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204744.835904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204745.795999:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204745.859899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204746.819925:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204746.883925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204747.011918:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204747.011927:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204747.011930:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204747.011939:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4028 00000100:00080000:3.0:1788204747.011947:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204747.011953:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204747.011985:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728234112/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204747.012013:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204747.012017:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204747.012019:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204747.012024:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4028 00000100:00080000:3.0:1788204747.012027:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204747.012032:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204747.012040:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204747.012052:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728234240/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204747.012103:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728234112:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204747.012180:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204747.012247:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204747/real 1788204747] req@ffff8bc1726ce300 x1875064728234112/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204747.012266:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728234112/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204747.012276:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204747.012279:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204747.012283:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728234112:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204747.012290:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728234240:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204747.012307:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204747.012317:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204747/real 1788204747] req@ffff8bc1726cea00 x1875064728234240/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204747.012326:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728234240/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204747.012332:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204747.012334:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204747.012336:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728234240:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204747.844016:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204747.907970:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204748.867986:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204748.931898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204749.891955:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204749.955940:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204750.916043:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204750.980882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204751.940020:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204752.003908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204752.131943:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204752.131959:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204752.131964:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204752.131977:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4033 00000100:00080000:1.0:1788204752.132001:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204752.132010:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204752.132061:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4e00 x1875064728234368/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204752.132084:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204752.132087:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204752.132090:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204752.132092:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4033 00000100:00080000:1.0:1788204752.132095:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204752.132098:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204752.132108:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204752.132118:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6a00 x1875064728234496/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204752.132127:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728234368:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204752.132199:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204752.132253:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204752/real 1788204752] req@ffff8bc1727d4e00 x1875064728234368/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204777 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204752.132269:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4e00 x1875064728234368/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204777 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204752.132277:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204752.132280:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204752.132283:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728234368:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204752.132305:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728234496:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204752.132322:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204752.132329:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204752/real 1788204752] req@ffff8bc1727d6a00 x1875064728234496/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204777 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204752.132338:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6a00 x1875064728234496/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204777 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204752.132343:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204752.132345:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204752.132347:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728234496:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204752.964015:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204753.028061:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788204753.987936:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204754.051874:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204755.012010:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204755.075944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788204756.035988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204756.099934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204757.060009:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204757.123923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204757.251935:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204757.251946:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204757.251950:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204757.251960:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4038 00000100:00080000:1.0:1788204757.251970:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204757.251978:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204757.252026:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7800 x1875064728234624/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204757.252055:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204757.252058:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204757.252059:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204757.252062:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4038 00000100:00080000:1.0:1788204757.252065:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204757.252068:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204757.252077:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204757.252087:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4a80 x1875064728234752/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204757.252103:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728234624:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204757.252165:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204757.252229:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204757/real 1788204757] req@ffff8bc1727d7800 x1875064728234624/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204782 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204757.252250:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7800 x1875064728234624/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204782 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204757.252258:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204757.252261:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204757.252264:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728234624:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204757.252286:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728234752:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204757.252303:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204757.252311:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204757/real 1788204757] req@ffff8bc1727d4a80 x1875064728234752/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204782 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204757.252323:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4a80 x1875064728234752/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204782 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204757.252328:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204757.252330:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204757.252332:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728234752:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788204758.084007:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204758.147935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204759.107922:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204759.171889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788204760.132004:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204760.195895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204761.155957:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204761.219976:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788204762.180055:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204762.243954:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204762.371962:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204762.371980:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204762.371986:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204762.372003:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4043 00000100:00080000:2.0:1788204762.372018:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204762.372027:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204762.372077:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c380 x1875064728234880/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204762.372115:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204762.372119:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204762.372121:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204762.372125:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4043 00000100:00080000:2.0:1788204762.372129:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204762.372134:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204762.372146:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204762.372162:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e300 x1875064728235008/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204762.372173:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728234880:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204762.372247:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204762.372316:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204762/real 1788204762] req@ffff8bc17257c380 x1875064728234880/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204787 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204762.372333:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c380 x1875064728234880/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204787 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204762.372357:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204762.372362:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204762.372397:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728234880:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204762.372432:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728235008:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204762.372461:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204762.372476:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204762/real 1788204762] req@ffff8bc17257e300 x1875064728235008/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204787 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204762.372527:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e300 x1875064728235008/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204787 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204762.372539:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204762.372543:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204762.372549:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728235008:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204763.203998:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204763.268879:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788204764.228008:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204764.291862:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204765.251974:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204765.315916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788204766.275977:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204766.339952:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204767.299975:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204767.363912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204767.491897:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204767.491905:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204767.491909:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204767.491917:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4048 00000100:00080000:0.0:1788204767.491926:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204767.491931:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204767.491962:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141f80 x1875064728235136/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204767.491984:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204767.491988:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204767.491989:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204767.491992:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4048 00000100:00080000:0.0:1788204767.491998:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204767.492002:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204767.492009:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204767.492019:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142300 x1875064728235264/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204767.492031:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728235136:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204767.492095:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204767.492149:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204767/real 1788204767] req@ffff8bc144141f80 x1875064728235136/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204792 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204767.492164:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141f80 x1875064728235136/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204792 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204767.492172:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204767.492175:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204767.492178:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728235136:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204767.492199:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728235264:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204767.492217:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204767.492225:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204767/real 1788204767] req@ffff8bc144142300 x1875064728235264/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204792 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204767.492234:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142300 x1875064728235264/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204792 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204767.492240:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204767.492242:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204767.492245:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728235264:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788204768.323987:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204768.387922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204769.347944:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204769.411848:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788204770.371986:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204770.435868:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204771.395929:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204771.459861:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788204772.420011:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204772.483931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204772.611939:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204772.611953:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204772.611959:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204772.611971:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4053 00000100:00080000:3.0:1788204772.611984:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204772.611994:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204772.612052:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728235392/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204772.612093:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204772.612097:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204772.612100:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204772.612104:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4053 00000100:00080000:3.0:1788204772.612108:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204772.612113:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204772.612125:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204772.612139:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728235520/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204772.612148:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728235392:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204772.612307:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728235520:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204773.443959:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204773.507958:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788204774.467952:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204774.531960:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204775.491970:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204775.555944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788204775.684096:0:10043:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788204775.684176:0:10043:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788204775.684192:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788204775.684240:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788204775.684335:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204772/real 1788204775] req@ffff8bc1726ce680 x1875064728235520/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204797 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204775.684362:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728235520/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204797 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204775.684375:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204775.684381:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204775.684385:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728235520:192.168.201.143@tcp:38:kworker.0 00000100:00100000:2.0:1788204775.684394:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204772/real 1788204775] req@ffff8bc1726cc380 x1875064728235392/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204797 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204775.684409:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728235392/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204797 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204775.684419:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204775.684423:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204775.684427:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728235392:192.168.201.143@tcp:250:kworker.0 00010000:00010000:0.0:1788204776.516025:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204776.579887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204777.539944:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204777.603870:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204777.731910:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204777.731920:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204777.731923:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204777.731935:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4059 00000100:00080000:2.0:1788204777.731943:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204777.731948:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204777.731979:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d500 x1875064728235648/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204777.732009:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204777.732013:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204777.732015:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204777.732019:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4059 00000100:00080000:2.0:1788204777.732022:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204777.732026:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204777.732036:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204777.732051:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f100 x1875064728235776/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204777.732065:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728235648:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204777.732141:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204777.732209:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204777/real 1788204777] req@ffff8bc17257d500 x1875064728235648/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204802 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204777.732228:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d500 x1875064728235648/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204802 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204777.732238:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204777.732242:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204777.732246:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728235648:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204777.732271:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728235776:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204777.732294:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204777.732305:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204777/real 1788204777] req@ffff8bc17257f100 x1875064728235776/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204802 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204777.732315:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f100 x1875064728235776/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204802 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204777.732322:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204777.732325:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204777.732328:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728235776:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788204778.563961:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204778.627945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204779.587950:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204779.651864:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788204780.611873:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204780.675866:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204781.635975:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204781.700911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788204782.659979:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204782.723905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204782.851902:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204782.851910:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204782.851914:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204782.851921:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4064 00000100:00080000:2.0:1788204782.851928:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204782.851933:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204782.851963:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d180 x1875064728235904/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204782.851992:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204782.851999:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204782.852001:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204782.852005:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4064 00000100:00080000:2.0:1788204782.852009:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1788204782.852040:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728235904:192.168.201.143@tcp:250:kworker.0 00000100:00080000:2.0:1788204782.852044:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204782.852053:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204782.852065:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c700 x1875064728236032/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788204782.852091:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204782.852127:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204782/real 1788204782] req@ffff8bc17257d180 x1875064728235904/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204807 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204782.852139:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d180 x1875064728235904/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204807 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204782.852146:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204782.852148:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204782.852151:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728235904:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204782.852167:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728236032:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204782.852180:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204782.852187:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204782/real 1788204782] req@ffff8bc17257c700 x1875064728236032/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204807 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204782.852194:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c700 x1875064728236032/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204807 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204782.852199:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204782.852201:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204782.852203:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728236032:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204783.683960:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204783.748143:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788204784.708009:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204784.771867:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204785.731984:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204785.795879:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788204786.756003:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204786.819953:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204787.779989:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204787.844019:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204787.971963:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204787.971977:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204787.971981:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204787.971993:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4069 00000100:00080000:3.0:1788204787.972004:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204787.972012:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204787.972059:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728236160/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204787.972089:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204787.972096:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204787.972098:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204787.972103:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4069 00000100:00080000:3.0:1788204787.972106:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204787.972110:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204787.972119:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204787.972130:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728236288/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204787.972146:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728236160:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204787.972220:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204787.972293:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204787/real 1788204787] req@ffff8bc1726cce00 x1875064728236160/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204812 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204787.972316:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728236160/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204812 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204787.972327:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204787.972331:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204787.972334:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728236160:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204787.972368:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728236288:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204787.972393:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204787.972405:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204787/real 1788204787] req@ffff8bc1726cdc00 x1875064728236288/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204812 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204787.972414:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728236288/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204812 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204787.972420:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204787.972422:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204787.972424:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728236288:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788204788.803969:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204788.867946:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204789.828039:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204789.891989:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788204790.851937:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204790.915962:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204791.876058:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204791.939927:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788204792.899938:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204792.963886:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204793.091938:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204793.091948:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204793.091952:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204793.091963:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4074 00000100:00080000:0.0:1788204793.091974:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204793.091980:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204793.092022:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141500 x1875064728236416/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204793.092050:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204793.092053:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204793.092054:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204793.092057:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4074 00000100:00080000:0.0:1788204793.092059:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204793.092061:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204793.092069:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204793.092078:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143b80 x1875064728236544/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204793.092106:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728236416:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204793.092196:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204793.092245:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204793/real 1788204793] req@ffff8bc144141500 x1875064728236416/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204793.092260:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141500 x1875064728236416/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204793.092268:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204793.092272:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204793.092276:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728236416:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204793.092284:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728236544:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204793.092306:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204793.092319:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204793/real 1788204793] req@ffff8bc144143b80 x1875064728236544/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204793.092331:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143b80 x1875064728236544/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204793.092340:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204793.092343:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204793.092346:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728236544:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204793.924029:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204793.987989:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788204794.948051:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204795.011905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204795.971976:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204796.036850:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788204796.995938:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204797.059858:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204798.019980:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204798.083905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204798.211902:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204798.211909:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204798.211913:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204798.211921:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4079 00000100:00080000:3.0:1788204798.211930:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204798.211936:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204798.211973:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728236672/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204798.211998:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204798.212000:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204798.212002:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204798.212004:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4079 00000100:00080000:3.0:1788204798.212006:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204798.212009:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204798.212016:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204798.212024:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728236800/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204798.212088:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728236672:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204798.212175:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204798.212245:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204798/real 1788204798] req@ffff8bc1726cdc00 x1875064728236672/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204798.212266:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728236672/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204798.212278:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204798.212282:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204798.212287:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728236672:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204798.212295:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728236800:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204798.212320:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204798.212333:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204798/real 1788204798] req@ffff8bc1726cce00 x1875064728236800/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204798.212345:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728236800/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204798.212353:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204798.212356:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204798.212360:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728236800:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788204799.043952:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204799.107925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204800.067919:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204800.131880:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788204801.091980:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204801.155883:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204802.115984:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204802.179934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788204803.140010:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204803.203926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204803.331943:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204803.331954:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204803.331958:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204803.331969:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4084 00000100:00080000:0.0:1788204803.331980:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204803.331987:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204803.332027:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143480 x1875064728236928/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204803.332052:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204803.332055:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204803.332056:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204803.332059:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4084 00000100:00080000:0.0:1788204803.332061:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204803.332063:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204803.332073:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204803.332082:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141880 x1875064728237056/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204803.332100:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728236928:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204803.332176:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204803.332229:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204803/real 1788204803] req@ffff8bc144143480 x1875064728236928/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204803.332244:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143480 x1875064728236928/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204803.332253:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204803.332256:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204803.332258:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728236928:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204803.332281:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728237056:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204803.332300:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204803.332313:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204803/real 1788204803] req@ffff8bc144141880 x1875064728237056/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204803.332325:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141880 x1875064728237056/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204803.332335:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204803.332338:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204803.332342:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728237056:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204804.164013:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204804.228027:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788204805.187999:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204805.251933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204806.212017:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204806.275914:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788204807.235977:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204807.299945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204808.259949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204808.323867:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204808.451958:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204808.451967:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204808.451971:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204808.451982:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4089 00000100:00080000:1.0:1788204808.451995:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204808.452003:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204808.452049:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7100 x1875064728237184/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204808.452072:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204808.452075:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204808.452076:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204808.452079:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4089 00000100:00080000:1.0:1788204808.452081:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204808.452084:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204808.452093:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204808.452102:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7b80 x1875064728237312/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204808.452135:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728237184:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204808.452223:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204808.452290:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204808/real 1788204808] req@ffff8bc1727d7100 x1875064728237184/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204808.452312:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7100 x1875064728237184/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204808.452323:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204808.452327:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204808.452331:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728237184:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204808.452339:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728237312:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204808.452357:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204808.452367:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204808/real 1788204808] req@ffff8bc1727d7b80 x1875064728237312/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204808.452376:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7b80 x1875064728237312/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204808.452381:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204808.452383:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204808.452385:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728237312:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788204809.284007:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204809.347938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204810.307944:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204810.371861:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788204811.331978:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204811.395874:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204812.355989:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204812.419920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788204813.379987:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204813.443930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204813.571927:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204813.571939:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204813.571944:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204813.571956:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4094 00000100:00080000:0.0:1788204813.571969:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204813.571977:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204813.572021:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140e00 x1875064728237440/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204813.572053:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204813.572056:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204813.572058:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204813.572062:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4094 00000100:00080000:0.0:1788204813.572066:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204813.572071:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204813.572081:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204813.572094:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142a00 x1875064728237568/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204813.572102:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728237440:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204813.572172:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204813.572223:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204813/real 1788204813] req@ffff8bc144140e00 x1875064728237440/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204838 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204813.572243:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140e00 x1875064728237440/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204838 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204813.572253:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204813.572257:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204813.572260:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728237440:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204813.572283:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728237568:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204813.572299:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204813.572309:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204813/real 1788204813] req@ffff8bc144142a00 x1875064728237568/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204838 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204813.572316:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142a00 x1875064728237568/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204838 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204813.572321:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204813.572323:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204813.572325:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728237568:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204814.403942:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204814.467928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788204815.427964:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204815.491934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204816.452000:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204816.515947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788204817.475908:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204817.539888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204818.499994:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204818.563885:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204818.691955:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204818.691967:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204818.691971:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204818.691981:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4100 00000100:00080000:1.0:1788204818.691992:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204818.692000:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204818.692046:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7b80 x1875064728237696/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204818.692076:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204818.692078:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204818.692080:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204818.692083:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4100 00000100:00080000:1.0:1788204818.692086:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204818.692089:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204818.692098:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204818.692108:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7100 x1875064728237824/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204818.692128:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728237696:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204818.692209:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204818.692266:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204818/real 1788204818] req@ffff8bc1727d7b80 x1875064728237696/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204843 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204818.692292:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7b80 x1875064728237696/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204843 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204818.692304:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204818.692309:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204818.692313:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728237696:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204818.692339:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728237824:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204818.692358:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204818.692373:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204818/real 1788204818] req@ffff8bc1727d7100 x1875064728237824/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204843 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204818.692382:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7100 x1875064728237824/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204843 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204818.692387:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204818.692389:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204818.692416:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728237824:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204819.523978:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204819.589469:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204820.548022:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204820.611907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204821.572010:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204821.635934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204822.596020:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204822.659874:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204823.620050:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204823.686467:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204823.811859:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204823.811869:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204823.811874:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204823.811883:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4105 00000100:00080000:0.0:1788204823.811894:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204823.811901:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204823.811946:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140700 x1875064728237952/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204823.811973:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204823.811976:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204823.811978:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204823.811980:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4105 00000100:00080000:0.0:1788204823.811983:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204823.811986:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204823.811995:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204823.812006:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141c00 x1875064728238080/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204823.812033:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728237952:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204823.812103:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204823.812146:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204823/real 1788204823] req@ffff8bc144140700 x1875064728237952/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204848 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204823.812161:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140700 x1875064728237952/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204848 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204823.812169:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204823.812171:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204823.812174:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728237952:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204823.812179:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728238080:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204823.812193:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204823.812199:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204823/real 1788204823] req@ffff8bc144141c00 x1875064728238080/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204848 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204823.812207:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141c00 x1875064728238080/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204848 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204823.812212:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204823.812213:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204823.812215:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728238080:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204824.644023:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204824.708105:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204825.667943:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204825.731932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204826.691987:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204826.755906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204827.715927:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204827.779872:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204828.739945:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204828.803869:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204828.931949:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204828.931958:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204828.931962:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204828.931970:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4110 00000100:00080000:2.0:1788204828.931979:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204828.931985:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204828.932031:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c700 x1875064728238208/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204828.932058:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204828.932061:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204828.932063:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204828.932065:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4110 00000100:00080000:2.0:1788204828.932067:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204828.932069:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204828.932077:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204828.932086:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d180 x1875064728238336/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204828.932111:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728238208:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204828.932195:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204828.932281:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204828/real 1788204828] req@ffff8bc17257c700 x1875064728238208/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204853 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204828.932300:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c700 x1875064728238208/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204853 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204828.932312:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204828.932316:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204828.932320:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728238208:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204828.932349:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728238336:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204828.932372:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204828.932386:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204828/real 1788204828] req@ffff8bc17257d180 x1875064728238336/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204853 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204828.932398:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d180 x1875064728238336/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204853 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204828.932407:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204828.932411:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204828.932413:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728238336:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204829.763943:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204829.827906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204830.787939:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204830.851890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204831.811905:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204831.875910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204832.835933:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204832.899942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204833.859991:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204833.923936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204834.051929:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204834.051937:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204834.051940:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204834.051948:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4115 00000100:00080000:1.0:1788204834.051956:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204834.051962:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204834.051994:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4a80 x1875064728238464/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204834.052020:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204834.052024:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204834.052026:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204834.052030:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4115 00000100:00080000:1.0:1788204834.052033:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204834.052038:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204834.052047:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204834.052062:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7800 x1875064728238592/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204834.052098:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728238464:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204834.052181:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204834.052232:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204834/real 1788204834] req@ffff8bc1727d4a80 x1875064728238464/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204834.052253:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4a80 x1875064728238464/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204834.052265:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204834.052270:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204834.052274:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728238464:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204834.052282:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728238592:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204834.052302:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204834.052311:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204834/real 1788204834] req@ffff8bc1727d7800 x1875064728238592/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204834.052320:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7800 x1875064728238592/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204834.052325:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204834.052327:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204834.052329:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728238592:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204834.883936:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204834.947953:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204835.908012:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204835.971901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204836.931970:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204836.995942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204837.956004:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204838.019925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204838.979919:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204839.043927:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204839.171912:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204839.171922:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204839.171926:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204839.171936:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4120 00000100:00080000:2.0:1788204839.171947:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204839.171953:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204839.171996:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f100 x1875064728238720/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204839.172025:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204839.172028:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204839.172029:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204839.172033:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4120 00000100:00080000:2.0:1788204839.172035:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204839.172050:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204839.172059:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204839.172073:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d500 x1875064728238848/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204839.172088:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728238720:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204839.172226:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728238848:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204840.004009:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204840.067928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204841.028013:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204841.091892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204842.051957:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204842.115897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:0.0:1788204842.244470:0:10040:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:0.0:1788204842.244555:0:10040:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:0.0:1788204842.244578:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:0.0:1788204842.244639:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788204842.244848:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204839/real 1788204842] req@ffff8bc17257d500 x1875064728238848/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204842.244898:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d500 x1875064728238848/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204842.244914:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204842.244920:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204842.244925:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728238848:192.168.201.143@tcp:38:kworker.0 00000100:00100000:2.0:1788204842.244934:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204839/real 1788204842] req@ffff8bc17257f100 x1875064728238720/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204842.244947:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f100 x1875064728238720/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204842.244955:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204842.244958:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204842.244961:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728238720:192.168.201.143@tcp:250:kworker.0 00010000:00010000:2.0:1788204843.076038:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204843.139925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204844.100005:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204844.163932:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204844.291969:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204844.291990:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204844.291995:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204844.292007:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4125 00000100:00080000:0.0:1788204844.292020:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204844.292028:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204844.292074:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141c00 x1875064728238976/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204844.292105:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204844.292110:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204844.292111:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204844.292116:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4125 00000100:00080000:0.0:1788204844.292120:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204844.292124:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204844.292136:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204844.292152:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728238976:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204844.292153:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140700 x1875064728239104/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788204844.292239:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204844.292318:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204844/real 1788204844] req@ffff8bc144141c00 x1875064728238976/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204844.292342:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141c00 x1875064728238976/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204844.292360:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204844.292365:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204844.292370:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728238976:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204844.292411:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728239104:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204844.292435:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204844.292448:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204844/real 1788204844] req@ffff8bc144140700 x1875064728239104/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204844.292459:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140700 x1875064728239104/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204844.292466:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204844.292469:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204844.292473:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728239104:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204845.124058:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204845.187965:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204846.147995:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204846.211930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204847.171947:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204847.235881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204848.195963:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204848.259913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204849.219959:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204849.283927:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204849.411899:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204849.411907:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204849.411911:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204849.411919:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4130 00000100:00080000:0.0:1788204849.411929:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204849.411936:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204849.411972:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142a00 x1875064728239232/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204849.411997:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204849.412001:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204849.412003:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204849.412007:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4130 00000100:00080000:0.0:1788204849.412010:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204849.412014:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204849.412023:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204849.412036:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140e00 x1875064728239360/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204849.412050:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728239232:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204849.412109:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204849.412159:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204849/real 1788204849] req@ffff8bc144142a00 x1875064728239232/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204849.412178:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142a00 x1875064728239232/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204849.412188:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204849.412192:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204849.412196:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728239232:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204849.412217:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728239360:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204849.412238:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204849.412251:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204849/real 1788204849] req@ffff8bc144140e00 x1875064728239360/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204849.412263:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140e00 x1875064728239360/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204849.412272:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204849.412275:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204849.412278:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728239360:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204850.244013:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204850.307956:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204851.267999:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204851.331963:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204852.291981:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204852.355931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204853.316038:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204853.379935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204854.339974:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204854.403924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204854.531968:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204854.531981:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204854.531987:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204854.531999:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4135 00000100:00080000:1.0:1788204854.532012:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204854.532021:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204854.532067:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6a00 x1875064728239488/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204854.532102:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204854.532105:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204854.532107:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204854.532111:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4135 00000100:00080000:1.0:1788204854.532114:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204854.532118:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204854.532129:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204854.532142:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4e00 x1875064728239616/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204854.532200:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728239488:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204854.532274:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204854.532336:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204854/real 1788204854] req@ffff8bc1727d6a00 x1875064728239488/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204879 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204854.532358:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6a00 x1875064728239488/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204879 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204854.532371:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204854.532375:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204854.532379:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728239488:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204854.532387:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728239616:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204854.532416:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204854.532430:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204854/real 1788204854] req@ffff8bc1727d4e00 x1875064728239616/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204879 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204854.532441:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4e00 x1875064728239616/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204879 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204854.532450:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204854.532453:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204854.532456:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728239616:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204855.363982:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204855.427926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204856.387924:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204856.451955:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204857.411947:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204857.475927:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204858.435963:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204858.499934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204859.460007:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204859.523882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204859.652105:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204859.652119:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204859.652124:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204859.652136:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4141 00000100:00080000:3.0:1788204859.652149:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204859.652157:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204859.652204:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728239744/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204859.652239:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204859.652243:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204859.652245:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204859.652249:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4141 00000100:00080000:3.0:1788204859.652253:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204859.652257:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204859.652267:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204859.652281:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728239872/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204859.652288:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728239744:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204859.652363:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204859.652410:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204859/real 1788204859] req@ffff8bc1726cc380 x1875064728239744/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204884 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204859.652424:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728239744/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204884 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204859.652433:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204859.652436:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204859.652439:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728239744:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204859.652463:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728239872:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204859.652478:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204859.652485:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204859/real 1788204859] req@ffff8bc1726ce680 x1875064728239872/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204884 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204859.652492:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728239872/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204884 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204859.652497:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204859.652499:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204859.652502:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728239872:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204860.483964:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204860.547936:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204861.507987:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204861.571860:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204862.531962:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204862.595897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204863.555976:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204863.619958:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204864.579944:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204864.643897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204864.771899:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204864.771909:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204864.771913:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204864.771923:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4146 00000100:00080000:3.0:1788204864.771934:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204864.771948:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204864.771980:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728240000/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204864.771999:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204864.772002:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204864.772003:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204864.772006:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4146 00000100:00080000:3.0:1788204864.772008:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204864.772010:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204864.772017:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204864.772024:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728240128/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204864.772052:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728240000:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204864.772110:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204864.772160:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204864/real 1788204864] req@ffff8bc1726cea00 x1875064728240000/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204889 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204864.772183:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728240000/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204889 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204864.772189:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204864.772192:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204864.772194:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728240000:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204864.772199:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728240128:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204864.772216:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204864.772228:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204864/real 1788204864] req@ffff8bc1726ce300 x1875064728240128/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204889 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204864.772239:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728240128/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204889 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204864.772248:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204864.772251:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204864.772255:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728240128:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204865.603947:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204865.667943:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204866.627936:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204866.691862:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204867.651967:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204867.715907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204868.675914:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204868.739895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204869.699977:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204869.763895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204869.891878:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204869.891886:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204869.891890:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204869.891900:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4151 00000100:00080000:0.0:1788204869.891909:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204869.891916:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204869.891953:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141880 x1875064728240256/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204869.891975:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204869.891978:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204869.891982:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204869.891985:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4151 00000100:00080000:0.0:1788204869.891987:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204869.891991:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204869.891998:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204869.892009:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143480 x1875064728240384/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204869.892012:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728240256:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204869.892063:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204869.892098:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204869/real 1788204869] req@ffff8bc144141880 x1875064728240256/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204894 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204869.892110:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141880 x1875064728240256/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204894 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204869.892116:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204869.892119:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204869.892121:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728240256:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204869.892139:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728240384:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204869.892152:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204869.892160:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204869/real 1788204869] req@ffff8bc144143480 x1875064728240384/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204894 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204869.892178:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143480 x1875064728240384/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204894 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204869.892184:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204869.892186:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204869.892188:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728240384:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204870.723956:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204870.787907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204871.747901:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204871.811888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204872.771957:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204872.835868:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204873.795933:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204873.859857:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204874.819968:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204874.883864:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204875.011949:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204875.011957:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204875.011960:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204875.011968:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4156 00000100:00080000:3.0:1788204875.011976:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204875.011981:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204875.012012:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728240512/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204875.012041:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204875.012045:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204875.012046:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204875.012050:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4156 00000100:00080000:3.0:1788204875.012053:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204875.012057:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204875.012065:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204875.012079:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728240640/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204875.012113:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728240512:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204875.012193:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204875.012253:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204875/real 1788204875] req@ffff8bc1726cfb80 x1875064728240512/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204875.012276:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728240512/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204875.012288:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204875.012293:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204875.012297:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728240512:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204875.012304:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728240640:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204875.012323:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204875.012332:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204875/real 1788204875] req@ffff8bc1726ced80 x1875064728240640/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204875.012341:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728240640/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204875.012347:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204875.012349:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204875.012351:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728240640:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204875.843950:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204875.907934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204876.867981:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204876.931870:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204877.891886:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204877.955853:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204878.915977:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204878.979837:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204879.939943:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204880.003888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204880.131873:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204880.131881:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204880.131885:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204880.131892:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4161 00000100:00080000:1.0:1788204880.131900:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204880.131905:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204880.131939:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5c00 x1875064728240768/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204880.131962:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204880.131964:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204880.131966:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204880.131968:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4161 00000100:00080000:1.0:1788204880.131970:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204880.131972:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204880.131979:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204880.131987:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4700 x1875064728240896/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204880.132011:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728240768:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204880.132068:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204880.132120:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204880/real 1788204880] req@ffff8bc1727d5c00 x1875064728240768/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204880.132141:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5c00 x1875064728240768/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204880.132151:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204880.132154:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204880.132156:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728240768:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204880.132162:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728240896:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204880.132183:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204880.132196:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204880/real 1788204880] req@ffff8bc1727d4700 x1875064728240896/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204880.132208:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4700 x1875064728240896/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204880.132217:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204880.132220:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204880.132223:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728240896:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204880.963936:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204881.027899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204881.987959:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204882.051928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204883.011967:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204883.075946:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204884.035941:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204884.099912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204885.060015:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204885.123926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204885.251944:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204885.251954:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204885.251958:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204885.251969:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4166 00000100:00080000:3.0:1788204885.251981:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204885.251990:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204885.252046:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728241024/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204885.252071:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204885.252074:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204885.252076:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204885.252079:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4166 00000100:00080000:3.0:1788204885.252082:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204885.252085:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204885.252094:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204885.252105:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728241152/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204885.252146:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728241024:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204885.252273:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204885.252359:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204885/real 1788204885] req@ffff8bc1726cd500 x1875064728241024/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204885.252383:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728241024/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204885.252396:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204885.252401:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204885.252405:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728241024:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204885.252414:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728241152:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204885.252441:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204885.252456:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204885/real 1788204885] req@ffff8bc1726cca80 x1875064728241152/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204885.252470:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728241152/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204885.252479:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204885.252482:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204885.252486:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728241152:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204886.083951:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204886.147881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204887.108000:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204887.171877:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204888.132003:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204888.195892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204889.156031:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204889.219884:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204890.180053:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204890.243864:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204890.371892:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204890.371900:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204890.371904:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204890.371911:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4171 00000100:00080000:3.0:1788204890.371919:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204890.371925:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204890.371954:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728241280/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204890.371976:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204890.371978:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204890.371979:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204890.371982:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4171 00000100:00080000:3.0:1788204890.371984:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204890.371986:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204890.371992:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204890.371999:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728241408/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204890.372030:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728241280:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204890.372079:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204890.372119:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204890/real 1788204890] req@ffff8bc1726cf480 x1875064728241280/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204890.372132:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728241280/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204890.372139:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204890.372142:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204890.372145:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728241280:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204890.372150:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728241408:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204890.372193:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204890.372205:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204890/real 1788204890] req@ffff8bc1726cf100 x1875064728241408/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204890.372217:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728241408/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204890.372225:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204890.372228:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204890.372232:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728241408:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204891.204128:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204891.267926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204892.227955:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204892.291898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204893.251946:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204893.315915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204894.275940:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204894.339866:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204895.299967:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204895.363961:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204895.491944:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204895.491955:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204895.491959:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204895.491971:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4176 00000100:00080000:3.0:1788204895.491984:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204895.491991:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204895.492034:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728241536/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204895.492078:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204895.492083:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204895.492085:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204895.492090:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4176 00000100:00080000:3.0:1788204895.492094:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204895.492098:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204895.492108:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204895.492120:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728241664/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204895.492130:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728241536:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204895.492209:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204895.492275:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204895/real 1788204895] req@ffff8bc1726cd180 x1875064728241536/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204895.492293:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728241536/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204895.492302:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204895.492305:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204895.492308:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728241536:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204895.492334:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728241664:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204895.492362:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204895.492372:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204895/real 1788204895] req@ffff8bc1726cc700 x1875064728241664/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204895.492380:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728241664/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204895.492387:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204895.492389:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204895.492392:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728241664:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204896.324008:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204896.387955:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204897.347994:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204897.411928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204898.372044:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204898.435867:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204899.395914:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204899.459862:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204900.419901:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204900.483844:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204900.611934:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204900.611942:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204900.611946:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204900.611956:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4181 00000100:00080000:1.0:1788204900.612010:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204900.612019:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204900.612057:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6300 x1875064728241792/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204900.612094:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204900.612097:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204900.612100:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204900.612103:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4181 00000100:00080000:1.0:1788204900.612107:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204900.612111:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204900.612125:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204900.612143:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728241792:192.168.201.143@tcp:250:kworker.0 00000100:00100000:1.0:1788204900.612145:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6d80 x1875064728241920/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788204900.612218:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204900.612268:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204900/real 1788204900] req@ffff8bc1727d6300 x1875064728241792/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204925 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204900.612284:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6300 x1875064728241792/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204925 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204900.612296:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204900.612300:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204900.612304:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728241792:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204900.612329:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728241920:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204900.612353:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204900.612366:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204900/real 1788204900] req@ffff8bc1727d6d80 x1875064728241920/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204925 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204900.612379:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6d80 x1875064728241920/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204925 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204900.612389:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204900.612393:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204900.612396:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728241920:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204901.443936:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204901.507982:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204902.467982:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204902.531904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204903.491971:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204903.555857:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204904.516009:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788204904.579974:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204905.539958:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204905.603965:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204905.731929:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204905.731937:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204905.731941:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204905.731950:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4187 00000100:00080000:3.0:1788204905.731958:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204905.731966:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204905.732001:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728242048/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204905.732032:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204905.732037:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204905.732039:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204905.732044:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4187 00000100:00080000:3.0:1788204905.732047:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204905.732050:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204905.732059:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204905.732071:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728242176/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204905.732129:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728242048:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204905.732259:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728242176:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204906.564005:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204906.627937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204907.587933:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204907.651922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204908.611985:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204908.675963:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788204908.804061:0:10041:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788204908.804103:0:10041:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788204908.804121:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788204908.804166:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788204908.804202:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204905/real 1788204908] req@ffff8bc1726cdf80 x1875064728242048/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204930 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204908.804229:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728242048/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204930 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204908.804241:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204908.804246:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204908.804250:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728242048:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204908.804265:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204905/real 1788204908] req@ffff8bc1726cf800 x1875064728242176/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204930 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204908.804278:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728242176/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204930 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204908.804286:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204908.804289:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204908.804293:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728242176:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204909.635978:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204909.699929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204910.659916:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204910.723908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204910.851899:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204910.851910:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204910.851914:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204910.851931:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4192 00000100:00080000:3.0:1788204910.851940:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204910.851946:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204910.851977:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728242304/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204910.851998:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204910.852001:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204910.852002:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204910.852005:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4192 00000100:00080000:3.0:1788204910.852008:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204910.852010:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204910.852018:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204910.852026:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728242432/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204910.852054:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728242304:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204910.852120:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204910.852189:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204910/real 1788204910] req@ffff8bc1726cf800 x1875064728242304/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204935 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204910.852209:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728242304/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204935 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204910.852221:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204910.852226:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204910.852231:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728242304:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204910.852239:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728242432:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204910.852261:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204910.852276:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204910/real 1788204910] req@ffff8bc1726cdf80 x1875064728242432/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204935 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204910.852296:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728242432/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204935 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204910.852305:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204910.852308:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204910.852312:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728242432:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204911.683975:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204911.748017:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204912.707918:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204912.772006:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204913.731964:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204913.795883:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204914.755942:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204914.819912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204915.780025:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204915.843860:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204915.971959:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204915.971975:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204915.971981:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204915.971994:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4197 00000100:00080000:1.0:1788204915.972008:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204915.972018:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204915.972077:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6680 x1875064728242560/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204915.972111:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204915.972116:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204915.972118:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204915.972122:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4197 00000100:00080000:1.0:1788204915.972127:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204915.972133:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204915.972145:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204915.972161:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5500 x1875064728242688/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204915.972191:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728242560:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204915.972286:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204915.972359:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204915/real 1788204915] req@ffff8bc1727d6680 x1875064728242560/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204940 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204915.972381:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6680 x1875064728242560/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204940 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204915.972393:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204915.972398:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204915.972403:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728242560:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204915.972411:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728242688:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204915.972436:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204915.972449:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204915/real 1788204915] req@ffff8bc1727d5500 x1875064728242688/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204940 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204915.972463:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5500 x1875064728242688/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204940 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204915.972473:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204915.972476:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204915.972480:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728242688:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204916.804056:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204916.867987:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204917.827935:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204917.891850:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204918.851935:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204918.915858:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204919.875969:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204919.939869:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204920.899977:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204920.963896:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204921.091883:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204921.091890:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204921.091893:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204921.091901:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4202 00000100:00080000:1.0:1788204921.091928:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204921.091934:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204921.091964:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4380 x1875064728242816/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204921.091995:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204921.091999:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204921.092001:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204921.092004:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4202 00000100:00080000:1.0:1788204921.092008:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204921.092012:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204921.092021:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204921.092032:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5f80 x1875064728242944/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204921.092052:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728242816:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204921.092106:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204921.092154:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204921/real 1788204921] req@ffff8bc1727d4380 x1875064728242816/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204921.092172:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4380 x1875064728242816/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204921.092183:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204921.092186:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204921.092190:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728242816:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204921.092196:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728242944:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204921.092213:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204921.092222:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204921/real 1788204921] req@ffff8bc1727d5f80 x1875064728242944/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204921.092234:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5f80 x1875064728242944/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204921.092241:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204921.092244:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204921.092246:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728242944:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204921.923993:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204921.988007:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204922.947945:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204923.012057:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204923.971945:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204924.035912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204924.995957:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204925.059890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204926.020006:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204926.083917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204926.211876:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204926.211883:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204926.211887:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204926.211894:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4207 00000100:00080000:1.0:1788204926.211902:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204926.211907:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204926.211936:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4000 x1875064728243072/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204926.211954:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204926.211957:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204926.211958:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204926.211960:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4207 00000100:00080000:1.0:1788204926.211962:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204926.211964:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204926.211972:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204926.211985:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5180 x1875064728243200/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204926.212044:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728243072:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204926.212114:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204926.212167:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204926/real 1788204926] req@ffff8bc1727d4000 x1875064728243072/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204926.212189:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4000 x1875064728243072/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204926.212201:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204926.212205:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204926.212209:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728243072:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204926.212216:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728243200:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204926.212235:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204926.212245:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204926/real 1788204926] req@ffff8bc1727d5180 x1875064728243200/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204926.212253:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5180 x1875064728243200/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204926.212258:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204926.212260:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204926.212262:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728243200:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204927.044013:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204927.107979:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204928.067944:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204928.131885:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204929.091949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204929.155911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204930.115981:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204930.179944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204931.140005:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204931.203914:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204931.331946:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204931.331955:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204931.331959:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204931.331969:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4212 00000100:00080000:3.0:1788204931.331982:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204931.331991:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204931.332039:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728243328/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204931.332070:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204931.332074:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204931.332076:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204931.332080:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4212 00000100:00080000:3.0:1788204931.332084:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204931.332089:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204931.332099:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204931.332113:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728243456/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204931.332125:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728243328:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204931.332197:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204931.332258:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204931/real 1788204931] req@ffff8bc1726cc700 x1875064728243328/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204931.332278:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728243328/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204931.332289:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204931.332293:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204931.332297:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728243328:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204931.332323:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728243456:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204931.332341:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204931.332352:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204931/real 1788204931] req@ffff8bc1726cd180 x1875064728243456/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204931.332369:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728243456/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204931.332378:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204931.332380:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204931.332383:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728243456:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204932.165926:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204932.229080:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204933.188016:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204933.251921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204934.211931:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204934.275939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204935.235984:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204935.299895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204936.260014:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204936.323911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204936.451958:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204936.451969:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204936.451973:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204936.451983:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4217 00000100:00080000:1.0:1788204936.451994:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204936.452001:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204936.452048:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7480 x1875064728243584/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204936.452081:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204936.452085:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204936.452087:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204936.452091:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4217 00000100:00080000:1.0:1788204936.452094:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204936.452099:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204936.452110:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204936.452127:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5880 x1875064728243712/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204936.452139:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728243584:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204936.452227:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204936.452275:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204936/real 1788204936] req@ffff8bc1727d7480 x1875064728243584/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204936.452289:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7480 x1875064728243584/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204936.452297:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204936.452300:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204936.452303:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728243584:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204936.452325:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728243712:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204936.452340:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204936.452348:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204936/real 1788204936] req@ffff8bc1727d5880 x1875064728243712/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204936.452369:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5880 x1875064728243712/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204936.452374:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204936.452376:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204936.452378:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728243712:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204937.283982:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204937.347979:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204938.307965:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204938.371939:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204939.331999:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204939.395893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204940.355992:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204940.419869:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204941.380004:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204941.443897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204941.571894:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204941.571903:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204941.571908:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204941.571921:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4222 00000100:00080000:3.0:1788204941.571934:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204941.571942:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204941.571987:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728243840/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204941.572011:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204941.572014:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204941.572016:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204941.572019:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4222 00000100:00080000:3.0:1788204941.572021:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204941.572025:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204941.572034:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204941.572044:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728243968/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204941.572051:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728243840:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204941.572126:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204941.572180:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204941/real 1788204941] req@ffff8bc1726cf100 x1875064728243840/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204966 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204941.572195:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728243840/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204966 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204941.572204:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204941.572207:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204941.572210:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728243840:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204941.572234:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728243968:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204941.572250:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204941.572257:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204941/real 1788204941] req@ffff8bc1726cf480 x1875064728243968/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204966 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204941.572282:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728243968/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204966 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204941.572290:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204941.572293:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204941.572297:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728243968:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204942.403974:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204942.467991:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204943.428024:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204943.491966:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204944.451982:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204944.515889:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204945.475998:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204945.539929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204946.499984:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204946.564003:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204946.691946:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204946.691960:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204946.691965:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204946.691978:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4228 00000100:00080000:1.0:1788204946.691991:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204946.692000:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204946.692049:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5880 x1875064728244096/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204946.692081:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204946.692085:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204946.692086:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204946.692090:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4228 00000100:00080000:1.0:1788204946.692094:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204946.692098:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204946.692109:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204946.692128:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7480 x1875064728244224/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204946.692138:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728244096:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204946.692250:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204946.692328:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204946/real 1788204946] req@ffff8bc1727d5880 x1875064728244096/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204971 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204946.692350:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5880 x1875064728244096/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204971 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204946.692361:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204946.692366:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204946.692370:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728244096:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204946.692400:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728244224:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204946.692424:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204946.692438:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204946/real 1788204946] req@ffff8bc1727d7480 x1875064728244224/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204971 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204946.692451:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7480 x1875064728244224/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204971 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204946.692459:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204946.692462:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204946.692466:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728244224:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204947.524011:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204947.588025:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204948.548035:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204948.611911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204949.571924:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204949.635923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204950.595968:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204950.659945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204951.619953:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204951.683881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204951.811915:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204951.811924:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204951.811928:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204951.811938:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4233 00000100:00080000:1.0:1788204951.811950:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204951.811957:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204951.811995:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5180 x1875064728244352/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204951.812023:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204951.812025:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204951.812027:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204951.812029:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4233 00000100:00080000:1.0:1788204951.812031:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204951.812033:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204951.812041:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204951.812049:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4000 x1875064728244480/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204951.812121:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728244352:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204951.812185:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204951.812230:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204951/real 1788204951] req@ffff8bc1727d5180 x1875064728244352/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204976 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204951.812243:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5180 x1875064728244352/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204976 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204951.812251:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204951.812254:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204951.812257:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728244352:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204951.812261:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728244480:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204951.812273:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204951.812280:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204951/real 1788204951] req@ffff8bc1727d4000 x1875064728244480/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204976 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204951.812288:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4000 x1875064728244480/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204976 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204951.812293:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204951.812295:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204951.812296:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728244480:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204952.643969:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204952.707908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204953.667954:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204953.731888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204954.691951:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204954.755876:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204955.715984:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204955.779856:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204956.739960:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204956.803852:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204956.931917:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204956.931923:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204956.931927:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204956.931935:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4238 00000100:00080000:0.0:1788204956.931944:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204956.931950:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204956.931980:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143b80 x1875064728244608/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204956.932014:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204956.932018:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204956.932020:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204956.932023:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4238 00000100:00080000:0.0:1788204956.932026:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204956.932029:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204956.932036:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204956.932048:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141500 x1875064728244736/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204956.932049:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728244608:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204956.932111:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204956.932158:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204956/real 1788204956] req@ffff8bc144143b80 x1875064728244608/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204981 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204956.932176:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143b80 x1875064728244608/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204981 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204956.932186:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204956.932190:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204956.932194:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728244608:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204956.932216:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728244736:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204956.932238:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204956.932251:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204956/real 1788204956] req@ffff8bc144141500 x1875064728244736/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204981 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204956.932261:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141500 x1875064728244736/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204981 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204956.932266:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204956.932268:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204956.932270:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728244736:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204957.764006:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204957.827900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204958.787968:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204958.851910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204959.811939:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204959.875892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204960.835986:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204960.899900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204961.859947:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204961.923877:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204962.051949:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204962.051959:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204962.051963:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204962.051973:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4243 00000100:00080000:1.0:1788204962.051982:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204962.051989:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204962.052025:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5f80 x1875064728244864/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204962.052053:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204962.052056:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204962.052058:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204962.052061:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4243 00000100:00080000:1.0:1788204962.052064:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204962.052068:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204962.052084:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204962.052106:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4380 x1875064728244992/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204962.052107:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728244864:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204962.052165:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204962.052212:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204962/real 1788204962] req@ffff8bc1727d5f80 x1875064728244864/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204962.052230:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5f80 x1875064728244864/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204962.052237:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204962.052240:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204962.052242:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728244864:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204962.052259:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728244992:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204962.052272:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204962.052280:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204962/real 1788204962] req@ffff8bc1727d4380 x1875064728244992/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204962.052287:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4380 x1875064728244992/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204962.052293:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204962.052294:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204962.052296:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728244992:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204962.883979:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204962.947917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204963.907949:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204963.971852:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204964.932064:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204964.995910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204965.956016:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204966.019917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204966.980059:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204967.043941:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204967.171928:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204967.171939:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204967.171944:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204967.171955:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4248 00000100:00080000:1.0:1788204967.171966:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204967.171972:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204967.172013:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5500 x1875064728245120/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204967.172043:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204967.172046:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204967.172047:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204967.172050:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4248 00000100:00080000:1.0:1788204967.172052:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204967.172055:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204967.172065:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204967.172077:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6680 x1875064728245248/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204967.172106:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728245120:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204967.172186:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204967.172251:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204967/real 1788204967] req@ffff8bc1727d5500 x1875064728245120/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204967.172275:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5500 x1875064728245120/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204967.172286:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204967.172289:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204967.172293:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728245120:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204967.172301:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728245248:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204967.172324:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204967.172338:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204967/real 1788204967] req@ffff8bc1727d6680 x1875064728245248/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204967.172351:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6680 x1875064728245248/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204967.172360:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204967.172363:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204967.172366:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728245248:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204968.004039:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204968.067947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204969.027949:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204969.091912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204970.052024:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204970.115915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204971.075940:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204971.139890:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204972.100000:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204972.163907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204972.291943:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204972.291958:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204972.291963:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204972.291976:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4253 00000100:00080000:2.0:1788204972.291989:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204972.291998:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204972.292040:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f100 x1875064728245376/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204972.292065:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204972.292069:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204972.292070:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204972.292073:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4253 00000100:00080000:2.0:1788204972.292075:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204972.292079:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204972.292088:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204972.292101:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d500 x1875064728245504/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204972.292150:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728245376:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204972.292272:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728245504:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204973.123935:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204973.187917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204974.147988:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204974.211898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204975.172023:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204975.235934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788204975.364085:0:10042:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788204975.364151:0:10042:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788204975.364170:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788204975.364224:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:0.0:1788204975.364567:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204972/real 1788204975] req@ffff8bc17257f100 x1875064728245376/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204975.364598:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f100 x1875064728245376/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788204997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204975.364612:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204975.364618:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204975.364622:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728245376:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204975.364632:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204972/real 1788204975] req@ffff8bc17257d500 x1875064728245504/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204975.364646:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d500 x1875064728245504/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788204997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204975.364655:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204975.364659:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204975.364662:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728245504:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204976.196039:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204976.259938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204977.219956:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204977.283931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204977.411858:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204977.411865:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204977.411868:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204977.411876:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4258 00000100:00080000:2.0:1788204977.411883:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204977.411889:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204977.411925:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e300 x1875064728245632/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204977.411952:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204977.411959:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204977.411960:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204977.411963:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4258 00000100:00080000:2.0:1788204977.411966:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204977.411968:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204977.411977:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204977.411988:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c380 x1875064728245760/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204977.412015:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728245632:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204977.412097:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204977.412153:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204977/real 1788204977] req@ffff8bc17257e300 x1875064728245632/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204977.412190:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e300 x1875064728245632/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204977.412204:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204977.412209:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204977.412212:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728245632:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204977.412248:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728245760:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204977.412274:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204977.412288:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204977/real 1788204977] req@ffff8bc17257c380 x1875064728245760/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204977.412302:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c380 x1875064728245760/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204977.412311:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204977.412315:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204977.412318:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728245760:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204978.243962:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204978.307911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204979.267925:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204979.331897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204980.292018:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204980.355929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204981.315947:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204981.379918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204982.339985:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788204982.403923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788204982.531900:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788204982.531911:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788204982.531915:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204982.531925:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4263 00000100:00080000:3.0:1788204982.531936:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204982.531942:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788204982.531981:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728245888/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788204982.532010:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788204982.532013:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788204982.532015:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788204982.532017:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4263 00000100:00080000:3.0:1788204982.532019:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788204982.532022:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788204982.532031:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788204982.532040:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728246016/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204982.532064:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728245888:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204982.532123:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204982.532169:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204982/real 1788204982] req@ffff8bc1726cca80 x1875064728245888/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205007 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204982.532186:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728245888/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205007 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204982.532196:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204982.532201:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204982.532205:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728245888:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204982.532227:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728246016:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204982.532244:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204982.532252:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204982/real 1788204982] req@ffff8bc1726cd500 x1875064728246016/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205007 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204982.532259:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728246016/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205007 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204982.532265:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204982.532267:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204982.532268:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728246016:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204983.363954:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204983.427905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204984.388018:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204984.451891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204985.412038:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204985.475859:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204986.435930:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204986.499879:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204987.459966:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204987.525981:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788204987.651921:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788204987.651928:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788204987.651932:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204987.651939:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4269 00000100:00080000:0.0:1788204987.651948:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204987.651953:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788204987.651987:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142300 x1875064728246144/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788204987.652008:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788204987.652010:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788204987.652011:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788204987.652014:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4269 00000100:00080000:0.0:1788204987.652016:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788204987.652018:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788204987.652024:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788204987.652032:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141f80 x1875064728246272/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204987.652053:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728246144:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204987.652112:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204987.652156:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204987/real 1788204987] req@ffff8bc144142300 x1875064728246144/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205012 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204987.652169:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142300 x1875064728246144/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205012 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204987.652176:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204987.652178:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204987.652181:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728246144:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204987.652186:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728246272:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204987.652202:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204987.652210:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204987/real 1788204987] req@ffff8bc144141f80 x1875064728246272/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205012 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204987.652217:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141f80 x1875064728246272/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205012 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204987.652223:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204987.652224:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204987.652226:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728246272:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204988.483915:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204988.547918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204989.507993:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204989.571910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204990.531883:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204990.595892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204991.555971:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204991.619916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204992.579966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788204992.643918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788204992.771881:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788204992.771888:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788204992.771891:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204992.771899:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4274 00000100:00080000:1.0:1788204992.771907:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204992.771912:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788204992.771943:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6d80 x1875064728246400/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788204992.771962:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788204992.771965:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788204992.771967:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788204992.771970:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4274 00000100:00080000:1.0:1788204992.771973:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788204992.771977:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788204992.771986:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788204992.772000:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6300 x1875064728246528/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788204992.772011:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728246400:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788204992.772067:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204992.772108:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204992/real 1788204992] req@ffff8bc1727d6d80 x1875064728246400/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205017 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204992.772124:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6d80 x1875064728246400/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205017 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204992.772133:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204992.772136:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204992.772140:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728246400:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788204992.772160:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728246528:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788204992.772178:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788204992.772188:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204992/real 1788204992] req@ffff8bc1727d6300 x1875064728246528/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205017 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788204992.772198:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6300 x1875064728246528/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205017 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788204992.772205:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788204992.772209:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788204992.772212:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728246528:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204993.603946:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204993.667883:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204994.627936:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204994.691891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204995.651987:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204995.715862:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204996.675979:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204996.739883:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204997.700001:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204997.763869:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788204997.891916:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788204997.891926:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788204997.891936:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204997.891945:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4279 00000100:00080000:2.0:1788204997.891957:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204997.891963:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788204997.892004:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257fb80 x1875064728246656/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788204997.892030:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788204997.892033:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788204997.892035:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788204997.892037:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4279 00000100:00080000:2.0:1788204997.892040:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788204997.892042:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788204997.892050:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788204997.892059:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ca80 x1875064728246784/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788204997.892074:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728246656:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788204997.892139:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204997.892185:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204997/real 1788204997] req@ffff8bc17257fb80 x1875064728246656/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205022 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204997.892199:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257fb80 x1875064728246656/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205022 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204997.892208:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204997.892211:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204997.892214:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728246656:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788204997.892237:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728246784:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788204997.892265:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788204997.892273:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788204997/real 1788204997] req@ffff8bc17257ca80 x1875064728246784/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205022 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788204997.892284:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ca80 x1875064728246784/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205022 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788204997.892303:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788204997.892307:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788204997.892311:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728246784:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788204998.723967:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204998.787919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788204999.747938:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788204999.811946:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205000.771982:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788205000.835880:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205001.796005:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788205001.859892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205002.819966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788205002.883862:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788205003.011889:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788205003.011896:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788205003.011900:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788205003.011907:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4284 00000100:00080000:2.0:1788205003.011915:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788205003.011920:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788205003.011950:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ea00 x1875064728246912/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788205003.011969:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788205003.011971:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788205003.011973:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788205003.011975:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4284 00000100:00080000:2.0:1788205003.011977:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788205003.011979:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788205003.011987:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788205003.011998:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ce00 x1875064728247040/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205003.012049:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728246912:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205003.012096:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205003.012137:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205003/real 1788205003] req@ffff8bc17257ea00 x1875064728246912/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205003.012150:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ea00 x1875064728246912/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205003.012156:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205003.012159:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205003.012162:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728246912:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205003.012168:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728247040:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205003.012187:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205003.012199:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205003/real 1788205003] req@ffff8bc17257ce00 x1875064728247040/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205003.012236:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ce00 x1875064728247040/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205003.012242:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205003.012245:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205003.012247:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728247040:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205003.843981:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205003.908093:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205004.868016:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205004.931909:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205005.891976:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205005.955937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205006.916001:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205006.979944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205007.939982:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205008.003950:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788205008.131963:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788205008.131976:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788205008.131980:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205008.131992:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4289 00000100:00080000:1.0:1788205008.132005:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205008.132013:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788205008.132064:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4700 x1875064728247168/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788205008.132099:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788205008.132104:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788205008.132106:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205008.132110:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4289 00000100:00080000:1.0:1788205008.132113:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205008.132131:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788205008.132142:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788205008.132156:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5c00 x1875064728247296/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205008.132164:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728247168:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205008.132228:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205008.132272:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205008/real 1788205008] req@ffff8bc1727d4700 x1875064728247168/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205008.132286:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4700 x1875064728247168/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205008.132293:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205008.132297:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205008.132301:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728247168:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205008.132327:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728247296:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205008.132347:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205008.132357:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205008/real 1788205008] req@ffff8bc1727d5c00 x1875064728247296/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205008.132365:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5c00 x1875064728247296/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205008.132370:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205008.132372:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205008.132374:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728247296:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205008.963994:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205009.027960:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205009.987938:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205010.051925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205011.011950:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205011.075930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205012.035926:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205012.099929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205013.059934:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205013.123917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788205013.251898:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788205013.251909:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788205013.251914:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788205013.251923:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4294 00000100:00080000:2.0:1788205013.251933:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788205013.251941:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788205013.251970:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ed80 x1875064728247424/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788205013.251991:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788205013.251993:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788205013.251994:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788205013.251997:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4294 00000100:00080000:2.0:1788205013.251999:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788205013.252001:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788205013.252008:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788205013.252017:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d880 x1875064728247552/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205013.252078:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728247424:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205013.252161:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205013.252217:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205013/real 1788205013] req@ffff8bc17257ed80 x1875064728247424/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205013.252233:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ed80 x1875064728247424/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205013.252242:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205013.252246:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205013.252249:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728247424:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205013.252255:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728247552:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205013.252273:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205013.252281:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205013/real 1788205013] req@ffff8bc17257d880 x1875064728247552/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205013.252294:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d880 x1875064728247552/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205013.252300:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205013.252302:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205013.252304:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728247552:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205014.083947:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205014.147881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205015.107986:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205015.171944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205016.132012:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205016.195942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205017.156014:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205017.219888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205018.179988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205018.243900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788205018.371915:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788205018.371928:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788205018.371934:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788205018.371976:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4299 00000100:00080000:2.0:1788205018.371988:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788205018.371994:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788205018.372037:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e680 x1875064728247680/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788205018.372066:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788205018.372069:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788205018.372071:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788205018.372076:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4299 00000100:00080000:2.0:1788205018.372078:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788205018.372081:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788205018.372090:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788205018.372100:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257df80 x1875064728247808/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205018.372129:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728247680:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205018.372210:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205018.372264:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205018/real 1788205018] req@ffff8bc17257e680 x1875064728247680/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205018.372285:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e680 x1875064728247680/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205018.372302:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205018.372307:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205018.372311:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728247680:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205018.372319:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728247808:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205018.372341:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205018.372354:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205018/real 1788205018] req@ffff8bc17257df80 x1875064728247808/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205018.372366:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257df80 x1875064728247808/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205018.372374:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205018.372378:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205018.372381:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728247808:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205019.203953:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205019.267955:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205020.227951:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205020.291893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205021.251966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205021.315927:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205022.275939:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205022.339904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205023.300101:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205023.363972:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788205023.491912:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788205023.491922:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788205023.491926:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205023.491943:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4304 00000100:00080000:3.0:1788205023.491954:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205023.491961:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788205023.492002:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728247936/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788205023.492025:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788205023.492028:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788205023.492029:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205023.492032:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4304 00000100:00080000:3.0:1788205023.492034:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205023.492037:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788205023.492046:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788205023.492055:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728248064/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205023.492069:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728247936:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205023.492134:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205023.492197:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205023/real 1788205023] req@ffff8bc1726ced80 x1875064728247936/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205023.492215:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728247936/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205023.492225:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205023.492229:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205023.492233:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728247936:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205023.492261:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728248064:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205023.492283:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205023.492294:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205023/real 1788205023] req@ffff8bc1726cfb80 x1875064728248064/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205023.492306:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728248064/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205023.492313:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205023.492316:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205023.492319:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728248064:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205024.324020:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205024.387923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205025.348014:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205025.411944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205026.372079:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205026.435944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205027.396003:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205027.459924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205028.421302:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205028.483898:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788205028.611895:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788205028.611904:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788205028.611907:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788205028.611915:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4309 00000100:00080000:0.0:1788205028.611923:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788205028.611928:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788205028.611957:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140380 x1875064728248192/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788205028.611978:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788205028.611980:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788205028.611982:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788205028.611984:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4309 00000100:00080000:0.0:1788205028.611986:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788205028.611989:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788205028.611997:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788205028.612010:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143800 x1875064728248320/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788205028.612028:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728248192:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788205028.612088:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205028.612141:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205028/real 1788205028] req@ffff8bc144140380 x1875064728248192/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205053 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205028.612159:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140380 x1875064728248192/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205053 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205028.612169:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205028.612173:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205028.612177:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728248192:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205028.612200:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728248320:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788205028.612220:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205028.612230:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205028/real 1788205028] req@ffff8bc144143800 x1875064728248320/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205053 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205028.612242:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143800 x1875064728248320/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205053 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205028.612250:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205028.612253:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205028.612256:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728248320:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205029.443946:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205029.507895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205030.467995:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205030.531910:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205031.491966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205031.555882:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205032.516017:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205032.579876:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205033.540010:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205033.603880:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788205033.731906:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788205033.731916:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788205033.731921:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788205033.731931:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4315 00000100:00080000:0.0:1788205033.731942:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788205033.731949:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788205033.731989:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140000 x1875064728248448/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788205033.732015:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788205033.732019:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788205033.732021:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788205033.732025:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4315 00000100:00080000:0.0:1788205033.732028:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788205033.732032:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788205033.732044:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788205033.732056:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143100 x1875064728248576/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788205033.732073:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728248448:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788205033.732143:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205033.732206:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205033/real 1788205033] req@ffff8bc144140000 x1875064728248448/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205058 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205033.732221:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140000 x1875064728248448/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205058 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205033.732228:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205033.732231:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205033.732234:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728248448:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205033.732255:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728248576:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788205033.732272:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205033.732280:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205033/real 1788205033] req@ffff8bc144143100 x1875064728248576/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205058 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205033.732288:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143100 x1875064728248576/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205058 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205033.732297:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205033.732299:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205033.732302:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728248576:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205034.563980:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205034.628032:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205035.588044:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205035.651895:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205036.611970:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205036.675905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205037.636021:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205037.699873:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205038.660031:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205038.723984:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788205038.851930:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788205038.851943:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788205038.851948:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205038.851962:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4320 00000100:00080000:1.0:1788205038.851975:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205038.851983:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788205038.852033:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4e00 x1875064728248704/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788205038.852061:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788205038.852066:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788205038.852067:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205038.852072:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4320 00000100:00080000:1.0:1788205038.852076:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205038.852080:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788205038.852091:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788205038.852104:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6a00 x1875064728248832/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788205038.852122:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728248704:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205038.852275:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728248832:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205039.684076:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205039.747977:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205040.707978:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205040.771954:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205041.731939:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205041.795894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788205041.924116:0:10043:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788205041.924165:0:10043:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788205041.924180:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788205041.924232:0:10043:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788205041.924284:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205038/real 1788205041] req@ffff8bc1727d6a00 x1875064728248832/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205063 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205041.924323:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6a00 x1875064728248832/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205063 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205041.924335:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205041.924340:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205041.924344:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728248832:192.168.201.143@tcp:38:kworker.0 00000100:00100000:2.0:1788205041.924351:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205038/real 1788205041] req@ffff8bc1727d4e00 x1875064728248704/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205063 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205041.924364:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4e00 x1875064728248704/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205063 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205041.924372:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205041.924375:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205041.924379:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728248704:192.168.201.143@tcp:250:kworker.0 00010000:00010000:2.0:1788205042.755953:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205042.819884:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205043.780015:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205043.843937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788205043.971973:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788205043.971986:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788205043.971991:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205043.972004:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4325 00000100:00080000:3.0:1788205043.972017:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205043.972027:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788205043.972070:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728248960/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788205043.972104:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788205043.972108:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788205043.972110:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205043.972114:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4325 00000100:00080000:3.0:1788205043.972118:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205043.972122:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788205043.972134:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788205043.972147:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728249088/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788205043.972161:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728248960:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788205043.972241:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205043.972297:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205043/real 1788205043] req@ffff8bc1726ce300 x1875064728248960/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205068 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205043.972325:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728248960/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205068 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205043.972337:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205043.972340:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205043.972343:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728248960:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205043.972378:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728249088:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788205043.972403:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205043.972416:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205043/real 1788205043] req@ffff8bc1726cea00 x1875064728249088/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205068 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205043.972429:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728249088/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205068 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205043.972438:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205043.972442:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205043.972446:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728249088:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205044.803969:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205044.868276:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205045.828514:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205045.894558:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205046.851932:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205046.915881:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205047.875965:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205047.940011:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205048.899932:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205048.963894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788205049.091882:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788205049.091890:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788205049.091893:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205049.091901:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4330 00000100:00080000:3.0:1788205049.091909:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205049.091914:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788205049.091947:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728249216/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788205049.091966:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788205049.091969:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788205049.091970:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205049.091972:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4330 00000100:00080000:3.0:1788205049.091977:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205049.091980:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788205049.091994:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788205049.092008:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728249344/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788205049.092032:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728249216:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788205049.092097:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205049.092154:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205049/real 1788205049] req@ffff8bc1726ce680 x1875064728249216/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205049.092172:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728249216/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205049.092183:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205049.092193:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205049.092197:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728249216:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205049.092204:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728249344:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788205049.092224:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205049.092236:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205049/real 1788205049] req@ffff8bc1726cc380 x1875064728249344/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205049.092255:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728249344/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205049.092263:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205049.092266:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205049.092269:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728249344:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205049.923939:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205049.987912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205050.947951:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205051.011924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205051.971970:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205052.036468:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205052.995996:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205053.059924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205054.019950:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205054.083897:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788205054.213259:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788205054.213267:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788205054.213271:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788205054.213279:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4335 00000100:00080000:2.0:1788205054.213289:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788205054.213294:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788205054.213358:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f480 x1875064728249472/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788205054.213396:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788205054.213400:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788205054.213402:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788205054.213406:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4335 00000100:00080000:2.0:1788205054.213410:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788205054.213414:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788205054.213423:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788205054.213437:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c000 x1875064728249600/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205054.213529:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728249472:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205054.213590:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205054.213634:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205054/real 1788205054] req@ffff8bc17257f480 x1875064728249472/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205054.213651:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f480 x1875064728249472/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205054.213660:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205054.213663:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205054.213667:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728249472:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205054.213673:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728249600:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205054.213694:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205054.213707:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205054/real 1788205054] req@ffff8bc17257c000 x1875064728249600/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205054.213718:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c000 x1875064728249600/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205054.213726:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205054.213729:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205054.213732:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728249600:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205055.043980:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205055.109445:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205056.067960:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205056.131911:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205057.091965:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205057.155901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205058.117225:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205058.179955:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205059.139990:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205059.203925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788205059.332160:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788205059.332171:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788205059.332175:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205059.332186:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4340 00000100:00080000:3.0:1788205059.332197:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205059.332205:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788205059.332281:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728249728/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788205059.332314:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788205059.332318:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788205059.332319:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205059.332322:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4340 00000100:00080000:3.0:1788205059.332325:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205059.332329:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788205059.332338:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788205059.332348:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728249856/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205059.332545:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728249728:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205059.332674:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205059.332729:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205059/real 1788205059] req@ffff8bc1726cce00 x1875064728249728/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205059.332749:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728249728/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205059.332759:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205059.332764:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205059.332769:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728249728:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205059.332777:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728249856:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205059.332821:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205059.332839:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205059/real 1788205059] req@ffff8bc1726cdc00 x1875064728249856/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205059.332851:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728249856/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205059.332859:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205059.332862:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205059.332866:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728249856:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205060.164053:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205060.228024:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205061.188113:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205061.251948:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205062.212251:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205062.275899:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205063.236076:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205063.299869:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205064.260347:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205064.323937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788205064.451924:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788205064.451936:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788205064.451941:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205064.451953:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4345 00000100:00080000:1.0:1788205064.451965:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205064.451973:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788205064.452015:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7800 x1875064728249984/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788205064.452040:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788205064.452044:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788205064.452046:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205064.452051:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4345 00000100:00080000:1.0:1788205064.452054:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205064.452059:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788205064.452070:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788205064.452083:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4a80 x1875064728250112/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205064.452095:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728249984:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205064.452175:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205064.452225:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205064/real 1788205064] req@ffff8bc1727d7800 x1875064728249984/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205064.452239:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7800 x1875064728249984/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205064.452252:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205064.452254:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205064.452257:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728249984:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205064.452278:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728250112:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205064.452294:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205064.452302:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205064/real 1788205064] req@ffff8bc1727d4a80 x1875064728250112/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205064.452309:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4a80 x1875064728250112/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205064.452314:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205064.452316:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205064.452318:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728250112:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205065.284001:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205065.347960:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205066.308057:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205066.371977:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205067.332009:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205067.395945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205068.355994:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205068.419925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205069.380009:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205069.444095:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788205069.571956:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788205069.571967:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788205069.571972:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205069.571984:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4350 00000100:00080000:1.0:1788205069.571995:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205069.572002:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788205069.572044:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7100 x1875064728250240/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788205069.572092:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788205069.572097:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788205069.572099:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205069.572104:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4350 00000100:00080000:1.0:1788205069.572108:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205069.572113:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788205069.572124:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788205069.572138:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7b80 x1875064728250368/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205069.572141:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728250240:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205069.572252:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205069.572313:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205069/real 1788205069] req@ffff8bc1727d7100 x1875064728250240/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205094 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205069.572342:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7100 x1875064728250240/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205094 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205069.572354:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205069.572358:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205069.572362:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728250240:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205069.572400:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728250368:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205069.572435:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205069.572448:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205069/real 1788205069] req@ffff8bc1727d7b80 x1875064728250368/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205094 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205069.572456:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7b80 x1875064728250368/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205094 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205069.572462:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205069.572464:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205069.572466:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728250368:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205070.404004:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205070.468089:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205071.428056:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205071.491970:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205072.451987:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205072.515955:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205073.476043:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205073.539950:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205074.499924:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205074.563919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788205074.691919:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788205074.691929:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788205074.691933:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788205074.691940:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4356 00000100:00080000:0.0:1788205074.691950:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788205074.691957:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788205074.692024:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140a80 x1875064728250496/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788205074.692053:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788205074.692057:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788205074.692058:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788205074.692061:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4356 00000100:00080000:0.0:1788205074.692064:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788205074.692067:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788205074.692074:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788205074.692084:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142680 x1875064728250624/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788205074.692097:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728250496:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788205074.692158:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205074.692210:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205074/real 1788205074] req@ffff8bc144140a80 x1875064728250496/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205099 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205074.692227:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140a80 x1875064728250496/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205099 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205074.692237:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205074.692240:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205074.692244:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728250496:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205074.692274:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728250624:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788205074.692296:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205074.692310:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205074/real 1788205074] req@ffff8bc144142680 x1875064728250624/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205099 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205074.692331:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142680 x1875064728250624/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205099 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205074.692340:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205074.692345:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205074.692348:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728250624:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205075.523989:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205075.587894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205076.547985:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205076.611919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205077.572041:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205077.635991:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205078.595978:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205078.659934:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205079.619973:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205079.683937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788205079.812014:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788205079.812028:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788205079.812033:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788205079.812046:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4361 00000100:00080000:0.0:1788205079.812059:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788205079.812067:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788205079.812119:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142d80 x1875064728250752/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788205079.812167:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788205079.812172:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788205079.812174:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788205079.812178:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4361 00000100:00080000:0.0:1788205079.812182:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788205079.812187:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788205079.812198:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788205079.812211:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141180 x1875064728250880/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788205079.813973:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728250752:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788205079.814059:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205079.814118:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205079/real 1788205079] req@ffff8bc144142d80 x1875064728250752/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205104 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205079.814139:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142d80 x1875064728250752/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205104 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205079.814151:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205079.814156:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205079.814160:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728250752:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205079.814169:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728250880:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788205079.814193:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205079.814206:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205079/real 1788205079] req@ffff8bc144141180 x1875064728250880/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205104 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205079.814973:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141180 x1875064728250880/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205104 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205079.814984:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205079.814988:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205079.814991:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728250880:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205080.644044:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788205080.708020:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205081.668194:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788205081.731945:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205082.692038:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788205082.755926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205083.715986:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788205083.779952:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205084.740031:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788205084.803925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788205084.931953:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788205084.931968:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788205084.931974:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788205084.931987:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4366 00000100:00080000:0.0:1788205084.931999:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788205084.932010:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788205084.932060:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141180 x1875064728251008/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788205084.932092:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788205084.932096:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788205084.932098:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788205084.932102:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4366 00000100:00080000:0.0:1788205084.932106:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788205084.932111:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788205084.932123:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788205084.932149:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142d80 x1875064728251136/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788205084.932153:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728251008:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788205084.932235:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205084.932292:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205084/real 1788205084] req@ffff8bc144141180 x1875064728251008/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205109 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205084.932308:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141180 x1875064728251008/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205109 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205084.932316:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205084.932319:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205084.932322:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728251008:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205084.932346:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728251136:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788205084.932363:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205084.932370:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205084/real 1788205084] req@ffff8bc144142d80 x1875064728251136/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205109 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205084.932378:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142d80 x1875064728251136/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205109 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205084.932384:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205084.932386:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205084.932388:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728251136:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205085.763992:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205085.828000:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205086.787997:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205086.851914:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205087.812011:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205087.875955:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205088.836019:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205088.899880:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205089.860013:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205089.923930:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788205090.052831:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788205090.052845:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788205090.052850:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788205090.052864:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4371 00000100:00080000:0.0:1788205090.052877:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788205090.052886:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788205090.052936:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142680 x1875064728251264/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788205090.052971:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788205090.052975:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788205090.052977:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788205090.052980:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4371 00000100:00080000:0.0:1788205090.052983:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788205090.052988:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788205090.053000:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788205090.053013:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140a80 x1875064728251392/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788205090.053034:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728251264:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788205090.053111:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205090.053227:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205090/real 1788205090] req@ffff8bc144142680 x1875064728251264/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205090.053250:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142680 x1875064728251264/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205090.053260:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205090.053266:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205090.053270:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728251264:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205090.053301:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728251392:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788205090.053325:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205090.053339:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205090/real 1788205090] req@ffff8bc144140a80 x1875064728251392/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205090.053372:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140a80 x1875064728251392/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205090.053381:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205090.053383:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205090.053387:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728251392:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205090.884003:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788205090.947933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205091.908006:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788205091.971915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205092.932029:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788205092.995929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205093.955980:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788205094.019907:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205094.980021:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788205095.043886:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788205095.171914:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788205095.171923:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788205095.171928:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788205095.171943:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4376 00000100:00080000:2.0:1788205095.171953:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788205095.171959:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788205095.172003:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f800 x1875064728251520/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788205095.172035:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788205095.172038:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788205095.172040:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788205095.172043:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4376 00000100:00080000:2.0:1788205095.172045:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788205095.172049:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788205095.172058:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788205095.172081:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728251520:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205095.172081:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257dc00 x1875064728251648/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:0.0:1788205095.172161:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205095.172223:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205095/real 1788205095] req@ffff8bc17257f800 x1875064728251520/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205095.172241:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f800 x1875064728251520/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205095.172249:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205095.172252:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205095.172254:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728251520:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205095.172278:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728251648:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205095.172301:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205095.172314:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205095/real 1788205095] req@ffff8bc17257dc00 x1875064728251648/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205095.172323:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257dc00 x1875064728251648/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205095.172329:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205095.172331:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205095.172333:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728251648:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205096.004299:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205096.068007:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205097.028018:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205097.092451:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205098.052010:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205098.115951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205099.076037:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205099.139891:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205100.100823:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205100.163935:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788205100.292033:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788205100.292046:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788205100.292051:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788205100.292064:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4381 00000100:00080000:2.0:1788205100.292077:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788205100.292085:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788205100.292146:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257dc00 x1875064728251776/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205100.292234:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728251776:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205100.292320:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00080000:2.0:1788205100.292364:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788205100.292369:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788205100.292371:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788205100.292375:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4381 00000100:00080000:2.0:1788205100.292379:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788205100.292383:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788205100.292394:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788205100.292408:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f800 x1875064728251904/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205100.292990:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205100/real 1788205100] req@ffff8bc17257dc00 x1875064728251776/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205100.293011:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257dc00 x1875064728251776/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205100.293022:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205100.293026:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205100.293029:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728251776:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205100.293055:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728251904:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205100.293079:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205100.293091:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205100/real 1788205100] req@ffff8bc17257f800 x1875064728251904/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205100.293103:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f800 x1875064728251904/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205100.293254:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205100.293422:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205100.293429:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728251904:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205101.124119:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788205101.188618:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205102.149964:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788205102.211901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205103.172029:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788205103.235979:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205104.196023:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788205104.260013:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205105.220069:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788205105.283972:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788205105.412194:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788205105.412206:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788205105.412210:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788205105.412221:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4386 00000100:00080000:2.0:1788205105.412232:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788205105.412239:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788205105.412280:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c000 x1875064728252032/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788205105.412308:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788205105.412311:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788205105.412312:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788205105.412315:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4386 00000100:00080000:2.0:1788205105.412317:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788205105.412319:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788205105.412327:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788205105.412336:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257f480 x1875064728252160/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205105.412406:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728252032:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205105.412550:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728252160:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205106.244388:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205106.309157:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205107.268003:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205107.331900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205108.293487:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205108.356753:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:3.0:1788205108.484151:0:10040:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:3.0:1788205108.484209:0:10040:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:3.0:1788205108.484228:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:3.0:1788205108.484276:0:10040:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:0.0:1788205108.484454:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205105/real 1788205108] req@ffff8bc17257c000 x1875064728252032/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205108.484485:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c000 x1875064728252032/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205108.484498:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205108.484503:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205108.484508:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728252032:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205108.484516:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205105/real 1788205108] req@ffff8bc17257f480 x1875064728252160/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205108.484529:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257f480 x1875064728252160/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205108.484537:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205108.484541:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205108.484544:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728252160:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205109.316080:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205109.379961:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205110.340135:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205110.403990:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788205110.531907:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788205110.531923:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788205110.531928:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205110.531941:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4391 00000100:00080000:1.0:1788205110.531954:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205110.531963:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788205110.532074:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7b80 x1875064728252288/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205110.532169:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728252288:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205110.532246:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00080000:1.0:1788205110.532291:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788205110.532295:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788205110.532298:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205110.532302:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4391 00000100:00080000:1.0:1788205110.532306:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205110.532310:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788205110.532323:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788205110.532337:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7100 x1875064728252416/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205110.535156:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205110/real 1788205110] req@ffff8bc1727d7b80 x1875064728252288/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205135 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205110.535200:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7b80 x1875064728252288/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205135 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205110.535215:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205110.535220:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205110.535225:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728252288:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205110.535269:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728252416:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205110.536529:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205110.536576:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205110/real 1788205110] req@ffff8bc1727d7100 x1875064728252416/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205135 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205110.536591:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7100 x1875064728252416/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205135 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205110.536600:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205110.536603:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205110.536606:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728252416:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205111.364026:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205111.428649:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205112.387976:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205112.452672:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205113.411957:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205113.475904:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205114.435988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205114.499876:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205115.460069:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205115.523912:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788205115.651964:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788205115.651974:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788205115.651978:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788205115.651988:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4397 00000100:00080000:2.0:1788205115.651999:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788205115.652006:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788205115.652041:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257df80 x1875064728252544/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788205115.652068:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788205115.652072:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788205115.652074:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788205115.652078:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4397 00000100:00080000:2.0:1788205115.652082:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788205115.652087:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788205115.652095:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788205115.652108:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e680 x1875064728252672/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205115.652318:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728252544:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205115.652377:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205115.652423:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205115/real 1788205115] req@ffff8bc17257df80 x1875064728252544/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205140 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205115.652441:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257df80 x1875064728252544/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205140 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205115.652451:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205115.652455:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205115.652459:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728252544:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205115.652466:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728252672:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205115.652501:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205115.652514:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205115/real 1788205115] req@ffff8bc17257e680 x1875064728252672/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205140 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205115.652525:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e680 x1875064728252672/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205140 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205115.652534:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205115.652537:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205115.652540:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728252672:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205116.483967:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205116.548032:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205117.507955:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205117.571900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205118.531972:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205118.595916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205119.556021:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205119.619973:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205120.579985:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205120.643962:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788205120.771872:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788205120.771882:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788205120.771887:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788205120.771897:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4402 00000100:00080000:2.0:1788205120.771908:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788205120.771914:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788205120.771964:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257d880 x1875064728252800/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788205120.771989:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788205120.771992:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788205120.771993:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788205120.771996:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4402 00000100:00080000:2.0:1788205120.771998:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788205120.772000:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788205120.772009:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788205120.772018:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ed80 x1875064728252928/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205120.772036:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728252800:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205120.772118:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205120.772167:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205120/real 1788205120] req@ffff8bc17257d880 x1875064728252800/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205145 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205120.772199:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257d880 x1875064728252800/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205145 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205120.772207:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205120.772210:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205120.772213:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728252800:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205120.772236:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728252928:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205120.772253:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205120.772261:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205120/real 1788205120] req@ffff8bc17257ed80 x1875064728252928/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205145 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205120.772268:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ed80 x1875064728252928/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205145 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205120.772274:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205120.772276:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205120.772278:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728252928:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788205121.604015:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205121.667900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205122.628029:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205122.691942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205123.651987:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205123.715960:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205124.676003:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205124.739938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205125.700012:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205125.763966:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788205125.891943:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788205125.891953:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788205125.891957:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788205125.891967:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4407 00000100:00080000:0.0:1788205125.891978:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788205125.891984:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788205125.892040:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143100 x1875064728253056/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788205125.892079:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788205125.892111:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788205125.892113:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788205125.892118:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4407 00000100:00080000:0.0:1788205125.892122:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788205125.892126:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788205125.892140:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728253056:192.168.201.143@tcp:250:kworker.0 00000008:00100000:0.0:1788205125.892142:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788205125.892156:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140000 x1875064728253184/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000800:00000100:2.0:1788205125.892213:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205125.892269:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205125/real 1788205125] req@ffff8bc144143100 x1875064728253056/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205150 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205125.892283:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143100 x1875064728253056/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205150 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205125.892292:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205125.892295:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205125.892297:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728253056:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205125.892319:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728253184:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788205125.892336:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205125.892343:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205125/real 1788205125] req@ffff8bc144140000 x1875064728253184/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205150 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205125.892350:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140000 x1875064728253184/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205150 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205125.892355:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205125.892357:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205125.892359:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728253184:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205126.724022:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205126.787943:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205127.748027:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205127.811923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205128.771948:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205128.835947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205129.796163:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205129.859949:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205130.820041:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205130.883952:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788205131.011945:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788205131.011960:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788205131.011965:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788205131.011978:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4412 00000100:00080000:2.0:1788205131.012006:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788205131.012016:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788205131.012066:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ce00 x1875064728253312/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788205131.012106:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788205131.012110:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788205131.012112:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788205131.012116:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4412 00000100:00080000:2.0:1788205131.012121:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788205131.012125:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788205131.012137:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788205131.012150:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ea00 x1875064728253440/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205131.012279:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728253312:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205131.012423:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205131.012497:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205131/real 1788205131] req@ffff8bc17257ce00 x1875064728253312/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205131.012519:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ce00 x1875064728253312/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205131.012531:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205131.012535:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205131.012539:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728253312:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205131.012547:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728253440:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205131.012571:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205131.012584:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205131/real 1788205131] req@ffff8bc17257ea00 x1875064728253440/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205131.012597:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ea00 x1875064728253440/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205131.012606:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205131.012609:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205131.012612:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728253440:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788205131.844025:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205131.907970:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205132.868008:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205132.931887:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205133.891978:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205133.955893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205134.916044:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205134.979916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205135.939993:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205136.003980:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788205136.132932:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788205136.132948:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788205136.132953:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205136.132967:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4417 00000100:00080000:1.0:1788205136.132981:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205136.132988:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788205136.133034:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4a80 x1875064728253568/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788205136.133071:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788205136.133074:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788205136.133076:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205136.133080:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4417 00000100:00080000:1.0:1788205136.133083:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205136.133088:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788205136.133098:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788205136.133109:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7800 x1875064728253696/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205136.133203:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728253568:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205136.133272:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205136.133333:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205136/real 1788205136] req@ffff8bc1727d4a80 x1875064728253568/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205136.133351:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4a80 x1875064728253568/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205136.133363:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205136.133367:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205136.133372:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728253568:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205136.133379:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728253696:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205136.133399:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205136.133409:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205136/real 1788205136] req@ffff8bc1727d7800 x1875064728253696/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205136.133421:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7800 x1875064728253696/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205136.133435:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205136.133439:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205136.133442:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728253696:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205136.964001:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205137.027933:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205137.988008:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205138.051980:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205139.012461:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205139.076027:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205140.036442:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205140.099940:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205141.060048:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205141.123929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788205141.252118:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788205141.252133:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788205141.252138:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205141.252151:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4422 00000100:00080000:3.0:1788205141.252165:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205141.252175:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788205141.252225:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdc00 x1875064728253824/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788205141.252256:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788205141.252260:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788205141.252261:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205141.252265:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4422 00000100:00080000:3.0:1788205141.252268:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205141.252271:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788205141.252281:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788205141.252291:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cce00 x1875064728253952/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205141.252359:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728253824:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205141.252436:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205141.252496:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205141/real 1788205141] req@ffff8bc1726cdc00 x1875064728253824/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205141.253014:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdc00 x1875064728253824/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205141.253027:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205141.253032:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205141.253037:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728253824:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205141.253045:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728253952:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205141.253073:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205141.253094:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205141/real 1788205141] req@ffff8bc1726cce00 x1875064728253952/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205141.253106:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cce00 x1875064728253952/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205141.253115:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205141.253118:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205141.253121:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728253952:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788205142.084044:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205142.148742:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205143.108375:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205143.171921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205144.132069:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205144.195924:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205145.156009:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205145.219920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205146.180023:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205146.244042:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788205146.372032:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788205146.372047:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788205146.372052:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205146.372066:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4427 00000100:00080000:3.0:1788205146.372081:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205146.372090:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788205146.372142:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc380 x1875064728254080/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788205146.372182:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788205146.372185:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788205146.372187:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205146.372192:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4427 00000100:00080000:3.0:1788205146.372195:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205146.372199:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788205146.372209:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788205146.372221:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce680 x1875064728254208/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205146.372312:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728254080:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205146.372388:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205146.372446:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205146/real 1788205146] req@ffff8bc1726cc380 x1875064728254080/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205146.372466:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc380 x1875064728254080/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205146.372478:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205146.372482:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205146.372487:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728254080:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205146.372495:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728254208:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205146.372518:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205146.372530:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205146/real 1788205146] req@ffff8bc1726ce680 x1875064728254208/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205146.372542:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce680 x1875064728254208/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205146.372550:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205146.372554:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205146.372557:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728254208:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205147.204396:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205147.268925:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205148.229507:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205148.291903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205149.252029:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205149.315931:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205150.275996:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205150.339902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205151.299983:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205151.364565:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788205151.491930:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788205151.491941:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788205151.491946:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205151.491955:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4432 00000100:00080000:1.0:1788205151.491966:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205151.491974:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788205151.492025:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4e00 x1875064728254336/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788205151.492046:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788205151.492048:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788205151.492050:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205151.492052:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4432 00000100:00080000:1.0:1788205151.492055:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205151.492058:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788205151.492066:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788205151.492075:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6a00 x1875064728254464/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205151.492084:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728254336:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205151.492135:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205151.492169:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205151/real 1788205151] req@ffff8bc1727d4e00 x1875064728254336/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205151.492181:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4e00 x1875064728254336/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205151.492187:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205151.492190:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205151.492192:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728254336:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205151.492211:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728254464:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205151.492223:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205151.492230:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205151/real 1788205151] req@ffff8bc1727d6a00 x1875064728254464/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205151.492244:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6a00 x1875064728254464/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205151.492249:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205151.492251:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205151.492253:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728254464:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788205152.323963:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205152.387958:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205153.348327:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205153.411865:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205154.371941:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205154.435903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205155.395988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205155.459879:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205156.419978:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205156.483860:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788205156.611990:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788205156.612000:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788205156.612005:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205156.612015:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4437 00000100:00080000:1.0:1788205156.612026:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205156.612032:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788205156.612073:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5c00 x1875064728254592/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788205156.612101:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788205156.612105:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788205156.612106:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205156.612110:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4437 00000100:00080000:1.0:1788205156.612113:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205156.612116:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788205156.612126:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788205156.612147:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4700 x1875064728254720/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205156.612152:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728254592:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205156.612216:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205156.612258:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205156/real 1788205156] req@ffff8bc1727d5c00 x1875064728254592/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205181 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205156.612271:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5c00 x1875064728254592/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205181 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205156.612278:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205156.612281:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205156.612284:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728254592:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205156.612306:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728254720:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205156.612326:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205156.612345:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205156/real 1788205156] req@ffff8bc1727d4700 x1875064728254720/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205181 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205156.612355:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4700 x1875064728254720/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205181 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205156.612361:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205156.612363:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205156.612365:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728254720:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205157.443953:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205157.507883:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205158.467973:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205158.531918:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205159.492042:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205159.555903:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205160.515966:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205160.579923:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205161.539948:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205161.603929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788205161.731915:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788205161.731925:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788205161.731929:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205161.731939:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4443 00000100:00080000:3.0:1788205161.731950:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205161.731957:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788205161.731990:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cea00 x1875064728254848/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788205161.732013:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788205161.732016:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788205161.732017:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205161.732019:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4443 00000100:00080000:3.0:1788205161.732022:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205161.732024:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788205161.732031:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788205161.732038:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ce300 x1875064728254976/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205161.732063:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728254848:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205161.732129:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205161.732173:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205161/real 1788205161] req@ffff8bc1726cea00 x1875064728254848/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205186 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205161.732190:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cea00 x1875064728254848/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205186 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205161.732196:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205161.732199:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205161.732202:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728254848:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205161.732207:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728254976:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205161.732224:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205161.732231:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205161/real 1788205161] req@ffff8bc1726ce300 x1875064728254976/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205186 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205161.732238:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ce300 x1875064728254976/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205186 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205161.732243:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205161.732245:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205161.732246:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728254976:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788205162.565523:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205162.628016:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205163.588002:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205163.651970:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205164.612199:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205164.676660:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205165.635907:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205165.699922:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205166.660074:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205166.723952:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788205166.852052:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788205166.852066:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788205166.852071:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205166.852085:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4448 00000100:00080000:1.0:1788205166.852099:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205166.852107:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788205166.852155:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6300 x1875064728255104/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788205166.852190:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788205166.852194:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788205166.852196:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205166.852200:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4448 00000100:00080000:1.0:1788205166.852204:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205166.852208:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788205166.852219:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788205166.852232:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6d80 x1875064728255232/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205166.852476:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728255104:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205166.852565:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205166.852646:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205166/real 1788205166] req@ffff8bc1727d6300 x1875064728255104/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205191 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205166.852668:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6300 x1875064728255104/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205191 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205166.852680:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205166.852684:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205166.852688:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728255104:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205166.852696:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728255232:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205166.852721:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205166.852734:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205166/real 1788205166] req@ffff8bc1727d6d80 x1875064728255232/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205191 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205166.852747:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6d80 x1875064728255232/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205191 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205166.852756:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205166.852759:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205166.852762:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728255232:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205167.686438:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205167.749604:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205168.708037:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205168.771985:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205169.732115:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205169.795947:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205170.756027:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205170.819950:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205171.780066:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205171.843928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788205171.972012:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788205171.972023:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788205171.972027:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788205171.972038:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4453 00000100:00080000:0.0:1788205171.972050:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788205171.972057:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788205171.972105:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143800 x1875064728255360/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788205171.972145:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788205171.972149:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788205171.972151:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788205171.972156:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4453 00000100:00080000:0.0:1788205171.972160:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788205171.972165:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788205171.972176:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788205171.972192:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140380 x1875064728255488/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788205171.972349:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728255360:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205171.975428:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728255488:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788205172.803978:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205172.868095:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205173.828016:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205173.891893:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205174.852022:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205174.916070:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788205175.044136:0:10041:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788205175.044197:0:10041:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788205175.044216:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788205175.044370:0:10041:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788205175.044411:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205171/real 1788205175] req@ffff8bc144143800 x1875064728255360/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205196 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205175.044441:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143800 x1875064728255360/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205196 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205175.044455:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205175.044461:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205175.044466:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728255360:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205175.044476:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205171/real 1788205175] req@ffff8bc144140380 x1875064728255488/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205196 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205175.044490:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140380 x1875064728255488/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205196 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205175.044499:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205175.044503:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205175.044506:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728255488:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205175.876021:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205175.940116:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205176.900021:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205176.978425:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788205177.092379:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788205177.092394:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788205177.092398:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205177.092413:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4458 00000100:00080000:3.0:1788205177.092427:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205177.092437:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788205177.092485:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cfb80 x1875064728255616/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788205177.092525:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788205177.092529:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788205177.092533:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205177.092537:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4458 00000100:00080000:3.0:1788205177.092541:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205177.092545:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788205177.092556:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788205177.092568:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726ced80 x1875064728255744/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788205177.094139:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728255616:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788205177.094249:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205177.094315:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205177/real 1788205177] req@ffff8bc1726cfb80 x1875064728255616/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205177.094343:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cfb80 x1875064728255616/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205177.094356:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205177.094361:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205177.094365:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728255616:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205177.094374:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728255744:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788205177.094400:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205177.094413:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205177/real 1788205177] req@ffff8bc1726ced80 x1875064728255744/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205177.094426:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726ced80 x1875064728255744/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205177.094435:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205177.094438:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205177.094441:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728255744:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205177.924097:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205177.988985:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205178.949056:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205179.011942:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205179.972093:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205180.037258:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205180.996068:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205181.059914:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205182.019977:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205182.083940:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788205182.212066:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788205182.212088:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788205182.212093:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788205182.212105:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4463 00000100:00080000:0.0:1788205182.212132:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788205182.212140:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788205182.212191:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141f80 x1875064728255872/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788205182.212222:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788205182.212226:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788205182.212228:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788205182.212232:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4463 00000100:00080000:0.0:1788205182.212235:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788205182.212239:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788205182.212251:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788205182.212263:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142300 x1875064728256000/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788205182.212282:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728255872:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788205182.212358:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205182.212443:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205182/real 1788205182] req@ffff8bc144141f80 x1875064728255872/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205182.212470:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141f80 x1875064728255872/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205182.212481:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205182.212485:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205182.212489:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728255872:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205182.212521:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728256000:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788205182.212543:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205182.212556:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205182/real 1788205182] req@ffff8bc144142300 x1875064728256000/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205182.212568:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142300 x1875064728256000/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205182.212575:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205182.212578:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205182.212581:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728256000:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788205183.044424:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205183.108031:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205184.068036:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205184.131913:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205185.091986:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205185.155956:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205186.116191:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205186.179944:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205187.140643:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205187.203917:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788205187.332036:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788205187.332049:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788205187.332053:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205187.332064:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4468 00000100:00080000:1.0:1788205187.332084:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205187.332093:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788205187.332134:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d6680 x1875064728256128/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788205187.332235:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728256128:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788205187.332312:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00080000:1.0:1788205187.332347:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788205187.332353:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788205187.332355:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205187.332361:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4468 00000100:00080000:1.0:1788205187.332367:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205187.332374:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788205187.332384:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788205187.332389:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205187/real 1788205187] req@ffff8bc1727d6680 x1875064728256128/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788205187.332409:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5500 x1875064728256256/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788205187.332426:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d6680 x1875064728256128/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205187.332451:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205187.332456:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205187.332461:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728256128:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205187.332494:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728256256:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788205187.332530:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205187.332543:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205187/real 1788205187] req@ffff8bc1727d5500 x1875064728256256/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205187.332553:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5500 x1875064728256256/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205187.332560:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205187.332563:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205187.332565:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728256256:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205188.163972:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205188.228113:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205189.188024:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205189.251883:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205190.212168:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205190.275892:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205191.235998:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205191.299845:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205192.259995:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205192.323902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788205192.451875:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788205192.451884:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788205192.451888:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205192.451897:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4473 00000100:00080000:3.0:1788205192.451907:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205192.451914:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788205192.451975:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd500 x1875064728256384/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788205192.452001:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788205192.452005:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788205192.452007:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205192.452011:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4473 00000100:00080000:3.0:1788205192.452016:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205192.452020:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788205192.452029:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788205192.452042:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cca80 x1875064728256512/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788205192.452086:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728256384:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788205192.452165:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205192.452233:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205192/real 1788205192] req@ffff8bc1726cd500 x1875064728256384/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205192.452253:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd500 x1875064728256384/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205192.452271:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205192.452276:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205192.452280:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728256384:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205192.452288:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728256512:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788205192.452308:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205192.452318:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205192/real 1788205192] req@ffff8bc1726cca80 x1875064728256512/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205192.452329:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cca80 x1875064728256512/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205192.452337:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205192.452340:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205192.452343:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728256512:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788205193.284029:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205193.348034:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205194.307971:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205194.371952:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205195.332135:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205195.395927:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205196.356037:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205196.419937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205197.380092:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205197.443900:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788205197.571931:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788205197.571941:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788205197.571945:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788205197.571955:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4478 00000100:00080000:2.0:1788205197.571966:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788205197.571973:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788205197.572019:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257ca80 x1875064728256640/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788205197.572049:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788205197.572056:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788205197.572058:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788205197.572062:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4478 00000100:00080000:2.0:1788205197.572065:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788205197.572069:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788205197.572078:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788205197.572091:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257fb80 x1875064728256768/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205197.572113:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728256640:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205197.572172:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205197.572225:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205197/real 1788205197] req@ffff8bc17257ca80 x1875064728256640/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205222 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205197.572242:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257ca80 x1875064728256640/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205222 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205197.572253:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205197.572256:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205197.572260:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728256640:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205197.572274:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728256768:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205197.572293:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205197.572304:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205197/real 1788205197] req@ffff8bc17257fb80 x1875064728256768/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205222 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205197.572316:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257fb80 x1875064728256768/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205222 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205197.572324:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205197.572327:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205197.572331:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728256768:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205198.404200:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205198.468164:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205199.428717:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205199.491919:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205200.451963:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205200.515906:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205201.476000:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205201.539860:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205202.500025:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205202.563926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788205202.692019:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788205202.692033:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788205202.692039:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205202.692053:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4484 00000100:00080000:3.0:1788205202.692068:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205202.692076:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788205202.692136:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf480 x1875064728256896/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788205202.692169:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788205202.692172:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788205202.692174:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205202.692177:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4484 00000100:00080000:3.0:1788205202.692180:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205202.692184:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788205202.692200:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788205202.692216:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf100 x1875064728257024/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205202.692231:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728256896:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205202.692310:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205202.692364:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205202/real 1788205202] req@ffff8bc1726cf480 x1875064728256896/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205227 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205202.692384:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf480 x1875064728256896/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205227 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205202.692393:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205202.692396:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205202.692399:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728256896:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205202.692429:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728257024:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205202.692452:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205202.692462:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205202/real 1788205202] req@ffff8bc1726cf100 x1875064728257024/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205227 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205202.692470:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf100 x1875064728257024/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205227 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205202.692476:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205202.692478:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205202.692480:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728257024:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788205203.523926:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205203.587951:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788205204.548154:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205204.611985:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205205.571948:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205205.635937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788205206.596016:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205206.659896:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205207.621421:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205207.683928:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788205207.811899:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788205207.811910:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788205207.811915:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788205207.811925:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4489 00000100:00080000:0.0:1788205207.811936:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788205207.811942:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788205207.811990:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141500 x1875064728257152/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788205207.812018:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788205207.812022:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788205207.812024:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788205207.812028:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4489 00000100:00080000:0.0:1788205207.812031:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788205207.812036:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788205207.812046:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788205207.812062:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143b80 x1875064728257280/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788205207.812071:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728257152:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788205207.812156:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205207.812204:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205207/real 1788205207] req@ffff8bc144141500 x1875064728257152/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205232 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205207.812218:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141500 x1875064728257152/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205232 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205207.812229:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205207.812233:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205207.812238:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728257152:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205207.812269:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728257280:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788205207.812286:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205207.812298:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205207/real 1788205207] req@ffff8bc144143b80 x1875064728257280/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205232 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205207.812309:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143b80 x1875064728257280/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205232 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205207.812317:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205207.812320:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205207.812323:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728257280:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788205208.643988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205208.708037:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205209.667993:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205209.731915:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788205210.693932:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205210.755929:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205211.716098:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205211.779885:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788205212.739985:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205212.803908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:2.0:1788205212.932050:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788205212.932062:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788205212.932067:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788205212.932078:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4494 00000100:00080000:2.0:1788205212.932088:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788205212.932096:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:2.0:1788205212.932134:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257c380 x1875064728257408/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788205212.932168:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788205212.932173:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788205212.932175:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788205212.932178:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4494 00000100:00080000:2.0:1788205212.932182:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788205212.932187:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:2.0:1788205212.932196:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1788205212.932210:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc17257e300 x1875064728257536/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205212.932293:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728257408:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205212.932357:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205212.932407:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205212/real 1788205212] req@ffff8bc17257c380 x1875064728257408/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205237 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205212.932426:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257c380 x1875064728257408/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205237 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205212.932436:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205212.932440:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205212.932444:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728257408:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205212.932451:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728257536:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205212.932471:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205212.932483:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205212/real 1788205212] req@ffff8bc17257e300 x1875064728257536/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205237 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205212.932495:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc17257e300 x1875064728257536/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205237 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205212.932504:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205212.932508:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205212.932511:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc17257e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728257536:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788205213.763981:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205213.831733:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788205214.787956:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205214.851920:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205215.811926:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205215.875905:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788205216.839096:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205216.899926:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205217.860024:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205217.923901:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788205218.051969:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788205218.051991:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788205218.051996:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205218.052017:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4499 00000100:00080000:3.0:1788205218.052031:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205218.052039:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788205218.052099:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728257664/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788205218.052130:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788205218.052134:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788205218.052135:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205218.052139:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4499 00000100:00080000:3.0:1788205218.052143:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205218.052147:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788205218.052158:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788205218.052170:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728257792/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205218.052196:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728257664:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205218.052279:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205218.052342:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205218/real 1788205218] req@ffff8bc1726cd180 x1875064728257664/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205218.052363:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728257664/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205218.052374:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205218.052378:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205218.052381:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728257664:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205218.052389:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728257792:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205218.052412:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205218.052425:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205218/real 1788205218] req@ffff8bc1726cc700 x1875064728257792/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205218.052437:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728257792/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205218.052445:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205218.052448:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205218.052451:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728257792:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788205218.883988:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205218.948033:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205219.908292:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205219.972054:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788205220.932012:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205220.995961:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205221.956202:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205222.020566:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788205222.980048:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205223.043980:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788205223.172009:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788205223.172022:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788205223.172028:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205223.172042:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4504 00000100:00080000:3.0:1788205223.172055:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205223.172063:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788205223.172114:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728257920/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788205223.172153:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788205223.172157:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788205223.172159:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205223.172164:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4504 00000100:00080000:3.0:1788205223.172168:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205223.172172:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788205223.172183:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788205223.172195:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728258048/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788205223.172446:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728257920:192.168.201.143@tcp:250:kworker.0 00000800:00000100:0.0:1788205223.172521:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205223.172596:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205223/real 1788205223] req@ffff8bc1726cdf80 x1875064728257920/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205223.172617:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728257920/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205223.172628:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205223.172632:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205223.172636:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728257920:192.168.201.143@tcp:250:kworker.0 00000100:00100000:0.0:1788205223.172644:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728258048:192.168.201.143@tcp:38:kworker.0 00000800:00000100:0.0:1788205223.172666:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:0.0:1788205223.172679:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205223/real 1788205223] req@ffff8bc1726cf800 x1875064728258048/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788205223.172691:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728258048/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788205223.172699:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788205223.172703:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:0.0:1788205223.172706:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728258048:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788205224.004535:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205224.068201:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788205225.028087:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205225.091960:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205226.052046:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205226.115902:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788205227.076036:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205227.139938:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205228.100093:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205228.163921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788205228.291983:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788205228.291993:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788205228.291998:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788205228.292010:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4509 00000100:00080000:0.0:1788205228.292023:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788205228.292030:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788205228.292071:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144143480 x1875064728258176/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788205228.292141:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728258176:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788205228.292218:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00080000:0.0:1788205228.292254:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788205228.292259:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788205228.292261:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788205228.292265:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4509 00000100:00080000:0.0:1788205228.292269:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788205228.292273:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788205228.292283:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788205228.292297:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144141880 x1875064728258304/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788205228.292378:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205228/real 1788205228] req@ffff8bc144143480 x1875064728258176/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205228.292400:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144143480 x1875064728258176/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205228.292511:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205228.292517:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205228.292522:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728258176:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205228.292552:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728258304:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788205228.292577:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205228.292591:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205228/real 1788205228] req@ffff8bc144141880 x1875064728258304/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205228.292602:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144141880 x1875064728258304/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205228.292610:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205228.292613:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205228.292616:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728258304:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788205229.124115:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205229.188112:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205230.148212:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205230.211954:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788205231.172338:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205231.235992:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205232.196696:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205232.259953:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788205233.222997:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205233.284169:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788205233.413587:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788205233.413601:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788205233.413606:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205233.413620:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4514 00000100:00080000:1.0:1788205233.413634:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205233.413643:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788205233.413696:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4380 x1875064728258432/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788205233.413733:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788205233.413737:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788205233.413739:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205233.413743:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4514 00000100:00080000:1.0:1788205233.413746:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205233.413750:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788205233.413762:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788205233.413776:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5f80 x1875064728258560/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788205233.413962:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728258432:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788205233.414037:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205233.414150:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205233/real 1788205233] req@ffff8bc1727d4380 x1875064728258432/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205233.414171:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4380 x1875064728258432/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205233.414183:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205233.414187:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205233.414192:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728258432:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205233.414200:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728258560:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788205233.414237:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205233.414250:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205233/real 1788205233] req@ffff8bc1727d5f80 x1875064728258560/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205233.414263:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5f80 x1875064728258560/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205233.414271:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205233.414275:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205233.414278:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728258560:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788205234.244029:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205234.308123:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788205235.268118:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205235.332149:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205236.292346:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205236.355955:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788205237.316116:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205237.379950:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205238.341378:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205238.403888:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788205238.535840:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788205238.535852:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788205238.535858:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205238.535870:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4519 00000100:00080000:3.0:1788205238.535882:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205238.535890:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788205238.535935:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cf800 x1875064728258688/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788205238.535969:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788205238.535972:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788205238.535974:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205238.535979:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4519 00000100:00080000:3.0:1788205238.535981:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205238.535986:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788205238.535996:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788205238.536007:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cdf80 x1875064728258816/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788205238.536102:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728258688:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205238.536390:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728258816:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788205239.366467:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205239.427956:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205240.388122:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205240.452037:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788205241.412231:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205241.476062:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000400:00000100:1.0:1788205241.605075:0:10042:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.201.143:988 00000400:00000100:1.0:1788205241.605140:0:10042:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.201.143@tcp at host 192.168.201.143 was unreachable: the network or that node may be down, or Lustre may be misconfigured. 00000800:00000100:1.0:1788205241.605158:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000800:00000100:1.0:1788205241.605204:0:10042:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.201.143@tcp 00000100:00100000:2.0:1788205241.605283:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205238/real 1788205241] req@ffff8bc1726cf800 x1875064728258688/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205263 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205241.605315:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cf800 x1875064728258688/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205263 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205241.605340:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205241.605346:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205241.605351:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728258688:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205241.605360:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205238/real 1788205241] req@ffff8bc1726cdf80 x1875064728258816/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205263 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205241.605373:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cdf80 x1875064728258816/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205263 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205241.605381:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205241.605385:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205241.605388:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728258816:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788205242.436042:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205242.499957:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788205243.460262:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788205243.524074:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788205243.652517:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788205243.652531:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788205243.652536:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205243.652550:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4525 00000100:00080000:1.0:1788205243.652564:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205243.652572:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788205243.652617:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d4000 x1875064728258944/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788205243.652709:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728258944:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788205243.652782:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00080000:1.0:1788205243.652957:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788205243.652962:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788205243.652964:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205243.652969:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4525 00000100:00080000:1.0:1788205243.652973:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205243.652978:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788205243.652989:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788205243.653003:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5180 x1875064728259072/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788205243.653167:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205243/real 1788205243] req@ffff8bc1727d4000 x1875064728258944/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205268 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205243.653201:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d4000 x1875064728258944/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205268 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205243.653213:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205243.653218:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205243.653222:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728258944:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205243.653253:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728259072:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788205243.653276:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205243.653289:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205243/real 1788205243] req@ffff8bc1727d5180 x1875064728259072/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205268 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205243.653301:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5180 x1875064728259072/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205268 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205243.653311:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205243.653314:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205243.653318:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728259072:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788205244.484721:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205244.548244:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788205245.508037:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205245.572135:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205246.533111:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205246.599207:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788205247.556065:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205247.619894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205248.580183:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205248.643908:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:0.0:1788205248.771975:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788205248.771985:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788205248.771989:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788205248.771998:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4530 00000100:00080000:0.0:1788205248.772008:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788205248.772015:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:0.0:1788205248.772050:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144140e00 x1875064728259200/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788205248.772076:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788205248.772078:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788205248.772079:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788205248.772082:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4530 00000100:00080000:0.0:1788205248.772084:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788205248.772087:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:0.0:1788205248.772096:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1788205248.772107:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc144142a00 x1875064728259328/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788205248.772135:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728259200:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788205248.772193:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205248.772252:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205248/real 1788205248] req@ffff8bc144140e00 x1875064728259200/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205273 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205248.772271:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144140e00 x1875064728259200/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205273 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205248.772283:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205248.772287:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205248.772291:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728259200:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205248.772298:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728259328:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788205248.772317:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205248.772327:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205248/real 1788205248] req@ffff8bc144142a00 x1875064728259328/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205273 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205248.772348:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc144142a00 x1875064728259328/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205273 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205248.772356:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205248.772359:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205248.772362:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc144142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728259328:192.168.201.143@tcp:38:kworker.0 00010000:00010000:0.0:1788205249.604003:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205249.668077:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205250.628201:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205250.692005:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788205251.651981:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205251.715985:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205252.675965:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205252.739937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788205253.699903:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205253.763921:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:3.0:1788205253.891934:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788205253.891942:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788205253.891945:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205253.891953:0:14232:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4535 00000100:00080000:3.0:1788205253.891962:0:14232:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205253.891967:0:14232:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:3.0:1788205253.892009:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cc700 x1875064728259456/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788205253.892035:0:14232:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788205253.892037:0:14232:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788205253.892038:0:14232:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788205253.892041:0:14232:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4535 00000100:00080000:3.0:1788205253.892043:0:14232:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788205253.892046:0:14232:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:3.0:1788205253.892053:0:14232:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1788205253.892063:0:14232:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1726cd180 x1875064728259584/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788205253.892082:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728259456:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788205253.892135:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205253.892179:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205253/real 1788205253] req@ffff8bc1726cc700 x1875064728259456/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205278 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205253.892194:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cc700 x1875064728259456/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205278 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205253.892210:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205253.892214:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205253.892218:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728259456:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205253.892225:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728259584:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788205253.892245:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205253.892254:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205253/real 1788205253] req@ffff8bc1726cd180 x1875064728259584/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205278 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205253.892262:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1726cd180 x1875064728259584/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205278 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205253.892268:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205253.892270:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205253.892272:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1726cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728259584:192.168.201.143@tcp:38:kworker.0 00010000:00010000:3.0:1788205254.724023:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205254.787970:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:0.0:1788205255.748168:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205255.811916:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205256.771983:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205256.835894:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:2.0:1788205257.795901:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205257.859871:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00010000:00010000:3.0:1788205258.820147:0:26428:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788205258.883961:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds 00000100:00080000:1.0:1788205259.011973:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) df9a72fe-77e2-4342-a886-d55a2baf9a49->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788205259.011988:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788205259.011993:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205259.012007:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.143@tcp: connect to NID 192.168.201.143@tcp last attempt 4540 00000100:00080000:1.0:1788205259.012022:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.143@tcp: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205259.012032:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.143@tcp: import ffff8bc145ede000 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000100:00100000:1.0:1788205259.012085:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d7480 x1875064728259712/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788205259.012116:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c0a6615-c7c4-4483-9f31-fb19c8e5931c->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788205259.012119:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788205259.012120:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788205259.012123:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: connect to NID 192.168.201.143@tcp last attempt 4540 00000100:00080000:1.0:1788205259.012126:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788205259.012129:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff8bc1452f0800: import ffff8bc146503800 using connection 192.168.201.143@tcp/192.168.201.143@tcp 00000008:00100000:1.0:1788205259.012139:0:36:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682934 ocd_grant: 134217728, lost: 0. 00000100:00100000:1.0:1788205259.012153:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bc1727d5880 x1875064728259840/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788205259.012179:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728259712:192.168.201.143@tcp:250:kworker.0 00000800:00000100:2.0:1788205259.012265:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205259.012332:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205259/real 1788205259] req@ffff8bc1727d7480 x1875064728259712/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205259.012350:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d7480 x1875064728259712/t0(0) o250->MGC192.168.201.143@tcp@192.168.201.143@tcp:26/25 lens 520/544 e 0 to 1 dl 1788205284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205259.012362:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc145ede000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205259.012366:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205259.012369:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:df9a72fe-77e2-4342-a886-d55a2baf9a49:10051:1875064728259712:192.168.201.143@tcp:250:kworker.0 00000100:00100000:2.0:1788205259.012395:0:10051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728259840:192.168.201.143@tcp:38:kworker.0 00000800:00000100:2.0:1788205259.012420:0:10051:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.201.143@tcp 00000100:00100000:2.0:1788205259.012433:0:10051:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1788205259/real 1788205259] req@ffff8bc1727d5880 x1875064728259840/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788205259.012446:0:10051:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bc1727d5880 x1875064728259840/t0(0) o38->lustre-MDT0000-mdc-ffff8bc1452f0800@192.168.201.143@tcp:12/10 lens 520/544 e 0 to 1 dl 1788205284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788205259.012454:0:10051:0:(import.c:65:import_set_state_nolock()) ffff8bc146503800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788205259.012457:0:10051:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.143@tcp failed (-110) 00000100:00100000:2.0:1788205259.012460:0:10051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8bc1727d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c0a6615-c7c4-4483-9f31-fb19c8e5931c:10051:1875064728259840:192.168.201.143@tcp:38:kworker.0 00010000:00010000:2.0:1788205259.844356:0:26429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788205259.910937:0:26422:0:(client.c:2702:ptlrpc_set_wait()) set ffff8bc1460e3480 going to sleep for 0 seconds Debug log: 76658 lines, 76658 kept, 0 dropped, 0 bad.